Docs / Claude Managed Agents

Connect Claude Managed Agents

Claude Managed Agents can export every session over OpenTelemetry. Add Papaya as the destination and keep improving your agents, even though Anthropic runs the agent loop. Setup takes a few minutes and needs no code changes.

Why use Papaya with Claude Managed Agents

The Claude Console shows you each session your agents run. Papaya reads across all of them and tells you what to change. You won’t get this use-case analysis anywhere else.

What it looks at
Claude ConsoleOne session at a time.
With PapayaEvery session together, so patterns across thousands of runs show up.
Use cases
Claude ConsoleYou read sessions to work out what people ask the agent to do.
With PapayaFinds the use cases on its own and shows how well the agent handles each one.
Failures
Claude ConsoleYou spot a failure when you open the session it happened in.
With PapayaGroups the failures that keep repeating and shows how often each one happens.
What to change
Claude ConsoleUp to you to work out.
With PapayaConcrete changes to the agent’s prompt, tools and model choices, ranked by their impact on quality, cost and latency.

Each recommendation comes with the sessions that show the problem. See how Papaya works.

Step 1 of 3

Create a Papaya SDK key

In Papaya
  1. Open SDK Keys in the Papaya app.
  2. Click Create SDK key and choose the agent these traces belong to.
  3. Under Capture, select Full.
  4. Copy the key now. Papaya shows it only once. If you lose it, create a new one.
Use a separate key for each agent. A key sends traces to the one agent it was created for, so don’t reuse it for another agent.
Keep the key secret, like a password. If it leaks, revoke it in SDK Keys and create a new one.
Step 2 of 3

Add Papaya as a telemetry destination

In Claude Console

Telemetry destinations are an organization setting, so you may need an org admin for this step.

  1. Open OpenTelemetry settings in the Claude Console.
  2. Click Add destination and choose Custom.
  3. Set the endpoint URL:
    https://papaya.fyi/api/v1/ingest/otel
  4. Add a request header, and replace <PAPAYA_KEY> with the key from step 1:
    Name
    Authorization
    Value
    Bearer <PAPAYA_KEY>
  5. Choose Full content, then select the workspaces you want to send to Papaya.
  6. Click Save.
Trace export is new and in beta, so the Claude Console’s screens change often. If a button or label doesn’t match these steps, look for the closest match, or write to us and we’ll help.
Step 3 of 3

Test it with a small session

In Claude Console
  1. On the destination you just added, click Test.
  2. Run one short session with your agent.
  3. Let us know you’re done. We’ll confirm the session arrived and start the analysis.

From then on, every new session goes to Papaya as it happens.

Common questions

What does Papaya receive?
Each session from the workspaces you choose: the system prompt, user messages, the agent’s replies, and its tool calls and results. Raw traces are kept for the raw trace retention set on the agent in Papaya: a number of days, or no expiry.
Why does it need Full content?
Papaya reads the prompts, messages and tool calls to see where the agent goes wrong and what to change. Full content is the setting that includes them in the export.
What about sessions that ran before I set this up?
Trace export sends new sessions only. We can pull your earlier sessions through the Claude API. Write to support@papaya.fyi and we’ll set it up with you.
How do I stop sending traces?
Delete the destination in the Claude Console, or revoke the key in SDK Keys in Papaya.
The Create SDK key button is disabled.
The agent you selected doesn’t have raw trace retention set yet. Click Edit agent below the agent picker, or go to Agents → Edit agent. Then enter Raw trace retention (days) or tick No expiry, and save. Only workspace owners, admins and developers can change it.
I can’t find the OpenTelemetry settings in the Console.
They’re an organization setting, not part of the agent page. Go to platform.claude.com/settings/telemetry-destinations, open Settings → OpenTelemetry from the sidebar, or search “OpenTelemetry” in the Console. If you can’t add a destination there, ask an org admin.
My agents don’t run on Claude Managed Agents.
You can send traces with the Papaya SDK instead, or upload them for a one-off analysis. See the docs or write to us.

Questions?

Write to us, or reply to the email we sent you.

Email support@papaya.fyi