Fleet and Langmsith - No output in the Trace

LangSmith Product Help Fleet
1

I just started playing around with Fleet, specifically, the agent builder. I did not use a template, and wanted to test out the manual build within the interface. I created a painfully simple agent and included API keys for web search and OpenAI. The interface is intended to be chat via the web UI.

It’s still not super obvious to me when I am attempting to use the agent versus “talk to update”, but my only goal is test the agent and see the trace data in Langsmith. To that end, I see an entry called langsmith-agent-builder in the UI

and when I review the latest run, I see token tracking, but the input and output are completely blank.

image
image2410×1024 214 KB

What am I missing? The chat was initiated from within the web UI and returned data.

And for what it is worth, every attempt (single turn) appears to burn 2 “Agent Runs”.

Perhaps I am missing many obvious things, but I was expecting to quickly “manually config” an agent, test it (not update it with natural language) and see that data not only in the chat UI within Fleet, but the trace data in Langsmith.

(Removed additional contextual screenshots as only one is allowed)

2

Hi there! inputs/outputs are omitted by default to avoid unexpected tracing of private information. We’re working on a better UX to opt-in to tracing the payloads.

The team will also investigate whether they can reproduce the double-counting issue you mentioned here.

Thanks for your patience!

3

Sounds great, thanks. On 2x, at least based on the ribbon in the UI, it seems like a single input chat message yielded +2 on the tally, at least it seemed that way to me.