I don’t know if anyone else has experienced this but ever since Langsmith’s UI started getting updated, the traces of longer graph executions do not show token usage anywhere. I’ve attached an image of the same graph being executed with different inputs which lead to different sized responses from the AI. One has the AI give a small response while the other has the AI give a much longer response. As you can see, the one with the shorter response shows token usage and costs but the other one doesn’t.
Hi @UsamaBinMuzaffar
Can you confirm for the trace with missing token usage – if you look at Attributes > Metadata do you see the usage_metadata key? this would be necessary to view token breakdown
Hi @arjun
There is no usage_metadatakey in either of the traces. If it’s necessary, I don’t understand how I’m able to see the token breakdown without it on the trace with the smaller AI response, but not on the larger AI response.