[FEATURE-REQUEST] Ability to add builtin tools in Prompt Playground/Evaluations

LangSmith Product Help Observability & Evals
1

I’m using the Langsmith UI, to run Evaluations. I would like the ability to specify the use of built-in (provider) tools , along with the OutputSchema.

In AWS Bed rock, its easy I just need to add this to the root of the request:

"toolConfig": {
    "tools": [
        {
            "systemTool": {
                "name": "nova_code_interpreter"
            }
        }
    ]
}

See Using built-in tools - Amazon Nova

From what I understand this is not available in the UI.

I understand I can run evaluations locally but thats more of a pain and more things to manage than the UI.

This feature is also available in Langchain library: ChatAmazonNova integration - Docs by LangChain

If you added this some how it would have to merge with the other tool definitions because we need to use the output schema tools along with this feature.

We also use Extra parameters for the model reasoning config but its my understanding for bedrock these are mapped to additionalModelRequestFields

Thanks