Creating a Custom Code Evaluator through the UI

palsumitpal · September 25, 2025, 12:42pm

Question on LangSmith - Evals

When Creating a Custom Code Evaluator through the UI - Is it true - I cannot use any external python libraries like jellyfish / sqlglot ?

What is my alternative then - use the SDK ?

Topic		Replies	Views
Can't add a new evaluator rule in LangSmith Academy module 5 LangChain Academy	0	27	October 15, 2025
About the Observability & Evals category Observability & Evals	0	213	April 22, 2025
Score_string LangChainStringEvaluator display Observability & Evals	0	47	September 24, 2025
Feature request: reference saved evaluators in offline evals Observability & Evals	0	39	October 14, 2025
About the LangSmith Product Help category LangSmith Product Help js-help	1	227	April 25, 2025