Offload background processes to improve latency

OSS Product Help LangGraph
1

I am trying to reduce latency for each turn. There are tasks that get performed that are not user facing and I want to offload them onto a background process. It seems like nothing I’ve tried really works that well. Has anyone done this that I can speak with?

2

Hi @jcmit

have you seen those:

3

Thanks for the response. I only see one page giving an example of launching background runs. Are there more documentation elsewhere? My tasks involve calling an LLM but also does some pre and processing logic. Currently sits in its own node holding up the entire turn.

4

What about this How to kick off background runs - Docs by LangChain ? Seems like the same but for the v1

5

It’s the same - these background runs are for entire agents so I would have to set up separate agents for each background process I want to run.