Hi Team
I have following format of CSV
Label ,jsonprop,jsonvalue,jsonpointer
Which is form data json is converted to CSV and ingested into milvus database
While retrieving I am using langgraph nodes
Rewrite with llm
Retrieve from milvus
Refine with llm final solution
I have following question can I send metadata information while rewrite step like
Complete label prop and pointer information so the llm rewrite can actually convert the NLP to a better query
Query can be like below
Get me unique person id
Does this formid has the exam enrolled
How many formid are active
Can you please suggest
Yep, you can. You can add whatever additional information you want to track into your state to make it available to your node, or otherwise set data in runnable config
Sure Thank you also just one thought should we send all 1200 field label and prop info as prompt Direct or create a new collection and embed as vectors
So the first step we call collection and rewrite and next week retrieve with value
Which option would be better
Given you have 1200 it might pack your context. If the amount won’t grow, you can test to see if your prompt performs well. Otherwise you could let your agent retrieve specific records