How to process large json like langchain mapreduce summarization ?

[stevensu1977]

I try to build data process pipeline with CrewAI , I write tools load local json, but some json too large , more than LLM input max token , I know langchain have mapreduce component support large file , is there any example like mapreduce ?

[18795859305]

same isuue,hope some suggestions. thanks