[ML] Evaluate reranking first N chunks from docs #133589
Description
The purpose of this issue is to add configuration parameters to this PR to only send the first N chunks generated to the rerank model. After adding this functionality we will need to develop new evaluation scripts to test the impact of various values of N against cost/latency/rerank accuracy.