Please provide us with the following information:
This issue is for a: (mark with an x)
- [X ] bug report -> please search issues before submitting
- [X ] feature request
- [ ] documentation issue or request
- [ ] regression (a behavior that used to work and stopped in a new release)
Minimal steps to reproduce
Ask a question.LLM will respond.Click on citation.Go to supporting content tab.
Any log messages given by the failure
Expected/desired behavior
Expected: The chunk should start forming a proper sentence and should stop ending correctly.Currently for few references the chunk supporting doc starting from middle of the reference document or sometimes stops without completing complete sentence.
For example it starts from: and development ....... and end without proper closing of sentence.
OS and Version?
Windows 7, 8 or 10. Linux (which distribution). macOS (Yosemite? El Capitan? Sierra?)
Win 10
azd version?
run azd version and copy paste here.
Versions
azd version 1.3.0 (commit 6605c5768cb3ab6d9e0e6c2d892c9e8b49e1f720)
Mention any other details that might be useful
May be this is happening because of token limitation the chunks getting created beforte creation of embedddings.
Thanks! We'll be in touch soon.