Rerankers, Context Window and Electron Packaging

[metaphier]

This is a great project but I have a few questions.

1. Any plan to add support for running reranker models now that llama.cpp supports them?

2. Is there a way to adjust the context window when using an LLM via node-llama-cpp?

3. I tried to build the included vanilla electron project along with what I think is the config file using electron-builder build -c electron-builder.ts. There are no errors I can see in terminal when building but when I try to open the .dmg, the window is just white and the app contents do not load. I am not very familiar with electron so perhaps I'm doing something simple wrong.

Thank you in advance for any help!

[metaphier]

Ah npm run build did the trick. Silly me. But the first two questions still stand!

[giladgd]

1. Will be added in the next few days
2. Documentation: contextSize (when using model.createContext(...))

[metaphier]

1. That would be great. I have been building a work-around but will wait if it's coming within days. I would certainly put it to use immediately.
2. Thank you. Don't know how I missed that.

[giladgd]

I’v just released a new version with support for reranking.
Check out the reranking section in the documentation to find out how to use it.