Visualize token probabilities #5
Open
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
To test the new api rng provider for llama.cpp
- Implement ExternalAPIRNGProvider class using libcurl for HTTP requests - Add support in create_rng_provider for external-api provider type - Update run.py to validate required api_url parameter - Enhance config.yaml with better documentation for RNG providers - Update external-api-rng.md with proper implementation details The external API provider fetches random numbers from a REST API that returns JSON with a "random" field (value between 0-1). This enables reproducible token generation by controlling the random number sequence through an external service.
- add gemma-2b to the model_setup.md - Throw an error if the API service is unavailable for ExternalAPIRNGProvider - fix run.py: a) use correct context limit argument for running the llama-run b) handle errors correctly c) fix script paths and convert to pathlib
petrlavrov-sl
changed the base branch from
dev-1-log-and-visualize-rng-distribution
to
master
…bilities Dev 3 visualize tokens probabilities
Dev 2 external rng api
Accept external list of prompts in parallel.cpp
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Make sure to read the contributing guidelines before submitting a PR