Release 2.7.1

What's new

Enhancements

• Performance Improvements:
  • Updated PersistDict to the latest version for better performance.
  • Improved the efficiency of embeddings by attempting in-memory caching during load.
• Model Handling:
  • Introduced adjustments to avoid reliance on external sources like litellm for model parameters and maximum tokens.
  • Implemented memoization for frequently called model name handlers to reduce computation times.
• Testing Experience:
  • Integrated pytest-xdist to parallelize and speed up the test execution.
  • Optimized test performance by utilizing a session fixture scope.

Bug Fixes

• Performance Fine-tuning:
  • Corrected versioning discrepancies for incrementals.
  • Addressed issues with multiple output answer handling.
• Logging and Debugging:
  • Enhanced debug message levels to provide clearer output.
  • Resolved issues with redundant logger information.
• Model Compatibility:
  • Amended model parameter defaults where strict support was unavailable.
  • Improved the hash method in ModelName for cache support integrity.
  • Fixed exit value inconsistency in create_embeddings.

Minor Changes

• Code Refinement:
  • Eliminated unused arguments and flags for simplified code.
  • Enhanced error messages for better clarity during debugging.

Commits details since the last release

• [5679fd9] by @thiswillbeyourgithub, 7 minutes ago:
  bump PersistDict to latest version for perf
  Signed-off-by: thiswillbeyourgithub
  [email protected]

setup.py

• [63d3386] by @thiswillbeyourgithub, 60 minutes ago:
  bump version 2.7.0 -> 2.7.1

bumpver.toml
docs/source/conf.py
setup.py
wdoc/wdoc.py

• [78faa58] by @thiswillbeyourgithub, 34 minutes ago:
  fix: use latest verdion of persistic for better performance
  Signed-off-by: thiswillbeyourgithub [email protected]

setup.py

• [9ff9176] by @thiswillbeyourgithub, 55 minutes ago:
  minor: the message to start langfuse shouod be in debug level
  Signed-off-by: thiswillbeyourgithub [email protected]

wdoc/utils/misc.py

• [5f21bc9] by @thiswillbeyourgithub, 69 minutes ago:
  new: no need actually to print message when bypassinh model name matching
  Signed-off-by: thiswillbeyourgithub [email protected]

wdoc/utils/misc.py

• [a37e732] by @thiswillbeyourgithub, 71 minutes ago:
  fix: handle multiple output answers

wdoc/wdoc.py

• [9cd6407] by @thiswillbeyourgithub, 4 hours ago:
  new: try to cache embeddings in memory when loading them
  Signed-off-by: thiswillbeyourgithub [email protected]

wdoc/utils/embeddings.py
wdoc/utils/misc.py

• [9b11e82] by @thiswillbeyourgithub, 4 hours ago:
  new: use a debug print when bypassing a modelname matching
  Signed-off-by: thiswillbeyourgithub [email protected]

wdoc/utils/misc.py

• [5cfa86a] by @thiswillbeyourgithub, 4 hours ago:
  new: update the model parameters if it actually does not support n
  Signed-off-by: thiswillbeyourgithub [email protected]

wdoc/wdoc.py

• [5202b45] by @thiswillbeyourgithub, 4 hours ago:
  fix: better handling of models that do not support modifying the n parameter
  Signed-off-by: thiswillbeyourgithub [email protected]

wdoc/docs/help.md
wdoc/wdoc.py

• [9d1e4f6] by @thiswillbeyourgithub, 4 hours ago:
  fix: add hash method to ModelName to make it work with caches
  Signed-off-by: thiswillbeyourgithub [email protected]

wdoc/utils/misc.py

• [72f6409] by @thiswillbeyourgithub, 4 hours ago:
  new: try to avoid trusting litellm or openrouter for model parameters and max_tokens
  Signed-off-by: thiswillbeyourgithub [email protected]

wdoc/utils/misc.py

• [d689b6a] by @thiswillbeyourgithub, 4 hours ago:
  new: add memoize decorator to frequently called model name handlers
  Signed-off-by: thiswillbeyourgithub [email protected]

wdoc/utils/misc.py

• [21108bd] by @thiswillbeyourgithub, 4 hours ago:
  minor: forgot a type checker decorator
  Signed-off-by: thiswillbeyourgithub [email protected]

wdoc/utils/misc.py

• [ffa0f80] by @thiswillbeyourgithub, 5 hours ago:
  minor: better error message
  Signed-off-by: thiswillbeyourgithub [email protected]

wdoc/wdoc.py

• [ec8682f] by @thiswillbeyourgithub, 5 hours ago:
  fix: forgot to update an exit value in create_embeddings
  Signed-off-by: thiswillbeyourgithub [email protected]

wdoc/utils/embeddings.py

• [6933655] by @thiswillbeyourgithub, 3 days ago:
  use pytest-xdist when running all tests
  Signed-off-by: thiswillbeyourgithub [email protected]

tests/run_all_tests.sh

• [371ed6c] by @thiswillbeyourgithub, 3 days ago:
  add pytest xdist to setup
  Signed-off-by: thiswillbeyourgithub [email protected]

setup.py

• [3bb7596] by @thiswillbeyourgithub, 3 days ago:
  test: use scope session fixture for pytest to make them faster
  Signed-off-by: thiswillbeyourgithub [email protected]

tests/conftest.py

• [00c46ca] by @thiswillbeyourgithub, 3 days ago:
  fix: forgot to remove a logger.info duplicate line
  Signed-off-by: thiswillbeyourgithub
  [email protected]

wdoc/utils/logger.py

• [49fcb23] by @thiswillbeyourgithub, 3 days ago:
  remove the is_silent argument and flag that are not used anymore
  Signed-off-by: thiswillbeyourgithub [email protected]

wdoc/docs/help.md
wdoc/utils/flags.py
wdoc/utils/logger.py

• [3882630] by @thiswillbeyourgithub, 3 days ago:
  new: use the logger instead of tqdm write to avoid duplicate prints and have better importability
  Signed-off-by: thiswillbeyourgithub [email protected]

wdoc/utils/logger.py