1.16.0

What's Changed

• Add looped mode support for bulk ingestion operation. (#968) by @rishabh6788 in #970
• [Backport 1.16] add os memory stats in node-stats telemetry call by @opensearch-trigger-bot[bot] in #990
• Bump minor version for 1.16 release by @IanHoang in #991

Full Changelog: 1.15.0...1.16.0

2.1.0

What's Changed

• Bump version 2.0.0 to 2.1.0 post release by @IanHoang in #948
• Update Python versions supported to 3.10 - 3.13 by @gkamat in #961
• Update PYTHON_SUPPORT_GUIDE.md and DEVELOPER_GUIDE.md by @IanHoang in #963
• Add looped mode support for bulk ingestion operation. by @rishabh6788 in #968
• Add support for gRPC transport by @finnegancarroll in #938
• Bugfix - Protobuf stored fields parsed as character strings by @finnegancarroll in #972
• Streaming ingestion enhancements: glob support, path separators, etc. by @gkamat in #967
• Add how to fix stale config issue to DEVELOPER_GUIDE by @bzhangam in #966
• Changes to aid integration between SDG and Streaming ingestion by @gkamat in #978
• Catch failing integration tests in GitHub workflows by @gkamat in #975
• Add TimeSeries Support to SDG by @IanHoang in #962
• [SDG] Add support for dense and sparse vectors by @IanHoang in #980

New Contributors

• @finnegancarroll made their first contribution in #938
• @bzhangam made their first contribution in #966

Full Changelog: 2.0.0...2.1.0

2.0.0

What's Changed

• Address pkg_resources deprecation by @IanHoang in #921
• Add Synthetic Data Generation in OSB by @IanHoang in #864
• Make OSB Cloud Agnostic: Refactor OSB Client Logic by @IanHoang in #845
• add checker for 1.x terms by @OVI3D0 in #888
• only run lint checker if 2.x-terms-only label is present by @OVI3D0 in #897
• Data Producer with multi-part downloads and partitioning by @gkamat in #890
• Enhance & Refactor SDG by @IanHoang in #895
• Rebase renamed-components onto latest developments by @IanHoang in #882
• Change run-test to run by @aman825 in #901
• Address remaining legacy names by @IanHoang
• Change aggregated_results to aggregated-results by @OVI3D0 in #932
• Add Pydantic to SDG for stronger validation, error handling, and extensibility by @IanHoang in #931
• Visualize subcommand by @OVI3D0 in #934
• Lint checker for 1.x/2.x terms by @OVI3D0 in #933
• Initial version of the Ingestion Manager for streaming ingestion by @gkamat
• Initial set of Data Reader changes for Streaming Ingestion by @gkamat in #935
• Bump version to 2.0.0 by @IanHoang
• Add fix for session for 2.0-rc by @IanHoang
• fixes for aggregate command by @OVI3D0 in #939
• Address Integration Tests by @IanHoang in #940
• Add missing _init.py file by @gkamat in #941
• Fix integ test failure in 2.0 RC by @gkamat in #942
• Fast forwarding main to incorporate 2.0-rc changes by @IanHoang in #943
• Update classifier to correct naming by @IanHoang in #946

Full Changelog: 1.15.0...2.0.0

1.15.0

What's Changed

• remove extra print statement by @OVI3D0 in #827
• Add operations for create/delete ml connector and register remote model by @weijia-aws in #821
• Add a %diff to compare command and some emoji by @asimmahmood1 in #797
• Add configurable values for redline testing by @OVI3D0 in #835
• change feedback actor's scale up method to use random sampling by @OVI3D0 in #837
• Add Synthetic Data Generation in OSB by @IanHoang in #829
• Filter operations not supported by Serverless. by @rishabh6788 in #831
• Block Scroll query for OSS as it is not supported by @rishabh6788 in #844
• Revise Docker Build Post PR Releases by @IanHoang in #848
• Revert "Add Synthetic Data Generation in OSB (#829)" by @IanHoang in #857
• Bump version to 1.14.0 pre-release by @IanHoang in #858
• Fix help text bug for execute-test subcommand by @IanHoang in #861
• Updates to Redline Testing by @OVI3D0 in #849
• Introduce CPU-based Feedback for Redline Testing by @OVI3D0 in #874
• add mandatory=False flag for CPU feedback fetch by @OVI3D0 in #884
• REFACTOR async def call(self, *args, **kwargs) by @rustemd02 in #843
• Adding query profiling metrics to metrics store by @neuenfeldttj in #891
• add ability to use benchmark.ini file to customize redline tests by @OVI3D0 in #887
• [BUG FIX] Profile Metric KNNQuery Fix by @neuenfeldttj in #898
• auto-refresh aws creds using boto3 by @rishabh6788 in #917
• bump release version to 1.15.0 by @rishabh6788 in #925

New Contributors

• @asimmahmood1 made their first contribution in #797
• @rustemd02 made their first contribution in #843
• @neuenfeldttj made their first contribution in #891

Full Changelog: 1.13.0...1.15.0

1.14.0

What's Changed

• remove extra print statement by @OVI3D0 in #827
• Add operations for create/delete ml connector and register remote model by @weijia-aws in #821
• Add a %diff to compare command and some emoji by @asimmahmood1 in #797
• Add configurable values for redline testing by @OVI3D0 in #835
• change feedback actor's scale up method to use random sampling by @OVI3D0 in #837
• Add Synthetic Data Generation in OSB by @IanHoang in #829
• Filter operations not supported by Serverless. by @rishabh6788 in #831
• Block Scroll query for OSS as it is not supported by @rishabh6788 in #844
• Revise Docker Build Post PR Releases by @IanHoang in #848
• Revert "Add Synthetic Data Generation in OSB (#829)" by @IanHoang in #857
• Bump version to 1.14.0 pre-release by @IanHoang in #859

New Contributors

• @asimmahmood1 made their first contribution in #797

Full Changelog: 1.13.0...1.14.0

1.13.0

What's Changed

• bump patch version by @OVI3D0 in #695
• Change min/max to overall_min/overall_max + update comparison results publisher by @OVI3D0 in #692
• Fix workload parameter processing when a key is mapped to a JSON file by @gkamat in #690
• Update README Badges by @IanHoang in #697
• Add calculate-recall parameter to vector search and skip calculating recall if number clients > cpu cores by @finnroblin in #626
• Add support for custom iteration values by @OVI3D0 in #696
• fix fetch for workload params by @OVI3D0 in #704
• update integ-test + unit-test yaml files by @OVI3D0 in #707
• Refactor aggregate by @OVI3D0 in #708
• Fix URLs for ml-model runners by @gkamat in #719
• Make query randomization more flexible by @peteralfonsi in #712
• Replaced occurrences of "Benchmark" with "OSB" by @gkamat in #705
• update maintainers list by @cgchinmay in #723
• Push image to Docker Hub staging repository on a successful build by @gkamat in #717
• Changes to support ramp-up feature by @rishabh6788 in #725
• Change OSB Config directory from ~/.benchmark to ~/.osb by @OVI3D0 in #732
• update to JDK 21 for integ tests by @OVI3D0 in #737
• add improved error messaging in Worker class by @OVI3D0 in #741
• Update Docker-build Workflow to Address Segfault Issue by @IanHoang in #756
• Interim workaround for QEMU bug that causes the Docker ARM build to fail by @gkamat in #757
• Fixes to update the Java version for integration tests by @gkamat in #751
• Revert "Update Docker-build Workflow to Address Segfault Issue " by @IanHoang in #758
• Add load-test-qps parameter for dynamic client ramp up by @OVI3D0 in #739
• Set GitHub ID token to be able to acquire credentials for the Docker build by @gkamat in #761
• Fix repo specification for push to Docker Hub by @gkamat in #762
• Workaround for the QEMU bug for the DockerHub build by @gkamat in #763
• Add shorthand version of opensearch-benchmark invocation, osb by @IanHoang in #745
• Skip running the Docker release workflow in forks of the authoritative repository by @gkamat in #766
• Change Topic name used by PyPI back to Benchmark from OSB by @IanHoang in #768
• Updated the Docker workflows to use the current version of buildx by @gkamat in #775
• Add warning when benchmarking multiple target hosts by @OVI3D0 in #779
• Add @time_func annotation to sleep runner by @Gankris96 in #781
• Update OpenSearch version used for integ tests to 2.17 by @gkamat in #788
• Support benchmark for polling ingestion by @xuxiong1 in #784
• Add qat_deflate and qat_lz4 as additional index codecs. by @mulugetam in #794
• Updated the developer guide with new Java requirements by @gkamat in #787
• Update release guide to reflect process for releasing from a branch by @gkamat in #774
• Add Sample Frequency to Create-Workload by @IanHoang in #801
• Bump version prior to release by @IanHoang in #805
• Bump twine version by @IanHoang in #807
• Fix code bug in RegisterMlModel operation for finding existing model with exact match by @weijia-aws in #816
• Introduce Redline Testing to OSB by @OVI3D0 in #793
• Onboard OSB to use GHA for PyPi Release by @IanHoang in #824

New Contributors

• @Gankris96 made their first contribution in #781
• @xuxiong1 made their first contribution in #784
• @mulugetam made their first contribution in #794
• @weijia-aws made their first contribution in #816

Full Changelog: 1.11.0...1.13.0

1.12.0

What's Changed

• bump patch version by @OVI3D0 in #695
• Change min/max to overall_min/overall_max + update comparison results publisher by @OVI3D0 in #692
• Fix workload parameter processing when a key is mapped to a JSON file by @gkamat in #690
• Update README Badges by @IanHoang in #697
• Add calculate-recall parameter to vector search and skip calculating recall if number clients > cpu cores by @finnroblin in #626
• Add support for custom iteration values by @OVI3D0 in #696
• fix fetch for workload params by @OVI3D0 in #704
• update integ-test + unit-test yaml files by @OVI3D0 in #707
• Refactor aggregate by @OVI3D0 in #708
• Fix URLs for ml-model runners by @gkamat in #719
• Make query randomization more flexible by @peteralfonsi in #712
• Replaced occurrences of "Benchmark" with "OSB" by @gkamat in #705
• update maintainers list by @cgchinmay in #723
• Push image to Docker Hub staging repository on a successful build by @gkamat in #717
• Changes to support ramp-up feature by @rishabh6788 in #725
• Change OSB Config directory from ~/.benchmark to ~/.osb by @OVI3D0 in #732
• update to JDK 21 for integ tests by @OVI3D0 in #737
• add improved error messaging in Worker class by @OVI3D0 in #741
• Update Docker-build Workflow to Address Segfault Issue by @IanHoang in #756
• Interim workaround for QEMU bug that causes the Docker ARM build to fail by @gkamat in #757
• Fixes to update the Java version for integration tests by @gkamat in #751
• Revert "Update Docker-build Workflow to Address Segfault Issue " by @IanHoang in #758
• Add load-test-qps parameter for dynamic client ramp up by @OVI3D0 in #739
• Set GitHub ID token to be able to acquire credentials for the Docker build by @gkamat in #761
• Fix repo specification for push to Docker Hub by @gkamat in #762
• Workaround for the QEMU bug for the DockerHub build by @gkamat in #763
• Add shorthand version of opensearch-benchmark invocation, osb by @IanHoang in #745
• Skip running the Docker release workflow in forks of the authoritative repository by @gkamat in #766
• Change Topic name used by PyPI back to Benchmark from OSB (#768) by @gkamat in #770

Full Changelog: 1.11.0...1.12.0

1.11.0

What's Changed

• add automatic testing and aggregation to OSB by @OVI3D0 in #655
• Add support for multi-part data corpora downloads by @gkamat in #677
• Minor updates for multi-part downloads by @gkamat in #678
• Add shorthand alternatives for command line options in OSB by @OVI3D0 in #660
• Bump minor version in main by @IanHoang in #674
• Add new issue template by @IanHoang in #676
• store aggregated results in separate folder by @OVI3D0 in #683
• add relative standard deviation to aggregated test execution metrics by @OVI3D0 in #681
• Add new maintainer Michael Oviedo by @IanHoang in #686
• Remove unnecessary logging by @VijayanB in #689

Full Changelog: 1.10.0...1.11.0

1.10.0

What's Changed

• Support Vector Search Nested benchmark by @finnroblin in #584
• Bump version to 1.10.0 by @gkamat in #623
• Add approximate filters by @finnroblin in #607
• Refactored the OSB build system by @gkamat in #632
• Specify multiple search clients for easier benchmarking by @finnroblin in #614
• Add tag as the release branch in jenkinsfile release by @peterzhuamazon in #640
• More updates to the OSB build by @gkamat in #635
• Address string issue in Groovy by @IanHoang in #646
• Update release guide with more details by @IanHoang in #651
• Remove small-nested-works.hdf5 by @finnroblin in #637
• Add aggregate command by @OVI3D0 in #638
• change op-metrics to op_metrics in aggregator file by @OVI3D0 in #657
• Fix --number-of-docs bug in create-workload by @IanHoang in #659

Full Changelog: 1.9.0...1.10.0

1.9.1

What's Changed

• Support Vector Search Nested benchmark by @finnroblin in #584
• Bump version to 1.10.0 by @gkamat in #623
• Bump 1.9 to 1.9.1 by @IanHoang in #624
• [Backport 1.9] Add tag as the release branch in jenkinsfile release by @opensearch-trigger-bot in #642
• Build updates and fix for docker mount issue in v1.9 by @gkamat in #643

Full Changelog: 1.9.0...1.9.1