Skip to content

Conversation

nirinchev
Copy link
Collaborator

Proposed changes

This adds the ability to create a vector search index to the create-index tool. It is still WIP, but putting it here so that we can run accuracy tests.

Checklist

  • Integration tests for vector search indexes
  • Accuracy tests

Copy link
Contributor

github-actions bot commented Oct 7, 2025

📊 Accuracy Test Results

📈 Summary

Metric Value
Commit SHA d52d9957053cc2ae0f59eed7e2a57cb8fdf4763e
Run ID f099752f-8877-429b-8369-35603ceb8914
Status done
Total Prompts Evaluated 61
Models Tested 1
Average Accuracy 96.7%
Responses with 0% Accuracy 1
Responses with 75% Accuracy 4
Responses with 100% Accuracy 56

📊 Baseline Comparison

Metric Value
Baseline Commit f384834ee558a0a9c79c0105194b0f6dcdc12fe4
Baseline Run ID 0cb61b79-616f-4733-808f-b6bf54739dd6
Baseline Run Status done
Responses Improved 1
Responses Regressed 2

📎 Download Full HTML Report - Look for the accuracy-test-summary artifact for detailed results.

Report generated on: 10/7/2025, 12:29:08 PM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant