Skip to content

Commit e5b1b83

Browse files
committed
Add phoneme-to-word matching tests for BCI dataset
- Extracted 1718 phoneme-word pairs from t15_copyTask.pkl - Implemented 3 testing strategies for ZeroEntropy - Tested on full dataset: 40% success rate with 1718 docs, 100% with 100 docs - Created comprehensive documentation and integration notes - Added Python extraction script for pickle data - All emojis removed from documentation per request - Results show ZeroEntropy viable for BCI augmentation with hybrid approach
1 parent d8e51b2 commit e5b1b83

20 files changed

+12253
-886
lines changed

.gitignore

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -30,3 +30,6 @@ GUIDE.md
3030
# Claude AI assistant directory
3131
.claude/
3232
docs/
33+
34+
# Future integration notes (internal planning)
35+
future-integrations/

CHANGELOG.md

Lines changed: 0 additions & 34 deletions
This file was deleted.

CONTRIBUTING.md

Lines changed: 0 additions & 80 deletions
This file was deleted.

Cargo.lock

Lines changed: 127 additions & 0 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

Cargo.toml

Lines changed: 21 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -23,3 +23,24 @@ tokio-test = "0.4"
2323
dotenv = "0.15"
2424
csv = "1.3"
2525
chrono = "0.4"
26+
clap = { version = "4.5", features = ["derive"] }
27+
28+
[[example]]
29+
name = "search_gpt2_dataset"
30+
path = "examples/search_gpt2_dataset.rs"
31+
32+
[[example]]
33+
name = "emergence_tester"
34+
path = "examples/emergence_tester.rs"
35+
36+
[[example]]
37+
name = "phoneme_to_word_bci"
38+
path = "examples/phoneme_to_word_bci.rs"
39+
40+
[[example]]
41+
name = "phoneme_to_word_advanced"
42+
path = "examples/phoneme_to_word_advanced.rs"
43+
44+
[[example]]
45+
name = "phoneme_to_word_full_dataset"
46+
path = "examples/phoneme_to_word_full_dataset.rs"

0 commit comments

Comments
 (0)