Skip to content

Commit b70c033

Browse files
committed
add chunk overlap
1 parent e7fdfec commit b70c033

File tree

802 files changed

+135
-125203
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

802 files changed

+135
-125203
lines changed

eval/chunkers/ast.ts

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -10,6 +10,10 @@ import { chunk } from '../../src'
1010
/**
1111
* Chunk a file using AST-aware chunking and return results
1212
* in a format compatible with the evaluation
13+
*
14+
* @param filepath - Path to the file
15+
* @param code - Source code content
16+
* @param maxNws - Maximum NWS characters per chunk (default: 1500)
1317
*/
1418
export async function chunkFile(
1519
filepath: string,

eval/data/repoeval/datasets/api_level_completion_1k_context_codegen.test.jsonl

Lines changed: 0 additions & 1600 deletions
This file was deleted.

eval/data/repoeval/datasets/api_level_completion_2k_context_codegen.test.jsonl

Lines changed: 0 additions & 1600 deletions
This file was deleted.

eval/data/repoeval/datasets/api_level_completion_2k_context_codex.test.jsonl

Lines changed: 0 additions & 1600 deletions
This file was deleted.

eval/data/repoeval/datasets/api_level_completion_4k_context_codex.test.jsonl

Lines changed: 0 additions & 1600 deletions
This file was deleted.

eval/data/repoeval/datasets/function_level_completion_2k_context_codex.test.jsonl

Lines changed: 0 additions & 455 deletions
This file was deleted.

eval/data/repoeval/datasets/function_level_completion_4k_context_codex.test.jsonl

Lines changed: 0 additions & 455 deletions
This file was deleted.

eval/data/repoeval/datasets/line_level_completion_1k_context_codegen.test.jsonl

Lines changed: 0 additions & 1600 deletions
This file was deleted.

eval/data/repoeval/datasets/line_level_completion_2k_context_codegen.test.jsonl

Lines changed: 0 additions & 1600 deletions
This file was deleted.

eval/data/repoeval/datasets/line_level_completion_2k_context_codex.test.jsonl

Lines changed: 0 additions & 1600 deletions
This file was deleted.

0 commit comments

Comments
 (0)