Skip to content

Commit 237be68

Browse files
chunk the document
1 parent 074cb3e commit 237be68

File tree

10 files changed

+598
-4
lines changed

10 files changed

+598
-4
lines changed

.gitignore

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -7,6 +7,7 @@ yarn-error.log*
77
pnpm-debug.log*
88
lerna-debug.log*
99

10+
/node_modules
1011
node_modules
1112
dist
1213
dist-ssr

README.MD

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
- [x] Upload Multiple Files
22
- [ ] implement queue worker
3-
- [ ] read pdf and chunk the text
3+
- [x] read pdf and chunk the text
44
- [ ] combine those knowledge
55
- [ ] store in vector db

package.json

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -36,9 +36,11 @@
3636
"express-validator": "^7.2.1",
3737
"helmet": "^8.0.0",
3838
"ioredis": "^5.6.1",
39+
"langchain": "^0.3.28",
3940
"morgan": "^1.10.0",
4041
"multer": "1.4.5-lts.1",
4142
"node-cron": "^4.1.0",
43+
"pdf-parse": "^1.1.1",
4244
"sharp": "^0.33.5"
4345
}
4446
}

0 commit comments

Comments
 (0)