Breaks on long files (missing retry logic)

[txkbir]

i'm trying to process a 180k line file using my own OAI api key, but i consistently crash after 6-7% of the file has been processed (which takes me approximately 1.5h). i'm curious if someone can share insights on the most complex / largest projects that this tool has successfully handled?

[0xdevalias]

@txkbir Are you able to provide details/specifics about what is crashing / what the error is?

And also what platform you're running on, node version, etc.

[txkbir]

i get an InternalServerError: 503 upstream connect error or disconnect/reset before headers. reset reason: connection termination at APIError.generate (file:///Users/takbir/.nvm/versions/node/v21.2.0/lib/node_modules/humanifyjs/node_modules/openai/error.mjs:62:20) at OpenAI.makeStatusError, which seems to mean it has nothing to do with the code but rather the api server. regardless, i'm still curious if my performance metrics sound reasonable based on what has been tested by this tool to handle.

im running node v21.2.0 with npm v10.2.3 on macOS sequoia 15.5

[brianjenkins94]

My guess would be that's related to humanify's dependency of openai being a major version behind what's current.

[jehna]

The underlying issue here is that there's no proper error handling logic on the 3rd party API clients. I'm thinking we'll probably need to add some kind of queue with retry logic to fix this.