Support additional JS environments?

[nfcampos]

Currently we support running LangChain on Node.js (18, 19), which can be deployed as a serverless function, a container or a VM.

We want to get the community involved in deciding what the next envs we support should be

Leave your vote below, and if you have any more thoughts leave us a comment

Thanks!

[gjohnsx]

I voted for Deno but only because I want to use it in a Supabase Edge Function!

[chanmathew]

+1 for Deno as well. Like @gjohnsx said I believe their edge functions use Deno.

I think covering Supabase and Vercel should help a lot of potential projects.

[ElCuboNegro]

Please downgrade it to v14 to allow usage along with #botpress (and keep the APIs and integrations they have 🙈🙈🙈🙈🙈)

[peterpme]

end of life for node v14 is in april unfortunately. the only path forward is node v18+

[bradjonesca]

Consider supporting Bun

[guirkgumbo]

DENO DENO DENO

[Jarred-Sumner]

It works in Bun v0.5.0+ without changes

[LuisMalhadas]

Not fully, check this. Maybe you can help me.

[abhagsain]

Cloudflare workers pleasee

[nfcampos]

We now have initial support for Cloudflare Workers, see #212 (comment) any issues let us know

[krishnanvsdelegate]

Please consider supporting a graaljs / nashorn context. Would open up the entire JVM ecosystem.

[stephenasuncionDEV]

Any ETA for Vercel Edge Functions?

[nfcampos]

We're looking into this, will keep people posted in this discussion

[danbri]

Voted browser but particularly, ObservableHQ would be a very good fit

[theprashant-one]

Any support for supabase edge functions?

[SebasScript]

you can use up to version 0.036 in deno (and supabase functions) via esm.sh

import {OpenAI} from "https://esm.sh/[email protected]";

all version after 0.0.36 aren't working though

[SebasScript]

if you stream the messages from openai normally they send a "[DONE]" in the the reply once the stream is completed, I haven't tried this with langchain yet but if you use server send events this looks something like this

 eventSource.addEventListener("message", async (e) => {
    if (e.data === "[DONE]") {
        //execute when done
      }
}

[nfcampos]

This is the line that ends the stream in the examples I linked above await writer.close();

https://github.com/langchain-ai/langchain-template-supabase/blob/main/supabase/functions/chat/index.ts#L43

[theprashant-one]

@SebasScript I know that when making raw OpenAI calls, it does send the [DONE] string at the end, but not when making calls through LangChain. To solve this issue, I added another line inside LLMEnd:

await writer.write(encoder.encode(data: [DONE]\n\n));

However, this line does not guarantee that it will always append at the end of the stream; it misses a few times, and I'm not sure why.
@nfcampos

@nfcampos Also, inside LLMEnd, my token usage always comes out as zero:

LLM End { tokenUsage: { completionTokens: 0, promptTokens: 0, totalTokens: 0 } }

[nfcampos]

afaik openai currently doesn't report token usage when streaming responses from chat models

that's a little strange about sometimes missing it, cc @agola11

[theprashant-one]

@nfcampos oh i didn't know about token usage

[KjROX]

Cloudflare workers pleasee

[nfcampos]

Hi, edge/browser support has been published as a prerelease, you can install the prerelease with npm i langchain@next to try it out before we release to everyone.

See upgrade instructions here https://langchainjs-docs-git-nc-test-exports-cf-langchain.vercel.app/docs/getting-started/install you'll need to update import paths, see the link for more details

If you test it let me know any issues!

[nfcampos]

Support for Browsers, Cloudflare workers, Nextjs/vercel (browser/serverless/edge), Deno, Supabase edge functions has been released, see https://blog.langchain.dev/js-envs/ for details. See the docs for install/upgrade instructions https://js.langchain.com/docs/getting-started/install including some breaking changes

Any issues let me know

[smargoli2]

Can you add support for angular?

[jonniedarko]

+bun

[jacoblee93]

We've added an export test and official support for Bun!

If you see anything amiss, please open an issue. Would also just generally love to hear about your experience as you build!

[saldestechnology]

+1 bun

[mendes-develop]

Bun, please! 🙏