Skip to content

Adding evals for natural language workflow building. #14417

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 19 commits into from
Closed

Adding evals for natural language workflow building. #14417

Show file tree
Hide file tree
Changes from 3 commits
Commits
Show all changes
19 commits
Select commit Hold shift + click to select a range
2cd57b6
Adding evals for natural language workflow building.
malexanderlim Oct 24, 2024
a9b710a
Adding evaluator.mjs
dylburger Oct 24, 2024
ab34992
pnpm-lock
dylburger Oct 24, 2024
74b4b5b
Updating incorrect evals.
malexanderlim Oct 24, 2024
4f35c8c
Output eval results as a csv
bzwrk Oct 24, 2024
d9f5de0
Merge remote-tracking branch 'origin/master' into component-retrieval…
dylburger Oct 25, 2024
a95b5b6
triggers -> sources on eval JSON
dylburger Oct 25, 2024
80f2256
pnpm
dylburger Oct 25, 2024
58f7eb9
New Components - pdf_app_net (#14406)
michelle0927 Oct 25, 2024
3cc761b
renew webhooks (#14386)
michelle0927 Oct 25, 2024
019f1cb
OpenAI - Add audio functionality to Chat action (#14367)
michelle0927 Oct 25, 2024
724d098
Adding app scaffolding for jina_reader
danhsiung Oct 25, 2024
8f89ee2
Runware: new action component (#14380)
jcortes Oct 25, 2024
d514b8d
New Components - smstools (#14378)
luancazarine Oct 28, 2024
d7b33bc
roamresearch: new action components (#14385)
jcortes Oct 28, 2024
cd3d560
New Components - everhour (#14307)
luancazarine Oct 28, 2024
9a16df6
Added actions (#14426)
lcaresia Oct 28, 2024
855a266
[Components] liveswitch #13859 (#14427)
lcaresia Oct 28, 2024
d78b009
Adding new validated list of evals.
malexanderlim Oct 29, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions packages/evals/component_retrieval/.env.example
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
API_BASE_URL=https://api.dylburger.gkes.pipedream.net
PIPEDREAM_API_KEY=
1 change: 1 addition & 0 deletions packages/evals/component_retrieval/.gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
.env
Loading
Loading