Skip to content

Conversation

@jgchn
Copy link
Owner

@jgchn jgchn commented Apr 12, 2025

No description provided.

@jgchn jgchn force-pushed the pr branch 2 times, most recently from 90b236c to 828e272 Compare April 13, 2025 14:08
jgchn added 5 commits April 13, 2025 10:43
* Cleaning up run examples pipeline

Signed-off-by: Jing Chen <[email protected]>

Rm run examples composite

Signed-off-by: Jing Chen <[email protected]>

Halt early if no file patch

Signed-off-by: Jing Chen <[email protected]>

Better msg

Signed-off-by: Jing Chen <[email protected]>

Modify some PDL files

Signed-off-by: Jing Chen <[email protected]>

Revert revisions

Signed-off-by: Jing Chen <[email protected]>

Modify some PDL programs

Signed-off-by: Jing Chen <[email protected]>

Fix if

Signed-off-by: Jing Chen <[email protected]>

Composite run examples

Signed-off-by: Jing Chen <[email protected]>

Checkout before using composite

Test if

Test if again

Rm bash test

Fix unfound path

Update if check

Delete a folder and see if test runs

Bring back deleted example. Expects test to run

Test if examples config is patched

Mv yaml patch to composite action

Try another patch strategy

Change some files

Checkout again in run examples

Modify files

Typo in composite action

Use json in check parse

Try to escape json

Use changes instead in yaml action

Bring back Ollama set up

Gather new results from GH env

Clean up workflows

Fix lint

Modify chatbot example

Fix run examples config file

* Add possible results for react examples

* Preserve trailing white space

* See if a commit is pushed on my behalf

* Rename config file

* Diff pdl file

* Check if commit happens despite pytet failures

* Allow pytest failure and continue run

* github-actions[bot]: Updated results file when running examples on Mon Apr  7 23:24:42 UTC 2025

Signed-off-by: github-actions[bot] <[email protected]>

* Set max parallel to 1 to prevent race conditions

* See if yaml action is triggered

* Change master branch

* Fix pytest

* Set update results to true

* Test yaml actio again

* Update result to true

* Reverting update_results to False. If you wish to update again, change locally and push with change.

* WRite permissions

* Reverting update_results to False. If you wish to update again, change locally and push with change.

* Don't commit using yaml action

* Set update results to true

* github-actions[bot]: Updated results file when running examples on Tue Apr  8 20:11:04 UTC 2025

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>

* Reverting update_results to False.

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>

* Try pytest failure

* Test pytest behavior again

* Test set +e

* Test again

* Set update to true to see if changed-files can capture results

* PR test

* github-actions[bot]: Updated results file when running examples

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>

* github-actions[bot]: Reverting update_result to false

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>

* Test only with PR, not push

* github-actions[bot]: Updated results file when running examples

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>

* github-actions[bot]: Reverting update_result to false

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>

* No pdl file change

* Clean up and fix run examples nightly

Signed-off-by: Jing Chen <[email protected]>

* Fix empty parse

* Fix

* Bring back more models on ollama set up

* Contrib readme updates

---------

Signed-off-by: github-actions[bot] <[email protected]>
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Signed-off-by: Jing Chen <[email protected]>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <75508867+github-actions[bot][email protected]>

Get new results for failing progs

github-actions[bot]: Run examples: updated result files on your behalf

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>

github-actions[bot]: Run examples: reverting update_result to false on your behalf

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>

See if ollama is cached

Try caching ollama

Set up Ollama outside composite action

Revert changes

Update runexamples config

Signed-off-by: Jing Chen <[email protected]>
Signed-off-by: Jing Chen <[email protected]>
github-actions[bot]: Run examples: reverting update_result to false on your behalf

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>

github-actions[bot]: Run examples: updated result files on your behalf

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>

Revert patches

Signed-off-by: Jing Chen <[email protected]>
Signed-off-by: Jing Chen <[email protected]>
starpit and others added 30 commits April 22, 2025 11:15
Split mode TODO!

Signed-off-by: Nick Mitchell <[email protected]>
* Initial prompt library

Signed-off-by: Claudio Spiess <[email protected]>

* Documentation and fixes

Signed-off-by: Claudio Spiess <[email protected]>

* Finish prompt lib docs

Signed-off-by: Claudio Spiess <[email protected]>

* Address feedback

Signed-off-by: Claudio Spiess <[email protected]>

---------

Signed-off-by: Claudio Spiess <[email protected]>
It wasn't set previously because importlib searches for the distribution
name and not the module's top-level name. Fallbacks are in place to
revert to searching for 'pdl', and if that fails, it fallsback to the
hardcoded version in _version.py

Signed-off-by: Abi Ullattil <[email protected]>
Signed-off-by: Nick Mitchell <[email protected]>
* independent implementation

Signed-off-by: Mandana Vaziri <[email protected]>
* feat: remove tauri cli support for running python interpreter

This also updates the tauri cli to rename runr -> run (run previously invoked the python interpreter).
And adds stub support for --data, --data-file, --trace command line options (not implemented yet).

Signed-off-by: Nick Mitchell <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>

* chore: bump rust dependencies to resolve alert

Signed-off-by: Nick Mitchell <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>

* test: tauri github actions test should apt install the deb

This also removes the beeai compiler test in that workflow, as we now cover that in the core rust interpreter tests.

Signed-off-by: Nick Mitchell <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>

* feat: support for --data and --data-file in rust interpreter

Signed-off-by: Nick Mitchell <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>

* Add optimizer module

Signed-off-by: Claudio Spiess <[email protected]>

* Remove BAM

Signed-off-by: Claudio Spiess <[email protected]>

* Initial prompt library

Signed-off-by: Claudio Spiess <[email protected]>

* Clean up & bring in changes

Signed-off-by: Claudio Spiess <[email protected]>

* AST dump fixes

Signed-off-by: Claudio Spiess <[email protected]>

* Documentation and fixes

Signed-off-by: Claudio Spiess <[email protected]>

* Finish prompt lib docs

Signed-off-by: Claudio Spiess <[email protected]>

* Address feedback

Signed-off-by: Claudio Spiess <[email protected]>

* Lint

Signed-off-by: Claudio Spiess <[email protected]>

* fix: begin phasing in Metadata (common defs, etc. attrs) into rust AST

Rather than duplicating this "metadata" logic -- the stuff common to all non-literal blocks. This just starts the migration. The main trick is to use the serde `flatten` capability, so that we can maintain a separate Metadata struct in Rust, but have it flattened into the enclosing object for serde.

Signed-off-by: Nick Mitchell <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>

* chore: update granite-io dependency (IBM#896)

Signed-off-by: Louis Mandel <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>

* refactor: move def attr into Metadata (rust interpreter)

Signed-off-by: Nick Mitchell <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>

* feat: introduce Expr typing and apply it to IfBlock.condition

Signed-off-by: Nick Mitchell <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>

* feat: update rust Call AST to use Expr for condition attr

Signed-off-by: Nick Mitchell <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>

* chore: bump to rust 2024 edition

Signed-off-by: Nick Mitchell <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>

* feat: continue to flesh out block metadata structure in rust

Signed-off-by: Nick Mitchell <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>

* refactor: add metadata attr to remaining rust block asts

This also adds initial scaffolding for timing, and adds a ModelBlock and ArrayBlockBuilder.

Signed-off-by: Nick Mitchell <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>

* feat: update rust Repeat AST to use Expr for `for` attr (IBM#904)

Signed-off-by: Louis Mandel <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>

* refactor: introduce Advanced enum to rust AST

Signed-off-by: Nick Mitchell <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>

* refactor: refactor rust ast to place metadata in common struct

And start populating the timing info (incomplete).

Signed-off-by: Nick Mitchell <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>

* fix: improve deserialization of python-generated model block traces

Signed-off-by: Nick Mitchell <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>

* fix: in rust ast, allow ModelBlock model to be an expr

Signed-off-by: Nick Mitchell <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>

* feat: initial pdl__id and --trace support for rust interpreter

Signed-off-by: Nick Mitchell <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>

* fix: update rust interpreter to create Data blocks for expr eval, and model_input trace field

Signed-off-by: Nick Mitchell <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>

* fix: populate trace context field in rust interpreter

Signed-off-by: Nick Mitchell <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>

* Update stop sequences in parameters (IBM#861)

* Stop sequence parameter update to align with ollama

Signed-off-by: Jing Chen <[email protected]>

* Update results

Signed-off-by: Jing Chen <[email protected]>

---------

Signed-off-by: Jing Chen <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>

* refactor: extract platform-generic logic from run_ollama_model() handler

Signed-off-by: Nick Mitchell <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>

* fix: rust interpreter was not handling pdl__context for re-runs of traces

This only covers the run_model code path, but it's a start.

Signed-off-by: Nick Mitchell <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>

* feat: improve support for importing stdlib in python code blocks

Signed-off-by: Nick Mitchell <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>

* skeleton-of-thought example (IBM#919)

Signed-off-by: Mandana Vaziri <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>

* Bump litellm and openai versions (IBM#920)

Signed-off-by: Mandana Vaziri <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>

* fix: improve support for rust interpreter python imports from venv

Signed-off-by: Nick Mitchell <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>

* chore: bump tauri and npm dependencies

And leverage the new prevent overflow feature of tauri.

Signed-off-by: Nick Mitchell <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>

* chore: bump ui to 0.6.1 (IBM#921)

Signed-off-by: Nick Mitchell <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>

* fix: rust ast support for gsm8k, including jsonl parser

The program may not run 100% yet, but it parses now.

Signed-off-by: Nick Mitchell <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>

* chore: bump rust dependencies

Signed-off-by: Nick Mitchell <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>

* feat: improve support for tool calling in ollama-rs

We need to send a system prompt to some models. Plus add some stubs for pydantic for python tool execution.

This also includes nascent support for openai-rs (not fully funcitonal yet).

Signed-off-by: Nick Mitchell <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>

* Fully qualify import (IBM#930)

Signed-off-by: Ed Snible <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>

* feat: some regex parser support for rust interpreter

Split mode TODO!

Signed-off-by: Nick Mitchell <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>

* Change to sys.path for python code block (IBM#931)

Signed-off-by: Mandana Vaziri <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>

* granite-io hallucination demo example and notebook (IBM#932)

Signed-off-by: Mandana Vaziri <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>

* Lint

Signed-off-by: Claudio Spiess <[email protected]>

* Refactor

Signed-off-by: Claudio Spiess <[email protected]>

* Tests

Signed-off-by: Claudio Spiess <[email protected]>

* Formatting

Signed-off-by: Claudio Spiess <[email protected]>

* Lint

Signed-off-by: Claudio Spiess <[email protected]>

* Skip tests for now

Signed-off-by: Claudio Spiess <[email protected]>

* Update schema

Signed-off-by: Claudio Spiess <[email protected]>

* Add contrib. prompt library (IBM#927)

* Initial prompt library

Signed-off-by: Claudio Spiess <[email protected]>

* Documentation and fixes

Signed-off-by: Claudio Spiess <[email protected]>

* Finish prompt lib docs

Signed-off-by: Claudio Spiess <[email protected]>

* Address feedback

Signed-off-by: Claudio Spiess <[email protected]>

---------

Signed-off-by: Claudio Spiess <[email protected]>

* Fixed the bug where pdl.__version__ was not set (IBM#882)

It wasn't set previously because importlib searches for the distribution
name and not the module's top-level name. Fallbacks are in place to
revert to searching for 'pdl', and if that fails, it fallsback to the
hardcoded version in _version.py

Signed-off-by: Abi Ullattil <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>

* chore: update pre-commit tools (IBM#937)

Signed-off-by: Louis Mandel <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>

* Use granite-io async interface (IBM#936)

Signed-off-by: Louis Mandel <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>

* Lint

Signed-off-by: Claudio Spiess <[email protected]>

* chore: bump ui dependences

Signed-off-by: Nick Mitchell <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>

* fix: skip failing execution tests (IBM#938)

Signed-off-by: Louis Mandel <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>

* independent implementation (IBM#934)

* independent implementation

Signed-off-by: Mandana Vaziri <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>

* feat: add a `parse_dict` function to `pdl_parser` (IBM#943)

Signed-off-by: Louis Mandel <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>

* Address feedback 1

Signed-off-by: Claudio Spiess <[email protected]>

* Address feedback 2

Signed-off-by: Claudio Spiess <[email protected]>

* Lint & fix mypy module warning

Signed-off-by: Claudio Spiess <[email protected]>

* Skip tests again

Signed-off-by: Claudio Spiess <[email protected]>

* Try to resolve wikipedia package in ci

Signed-off-by: Claudio Spiess <[email protected]>

* Fix rebase

Signed-off-by: Claudio Spiess <[email protected]>

* Fix pyproject

Signed-off-by: Claudio Spiess <[email protected]>

* Move multiprocess to optional

Signed-off-by: Claudio Spiess <[email protected]>

* Add ipython to pdl-live

Signed-off-by: Claudio Spiess <[email protected]>

* Fix trace metadata

Signed-off-by: Claudio Spiess <[email protected]>

* Add documentation

Signed-off-by: Claudio Spiess <[email protected]>

* Add optimizer test PDL

Signed-off-by: Claudio Spiess <[email protected]>

* Add config and expand docs

Signed-off-by: Claudio Spiess <[email protected]>

---------

Signed-off-by: Nick Mitchell <[email protected]>
Signed-off-by: Claudio Spiess <[email protected]>
Signed-off-by: Louis Mandel <[email protected]>
Signed-off-by: Jing Chen <[email protected]>
Signed-off-by: Mandana Vaziri <[email protected]>
Signed-off-by: Ed Snible <[email protected]>
Signed-off-by: Abi Ullattil <[email protected]>
Co-authored-by: Nick Mitchell <[email protected]>
Co-authored-by: Louis Mandel <[email protected]>
Co-authored-by: Jing Chen <[email protected]>
Co-authored-by: Mandana Vaziri <[email protected]>
Co-authored-by: Nick Mitchell <[email protected]>
Co-authored-by: Ed Snible <[email protected]>
Co-authored-by: Abi Ullattil <[email protected]>
Signed-off-by: hirokuni-kitahara <[email protected]>
…0.5 (IBM#946)

Updates the requirements on [granite-io](https://github.com/ibm-granite/granite-io) to permit the latest version.
- [Release notes](https://github.com/ibm-granite/granite-io/releases)
- [Commits](ibm-granite/granite-io@v0.2.0...v0.4.0)

---
updated-dependencies:
- dependency-name: granite-io
  dependency-version: 0.4.0
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
…12 (IBM#940)

Updates the requirements on [faiss-cpu](https://github.com/kyamagu/faiss-wheels) to permit the latest version.
- [Release notes](https://github.com/kyamagu/faiss-wheels/releases)
- [Commits](faiss-wheels/faiss-wheels@v1.10.0...v1.11.0)

---
updated-dependencies:
- dependency-name: faiss-cpu
  dependency-version: 1.11.0
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Louis Mandel <[email protected]>
* fix for extra fields

Signed-off-by: Mandana Vaziri <[email protected]>
Signed-off-by: Jing Chen <[email protected]>
Signed-off-by: Jing Chen <[email protected]>
Signed-off-by: Jing Chen <[email protected]>
Signed-off-by: Jing Chen <[email protected]>
Signed-off-by: Jing Chen <[email protected]>
Signed-off-by: Jing Chen <[email protected]>
Signed-off-by: Jing Chen <[email protected]>
Signed-off-by: Jing Chen <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

9 participants