Testeranto lets you vibe code large, real-world polyglot codebases via BDD tests written in javascript, python, golang, rust and java. By wrapping your code in gherkin semantics, you specify the behavior of your components. The tests are run and the output of those tests are passed into the context of your favorite LLM. Testeranto edits your code and tests using your documentation and then runs the tests again. Once all the tests pass, the results are committed to the repo. In short, testeranto is my attempt to automate my job. It allows a Product Manager to create a jira ticket and, within minutes, recieve a well-tested pull request addressing that ticket and without human intervention.
In more conrete terms, testeranto is
-
a test runner that uses docker as a multi-language process manager
-
a VS code extension
-
integrates static tests, unit tests, integration tests and source code into focused Aider sessions.
-
turns github issues, BDD specs and markdown documentation into packaged artifacts and human readable test reports.
-
a library of code split across 7 languages and 2 purposes
testeranto.ts - the server testeranto.rb testeranto.py testeranto.golang testeranto.java testeranto.rust
- tiposkripto (ts) npm
- rusto (rust) cargo
- pitono (python) pypi
- golingvu (go) TBD
- kafe (java) TBD
- rubeno (ruby ) rubygems
The common pattern of testing and packaging software is
- static tests of entire codebase
- unit tests of entire codebase
- packaging
- integration tests of entire codebase
Testeranto reverses this pattern
- Breakup the application into "slices"
- Package each
- static tests of input files
- unit tests of input files
- run testeranto tests of input files
- packaging
- integration tests of entire codebase
By packaging a piece of software first, we can correlate the output aritifacts to it's specific input source files. We can then run static tests and unit tests upon this set of input files. The results of all these tests, plus the BDD test results, are given to an LLM. This allows focus the LLM's context entirely around 1 slice of an application.