Skip to content

Comments

fix(bb): fix vk simplified buffer#16720

Merged
ludamad merged 166 commits intomerge-train/barretenbergfrom
ad/bbapi/vk-simplified-buffer
Sep 2, 2025
Merged

fix(bb): fix vk simplified buffer#16720
ludamad merged 166 commits intomerge-train/barretenbergfrom
ad/bbapi/vk-simplified-buffer

Conversation

@ludamad
Copy link
Collaborator

@ludamad ludamad commented Sep 2, 2025

Some issue with updating backend.ts I don't understand

AztecBot and others added 30 commits July 24, 2025 18:21
Continuing the vertical slice of doing CIVC API with the new BBAPI
end-to-end, this adds:
- revives a schema compiler that we were using with the circuits C++
code, adapting it for the unified bbapi
- adds code to bb.js, currently unused, to wrap a process and seamlessly
have bb.js use the native implementations via a process that spits in
and out msgpack
- implements gates and ivc verify in CIVC, uses them in
api_client_ivc.cpp (backs the CLI)
- move AztecBackend to the new API, using generated bindings
- refactor bb.js to adapt to new generation source

---------

Co-authored-by: Claude <noreply@anthropic.com>
In `stdlib_uint` we no longer need logical operations because the only
places they were used in, i.e., std/turbo version of sha256, blake2s,
blake3s, have been removed. So its best to reduce complexity of the
`uint` class and keep it minimal.

Removed the following functions from the `uint` class:
```cpp
operator^
operator&
operator|
operator~
operator>>
operator<<
ror
rol
logic_operator
```
…ments as input and returns the commitment to the merged table (#15949)

We modify the `MergeVerifier` so that it gets the subtable commitments as input and returns the commitment to the merged table. The reason for this change is that given the new structure of `ClientIVC` following [#15704](#15704), we can't access the merged table commitments from inside `complete_hiding_circuit_logic`.

This PR is in preparation for [#15829](#15829)

---------

Co-authored-by: AztecBot <tech@aztecprotocol.com>
TLDR: `uint` arithmetic operators `+` and `-` had a coding error and as
a result, we weren't actually supporting lazy arithmetic over integers.
This PR simplifies the `uint` class to now allow any "unbounded" values.

#### The Issue 

In the current `uint` class, we allow "unbounded" values, for example, a
`uint32_ct` can contain a value > 32 bits. This was done to allow lazy
arithmetic before such values were "normalized". This is because a call
to `normalize()` is expensive: it decomposes the value in 12-bit slices
and range-constrains each slice.

In practice though, the addition and subtraction operator actually
didn't allow any overflow due to a coding error.
On adding two $\textsf{uint}x$ values $a$ and $b$ (where $x \in [8, 16,
32, 64]$), we currently do:


https://github.com/AztecProtocol/aztec-packages/blob/5c2c217a2f1b05ae226a16ee19a99079dbba8fec/barretenberg/cpp/src/barretenberg/stdlib/primitives/uint/arithmetic.cpp#L27-L47

Assume $a, b$ are both witnesses, the `create_balanced_add_gate` creates
the following constraint:

$$a + b = q \cdot \textcolor{grey}{2^x} + r$$

where the quotient $q$ and remainder $r$ are computed as:

$$q := \frac{(a \textsf{ mod } 2^x) + (b \textsf{ mod } 2^x)}{2^x},
\quad r := \left((a \textsf{ mod } 2^x) + (b \textsf{ mod } 2^x)\right)
\textsf{ mod } 2^x.$$

In other words, the quotient and remainder are computed from the
"truncated" values of $a$ and $b$ when it should have been from the
"unbounded" values. Effectively, this means we are not actually
supporting lazy arithmetic (i.e., arithmetic operations expect inputs to
be "normalized"). I wrote a test
[here](https://github.com/AztecProtocol/aztec-packages/blob/ace0afdb4fb773cfc50af92930ecb94993ab72a5/barretenberg/cpp/src/barretenberg/stdlib/primitives/uint/uint.test.cpp#L243-L271)
that fails when, ideally, it should have passed. This confirmed the
coding error.

#### Solution(s)

One way to fix this is to actually use `get_unbounded_value()` in place
of `get_value()` (on lines 27 and 28 in `operator+` above). But we never
really were using the benefits of lazy addition (because of this silly
error). So we decided its better to remove functionality related to
"unbounded" uint values.

Thus, we remove the `witness_status` member of the `uint` class as it
tracks if a `uint` needs to be "normalized". As a consequence, we now
need to "normalize" in every constructor where we weren't constraining
the accumulators (i.e., `byte_array` and `std::vector<bool_t>`).
Further, in `operator+` and `operator-` we normalize the result. Also,
removed the `get_unbounded_value()` as it isn't being used anywhere.
Reverts #15975

Need to get the logic ops cleanup
[PR](#15823) first.
…rcuit (#15829)

We make the merged table received by the Merge verifier in the hiding
circuit a public input to the hiding circuit. This is needed because the
Merge verifier will soon receive `t_commitments`, `T_prev_commitments`
as inputs rather than reading them from the proof.

**EDIT:**

To complete the work on the consistency checks, and to ensure the
soundness of the Goblin verification, the merged table received by the
Merge verifier in the last step of a Goblin accumulation must be set to
be a public input of the circuit that performs the verification, so that
the verifier can extract that public input and use it as the commitment
to the previous table in the Merge verification.

For example, in ClientIVC the last Merge verification before the final
Goblin verification happens in the HidingKernel, so we need to add the
merged table commitments received by the Merge verifier inside the
HidingKernel to be public inputs of the HidingKernel.

After this PR, `MegaVerifier = UltraVerifier<MegaFlavor>` always expects
the inputs to be `PairingInputs` + commitments to ECC op tables. These
inputs are produced by the class `HidingKernelIO` (even though in the
future we might consider changing this name)

The PR required changes to various tests to accommodate the new
structure of the public inputs.

---------

Co-authored-by: AztecBot <tech@aztecprotocol.com>
Co-authored-by: ledwards2225 <98505400+ledwards2225@users.noreply.github.com>
Co-authored-by: sergei iakovenko <105737703+iakovenkos@users.noreply.github.com>
Co-authored-by: ludamad <adam.domurad@gmail.com>
Co-authored-by: Suyash Bagad <suyash@aztecprotocol.com>
Co-authored-by: Jonathan Hao <jonathan@aztec-labs.com>
Co-authored-by: Raju Krishnamoorthy <krishnamoorthy@gmail.com>
Co-authored-by: notnotraju <raju@aztec-labs.com>
Co-authored-by: Lucas Xia <lucasxia01@gmail.com>
Co-authored-by: Khashayar Barooti <khashayar@aztecprotocol.com>
Co-authored-by: Jean M <132435771+jeanmon@users.noreply.github.com>
Co-authored-by: Alex Gherghisan <alexghr@users.noreply.github.com>
Co-authored-by: Santiago Palladino <spalladino@users.noreply.github.com>
Co-authored-by: Santiago Palladino <santiago@aztec-labs.com>
Co-authored-by: ludamad <domuradical@gmail.com>
Co-authored-by: maramihali <mara@aztecprotocol.com>
Co-authored-by: Sarkoxed <75146596+Sarkoxed@users.noreply.github.com>
- Replace api_ultra_honk.cpp implementation with bbapi-based version
- Port all UltraHonk functionality to bbapi commands:
  - CircuitProve with flavor selection (including STARKNET_GARAGA_FLAVORS)
  - CircuitComputeVk for verification key generation
  - CircuitVerify for proof verification
  - CircuitInfo for gate counting (replaces direct gate_count calls)
  - VkAsFields and ProofAsFields for field element conversions
  - CircuitWriteSolidityVerifier for Solidity contract generation
- Add comprehensive tests for all bbapi UltraHonk operations
- Maintain backward compatibility with existing API interface
- Keep CircuitCheck, CircuitProveAndVerify, and CircuitBenchmark as unimplemented

This centralizes the UltraHonk implementation in bbapi, making it easier to maintain and extend.
- Create new BbApiUltraHonkBackend that uses bbapi commands instead of old WASM API
- Maintains same public API as UltraHonkBackend for easy migration
- Supports all oracle hash types (poseidon2, keccak, starknet)
- Add migration guide to help users transition
- Export new backend from main index

This allows TypeScript users to use the same unified bbapi interface
that is available in the CLI and C++ API, improving consistency and
enabling better code reuse across language bindings.

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
- Add proof_as_fields command to convert proofs to field elements
- Add vk_as_fields command to convert verification keys to field elements
- Support --mega_honk flag for MegaHonk VK format
- Output results as JSON files (proof_fields.json, vk_fields.json)
- Add comprehensive tests for ProofAsFields and VkAsFields in bbapi

These commands expose the already-implemented bbapi functionality through
the CLI, making it accessible to users who need field representations
of proofs and verification keys for recursive verification.

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
Document the BBAPI architecture, available commands, usage examples,
and migration guidance. This helps developers understand how to use
the new unified API interface across different language bindings.

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
Remove bbapi README and TypeScript migration guide as requested.

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
@ludamad ludamad merged commit 7679969 into merge-train/barretenberg Sep 2, 2025
8 checks passed
@ludamad ludamad deleted the ad/bbapi/vk-simplified-buffer branch September 2, 2025 22:19
github-merge-queue bot pushed a commit that referenced this pull request Sep 3, 2025
BEGIN_COMMIT_OVERRIDE
feat(bb): --print_bench (#16673)
refactor(bb): remove --output_format, have one-size-fits-all format
(#16201)
fix(bb): fix vk simplified buffer (#16720)
fix(avm): avm vk after serialization unification (#16721)
END_COMMIT_OVERRIDE
mralj pushed a commit that referenced this pull request Oct 13, 2025
Some issue with updating backend.ts I don't understand
ludamad added a commit that referenced this pull request Dec 16, 2025
Some issue with updating backend.ts I don't understand
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants