Skip to content

[[2ʲ, 2ʲ - 2j - 2, 4]] Gottesman code#282

Draft
Fe-r-oz wants to merge 7 commits intoQuantumSavory:masterfrom
Fe-r-oz:GottesmanDistance4code
Draft

[[2ʲ, 2ʲ - 2j - 2, 4]] Gottesman code#282
Fe-r-oz wants to merge 7 commits intoQuantumSavory:masterfrom
Fe-r-oz:GottesmanDistance4code

Conversation

@Fe-r-oz
Copy link
Contributor

@Fe-r-oz Fe-r-oz commented May 25, 2024

I found a small quantum code, aka a Distance 4 code from Gottesman 1997 thesis. This class of [[2ʲ, 2ʲ - j - 2, 3]]` Gottesman codes is derived from [[2ʲ, 2ʲ - 2j - 2, 4]] Gottesman codes . The method is taken from the his thesis:

  • The first two generators are the Pauli-X and Pauli-Z operators acting on all qubits, represented by Mₓ and Mz, respectively.
  • The next j generators correspond to M₁ through Mⱼ, which are directly inherited from the [[2ʲ, 2ʲ - j - 2, 3]] Gottesman code's stabilizers. This inclusion ensures that S retains the inherent distance-three property of the original Gottesman code.

So, this is Gottesman(4) that we have in the library
Screenshot_select-area_20240526041636

  • The final j generators are defined as Nᵢ = RMᵢR, where i ranges from 1 to j. Here, R signifies a Hadamard Rotation operation applied to all 2ʲ qubits, and Mᵢ refers to one of the existing generators from the second set (M₁ to Mⱼ).

Finally, Hadamard transform turns X operator to Z and Z operator to X, so for 1 to j Rows of (M₁ to Mⱼ)
Screenshot_select-area_20240526041620

@github-actions
Copy link
Contributor

github-actions bot commented May 25, 2024 •
edited
Loading

Benchmark Result

Judge result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmarks:
  • Target: 25 May 2024 - 23:44
  • Baseline: 25 May 2024 - 23:51
  • Package commits:
  • Target: 43425f
  • Baseline: 44f618
  • Julia commits:
  • Target: d8f37c
  • Baseline: d8f37c
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 0.95 (5%) ✅ 0.99 (1%) ✅
["ecc", "evaluate_decoder", "toric8_bp_comm"] 1.03 (5%) 0.98 (1%) ✅
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 0.99 (5%) 0.97 (1%) ✅
["ecc", "evaluate_decoder", "toric8_pybp_naivesyn"] 0.94 (5%) ✅ 1.00 (1%)
["ecc", "evaluate_decoder", "toric8_pybp_shorsyn"] 0.92 (5%) ✅ 1.00 (1%)
["stabilizer", "canon", "diag_rref500"] 1.08 (5%) ❌ 1.00 (1%)
["stabilizer", "tensor", "diag_pow5_20"] 1.12 (5%) ❌ 1.00 (1%)
["stabilizer", "tensor", "pow5_20"] 1.08 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Target

Julia Version 1.12.0-DEV.603
Commit d8f37c9920a (2024-05-25 21:46 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 0 MHz 1983 s 0 s 188 s 8203 s 0 s
 #2 0 MHz 2029 s 0 s 184 s 8147 s 0 s
 #3 0 MHz 2190 s 0 s 161 s 8027 s 0 s
 #4 0 MHz 3111 s 0 s 179 s 7065 s 0 s
 Memory: 15.606502532958984 GB (13284.55859375 MB free)
 Uptime: 1042.99 sec
 Load Avg: 1.03 1.02 0.74
 WORD_SIZE: 64
 LLVM: libLLVM-17.0.6 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.12.0-DEV.603
Commit d8f37c9920a (2024-05-25 21:46 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 0 MHz 3580 s 0 s 238 s 10960 s 0 s
 #2 0 MHz 3604 s 0 s 227 s 10933 s 0 s
 #3 0 MHz 2857 s 0 s 214 s 11708 s 0 s
 #4 0 MHz 3697 s 0 s 234 s 10826 s 0 s
 Memory: 15.606502532958984 GB (13304.78515625 MB free)
 Uptime: 1484.06 sec
 Load Avg: 1.0 1.01 0.86
 WORD_SIZE: 64
 LLVM: libLLVM-17.0.6 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 25 May 2024 - 23:44
  • Package commit: 43425f
  • Julia commit: d8f37c
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "compactification", "compact"] 7.140 ms (5%)
["circuitsim", "compactification", "no_compact"] 7.338 ms (5%) 281.25 KiB (1%) 6000
["circuitsim", "mctrajectories", "q1001_r1"] 15.269 ms (5%) 500.77 KiB (1%) 18019
["circuitsim", "mctrajectories", "q101_r1"] 170.339 μs (5%) 50.53 KiB (1%) 1818
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 13.536 ms (5%) 496 bytes (1%) 9
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 121.216 μs (5%) 256 bytes (1%) 8
["circuitsim", "mctrajectories_union", "q1001_r1"] 13.393 ms (5%) 496 bytes (1%) 9
["circuitsim", "mctrajectories_union", "q101_r1"] 119.604 μs (5%) 256 bytes (1%) 8
["circuitsim", "pftrajectories", "q1001_r1"] 59.752 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 171.120 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 1.098 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 6.021 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 42.370 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 149.660 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.079 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"] 5.856 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 4.277 μs (5%)
["circuitsim", "pftrajectories_union", "q1001_r1"] 22.612 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 131.776 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 1.054 ms (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 2.334 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 11.369 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot250_on_dense500_stab"] 5.685 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot250_on_diag500_destab"] 1.119 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot250_on_diag500_stab"] 560.065 μs (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot_on_dense500_destab"] 48.821 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "cnot_on_dense500_stab"] 22.663 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "cnot_on_diag500_destab"] 25.818 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "cnot_on_diag500_stab"] 12.914 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "dense500_on_dense500_destab"] 11.362 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "dense500_on_dense500_stab"] 5.688 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "dense500_on_diag500_destab"] 966.749 μs (5%) 512 bytes (1%) 8
["clifford", "dense", "dense500_on_diag500_stab"] 560.078 μs (5%) 512 bytes (1%) 8
["clifford", "symbolic", "cnot250_on_dense500_destab"] 1.480 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 702.125 μs (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.200 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 584.754 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 4.849 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 2.374 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 4.809 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 2.364 μs (5%)
["ecc", "evaluate_decoder", "shor_bp_comm"] 1.817 ms (5%) 1.77 MiB (1%) 42625
["ecc", "evaluate_decoder", "shor_bp_naivesyn"] 4.282 ms (5%) 3.63 MiB (1%) 81915
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 4.724 ms (5%) 3.72 MiB (1%) 83095
["ecc", "evaluate_decoder", "shor_pybp_comm"] 25.565 ms (5%) 3.97 MiB (1%) 116084
["ecc", "evaluate_decoder", "shor_pybp_naivesyn"] 51.600 ms (5%) 7.99 MiB (1%) 228133
["ecc", "evaluate_decoder", "shor_pybp_shorsyn"] 51.874 ms (5%) 8.07 MiB (1%) 229131
["ecc", "evaluate_decoder", "shor_table_comm"] 257.863 μs (5%) 241.48 KiB (1%) 4595
["ecc", "evaluate_decoder", "shor_table_naivesyn"] 1.090 ms (5%) 350.88 KiB (1%) 5155
["ecc", "evaluate_decoder", "shor_table_shorsyn"] 1.513 ms (5%) 440.22 KiB (1%) 6153
["ecc", "evaluate_decoder", "toric8_bp_comm"] 691.429 ms (5%) 11.656 ms 168.48 MiB (1%) 1010665
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.390 s (5%) 26.587 ms 351.34 MiB (1%) 2138899
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 1.411 s (5%) 32.453 ms 349.55 MiB (1%) 2147748
["ecc", "evaluate_decoder", "toric8_pybp_comm"] 401.131 ms (5%) 7.31 MiB (1%) 135575
["ecc", "evaluate_decoder", "toric8_pybp_naivesyn"] 802.326 ms (5%) 16.90 MiB (1%) 317606
["ecc", "evaluate_decoder", "toric8_pybp_shorsyn"] 812.386 ms (5%) 19.38 MiB (1%) 351522
["ecc", "evaluate_decoder", "toric8_pymatch_comm"] 4.211 ms (5%) 1.95 MiB (1%) 23180
["ecc", "evaluate_decoder", "toric8_pymatch_naivesyn"] 16.951 ms (5%) 6.03 MiB (1%) 92823
["ecc", "evaluate_decoder", "toric8_pymatch_shorsyn"] 25.985 ms (5%) 8.50 MiB (1%) 126739
["ecc", "evaluate_decoder", "toric8_table_comm"] 2.670 ms (5%) 1.64 MiB (1%) 23086
["ecc", "evaluate_decoder", "toric8_table_naivesyn"] 14.756 ms (5%) 5.38 MiB (1%) 92628
["ecc", "evaluate_decoder", "toric8_table_shorsyn"] 23.822 ms (5%) 7.86 MiB (1%) 126544
["pauli", "mul", "100"] 14.195 ns (5%)
["pauli", "mul", "1000"] 17.907 ns (5%)
["pauli", "mul", "100000"] 713.589 ns (5%)
["pauli", "mul", "20000000"] 190.577 μs (5%)
["stabilizer", "canon", "cano500"] 3.025 ms (5%)
["stabilizer", "canon", "diag_cano500"] 636.811 μs (5%)
["stabilizer", "canon", "diag_gott500"] 4.137 ms (5%) 5.19 MiB (1%) 34521
["stabilizer", "canon", "diag_rref500"] 731.700 μs (5%)
["stabilizer", "canon", "gott500"] 6.574 ms (5%) 5.19 MiB (1%) 34531
["stabilizer", "canon", "md_cano500"] 1.540 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.563 ms (5%)
["stabilizer", "canon", "rref500"] 3.138 ms (5%)
["stabilizer", "project", "destabilizer"] 17.943 μs (5%) 288 bytes (1%) 5
["stabilizer", "project", "stabilizer"] 8.806 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 1.407 ms (5%) 23.97 MiB (1%) 34
["stabilizer", "tensor", "pow5_20"] 2.597 μs (5%) 6.44 KiB (1%) 31
["stabilizer", "trace", "destabilizer"] 31.459 μs (5%) 80 bytes (1%) 2
["stabilizer", "trace", "stabilizer"] 24.435 μs (5%) 112 bytes (1%) 3

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.12.0-DEV.603
Commit d8f37c9920a (2024-05-25 21:46 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 0 MHz 1983 s 0 s 188 s 8203 s 0 s
 #2 0 MHz 2029 s 0 s 184 s 8147 s 0 s
 #3 0 MHz 2190 s 0 s 161 s 8027 s 0 s
 #4 0 MHz 3111 s 0 s 179 s 7065 s 0 s
 Memory: 15.606502532958984 GB (13284.55859375 MB free)
 Uptime: 1042.99 sec
 Load Avg: 1.03 1.02 0.74
 WORD_SIZE: 64
 LLVM: libLLVM-17.0.6 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 25 May 2024 - 23:51
  • Package commit: 44f618
  • Julia commit: d8f37c
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "compactification", "compact"] 7.219 ms (5%)
["circuitsim", "compactification", "no_compact"] 7.383 ms (5%) 281.25 KiB (1%) 6000
["circuitsim", "mctrajectories", "q1001_r1"] 15.296 ms (5%) 500.77 KiB (1%) 18019
["circuitsim", "mctrajectories", "q101_r1"] 172.693 μs (5%) 50.53 KiB (1%) 1818
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 13.444 ms (5%) 496 bytes (1%) 9
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 121.728 μs (5%) 256 bytes (1%) 8
["circuitsim", "mctrajectories_union", "q1001_r1"] 13.178 ms (5%) 496 bytes (1%) 9
["circuitsim", "mctrajectories_union", "q101_r1"] 120.666 μs (5%) 256 bytes (1%) 8
["circuitsim", "pftrajectories", "q1001_r1"] 61.004 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 172.072 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 1.098 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 6.121 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 43.511 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 149.450 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.080 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"] 5.808 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 4.388 μs (5%)
["circuitsim", "pftrajectories_union", "q1001_r1"] 22.912 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 132.247 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 1.052 ms (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 2.364 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 11.418 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot250_on_dense500_stab"] 5.799 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot250_on_diag500_destab"] 1.119 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot250_on_diag500_stab"] 558.866 μs (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot_on_dense500_destab"] 48.561 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "cnot_on_dense500_stab"] 22.592 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "cnot_on_diag500_destab"] 26.179 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "cnot_on_diag500_stab"] 12.704 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "dense500_on_dense500_destab"] 11.432 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "dense500_on_dense500_stab"] 5.721 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "dense500_on_diag500_destab"] 966.809 μs (5%) 512 bytes (1%) 8
["clifford", "dense", "dense500_on_diag500_stab"] 558.836 μs (5%) 512 bytes (1%) 8
["clifford", "symbolic", "cnot250_on_dense500_destab"] 1.478 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 702.013 μs (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.197 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 584.894 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 4.849 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 2.364 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 4.799 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 2.365 μs (5%)
["ecc", "evaluate_decoder", "shor_bp_comm"] 1.820 ms (5%) 1.78 MiB (1%) 42751
["ecc", "evaluate_decoder", "shor_bp_naivesyn"] 4.301 ms (5%) 3.63 MiB (1%) 81971
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 4.993 ms (5%) 3.77 MiB (1%) 84173
["ecc", "evaluate_decoder", "shor_pybp_comm"] 24.426 ms (5%) 3.97 MiB (1%) 116084
["ecc", "evaluate_decoder", "shor_pybp_naivesyn"] 50.433 ms (5%) 7.99 MiB (1%) 228133
["ecc", "evaluate_decoder", "shor_pybp_shorsyn"] 50.183 ms (5%) 8.07 MiB (1%) 229131
["ecc", "evaluate_decoder", "shor_table_comm"] 258.804 μs (5%) 241.48 KiB (1%) 4595
["ecc", "evaluate_decoder", "shor_table_naivesyn"] 1.085 ms (5%) 350.88 KiB (1%) 5155
["ecc", "evaluate_decoder", "shor_table_shorsyn"] 1.506 ms (5%) 440.22 KiB (1%) 6153
["ecc", "evaluate_decoder", "toric8_bp_comm"] 668.651 ms (5%) 11.201 ms 171.95 MiB (1%) 1031070
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.398 s (5%) 21.304 ms 350.12 MiB (1%) 2131731
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 1.427 s (5%) 25.510 ms 359.84 MiB (1%) 2208270
["ecc", "evaluate_decoder", "toric8_pybp_comm"] 396.626 ms (5%) 7.31 MiB (1%) 135575
["ecc", "evaluate_decoder", "toric8_pybp_naivesyn"] 849.945 ms (5%) 16.90 MiB (1%) 317606
["ecc", "evaluate_decoder", "toric8_pybp_shorsyn"] 878.426 ms (5%) 19.38 MiB (1%) 351522
["ecc", "evaluate_decoder", "toric8_pymatch_comm"] 4.129 ms (5%) 1.95 MiB (1%) 23180
["ecc", "evaluate_decoder", "toric8_pymatch_naivesyn"] 16.789 ms (5%) 6.03 MiB (1%) 92823
["ecc", "evaluate_decoder", "toric8_pymatch_shorsyn"] 25.607 ms (5%) 8.50 MiB (1%) 126739
["ecc", "evaluate_decoder", "toric8_table_comm"] 2.574 ms (5%) 1.64 MiB (1%) 23086
["ecc", "evaluate_decoder", "toric8_table_naivesyn"] 14.538 ms (5%) 5.38 MiB (1%) 92628
["ecc", "evaluate_decoder", "toric8_table_shorsyn"] 23.694 ms (5%) 7.86 MiB (1%) 126544
["pauli", "mul", "100"] 14.406 ns (5%)
["pauli", "mul", "1000"] 18.209 ns (5%)
["pauli", "mul", "100000"] 727.178 ns (5%)
["pauli", "mul", "20000000"] 194.684 μs (5%)
["stabilizer", "canon", "cano500"] 3.015 ms (5%)
["stabilizer", "canon", "diag_cano500"] 620.000 μs (5%)
["stabilizer", "canon", "diag_gott500"] 4.053 ms (5%) 5.19 MiB (1%) 34521
["stabilizer", "canon", "diag_rref500"] 674.712 μs (5%)
["stabilizer", "canon", "gott500"] 6.507 ms (5%) 5.19 MiB (1%) 34531
["stabilizer", "canon", "md_cano500"] 1.613 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.601 ms (5%)
["stabilizer", "canon", "rref500"] 3.136 ms (5%)
["stabilizer", "project", "destabilizer"] 17.914 μs (5%) 288 bytes (1%) 5
["stabilizer", "project", "stabilizer"] 8.886 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 1.254 ms (5%) 23.97 MiB (1%) 34
["stabilizer", "tensor", "pow5_20"] 2.396 μs (5%) 6.44 KiB (1%) 31
["stabilizer", "trace", "destabilizer"] 31.298 μs (5%) 80 bytes (1%) 2
["stabilizer", "trace", "stabilizer"] 24.426 μs (5%) 112 bytes (1%) 3

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.12.0-DEV.603
Commit d8f37c9920a (2024-05-25 21:46 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 0 MHz 3580 s 0 s 238 s 10960 s 0 s
 #2 0 MHz 3604 s 0 s 227 s 10933 s 0 s
 #3 0 MHz 2857 s 0 s 214 s 11708 s 0 s
 #4 0 MHz 3697 s 0 s 234 s 10826 s 0 s
 Memory: 15.606502532958984 GB (13304.78515625 MB free)
 Uptime: 1484.06 sec
 Load Avg: 1.0 1.01 0.86
 WORD_SIZE: 64
 LLVM: libLLVM-17.0.6 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 48 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 4
On-line CPU(s) list: 0-3
Vendor ID: AuthenticAMD
Model name: AMD EPYC 7763 64-Core Processor
CPU family: 25
Model: 1
Thread(s) per core: 2
Core(s) per socket: 2
Socket(s): 1
Stepping: 1
BogoMIPS: 4890.86
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization: AMD-V
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 1 MiB (2 instances)
L3 cache: 32 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Not affected

Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
Benchmark Result

Judge result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmarks:
  • Target: 25 May 2024 - 23:53
  • Baseline: 26 May 2024 - 00:00
  • Package commits:
  • Target: 457fe2
  • Baseline: 44f618
  • Julia commits:
  • Target: d8f37c
  • Baseline: d8f37c
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["circuitsim", "pftrajectories", "q1001_r1"] 0.93 (5%) ✅ 1.00 (1%)
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 0.91 (5%) ✅ 0.98 (1%) ✅
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.02 (5%) 0.99 (1%) ✅
["pauli", "mul", "20000000"] 1.05 (5%) ❌ 1.00 (1%)
["stabilizer", "canon", "md_cano500"] 1.10 (5%) ❌ 1.00 (1%)
["stabilizer", "canon", "md_rref500"] 1.05 (5%) ❌ 1.00 (1%)
["stabilizer", "tensor", "diag_pow5_20"] 1.09 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Target

Julia Version 1.12.0-DEV.603
Commit d8f37c9920a (2024-05-25 21:46 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 0 MHz 2622 s 0 s 161 s 6735 s 0 s
 #2 0 MHz 2233 s 0 s 190 s 7095 s 0 s
 #3 0 MHz 2160 s 0 s 174 s 7174 s 0 s
 #4 0 MHz 2240 s 0 s 178 s 7098 s 0 s
 Memory: 15.606502532958984 GB (13310.4140625 MB free)
 Uptime: 955.3 sec
 Load Avg: 1.07 1.05 0.75
 WORD_SIZE: 64
 LLVM: libLLVM-17.0.6 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.12.0-DEV.603
Commit d8f37c9920a (2024-05-25 21:46 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 0 MHz 3998 s 0 s 212 s 9709 s 0 s
 #2 0 MHz 2985 s 0 s 239 s 10695 s 0 s
 #3 0 MHz 3341 s 0 s 223 s 10346 s 0 s
 #4 0 MHz 3356 s 0 s 234 s 10328 s 0 s
 Memory: 15.606502532958984 GB (13304.7421875 MB free)
 Uptime: 1396.24 sec
 Load Avg: 1.07 1.05 0.88
 WORD_SIZE: 64
 LLVM: libLLVM-17.0.6 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 25 May 2024 - 23:53
  • Package commit: 457fe2
  • Julia commit: d8f37c
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "compactification", "compact"] 7.065 ms (5%)
["circuitsim", "compactification", "no_compact"] 7.260 ms (5%) 281.25 KiB (1%) 6000
["circuitsim", "mctrajectories", "q1001_r1"] 15.486 ms (5%) 500.77 KiB (1%) 18019
["circuitsim", "mctrajectories", "q101_r1"] 173.145 μs (5%) 50.53 KiB (1%) 1818
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 13.464 ms (5%) 496 bytes (1%) 9
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 121.698 μs (5%) 256 bytes (1%) 8
["circuitsim", "mctrajectories_union", "q1001_r1"] 13.462 ms (5%) 496 bytes (1%) 9
["circuitsim", "mctrajectories_union", "q101_r1"] 120.676 μs (5%) 256 bytes (1%) 8
["circuitsim", "pftrajectories", "q1001_r1"] 59.341 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 174.537 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 1.143 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 5.971 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 42.740 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 153.769 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.126 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"] 5.868 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 4.328 μs (5%)
["circuitsim", "pftrajectories_union", "q1001_r1"] 22.612 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 136.705 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 1.100 ms (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 2.334 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 11.516 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot250_on_dense500_stab"] 5.853 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot250_on_diag500_destab"] 1.118 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot250_on_diag500_stab"] 559.198 μs (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot_on_dense500_destab"] 49.473 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "cnot_on_dense500_stab"] 22.702 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "cnot_on_diag500_destab"] 25.499 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "cnot_on_diag500_stab"] 12.784 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "dense500_on_dense500_destab"] 11.517 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "dense500_on_dense500_stab"] 5.853 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "dense500_on_diag500_destab"] 968.676 μs (5%) 512 bytes (1%) 8
["clifford", "dense", "dense500_on_diag500_stab"] 559.228 μs (5%) 512 bytes (1%) 8
["clifford", "symbolic", "cnot250_on_dense500_destab"] 1.474 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 696.436 μs (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.200 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 579.788 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 4.829 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 2.354 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 4.799 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 2.354 μs (5%)
["ecc", "evaluate_decoder", "shor_bp_comm"] 1.808 ms (5%) 1.78 MiB (1%) 42709
["ecc", "evaluate_decoder", "shor_bp_naivesyn"] 4.300 ms (5%) 3.64 MiB (1%) 82125
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 4.712 ms (5%) 3.71 MiB (1%) 82815
["ecc", "evaluate_decoder", "shor_pybp_comm"] 24.812 ms (5%) 3.97 MiB (1%) 116084
["ecc", "evaluate_decoder", "shor_pybp_naivesyn"] 50.163 ms (5%) 7.99 MiB (1%) 228133
["ecc", "evaluate_decoder", "shor_pybp_shorsyn"] 50.767 ms (5%) 8.07 MiB (1%) 229131
["ecc", "evaluate_decoder", "shor_table_comm"] 261.860 μs (5%) 241.48 KiB (1%) 4595
["ecc", "evaluate_decoder", "shor_table_naivesyn"] 1.089 ms (5%) 350.88 KiB (1%) 5155
["ecc", "evaluate_decoder", "shor_table_shorsyn"] 1.516 ms (5%) 440.22 KiB (1%) 6153
["ecc", "evaluate_decoder", "toric8_bp_comm"] 689.237 ms (5%) 12.945 ms 172.09 MiB (1%) 1031875
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.422 s (5%) 32.067 ms 352.54 MiB (1%) 2145976
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 1.381 s (5%) 25.659 ms 350.18 MiB (1%) 2151472
["ecc", "evaluate_decoder", "toric8_pybp_comm"] 389.107 ms (5%) 7.31 MiB (1%) 135575
["ecc", "evaluate_decoder", "toric8_pybp_naivesyn"] 807.105 ms (5%) 16.90 MiB (1%) 317606
["ecc", "evaluate_decoder", "toric8_pybp_shorsyn"] 805.732 ms (5%) 19.38 MiB (1%) 351522
["ecc", "evaluate_decoder", "toric8_pymatch_comm"] 4.211 ms (5%) 1.95 MiB (1%) 23180
["ecc", "evaluate_decoder", "toric8_pymatch_naivesyn"] 17.074 ms (5%) 6.03 MiB (1%) 92823
["ecc", "evaluate_decoder", "toric8_pymatch_shorsyn"] 26.168 ms (5%) 8.50 MiB (1%) 126739
["ecc", "evaluate_decoder", "toric8_table_comm"] 2.661 ms (5%) 1.64 MiB (1%) 23086
["ecc", "evaluate_decoder", "toric8_table_naivesyn"] 14.800 ms (5%) 5.38 MiB (1%) 92628
["ecc", "evaluate_decoder", "toric8_table_shorsyn"] 23.906 ms (5%) 7.86 MiB (1%) 126544
["pauli", "mul", "100"] 14.928 ns (5%)
["pauli", "mul", "1000"] 17.910 ns (5%)
["pauli", "mul", "100000"] 719.346 ns (5%)
["pauli", "mul", "20000000"] 203.472 μs (5%)
["stabilizer", "canon", "cano500"] 3.040 ms (5%)
["stabilizer", "canon", "diag_cano500"] 619.211 μs (5%)
["stabilizer", "canon", "diag_gott500"] 4.100 ms (5%) 5.19 MiB (1%) 34521
["stabilizer", "canon", "diag_rref500"] 655.549 μs (5%)
["stabilizer", "canon", "gott500"] 6.612 ms (5%) 5.19 MiB (1%) 34531
["stabilizer", "canon", "md_cano500"] 1.711 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.655 ms (5%)
["stabilizer", "canon", "rref500"] 3.164 ms (5%)
["stabilizer", "project", "destabilizer"] 17.894 μs (5%) 288 bytes (1%) 5
["stabilizer", "project", "stabilizer"] 8.976 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 1.388 ms (5%) 23.97 MiB (1%) 34
["stabilizer", "tensor", "pow5_20"] 2.579 μs (5%) 6.44 KiB (1%) 31
["stabilizer", "trace", "destabilizer"] 31.249 μs (5%) 80 bytes (1%) 2
["stabilizer", "trace", "stabilizer"] 24.846 μs (5%) 112 bytes (1%) 3

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.12.0-DEV.603
Commit d8f37c9920a (2024-05-25 21:46 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 0 MHz 2622 s 0 s 161 s 6735 s 0 s
 #2 0 MHz 2233 s 0 s 190 s 7095 s 0 s
 #3 0 MHz 2160 s 0 s 174 s 7174 s 0 s
 #4 0 MHz 2240 s 0 s 178 s 7098 s 0 s
 Memory: 15.606502532958984 GB (13310.4140625 MB free)
 Uptime: 955.3 sec
 Load Avg: 1.07 1.05 0.75
 WORD_SIZE: 64
 LLVM: libLLVM-17.0.6 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 26 May 2024 - 0:0
  • Package commit: 44f618
  • Julia commit: d8f37c
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "compactification", "compact"] 6.945 ms (5%)
["circuitsim", "compactification", "no_compact"] 7.124 ms (5%) 281.25 KiB (1%) 6000
["circuitsim", "mctrajectories", "q1001_r1"] 15.698 ms (5%) 500.77 KiB (1%) 18019
["circuitsim", "mctrajectories", "q101_r1"] 173.384 μs (5%) 50.53 KiB (1%) 1818
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 13.397 ms (5%) 496 bytes (1%) 9
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 121.217 μs (5%) 256 bytes (1%) 8
["circuitsim", "mctrajectories_union", "q1001_r1"] 13.424 ms (5%) 496 bytes (1%) 9
["circuitsim", "mctrajectories_union", "q101_r1"] 120.385 μs (5%) 256 bytes (1%) 8
["circuitsim", "pftrajectories", "q1001_r1"] 63.709 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 182.822 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 1.154 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 6.161 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 42.870 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 153.848 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.128 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"] 5.830 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 4.328 μs (5%)
["circuitsim", "pftrajectories_union", "q1001_r1"] 22.612 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 136.736 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 1.102 ms (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 2.354 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 11.398 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot250_on_dense500_stab"] 5.698 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot250_on_diag500_destab"] 1.120 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot250_on_diag500_stab"] 560.119 μs (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot_on_dense500_destab"] 49.964 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "cnot_on_dense500_stab"] 23.895 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "cnot_on_diag500_destab"] 25.427 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "cnot_on_diag500_stab"] 13.205 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "dense500_on_dense500_destab"] 11.373 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "dense500_on_dense500_stab"] 5.684 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "dense500_on_diag500_destab"] 968.585 μs (5%) 512 bytes (1%) 8
["clifford", "dense", "dense500_on_diag500_stab"] 560.089 μs (5%) 512 bytes (1%) 8
["clifford", "symbolic", "cnot250_on_dense500_destab"] 1.476 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 697.036 μs (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.195 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 580.237 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 4.849 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 2.354 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 4.799 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 2.354 μs (5%)
["ecc", "evaluate_decoder", "shor_bp_comm"] 1.830 ms (5%) 1.78 MiB (1%) 42681
["ecc", "evaluate_decoder", "shor_bp_naivesyn"] 4.317 ms (5%) 3.62 MiB (1%) 81859
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 5.206 ms (5%) 3.79 MiB (1%) 84691
["ecc", "evaluate_decoder", "shor_pybp_comm"] 24.610 ms (5%) 3.97 MiB (1%) 116084
["ecc", "evaluate_decoder", "shor_pybp_naivesyn"] 50.101 ms (5%) 7.99 MiB (1%) 228133
["ecc", "evaluate_decoder", "shor_pybp_shorsyn"] 50.310 ms (5%) 8.07 MiB (1%) 229131
["ecc", "evaluate_decoder", "shor_table_comm"] 258.054 μs (5%) 241.48 KiB (1%) 4595
["ecc", "evaluate_decoder", "shor_table_naivesyn"] 1.086 ms (5%) 350.88 KiB (1%) 5155
["ecc", "evaluate_decoder", "shor_table_shorsyn"] 1.512 ms (5%) 440.22 KiB (1%) 6153
["ecc", "evaluate_decoder", "toric8_bp_comm"] 702.941 ms (5%) 13.137 ms 172.09 MiB (1%) 1031882
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.398 s (5%) 22.592 ms 357.05 MiB (1%) 2172478
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 1.381 s (5%) 22.968 ms 351.51 MiB (1%) 2159263
["ecc", "evaluate_decoder", "toric8_pybp_comm"] 386.634 ms (5%) 7.31 MiB (1%) 135575
["ecc", "evaluate_decoder", "toric8_pybp_naivesyn"] 803.244 ms (5%) 16.90 MiB (1%) 317606
["ecc", "evaluate_decoder", "toric8_pybp_shorsyn"] 801.306 ms (5%) 19.38 MiB (1%) 351522
["ecc", "evaluate_decoder", "toric8_pymatch_comm"] 4.231 ms (5%) 1.95 MiB (1%) 23180
["ecc", "evaluate_decoder", "toric8_pymatch_naivesyn"] 16.931 ms (5%) 6.03 MiB (1%) 92823
["ecc", "evaluate_decoder", "toric8_pymatch_shorsyn"] 25.992 ms (5%) 8.50 MiB (1%) 126739
["ecc", "evaluate_decoder", "toric8_table_comm"] 2.708 ms (5%) 1.64 MiB (1%) 23086
["ecc", "evaluate_decoder", "toric8_table_naivesyn"] 14.640 ms (5%) 5.38 MiB (1%) 92628
["ecc", "evaluate_decoder", "toric8_table_shorsyn"] 23.662 ms (5%) 7.86 MiB (1%) 126544
["pauli", "mul", "100"] 14.295 ns (5%)
["pauli", "mul", "1000"] 18.391 ns (5%)
["pauli", "mul", "100000"] 730.138 ns (5%)
["pauli", "mul", "20000000"] 193.733 μs (5%)
["stabilizer", "canon", "cano500"] 3.078 ms (5%)
["stabilizer", "canon", "diag_cano500"] 600.394 μs (5%)
["stabilizer", "canon", "diag_gott500"] 4.070 ms (5%) 5.19 MiB (1%) 34521
["stabilizer", "canon", "diag_rref500"] 655.258 μs (5%)
["stabilizer", "canon", "gott500"] 6.552 ms (5%) 5.19 MiB (1%) 34531
["stabilizer", "canon", "md_cano500"] 1.561 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.576 ms (5%)
["stabilizer", "canon", "rref500"] 3.118 ms (5%)
["stabilizer", "project", "destabilizer"] 17.693 μs (5%) 288 bytes (1%) 5
["stabilizer", "project", "stabilizer"] 8.756 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 1.276 ms (5%) 23.97 MiB (1%) 34
["stabilizer", "tensor", "pow5_20"] 2.548 μs (5%) 6.44 KiB (1%) 31
["stabilizer", "trace", "destabilizer"] 31.729 μs (5%) 80 bytes (1%) 2
["stabilizer", "trace", "stabilizer"] 24.596 μs (5%) 112 bytes (1%) 3

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.12.0-DEV.603
Commit d8f37c9920a (2024-05-25 21:46 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 0 MHz 3998 s 0 s 212 s 9709 s 0 s
 #2 0 MHz 2985 s 0 s 239 s 10695 s 0 s
 #3 0 MHz 3341 s 0 s 223 s 10346 s 0 s
 #4 0 MHz 3356 s 0 s 234 s 10328 s 0 s
 Memory: 15.606502532958984 GB (13304.7421875 MB free)
 Uptime: 1396.24 sec
 Load Avg: 1.07 1.05 0.88
 WORD_SIZE: 64
 LLVM: libLLVM-17.0.6 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 48 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 4
On-line CPU(s) list: 0-3
Vendor ID: AuthenticAMD
Model name: AMD EPYC 7763 64-Core Processor
CPU family: 25
Model: 1
Thread(s) per core: 2
Core(s) per socket: 2
Socket(s): 1
Stepping: 1
BogoMIPS: 4890.85
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization: AMD-V
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 1 MiB (2 instances)
L3 cache: 32 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Not affected

Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft

@codecov
Copy link

codecov bot commented May 26, 2024 •
edited
Loading

Codecov Report

Attention: Patch coverage is 0% with 14 lines in your changes missing coverage. Please review.

Project coverage is 77.06%. Comparing base (d86ff67) to head (6c05f93).

Files with missing lines Patch % Lines
src/ecc/codes/gottesman4.jl 0.00% 14 Missing ⚠️

❗ There is a different number of reports uploaded between BASE (d86ff67) and HEAD (6c05f93). Click for more details.

HEAD has 2 uploads less than BASE
Flag BASE (d86ff67) HEAD (6c05f93)
10 8
Additional details and impacted files 
@@            Coverage Diff             @@
##           master     #282      +/-   ##
==========================================
- Coverage   84.46%   77.06%   -7.41%     
==========================================
  Files          95       96       +1     
  Lines        5956     5964       +8     
==========================================
- Hits         5031     4596     -435     
- Misses        925     1368     +443

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@Fe-r-oz Fe-r-oz marked this pull request as draft June 5, 2024 17:45
@Fe-r-oz
Copy link
Contributor Author

Fe-r-oz commented Jun 14, 2024

Thanks, @Krastanov, for providing clarification in #287!

Gottesman applies H to the state to get Family of Distance 4 codes.

Previously, I was using

 for rows in 1:c.j
       for cols in 1:2^c.j
             if Hⱼ[rows][cols] == (true, false) # X
                  Hⱼ[rows, cols] = (false, true) # X -> Z
             elseif Hⱼ[rows][cols] == (false, true) # Z
                  Hⱼ[rows, cols] = (true, false) # Z -> X
             end 
         end
     end

which can now be changed

    for qᵢ in 1:nqubits(Hⱼ)
        apply!(Hⱼ, sHadamard(qᵢ))
    end

@Fe-r-oz Fe-r-oz marked this pull request as ready for review June 14, 2024 06:35
@Fe-r-oz
Copy link
Contributor Author

Fe-r-oz commented Jun 14, 2024

display

display

@Fe-r-oz Fe-r-oz mentioned this pull request Jul 10, 2024
Closed
@Fe-r-oz Fe-r-oz changed the title Adding [[2ʲ, 2ʲ - 2j - 2, 4]] Gottesman codes to the ECC module [[2ʲ, 2ʲ - 2j - 2, 4]] Gottesman code Jul 22, 2024
@Krastanov Krastanov added the ECC Having to do with the ECC submodule label Aug 3, 2024
@Fe-r-oz Fe-r-oz marked this pull request as draft August 4, 2024 15:15
@Krastanov Krastanov added the needs rebase A PR that is nearly done, but a merge conflict needs to be fixed. label Sep 27, 2024
@Fe-r-oz Fe-r-oz removed the needs rebase A PR that is nearly done, but a merge conflict needs to be fixed. label Jul 23, 2025
Krastanov
Krastanov reviewed Dec 31, 2025
View reviewed changes
src/ecc/codes/gottesman4.jl
@@ -0,0 +1,25 @@
"""The family of `[[2ʲ, 2ʲ - 2j - 2, 4]]` Gottesman codes, also known as a 'Class of Distance Four Codes', as described in [Gottesman's 1997 PhD thesis](@cite gottesman1997stabilizer) and in [gottesman1996class](@cite).

The stabilizer generators of the original `[[2ʲ, 2ʲ - j - 2, 3]]` Gottesman codes are incorporated to create a set of generators for this distance-four code. The resulting stabilizer set, denoted by S, incorporates the following elements: The first two generators are the Pauli-`X` and Pauli-`Z` operators acting on all qubits, represented by `Mₓ` and `Mz`, respectively. The next `j` generators correspond to `M₁` through `Mⱼ`, which are directly inherited from the `[[2ʲ, 2ʲ - j - 2, 3]]` Gottesman code's stabilizers. This inclusion ensures that `S` retains the inherent distance-three property of the original Gottesman code. The final `j` generators are defined as `Nᵢ = RMᵢR`, where `i` ranges from `1` to `j`. Here, `R` signifies a Hadamard Rotation operation applied to all `2ʲ` qubits, and `Mᵢ` refers to one of the existing generators from the second set `(M₁ to Mⱼ)`. By incorporating the stabilizers of a distance-three code, the constructed set `S` inherently guarantees a minimum distance of three for the resulting distance-four Gottesman code.
Copy link
Member

@Krastanov Krastanov Dec 31, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A see also to Gottesman and an explanation about the different would be useful.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@Krastanov Krastanov Krastanov left review comments

Assignees

No one assigned

Labels

ECC Having to do with the ECC submodule

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@Fe-r-oz @Krastanov