Testing fo Benchmark trigger as GH comment #1099

LuisAlfredoNu · 2025-03-18T05:34:39Z

Before submitting

Please complete the following checklist when submitting a PR:

All new features must include a unit test.
If you've fixed a bug or added code that should be tested, add a test to the
tests directory!
All new functions and code must be clearly commented and documented.
If you do make documentation changes, make sure that the docs build and
render correctly by running make docs.
Ensure that the test suite passes, by running make test.
Add a new entry to the .github/CHANGELOG.md file, summarizing the
change, and including a link back to the PR.
Ensure that code is properly formatted by running make format.

When all the above are checked, delete everything above the dashed
line and fill in the pull request template.

Context:

Description of the Change:

Benefits:

Possible Drawbacks:

Related GitHub Issues:

codecov · 2025-03-18T05:39:05Z

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 55.55%. Comparing base (5f35ed4) to head (15e601f).

❗ There is a different number of reports uploaded between BASE (5f35ed4) and HEAD (15e601f). Click for more details.

HEAD has 26 uploads less than BASE

Flag BASE (5f35ed4) HEAD (15e601f)

31 5

Additional details and impacted files

@@             Coverage Diff             @@
##           master    #1099       +/-   ##
===========================================
- Coverage   97.97%   55.55%   -42.42%     
===========================================
  Files         237       28      -209     
  Lines       41192     2727    -38465     
===========================================
- Hits        40356     1515    -38841     
- Misses        836     1212      +376

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

LuisAlfredoNu · 2025-03-18T06:07:05Z

/benchmark

ringo-but-quantum · 2025-03-18T06:07:43Z

Benchmark Results

This is just simple markdown, render this however you'd like

Metric	Value
Time	123s
Speed	1x

ringo-but-quantum · 2025-03-18T08:46:41Z

PennyLane Benchmarks

Benchmarks Report for lightning.qubit

Workflows

Interpreted

workflow	time [s]	std/mean		time score		mem [MB]	mem score
QPE[12-12]	2.085	0.1%		0.73	🔴	256	1.00
QPE[11-12]	1.026	0.0%		0.73	🔴	128	1.00
QSVT	2.166	1.7%		1.00		1	1.00
XAS[2-9]	8.108	0.6%		0.58	🔴	20	1.00
XAS[1-9]	4.040	1.4%		0.57	🔴	570	1.00
molecular_hamiltonian[CH2-STO-3G]	3.263	0.9%		1.00		146	1.00
molecular_hamiltonian[NH3-STO-3G]	9.482	0.9%		0.99		316	1.00
sampling[24-2]	1.326	0.1%		0.99		775	1.00
sampling[25-2]	2.754	0.0%		0.99		1548	1.00
stateprep[15-ArbitraryStatePreparation]	6.789	0.8%		0.86	🔴	38	1.02	🟢
stateprep[12-MottonenStatePreparation]	6.151	0.7%		1.02		32	1.00
grover[18]	1.804	1.3%		0.87	🔴	27	1.00
QAOA_layers_scaling[19-4]	1.122	1.9%		0.96	🔴	296	1.00
QML_jaxjit[IQPKernelClassifier-12-10]	4.578	15.5%	⚠️	0.98	🔴	16	1.00
QML_jaxjit[IQPVariationalClassifier-20-10]	4.617	6.9%	⚠️	1.00		36	1.00
UCCSD[CH2-STO-3G]	1.097	6.6%	⚠️	0.99		145	1.00
UCCSD[NH3-STO-3G]	3.024	3.0%		0.97	🔴	316	1.00
VQE[CH2-STO-3G]	2.991	3.4%		0.96	🔴	144	1.00
VQE[NH3-STO-3G]	15.652	1.9%		0.98		316	1.00

Hardware and Software Specifications

System	Current	Reference
CPU Name	Intel(R) Xeon(R) E-2388G CPU @ 3.20GHz
Architecture	X86_64
Memory	62.64 GB
PennyLane Version	0.41.0.dev51	0.41.0.dev51
Lightning Version	0.41.0.dev36	0.41.0.dev37
NumPy Version	2.0.2	2.0.2
SciPy Version	1.15.2	1.15.2
Lightning Compiler	Unknown	Unknown

ringo-but-quantum · 2025-03-18T14:35:02Z

PennyLane Benchmarks

Benchmarks Report for lightning.qubit

Workflows

Interpreted

workflow	time [s]	std/mean		time score		mem [MB]	mem score
QPE[11-12]	1.022	0.0%		0.73	🔴	128	1.00
QPE[12-12]	2.085	0.1%		0.73	🔴	256	1.00
QSVT	2.159	1.7%		1.00		1	1.00
XAS[2-9]	8.019	0.6%		0.58	🔴	20	1.00
XAS[1-9]	3.983	1.4%		0.58	🔴	570	1.00
molecular_hamiltonian[NH3-STO-3G]	9.411	0.2%		1.01		316	1.00
molecular_hamiltonian[CH2-STO-3G]	3.241	0.8%		1.01		146	1.00
sampling[24-2]	1.321	0.1%		0.99		775	1.00
sampling[25-2]	2.706	1.0%		1.00		1548	1.00
stateprep[12-MottonenStatePreparation]	6.163	0.6%		1.02	🟢	32	1.00
stateprep[15-ArbitraryStatePreparation]	6.766	0.8%		0.86	🔴	37	1.08	🟢
grover[18]	1.867	1.4%		0.85	🔴	27	1.00
QAOA_layers_scaling[19-4]	1.140	2.2%		0.91	🔴	296	1.00
QML_jaxjit[IQPKernelClassifier-12-10]	4.609	15.8%	⚠️	0.97	🔴	16	1.00
QML_jaxjit[IQPVariationalClassifier-20-10]	4.626	7.0%	⚠️	1.00		36	1.00
UCCSD[NH3-STO-3G]	2.980	3.1%		1.00		316	1.00
UCCSD[CH2-STO-3G]	1.098	6.3%	⚠️	0.99		145	1.00
VQE[CH2-STO-3G]	2.938	2.1%		0.96	🔴	144	1.00
VQE[NH3-STO-3G]	15.612	1.6%		0.97	🔴	316	1.00

Hardware and Software Specifications

System	Current	Reference
CPU Name	Intel(R) Xeon(R) E-2388G CPU @ 3.20GHz
Architecture	X86_64
Memory	62.64 GB
PennyLane Version	0.41.0.dev52	0.41.0.dev52
Lightning Version	0.41.0.dev36	0.41.0.dev37
NumPy Version	2.0.2	2.0.2
SciPy Version	1.15.2	1.15.2
Lightning Compiler	Unknown	Unknown

ringo-but-quantum · 2025-03-18T21:54:02Z

Benchmark Results

This is just simple markdown, render this however you'd like

Metric	Value
Time	123s
Speed	1x

ringo-but-quantum · 2025-03-19T14:48:45Z

PennyLane Benchmarks

Benchmarks Report for lightning.qubit

Workflows

Interpreted

workflow	time [s]	std/mean		time score		mem [MB]	mem score
QPE[12-12]	2.086	0.1%		1.00		256	1.00
QPE[11-12]	1.025	0.1%		1.00		128	1.00
QSVT	2.142	1.9%		1.01		10	1.00
XAS[2-9]	8.207	0.7%		1.00		21	1.05	🟢
XAS[1-9]	4.105	1.3%		1.00		570	1.00
sampling[24-2]	1.322	0.1%		1.01		775	1.00
sampling[25-2]	2.743	0.0%		1.01		1548	1.00
stateprep[12-MottonenStatePreparation]	6.884	0.6%		0.90	🔴	64	1.00
stateprep[15-ArbitraryStatePreparation]	6.755	0.9%		1.01		44	1.00
grover[18]	1.756	1.7%		1.02	🟢	27	1.00
QAOA_layers_scaling[19-4]	1.150	3.2%		0.99		296	1.00
QML_jaxjit[IQPVariationalClassifier-20-10]	4.607	7.5%	⚠️	1.01		36	1.00
QML_jaxjit[IQPKernelClassifier-12-10]	4.548	15.4%	⚠️	1.01		16	1.00

Hardware and Software Specifications

System	Current	Reference
CPU Name	Intel(R) Xeon(R) E-2388G CPU @ 3.20GHz
Architecture	X86_64
Memory	62.64 GB
PennyLane Version	0.41.0.dev53	0.41.0.dev53
Lightning Version	0.41.0.dev37	0.41.0.dev37
NumPy Version	2.2.4	2.2.4
SciPy Version	1.15.2	1.15.2
Lightning Compiler	Unknown	Unknown

ringo-but-quantum · 2025-03-19T18:16:36Z

PennyLane Benchmarks

Benchmarks Report for lightning.qubit

Workflows

Interpreted

workflow	time [s]	std/mean		time score		mem [MB]	mem score
QPE[12-12]	2.094	0.0%		1.00		256	1.00
QPE[11-12]	1.028	0.1%		1.00		128	1.00
QSVT	2.140	1.9%		1.01		1	1.00
XAS[2-9]	8.253	0.6%		0.99		20	1.00
XAS[1-9]	4.129	1.4%		0.96	🔴	570	1.00
molecular_hamiltonian[NH3-STO-3G]	9.492	0.4%		0.97	🔴	319	1.00
molecular_hamiltonian[H2O-STO-3G]	3.281	0.7%		0.97	🔴	131	1.00
sampling[25-2]	2.750	0.0%		0.99		1548	1.00
sampling[24-2]	1.323	0.1%		1.00		775	1.00
stateprep[15-ArbitraryStatePreparation]	6.787	0.8%		1.00		40	0.97	🔴
stateprep[12-MottonenStatePreparation]	6.189	0.7%		1.01		32	1.00
grover[18]	1.791	1.6%		0.98	🔴	27	1.00
QAOA_layers_scaling[19-4]	1.128	2.0%		1.01		296	1.00
QML_jaxjit[IQPVariationalClassifier-20-10]	4.634	7.4%	⚠️	1.00		36	1.00
QML_jaxjit[IQPKernelClassifier-12-10]	4.596	15.6%	⚠️	1.00		16	1.00
UCCSD[H2O-STO-3G]	0.757	9.8%	⚠️	1.00		130	1.00
UCCSD[NH3-STO-3G]	2.938	3.1%		1.02	🟢	319	1.00
VQE[H2O-STO-3G]	2.874	2.4%		0.99		130	1.00
VQE[NH3-STO-3G]	15.344	3.8%		1.00		319	1.00

Hardware and Software Specifications

System	Current	Reference
CPU Name	Intel(R) Xeon(R) E-2388G CPU @ 3.20GHz
Architecture	X86_64
Memory	62.64 GB
PennyLane Version	0.41.0.dev53	0.41.0.dev53
Lightning Version	0.41.0.dev38	0.41.0.dev37
NumPy Version	2.2.4	2.2.4
SciPy Version	1.15.2	1.15.2
Lightning Compiler	Unknown	Unknown

LuisAlfredoNu · 2025-03-20T13:51:28Z

/benchmark

ringo-but-quantum · 2025-03-20T14:28:45Z

PennyLane Benchmarks

Benchmarks Report for lightning.qubit

Workflows

Interpreted

workflow	time [s]	std/mean		time score	mem [MB]	mem score
QPE[12-12]	2.083	0.1%		1.01	256	1.00
QPE[11-12]	1.023	0.1%		1.00	128	1.00
QSVT	2.145	2.0%		1.00	1	1.00
XAS[2-9]	7.986	1.4%		1.00	20	1.00
XAS[1-9]	3.986	1.5%		1.00	570	1.00
molecular_hamiltonian[H2O-STO-3G]	3.277	0.9%		0.99	131	1.00
molecular_hamiltonian[NH3-STO-3G]	9.494	0.6%		0.99	319	1.00
sampling[24-2]	1.326	0.2%		1.00	775	1.00
sampling[25-2]	2.722	1.0%		1.01	1548	1.00
stateprep[15-ArbitraryStatePreparation]	6.806	0.8%		0.99	39	0.97	🔴
stateprep[12-MottonenStatePreparation]	6.185	0.6%		1.00	32	1.00
grover[18]	1.789	1.6%		1.02	27	1.00
QAOA_layers_scaling[19-4]	1.128	2.2%		0.99	296	1.00
QML_jaxjit[IQPKernelClassifier-12-10]	4.641	15.2%	⚠️	1.00	16	1.00
QML_jaxjit[IQPVariationalClassifier-20-10]	4.662	8.2%	⚠️	0.99	36	1.00
UCCSD[H2O-STO-3G]	0.756	9.9%	⚠️	1.00	130	1.00
UCCSD[NH3-STO-3G]	3.017	3.0%		0.98	319	1.00
VQE[H2O-STO-3G]	2.841	1.6%		1.00	130	1.00
VQE[NH3-STO-3G]	15.523	3.4%		1.00	319	1.00

Hardware and Software Specifications

System	Current	Reference
CPU Name	Intel(R) Xeon(R) E-2388G CPU @ 3.20GHz
Architecture	X86_64
Memory	62.64 GB
PennyLane Version	0.41.0.dev54	0.41.0.dev54
Lightning Version	0.41.0.dev39	0.41.0.dev37
NumPy Version	2.2.4	2.2.4
SciPy Version	1.15.2	1.15.2
Lightning Compiler	Unknown	Unknown

LuisAlfredoNu · 2025-03-21T15:29:46Z

/benchmark

LuisAlfredoNu · 2025-03-21T15:42:21Z

/benchmark

ringo-but-quantum · 2025-03-21T22:10:45Z

PennyLane Benchmarks

Benchmarks Report for lightning.qubit

Workflows

Interpreted

workflow	time [s]	std/mean		time score		mem [MB]	mem score
QPE[12-12]	2.087	0.0%		1.00		256	1.00
QPE[11-12]	1.027	0.1%		1.00		128	1.00
QSVT	1.869	2.1%		1.14	🟢	1	1.00
XAS[2-9]	7.970	1.2%		1.00		14	1.00
XAS[1-9]	3.957	1.7%		1.01		564	1.00
molecular_hamiltonian[H2O-STO-3G]	3.333	1.0%		0.98	🔴	131	1.00
molecular_hamiltonian[NH3-STO-3G]	9.674	0.5%		0.98	🔴	319	1.00
sampling[24-2]	1.321	0.1%		1.00		775	1.00
sampling[25-2]	2.704	1.0%		1.00		1548	1.00
stateprep[12-MottonenStatePreparation]	6.128	0.8%		1.01		32	1.00
stateprep[15-ArbitraryStatePreparation]	6.188	0.8%		1.09	🟢	42	0.93	🔴
grover[18]	1.699	1.4%		1.02	🟢	26	1.08	🟢
QAOA_layers_scaling[19-4]	1.140	2.8%		1.00		296	1.00
QML_jaxjit[IQPKernelClassifier-12-10]	4.581	14.8%	⚠️	1.00		16	1.00
QML_jaxjit[IQPVariationalClassifier-20-10]	4.592	7.7%	⚠️	1.02		36	1.00
UCCSD[NH3-STO-3G]	2.796	3.9%		1.07	🟢	319	1.00
UCCSD[H2O-STO-3G]	0.685	16.0%	⚠️	1.14	🟢	130	1.00
VQE[H2O-STO-3G]	2.744	2.9%		1.05	🟢	130	1.00
VQE[NH3-STO-3G]	15.195	3.1%		1.01		319	1.00

Hardware and Software Specifications

System	Current	Reference
CPU Name	Intel(R) Xeon(R) E-2388G CPU @ 3.20GHz
Architecture	X86_64
Memory	62.64 GB
PennyLane Version	0.41.0.dev55	0.41.0.dev55
Lightning Version	0.41.0.dev42	0.41.0.dev41
NumPy Version	2.2.4	2.2.4
SciPy Version	1.15.2	1.15.2
Lightning Compiler	Unknown	Unknown

LuisAlfredoNu and others added 5 commits March 5, 2025 20:15

dummy comnit

bf5a281

Auto update version from '0.41.0-dev29' to '0.41.0-dev30'

ec715f0

Auto update version from '0.41.0-dev30' to '0.41.0-dev37'

dacee37

Merge branch 'master' into benchmark_call

3ba9aa1

Auto update version from '0.41.0-dev36' to '0.41.0-dev37'

1fc6452

LuisAlfredoNu and others added 2 commits March 21, 2025 09:43

Merge branch 'master' into benchmark_call

a96c5fe

Auto update version from '0.41.0-dev40' to '0.41.0-dev41'

15e601f

Testing fo Benchmark trigger as GH comment #1099

Are you sure you want to change the base?

Testing fo Benchmark trigger as GH comment #1099

Uh oh!

Conversation

LuisAlfredoNu commented Mar 18, 2025

Before submitting

Uh oh!

codecov bot commented Mar 18, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codecov Report

Uh oh!

LuisAlfredoNu commented Mar 18, 2025

Uh oh!

ringo-but-quantum commented Mar 18, 2025

Benchmark Results

Uh oh!

ringo-but-quantum commented Mar 18, 2025

PennyLane Benchmarks

Benchmarks Report for lightning.qubit

Workflows

Interpreted

Hardware and Software Specifications

Uh oh!

ringo-but-quantum commented Mar 18, 2025

PennyLane Benchmarks

Benchmarks Report for lightning.qubit

Workflows

Interpreted

Hardware and Software Specifications

Uh oh!

ringo-but-quantum commented Mar 18, 2025

Benchmark Results

Uh oh!

ringo-but-quantum commented Mar 19, 2025

PennyLane Benchmarks

Benchmarks Report for lightning.qubit

Workflows

Interpreted

Hardware and Software Specifications

Uh oh!

ringo-but-quantum commented Mar 19, 2025

PennyLane Benchmarks

Benchmarks Report for lightning.qubit

Workflows

Interpreted

Hardware and Software Specifications

Uh oh!

LuisAlfredoNu commented Mar 20, 2025

Uh oh!

ringo-but-quantum commented Mar 20, 2025

PennyLane Benchmarks

Benchmarks Report for lightning.qubit

Workflows

Interpreted

Hardware and Software Specifications

Uh oh!

LuisAlfredoNu commented Mar 21, 2025

Uh oh!

LuisAlfredoNu commented Mar 21, 2025

Uh oh!

ringo-but-quantum commented Mar 21, 2025

PennyLane Benchmarks

Benchmarks Report for lightning.qubit

Workflows

Interpreted

Hardware and Software Specifications

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

codecov bot commented Mar 18, 2025 •

edited

Loading