Enzyme gradient fails when `sensealg` is defined in the `ODEProblem` rather than in the `solve` function

[albertomercurio]

Describe the bug 🐞

The differentiation with Enzyme.jl of an ODE involving SciMLOperators.jl has been fixed in #1139. To achieve this, we have to manually set sensealg=BacksolveAdjoint(autojacvec=EnzymeVJP()) in the solve function.

However, if I set this argument directly in the ODEProblem, it doesn't work, and it returns an error.

Expected behavior

A correct value of the gradient.

Minimal Reproducible Example 👇

using LinearAlgebra
using SparseArrays
using OrdinaryDiffEq
using SciMLSensitivity
using SciMLOperators
using Enzyme

##

const T = ComplexF64

coef1(a, u, p, t) = -p[1]
coef2(a, u, p, t) = p[2]

A1_data = sparse(T[0.0 1.0; 0.0 0.0])
A2_data = sparse(T[0.0 0.0; 1.0 0.0])
c1 = ScalarOperator(one(T), coef1)
c2 = ScalarOperator(one(T), coef2)

const U = c1 * MatrixOperator(A1_data) + c2 * MatrixOperator(A2_data)

function my_fun(p)
    x = T[3.0, 4.0]

    prob = ODEProblem{true}(U, x, (0.0, 1.0), p, sensealg=BacksolveAdjoint(autojacvec=EnzymeVJP()))

    sol = solve(prob, Tsit5(), save_everystep=false, 
        # sensealg=BacksolveAdjoint(autojacvec=EnzymeVJP()) # Here it works
    )

    return real(sol.u[end][end])
end

##

p = [1.0, 2.0]

dp = Enzyme.make_zero(p)
Enzyme.autodiff(Enzyme.set_runtime_activity(Enzyme.Reverse), my_fun, Active, Duplicated(p, dp))
dp

Error & Stacktrace ⚠️

ERROR: Error handling recursive stores for String which has a fieldcount of 0
Stacktrace:
  [1] error(s::String)
    @ Base ./error.jl:35
  [2] create_recursive_stores(B::LLVM.IRBuilder, Ty::DataType, prev::LLVM.Value)
    @ Enzyme.Compiler ~/.julia/packages/Enzyme/MZ6Nf/src/compiler.jl:622
  [3] create_recursive_stores(B::LLVM.IRBuilder, Ty::DataType, prev::LLVM.Value) (repeats 2 times)
    @ Enzyme.Compiler ~/.julia/packages/Enzyme/MZ6Nf/src/compiler.jl:667
  [4] shadow_alloc_rewrite(V::Ptr{…}, gutils::Ptr{…}, Orig::Ptr{…}, idx::UInt64, prev::Ptr{…}, used::UInt8)
    @ Enzyme.Compiler ~/.julia/packages/Enzyme/MZ6Nf/src/compiler.jl:739
  [5] EnzymeCreatePrimalAndGradient(logic::Enzyme.Logic, todiff::LLVM.Function, retType::Enzyme.API.CDIFFE_TYPE, constant_args::Vector{…}, TA::Enzyme.TypeAnalysis, returnValue::Bool, dretUsed::Bool, mode::Enzyme.API.CDerivativeMode, runtimeActivity::Bool, strongZero::Bool, width::Int64, additionalArg::Ptr{…}, forceAnonymousTape::Bool, typeInfo::Enzyme.FnTypeInfo, uncacheable_args::Vector{…}, augmented::Ptr{…}, atomicAdd::Bool)
    @ Enzyme.API ~/.julia/packages/Enzyme/MZ6Nf/src/api.jl:270
  [6] enzyme!(job::GPUCompiler.CompilerJob{…}, mod::LLVM.Module, primalf::LLVM.Function, TT::Type, mode::Enzyme.API.CDerivativeMode, width::Int64, parallel::Bool, actualRetType::Type, wrap::Bool, modifiedBetween::Tuple{…} where N, returnPrimal::Bool, expectedTapeType::Type, loweredArgs::Set{…}, boxedArgs::Set{…})
    @ Enzyme.Compiler ~/.julia/packages/Enzyme/MZ6Nf/src/compiler.jl:1762
  [7] codegen(output::Symbol, job::GPUCompiler.CompilerJob{…}; libraries::Bool, deferred_codegen::Bool, optimize::Bool, toplevel::Bool, strip::Bool, validate::Bool, only_entry::Bool, parent_job::Nothing)
    @ Enzyme.Compiler ~/.julia/packages/Enzyme/MZ6Nf/src/compiler.jl:4702
  [8] codegen
    @ ~/.julia/packages/Enzyme/MZ6Nf/src/compiler.jl:3465 [inlined]
  [9] _thunk(job::GPUCompiler.CompilerJob{Enzyme.Compiler.EnzymeTarget, Enzyme.Compiler.EnzymeCompilerParams}, postopt::Bool)
    @ Enzyme.Compiler ~/.julia/packages/Enzyme/MZ6Nf/src/compiler.jl:5563
 [10] _thunk
    @ ~/.julia/packages/Enzyme/MZ6Nf/src/compiler.jl:5563 [inlined]
 [11] cached_compilation
    @ ~/.julia/packages/Enzyme/MZ6Nf/src/compiler.jl:5615 [inlined]
 [12] thunkbase(mi::Core.MethodInstance, World::UInt64, FA::Type{…}, A::Type{…}, TT::Type, Mode::Enzyme.API.CDerivativeMode, width::Int64, ModifiedBetween::Tuple{…} where N, ReturnPrimal::Bool, ShadowInit::Bool, ABI::Type, ErrIfFuncWritten::Bool, RuntimeActivity::Bool, StrongZero::Bool, edges::Vector{…})
    @ Enzyme.Compiler ~/.julia/packages/Enzyme/MZ6Nf/src/compiler.jl:5729
 [13] thunk_generator(world::UInt64, source::LineNumberNode, FA::Type, A::Type, TT::Type, Mode::Enzyme.API.CDerivativeMode, Width::Int64, ModifiedBetween::Tuple{…} where N, ReturnPrimal::Bool, ShadowInit::Bool, ABI::Type, ErrIfFuncWritten::Bool, RuntimeActivity::Bool, StrongZero::Bool, self::Any, fakeworld::Any, fa::Type, a::Type, tt::Type, mode::Type, width::Type, modifiedbetween::Type, returnprimal::Type, shadowinit::Type, abi::Type, erriffuncwritten::Type, runtimeactivity::Type, strongzero::Type)
    @ Enzyme.Compiler ~/.julia/packages/Enzyme/MZ6Nf/src/compiler.jl:5917
 [14] autodiff
    @ ~/.julia/packages/Enzyme/MZ6Nf/src/Enzyme.jl:498 [inlined]
 [15] autodiff(mode::ReverseMode{…}, f::typeof(my_fun), ::Type{…}, args::Duplicated{…})
    @ Enzyme ~/.julia/packages/Enzyme/MZ6Nf/src/Enzyme.jl:538
 [16] top-level scope
    @ ~/GitHub/Research/Undef/Autodiff QuantumToolbox/autodiff_ode.jl:88
Some type information was truncated. Use `show(err)` to see complete types.

Environment (please complete the following information):

• Output of using Pkg; Pkg.status()

(Autodiff QuantumToolbox) pkg> st
Status `~/GitHub/Research/Undef/Autodiff QuantumToolbox/Project.toml`
  [6e4b80f9] BenchmarkTools v1.6.0
  [a0c0ee7d] DifferentiationInterface v0.7.1
  [7da242da] Enzyme v0.13.51
  [26cc04aa] FiniteDifferences v0.12.32
  [f6369f11] ForwardDiff v1.0.1
  [b27dd330] GTPSA v1.4.7
  [1dea7af3] OrdinaryDiffEq v6.98.0
⌃ [6c2fb7c5] QuantumToolbox v0.32.0
⌅ [c0aeaf25] SciMLOperators v0.4.0
  [1ed8b502] SciMLSensitivity v7.86.1
  [e88e6eb3] Zygote v0.7.10

• Output of using Pkg; Pkg.status(; mode = PKGMODE_MANIFEST)

Status `~/GitHub/Research/Undef/Autodiff QuantumToolbox/Manifest.toml`
  [47edcb42] ADTypes v1.15.0
  [621f4979] AbstractFFTs v1.5.0
  [7d9f7c33] Accessors v0.1.42
  [79e6a3ab] Adapt v4.3.0
  [66dad0bd] AliasTables v1.1.3
  [ec485272] ArnoldiMethod v0.4.0
  [4fba245c] ArrayInterface v7.19.0
  [4c555306] ArrayLayouts v1.11.1
  [a9b6321e] Atomix v1.1.1
  [6e4b80f9] BenchmarkTools v1.6.0
  [62783981] BitTwiddlingConvenienceFunctions v0.1.6
  [70df07ce] BracketingNonlinearSolve v1.3.0
  [fa961155] CEnum v0.5.0
  [2a0fbf3d] CPUSummary v0.2.6
  [7057c7e9] Cassette v0.3.14
  [082447d4] ChainRules v1.72.5
  [d360d2e6] ChainRulesCore v1.25.2
  [fb6a15b2] CloseOpenIntervals v0.1.13
  [38540f10] CommonSolve v0.2.4
  [bbf7d656] CommonSubexpressions v0.3.1
  [f70d9fcc] CommonWorldInvalidations v1.0.0
  [34da2185] Compat v4.16.0
  [a33af91c] CompositionsBase v0.1.2
  [2569d6c7] ConcreteStructs v0.2.3
  [187b0558] ConstructionBase v1.6.0
  [adafc99b] CpuId v0.3.1
  [a8cc5b0e] Crayons v4.1.1
  [9a962f9c] DataAPI v1.16.0
  [864edb3b] DataStructures v0.18.22
  [e2d170a0] DataValueInterfaces v1.0.0
  [2b5f629d] DiffEqBase v6.176.0
  [459566f4] DiffEqCallbacks v4.8.0
  [77a26b50] DiffEqNoiseProcess v5.24.1
  [163ba53b] DiffResults v1.1.0
  [b552c78f] DiffRules v1.15.1
  [a0c0ee7d] DifferentiationInterface v0.7.1
  [b4f34e82] Distances v0.10.12
  [31c24e10] Distributions v0.25.120
  [ffbed154] DocStringExtensions v0.9.5
  [4e289a0a] EnumX v1.0.5
  [7da242da] Enzyme v0.13.51
  [f151be2c] EnzymeCore v0.8.12
  [d4d017d3] ExponentialUtilities v1.27.0
  [e2ba6199] ExprTools v0.1.10
  [55351af7] ExproniconLite v0.10.14
  [7a1cc6ca] FFTW v1.9.0
  [7034ab61] FastBroadcast v0.3.5
  [9aa1b823] FastClosures v0.3.2
  [442a2c76] FastGaussQuadrature v1.0.2
  [a4df4552] FastPower v1.1.3
  [1a297f60] FillArrays v1.13.0
  [6a86dc24] FiniteDiff v2.27.0
  [26cc04aa] FiniteDifferences v0.12.32
  [f6369f11] ForwardDiff v1.0.1
  [f62d2435] FunctionProperties v0.1.2
  [069b7b12] FunctionWrappers v1.1.3
  [77dc65aa] FunctionWrappersWrappers v0.1.3
  [d9f16b24] Functors v0.5.2
  [46192b85] GPUArraysCore v0.2.0
  [61eb1bfa] GPUCompiler v1.5.3
  [b27dd330] GTPSA v1.4.7
  [c145ed77] GenericSchur v0.5.5
  [86223c79] Graphs v1.13.0
  [076d061b] HashArrayMappedTries v0.2.0
  [34004b35] HypergeometricFunctions v0.3.28
  [7869d1d1] IRTools v0.4.15
  [615f187c] IfElse v0.1.1
  [40713840] IncompleteLU v0.2.1
  [d25df0c9] Inflate v0.1.5
  [3587e190] InverseFunctions v0.1.17
  [92d709cd] IrrationalConstants v0.2.4
  [82899510] IteratorInterfaceExtensions v1.0.0
  [692b3bcd] JLLWrappers v1.7.0
  [682c06a0] JSON v0.21.4
  [ae98c720] Jieko v0.2.1
  [ccbc3e58] JumpProcesses v9.16.0
  [63c18a36] KernelAbstractions v0.9.35
  [ba0b0d4f] Krylov v0.10.1
  [929cbde3] LLVM v9.4.1
  [b964fa9f] LaTeXStrings v1.4.0
  [10f19ff3] LayoutPointers v0.1.17
  [5078a376] LazyArrays v2.6.1
  [2d8b4e74] LevyArea v1.0.0
  [87fe0de2] LineSearch v0.1.4
  [d3d80556] LineSearches v7.4.0
  [7ed4a6bd] LinearSolve v3.17.0
  [2ab3a3ac] LogExpFunctions v0.3.29
  [1914dd2f] MacroTools v0.5.16
  [d125e4d3] ManualMemory v0.1.8
  [bb5d69b7] MaybeInplace v0.1.4
  [e1d29d7a] Missings v1.2.0
  [2e0e35c7] Moshi v0.3.5
  [46d2c3a1] MuladdMacro v0.2.4
  [d41bc354] NLSolversBase v7.10.0
  [2774e3e8] NLsolve v4.5.1
  [872c559c] NNlib v0.9.30
  [77ba4419] NaNMath v1.1.3
  [8913a72c] NonlinearSolve v4.9.0
  [be0214bd] NonlinearSolveBase v1.12.0
  [5959db7a] NonlinearSolveFirstOrder v1.5.0
  [9a2c21bd] NonlinearSolveQuasiNewton v1.6.0
  [26075421] NonlinearSolveSpectralMethods v1.2.0
  [d8793406] ObjectFile v0.4.4
  [429524aa] Optim v1.13.2
  [3bd65402] Optimisers v0.4.6
  [bac558e1] OrderedCollections v1.8.1
  [1dea7af3] OrdinaryDiffEq v6.98.0
  [89bda076] OrdinaryDiffEqAdamsBashforthMoulton v1.2.0
  [6ad6398a] OrdinaryDiffEqBDF v1.6.0
  [bbf590c4] OrdinaryDiffEqCore v1.26.1
  [50262376] OrdinaryDiffEqDefault v1.4.0
  [4302a76b] OrdinaryDiffEqDifferentiation v1.10.0
  [9286f039] OrdinaryDiffEqExplicitRK v1.1.0
  [e0540318] OrdinaryDiffEqExponentialRK v1.4.0
  [becaefa8] OrdinaryDiffEqExtrapolation v1.5.0
  [5960d6e9] OrdinaryDiffEqFIRK v1.12.0
  [101fe9f7] OrdinaryDiffEqFeagin v1.1.0
  [d3585ca7] OrdinaryDiffEqFunctionMap v1.1.1
  [d28bc4f8] OrdinaryDiffEqHighOrderRK v1.1.0
  [9f002381] OrdinaryDiffEqIMEXMultistep v1.3.0
  [521117fe] OrdinaryDiffEqLinear v1.3.0
  [1344f307] OrdinaryDiffEqLowOrderRK v1.2.0
  [b0944070] OrdinaryDiffEqLowStorageRK v1.3.0
  [127b3ac7] OrdinaryDiffEqNonlinearSolve v1.10.0
  [c9986a66] OrdinaryDiffEqNordsieck v1.1.0
  [5dd0a6cf] OrdinaryDiffEqPDIRK v1.3.1
  [5b33eab2] OrdinaryDiffEqPRK v1.1.0
  [04162be5] OrdinaryDiffEqQPRK v1.1.0
  [af6ede74] OrdinaryDiffEqRKN v1.1.0
  [43230ef6] OrdinaryDiffEqRosenbrock v1.11.0
  [2d112036] OrdinaryDiffEqSDIRK v1.3.0
  [669c94d9] OrdinaryDiffEqSSPRK v1.3.0
  [e3e12d00] OrdinaryDiffEqStabilizedIRK v1.3.0
  [358294b1] OrdinaryDiffEqStabilizedRK v1.1.0
  [fa646aed] OrdinaryDiffEqSymplecticRK v1.3.0
  [b1df2697] OrdinaryDiffEqTsit5 v1.1.0
  [79d7bb75] OrdinaryDiffEqVerner v1.2.0
  [90014a1f] PDMats v0.11.35
  [d96e819e] Parameters v0.12.3
  [69de0a69] Parsers v2.8.3
  [e409e4f3] PoissonRandom v0.4.4
  [f517fe37] Polyester v0.7.18
  [1d0040c9] PolyesterWeave v0.2.2
  [85a6dd25] PositiveFactorizations v0.2.4
  [d236fae5] PreallocationTools v0.4.27
⌅ [aea7be01] PrecompileTools v1.2.1
  [21216c6a] Preferences v1.4.3
  [08abe8d2] PrettyTables v2.4.0
  [43287f4e] PtrArrays v1.3.0
  [1fd47b50] QuadGK v2.11.2
⌃ [6c2fb7c5] QuantumToolbox v0.32.0
  [74087812] Random123 v1.7.1
  [e6cf234a] RandomNumbers v1.6.0
  [c1ae055f] RealDot v0.1.0
  [3cdcf5f2] RecipesBase v1.3.4
  [731186ca] RecursiveArrayTools v3.33.0
  [189a3867] Reexport v1.2.2
  [ae029012] Requires v1.3.1
  [ae5879a3] ResettableStacks v1.1.1
  [37e2e3b7] ReverseDiff v1.16.1
  [708f8203] Richardson v1.4.2
  [79098fc4] Rmath v0.8.0
  [7e49a35a] RuntimeGeneratedFunctions v0.5.15
  [94e857df] SIMDTypes v0.1.0
⌃ [0bca4576] SciMLBase v2.99.0
  [19f34311] SciMLJacobianOperators v0.1.6
⌅ [c0aeaf25] SciMLOperators v0.4.0
  [1ed8b502] SciMLSensitivity v7.86.1
  [53ae85a6] SciMLStructures v1.7.0
  [7e506255] ScopedValues v1.3.0
  [6c6a2e73] Scratch v1.3.0
  [efcf1570] Setfield v1.1.2
  [727e6d20] SimpleNonlinearSolve v2.5.0
  [699a6c99] SimpleTraits v0.9.4
  [ce78b400] SimpleUnPack v1.1.0
  [a2af1166] SortingAlgorithms v1.2.1
  [dc90abb0] SparseInverseSubset v0.1.2
  [0a514795] SparseMatrixColorings v0.4.21
  [276daf66] SpecialFunctions v2.5.1
  [aedffcd0] Static v1.2.0
  [0d7ed370] StaticArrayInterface v1.8.0
  [90137ffa] StaticArrays v1.9.13
  [1e83bf80] StaticArraysCore v1.4.3
  [82ae8749] StatsAPI v1.7.1
  [2913bbd2] StatsBase v0.34.5
  [4c63d2b9] StatsFuns v1.5.0
  [789caeaf] StochasticDiffEq v6.80.0
  [7792a7ef] StrideArraysCore v0.5.7
  [892a3eda] StringManipulation v0.4.1
  [09ab397b] StructArrays v0.7.1
  [53d494c1] StructIO v0.3.1
  [2efcf032] SymbolicIndexingInterface v0.3.41
  [3783bdb8] TableTraits v1.0.1
  [bd369af6] Tables v1.12.1
  [8290d209] ThreadingUtilities v0.5.5
  [a759f4b9] TimerOutputs v0.5.29
  [9f7883ad] Tracker v0.2.38
  [e689c965] Tracy v0.1.4
  [781d530d] TruncatedStacktraces v1.4.0
  [3a884ed6] UnPack v1.0.2
  [013be700] UnsafeAtomics v0.3.0
  [e88e6eb3] Zygote v0.7.10
  [700de1a5] ZygoteRules v0.2.7
  [7cc45869] Enzyme_jll v0.0.183+0
  [f5851436] FFTW_jll v3.3.11+0
  [a4739e29] GTPSA_jll v1.6.1+0
  [1d5cc7b8] IntelOpenMP_jll v2025.0.4+0
  [dad2f222] LLVMExtra_jll v0.0.37+2
  [ad6e5548] LibTracyClient_jll v0.9.1+6
  [856f044c] MKL_jll v2025.0.1+1
⌅ [656ef2d0] OpenBLAS32_jll v0.3.24+0
  [efe28fd5] OpenSpecFun_jll v0.5.6+0
  [f50d1b31] Rmath_jll v0.5.1+0
  [1317d2d5] oneTBB_jll v2022.0.0+0
  [0dad84c5] ArgTools v1.1.1
  [56f22d72] Artifacts
  [2a0f44e3] Base64
  [ade2ca70] Dates
  [8ba89e20] Distributed
  [f43a241f] Downloads v1.6.0
  [7b1f6079] FileWatching
  [9fa8497b] Future
  [b77e0a4c] InteractiveUtils
  [4af54fe1] LazyArtifacts
  [b27032c2] LibCURL v0.6.4
  [76f85450] LibGit2
  [8f399da3] Libdl
  [37e2e46d] LinearAlgebra
  [56ddb016] Logging
  [d6f4376e] Markdown
  [a63ad114] Mmap
  [ca575930] NetworkOptions v1.2.0
  [44cfe95a] Pkg v1.10.0
  [de0858da] Printf
  [9abbd945] Profile
  [3fa0cd96] REPL
  [9a3f8284] Random
  [ea8e919c] SHA v0.7.0
  [9e88b42a] Serialization
  [1a1011a3] SharedArrays
  [6462fe0b] Sockets
  [2f01184e] SparseArrays v1.10.0
  [10745b16] Statistics v1.10.0
  [4607b0f0] SuiteSparse
  [fa267f1f] TOML v1.0.3
  [a4e569a6] Tar v1.10.0
  [cf7118a7] UUIDs
  [4ec0a83e] Unicode
  [e66e0078] CompilerSupportLibraries_jll v1.1.1+0
  [deac9b47] LibCURL_jll v8.4.0+0
  [e37daf67] LibGit2_jll v1.6.4+0
  [29816b5a] LibSSH2_jll v1.11.0+1
  [c8ffd9c3] MbedTLS_jll v2.28.2+1
  [14a3606d] MozillaCACerts_jll v2023.1.10
  [4536629a] OpenBLAS_jll v0.3.23+4
  [05823500] OpenLibm_jll v0.8.1+4
  [bea87d4a] SuiteSparse_jll v7.2.1+1
  [83775a58] Zlib_jll v1.2.13+1
  [8e850b90] libblastrampoline_jll v5.11.0+0
  [8e850ede] nghttp2_jll v1.52.0+1
  [3f19e933] p7zip_jll v17.4.0+2
Info Packages marked with ⌃ and ⌅ have new versions available. Those with ⌃ may be upgradable, but those with ⌅ are restricted by compatibility constraints from upgrading. To see why use `status --outdated -m`

• Output of versioninfo()

Julia Version 1.10.9
Commit 5595d20a287 (2025-03-10 12:51 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: macOS (arm64-apple-darwin24.0.0)
  CPU: 8 × Apple M3
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, apple-m1)
Threads: 4 default, 0 interactive, 2 GC (on 4 virtual cores)
Environment:
  JULIA_NUM_THREADS = auto

[ChrisRackauckas]

Okay this is odd. It is actually handled right here:

https://github.com/SciML/DiffEqBase.jl/blob/master/src/solve.jl#L1088-L1089

If I change this to:

function solve(prob::AbstractDEProblem, args...; sensealg = nothing,
        u0 = nothing, p = nothing, wrap = Val(true), kwargs...)
    
    @show sensealg === nothing && haskey(prob.kwargs, :sensealg)
    if sensealg === nothing && haskey(prob.kwargs, :sensealg)
        sensealg = prob.kwargs[:sensealg]
    end

    u0 = u0 !== nothing ? u0 : prob.u0
    p = p !== nothing ? p : prob.p

    if wrap isa Val{true}
        wrap_sol(solve_up(prob, sensealg, u0, p, args...; kwargs...))
    else
        solve_up(prob, sensealg, u0, p, args...; kwargs...)
    end
end

then I get:

ulia> my_fun(p)
sensealg === nothing && haskey(prob.kwargs, :sensealg) = true
4086.3101401553995

so the prob is setting the sensealg. But when I run it in the enzyme context, it never prints it. But the custom rule is on the solve_up call, so I don't see why this would be getting ignored... @wsmoses?

[wsmoses]

the string fieldcount zero issue was fixed upstream

[albertomercurio]

Ok, if I update Enzyme I don't get that error anymore, but I get

┌ Warning: TODO reverse jl_array_del_end zero-set used memset rather than runtime type of (false, nothing) in   %147 = load {} addrspace(10)*, {} addrspace(10)* addrspace(11)* %146, align 8, !dbg !450, !tbaa !338, !alias.scope !342, !noalias !345, !enzyme_type !370 
│ Caused by:
│ Stacktrace:
│  [1] _deleteend!
│    @ ./array.jl:1081
│  [2] resize!
│    @ ./array.jl:1320
│  [3] _postamble!
│    @ ~/.julia/packages/OrdinaryDiffEqCore/AYNr9/src/integrators/integrator_utils.jl:155
└ @ Enzyme.Compiler ~/.julia/packages/Enzyme/m2qpV/src/rules/llvmrules.jl:1719
┌ Warning: TODO reverse jl_array_del_end zero-set used memset rather than runtime type of (false, nothing) in   %getfield92 = load atomic {} addrspace(10)*, {} addrspace(10)* addrspace(11)* %308 unordered, align 8, !dbg !640, !tbaa !386, !alias.scope !390, !noalias !393, !nonnull !0, !dereferenceable !427, !align !428, !enzyme_type !491 
│ Caused by:
│ Stacktrace:
│  [1] _deleteend!
│    @ ./array.jl:1081
│  [2] resize!
│    @ ./array.jl:1320
│  [3] _savevalues!
│    @ ~/.julia/packages/OrdinaryDiffEqCore/AYNr9/src/integrators/integrator_utils.jl:145
└ @ Enzyme.Compiler ~/.julia/packages/Enzyme/m2qpV/src/rules/llvmrules.jl:1719
┌ Warning: TODO reverse jl_array_del_end zero-set used memset rather than runtime type of (false, nothing) in   %getfield7 = load atomic {} addrspace(10)*, {} addrspace(10)* addrspace(11)* %32 unordered, align 8, !dbg !438, !tbaa !386, !alias.scope !390, !noalias !393, !nonnull !0, !dereferenceable !405, !align !406, !enzyme_type !440 
│ Caused by:
│ Stacktrace:
│  [1] _deleteend!
│    @ ./array.jl:1081
│  [2] resize!
│    @ ./array.jl:1320
│  [3] #reeval_internals_due_to_modification!#29
│    @ ~/.julia/packages/OrdinaryDiffEqCore/AYNr9/src/integrators/integrator_interface.jl:50
└ @ Enzyme.Compiler ~/.julia/packages/Enzyme/m2qpV/src/rules/llvmrules.jl:1719
┌ Warning: TODO reverse jl_array_del_end zero-set used memset rather than runtime type of (false, nothing) in   %getfield = load atomic {} addrspace(10)*, {} addrspace(10)* addrspace(11)* %15 unordered, align 8, !dbg !400, !tbaa !386, !alias.scope !390, !noalias !404, !nonnull !0, !dereferenceable !405, !align !406, !enzyme_type !407 
│ Caused by:
│ Stacktrace:
│  [1] _deleteend!
│    @ ./array.jl:1081
│  [2] resize!
│    @ ./array.jl:1320
│  [3] initialize!
│    @ ~/.julia/packages/OrdinaryDiffEqTsit5/DHYtz/src/tsit_perform_step.jl:166
└ @ Enzyme.Compiler ~/.julia/packages/Enzyme/m2qpV/src/rules/llvmrules.jl:1719
ERROR: Enzyme execution failed.
Enzyme: Not yet implemented runtime activity for reverse of jl_array_del_end

Stacktrace:
  [1] setindex!
    @ ./array.jl:1021 [inlined]
  [2] percolate_down!
    @ ~/.julia/packages/DataStructures/IrAJn/src/heaps/arrays_as_heaps.jl:23 [inlined]
  [3] percolate_down!
    @ ~/.julia/packages/DataStructures/IrAJn/src/heaps/arrays_as_heaps.jl:19 [inlined]
  [4] heappop!
    @ ~/.julia/packages/DataStructures/IrAJn/src/heaps/arrays_as_heaps.jl:60
  [5] change_t_via_interpolation! (repeats 2 times)
    @ ~/.julia/packages/OrdinaryDiffEqCore/AYNr9/src/integrators/integrator_interface.jl:35 [inlined]
  [6] handle_tstop!
    @ ~/.julia/packages/OrdinaryDiffEqCore/AYNr9/src/integrators/integrator_utils.jl:464
  [7] solve!
    @ ~/.julia/packages/OrdinaryDiffEqCore/AYNr9/src/solve.jl:626
  [8] #__solve#62
    @ ~/.julia/packages/OrdinaryDiffEqCore/AYNr9/src/solve.jl:7 [inlined]
  [9] __solve
    @ ~/.julia/packages/OrdinaryDiffEqCore/AYNr9/src/solve.jl:1 [inlined]
 [10] #solve_call#36
    @ ~/.julia/packages/DiffEqBase/qvEPa/src/solve.jl:670
 [11] solve_call
    @ ~/.julia/packages/DiffEqBase/qvEPa/src/solve.jl:627 [inlined]
 [12] #solve_up#45
    @ ~/.julia/packages/DiffEqBase/qvEPa/src/solve.jl:1205 [inlined]
 [13] solve_up
    @ ~/.julia/packages/DiffEqBase/qvEPa/src/solve.jl:1183 [inlined]
 [14] #solve#43
    @ ~/.julia/packages/DiffEqBase/qvEPa/src/solve.jl:1096 [inlined]
 [15] solve
    @ ~/.julia/packages/DiffEqBase/qvEPa/src/solve.jl:1086 [inlined]
 [16] my_fun
    @ ~/GitHub/Research/Undef/Autodiff QuantumToolbox/autodiff_ode.jl:77 [inlined]
 [17] diffejulia_my_fun_16731wrap
    @ ~/GitHub/Research/Undef/Autodiff QuantumToolbox/autodiff_ode.jl:0
 [18] macro expansion
    @ ~/.julia/packages/Enzyme/m2qpV/src/compiler.jl:5493 [inlined]
 [19] enzyme_call
    @ ~/.julia/packages/Enzyme/m2qpV/src/compiler.jl:5027 [inlined]
 [20] CombinedAdjointThunk
    @ ~/.julia/packages/Enzyme/m2qpV/src/compiler.jl:4902 [inlined]
 [21] autodiff
    @ ~/.julia/packages/Enzyme/m2qpV/src/Enzyme.jl:517 [inlined]
 [22] autodiff(mode::ReverseMode{…}, f::typeof(my_fun), ::Type{…}, args::Duplicated{…})
    @ Enzyme ~/.julia/packages/Enzyme/m2qpV/src/Enzyme.jl:538
 [23] top-level scope
    @ ~/GitHub/Research/Undef/Autodiff QuantumToolbox/autodiff_ode.jl:88
Some type information was truncated. Use `show(err)` to see complete types.

[albertomercurio]

Hi, do you have any ideas about this?

[ChrisRackauckas]

It's probably best as an Enzyme issue since the example doesn't use any SciMLSensitivity.jl code so it cannot be fixed here (well without adding overloads, but I don't think it should be needed as Enzyme forward mode should be able to just handle the solver optimally). Tracking it here won't get any action because there is nothing to be done here, any change would be an Enzyme compiler change.

Looking at the stack trace I'd guess you could make an MWE that just is using Array resize! to decrease array sizes and putting forward mode over that. Seems like a missing primitive.

[ChrisRackauckas]

Oh wait this is different from the Enzyme forward issue. The fact that the reverse mode isn't being captured does seem like a bug in Enzyme rules, but I haven't tracked it down and won't come back to it until after JuliaCon.

[albertomercurio]

By updating all the packages I don't get the error anymore, but the results either gives wrong results or NaN.

[ChrisRackauckas]

What are you running?

[albertomercurio]

The MWE of my first comment.