Skip to content

Conversation

@alamb
Copy link
Contributor

@alamb alamb commented Jan 5, 2026

Which issue does this PR close?

Rationale for this change

CI is failing I think because aws-smithy-runtime was yanked

What changes are included in this PR?

ran cargo update for this crate and then checked in the results:

andrewlamb@Andrews-MacBook-Pro-3:~/Software/datafusion$ cargo update -p aws-smithy-runtime
    Updating crates.io index
     Locking 1 package to latest compatible version
 Downgrading aws-smithy-runtime v1.9.6 -> v1.9.5
note: pass `--verbose` to see 149 unchanged dependencies behind latest

Are these changes tested?

I tested locally

cargo audit

Are there any user-facing changes?

No this is a developmnt process only

@alamb alamb changed the title Downgrade aws-smithy-runtime to avoid rustsec Downgrade aws-smithy-runtime, update rust_decimal to avoid rustsec errors Jan 5, 2026
@alamb
Copy link
Contributor Author

alamb commented Jan 5, 2026

Looks like there is something wrong with rkyv as well

@alamb
Copy link
Contributor Author

alamb commented Jan 5, 2026

I am going to be lazy and wait to see if someone upstream hits the same issue and hopefully we get a fix out

@Omega359
Copy link
Contributor

Omega359 commented Jan 5, 2026

fwiw the rust_decimal team seems to be waiting on a backport of the fix for rkyv - paupino/rust-decimal#767 (comment)

@Jefffrey
Copy link
Contributor

Jefffrey commented Jan 6, 2026

Looks like rkyv released a backport 0.7.46 with the fix (I assume? I can't find changelog notes)

Though the advisory db still requires >= 0.8.13 so might need to wait on that

@github-actions github-actions bot added the sqllogictest SQL Logic Tests (.slt) label Jan 6, 2026
@alamb
Copy link
Contributor Author

alamb commented Jan 6, 2026

Looks like there is progress being made on the upstream issue

In the interim, I'll add a ignore to the file to get CI passing cleanly again and I have an AI trying to remove the rust_decimal dependency

@github-actions github-actions bot added the development-process Related to development process of DataFusion label Jan 6, 2026
@alamb alamb marked this pull request as ready for review January 6, 2026 12:29
@alamb alamb changed the title Downgrade aws-smithy-runtime, update rust_decimal to avoid rustsec errors Downgrade aws-smithy-runtime, update rust_decimal, ignore RUSTSEC-2026-0001 to get clean CI Jan 6, 2026
@alamb
Copy link
Contributor Author

alamb commented Jan 6, 2026

Merging this to get the CI clean

@alamb alamb added this pull request to the merge queue Jan 6, 2026
Merged via the queue into apache:main with commit c3e1c36 Jan 6, 2026
32 checks passed
@alamb
Copy link
Contributor Author

alamb commented Jan 6, 2026

Here is my proposal to remove the dependnecy (and the --ignore)

github-merge-queue bot pushed a commit that referenced this pull request Jan 7, 2026
…001` (#19666)

## Which issue does this PR close?

- Part of #19656


## Rationale for this change
rust_decimal is a one person crate and is released somewhat infrequently
* https://github.com/paupino/rust-decimal
* https://crates.io/crates/rust_decimal

It also uses a non trivial number of dependencies, including
https://crates.io/crates/rkyv, some sort of zero copy deserialization
framework that was recently subject to a RUSTSEC security advisory, see
#19656 /
#19657

Since `rust_decimal` is only used for sqllogictests to parse the results
from postgres, we can pretty easily remove the dependency on
`rust_decimal` and inline the very small amount functionality we need
for sqllogictests

This will both decrease the build time and our dependency trail.


## What changes are included in this PR?

Removes the `rust_decimal` dependency from DataFusion
and inlines the smallest required subset of decimal functionality we
need for
sqllogictests (which turns out to be pretty small)

## Are these changes tested?

Yes by CI

## Are there any user-facing changes?
No, this is all internal testing infrastructure
alamb added a commit to alamb/datafusion that referenced this pull request Jan 7, 2026
…001` (apache#19666)

- Part of apache#19656

rust_decimal is a one person crate and is released somewhat infrequently
* https://github.com/paupino/rust-decimal
* https://crates.io/crates/rust_decimal

It also uses a non trivial number of dependencies, including
https://crates.io/crates/rkyv, some sort of zero copy deserialization
framework that was recently subject to a RUSTSEC security advisory, see
apache#19656 /
apache#19657

Since `rust_decimal` is only used for sqllogictests to parse the results
from postgres, we can pretty easily remove the dependency on
`rust_decimal` and inline the very small amount functionality we need
for sqllogictests

This will both decrease the build time and our dependency trail.

Removes the `rust_decimal` dependency from DataFusion
and inlines the smallest required subset of decimal functionality we
need for
sqllogictests (which turns out to be pretty small)

Yes by CI

No, this is all internal testing infrastructure
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

development-process Related to development process of DataFusion sqllogictest SQL Logic Tests (.slt)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

cargo audit failing on DataFusion main

3 participants