Skip to content

Added an atime test for performance improvement in forderv when reusing existing key and index attributes #6555

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 15 commits into from
Oct 11, 2024
Merged

Added an atime test for performance improvement in forderv when reusing existing key and index attributes #6555

Changes from 2 commits
Commits
Show all changes
15 commits
Select commit Hold shift + click to select a range
5a15dd2
Added the test with minor changes to comments
Anirban166 Oct 3, 2024
7e822ad
Narrow down on N
Anirban166 Oct 3, 2024
4ecb240
Go with default N spec
Anirban166 Oct 3, 2024
b0c10f5
Set seed for reproducibility given the use of sample()
Anirban166 Oct 3, 2024
ba72deb
rm sort reuse option
Anirban166 Oct 3, 2024
c519de1
for loop over retGrp=T,F
Oct 3, 2024
f24984a
historical sha1s from commits page instead of merge commit
Oct 3, 2024
6e69305
rm > from test name since that fails on CI
Oct 3, 2024
401f3d7
remove extra blank lines
Oct 3, 2024
7800a62
use setattr-> Fast always linear
Oct 3, 2024
7a16341
forderv retGrp=T or F, no setindex
tdhock Oct 8, 2024
6603d06
more detailed comment about expectations
tdhock Oct 8, 2024
6509080
restore old option after test
tdhock Oct 8, 2024
4e69115
log
tdhock Oct 8, 2024
13c4b1f
undo white space addition
tdhock Oct 11, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
15 changes: 15 additions & 0 deletions .ci/atime/tests.R
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -208,5 +208,20 @@ test.list <- atime::atime_test_list(
Slow = "fd24a3105953f7785ea7414678ed8e04524e6955", # Parent of the merge commit (https://github.com/Rdatatable/data.table/commit/ed72e398df76a0fcfd134a4ad92356690e4210ea) of the PR (https://github.com/Rdatatable/data.table/pull/5054) that fixes the issue
Fast = "ed72e398df76a0fcfd134a4ad92356690e4210ea"), # Merge commit of the PR (https://github.com/Rdatatable/data.table/pull/5054) that fixes the issue

# Improvement discussed in and brought by https://github.com/Rdatatable/data.table/pull/4386
"forderv improved in #4386" = atime::atime_test(
N = 10^seq(3, 7),
setup = {
options(datatable.forder.auto.index = TRUE, datatable.forder.reuse.sorting = TRUE)
dt <- data.table(index = sample(N), values = sample(N))
data.table:::forderv(dt, "index") # Initial sort to create the index and initialize caching
},
expr = {
data.table:::forderv(dt, "index", retGrp = FALSE) # Reusing the cached index (no group information required)
data.table:::forderv(dt, "index", retGrp = TRUE) # Reusing the index and computing group info.
},
Slow = "c152ced0e5799acee1589910c69c1a2c6586b95d", # Parent of the merge commit of the PR (https://github.com/Rdatatable/data.table/pull/4386/commits) that fixes the regression
Fast = "1a84514f6d20ff1f9cc614ea9b92ccdee5541506"), # Merge commit of the PR (https://github.com/Rdatatable/data.table/pull/4386/commits) that fixes the regression

tests=extra.test.list)
# nolint end: undesirable_operator_linter.
Loading