Commit d77d2d0
Speed up smoke tests: cache works_df, combine aggregations, multi-node cluster
- Cache works snapshot DataFrame once and reuse across all 9 test suites
instead of re-reading the 300M+ row table in every cell
- Combine Tests 5 and 5b into a single aggregation pass (12 conditional
counts in one scan instead of ~10 separate scans)
- Combine Test 7 null checks into a single aggregation
- Switch cluster from single-node i3.4xlarge to 4-worker i3.2xlarge
for parallel reads
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>1 parent 513581f commit d77d2d0
File tree
2 files changed
+14
-459
lines changed- jobs
- notebooks/snapshot/full
2 files changed
+14
-459
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
326 | 326 | | |
327 | 327 | | |
328 | 328 | | |
329 | | - | |
| 329 | + | |
| 330 | + | |
330 | 331 | | |
331 | 332 | | |
332 | 333 | | |
333 | | - | |
334 | | - | |
335 | 334 | | |
336 | 335 | | |
337 | 336 | | |
| |||
0 commit comments