Made an attempt at implementing Speculative cascades #466

fblissjr · 2025-09-15T20:28:03Z

fblissjr
Sep 15, 2025

RE: https://research.google/blog/speculative-cascades-a-hybrid-approach-for-smarter-faster-llm-inference/
Paper: https://arxiv.org/abs/2405.19261

my fork with the code: https://github.com/fblissjr/mlx-lm-playground/tree/spec-cascade

It's not at all performance optimized (which is the whole point of this) or faster than baseline, let alone speculative decoding, since I'm sure there's a ton of core stuff missing or flat out wrong, but thought I'd share in case anyone else is exploring it.

Baseline:

python -m mlx_lm.generate \
    --model ./modelzoo/google_gemma-3-27b-it-mlx-bf16 \
    --prompt "Write a short story about a librarian who discovers a magical book. The story should be three paragraphs long." \
    --max-tokens 256 \
    --verbose True

==========
Old Man Tiber hadn't expected much excitement in his seventy years, let alone in his thirty years as the librarian of Havenwood. He’d cataloged, shelved, and dusted countless books, each a silent story waiting to be rediscovered. But today was different. While sorting through a donation of books from a recently deceased eccentric collector, a volume bound in dark, unmarked leather caught his eye. It had no title, no author, and the pages felt strangely warm to the touch. As he carefully opened it, the script wasn't any language he recognized, yet as he traced the swirling symbols with his finger, a faint scent of pine and woodsmoke filled the air, and the library seemed to hum with a low, vibrant energy.

Intrigued, Tiber continued to explore the book. He soon discovered that when he focused on a symbol and *thought* of a place – a sun-drenched beach, a snow-capped mountain, even the bustling marketplace he’d visited as a boy – the scent would intensify, and a vivid, almost tangible image would bloom in his mind. It wasn't just visualization; he could *feel* the warmth of the sun, the chill of the snow, the press of the crowd. He cautiously thought
==========
Prompt: 30 tokens, 60.144 tokens-per-sec
Generation: 256 tokens, 11.582 tokens-per-sec
Peak memory: 57.123 GB

Baseline w/ Speculative Decoding:

python -m mlx_lm.generate \
    --model ./modelzoo/google_gemma-3-27b-it-mlx-bf16 \
    --draft-model .modelzoo/gemma-3-4b-it-qat-int4-unquantized-mlx-mixed_4_6 \
    --prompt "Write a short story about a librarian who discovers a magical book. The story should be three paragraphs long." \
    --max-tokens 256 \
    --verbose True

==========
The lunar dust swirled around Captain Eva Rostova’s boots, a strangely graceful ballet in the low gravity. But it wasn’t the dust that stole her breath, it was the warm, solid presence beneath her. Not the cold metal of the lunar module, but the muscular flank of a palomino mare named Luna, specially bred and trained for this impossible journey. Years of research, genetic engineering, and a frankly ludicrous amount of funding had culminated in this moment: a human riding a horse on the moon. Luna, outfitted with a modified spacesuit and oxygen supply integrated into her bridle, seemed remarkably unfazed, her ears twitching as she took in the alien landscape. Eva adjusted her grip, the reins feeling strangely familiar against the backdrop of the Earth hanging like a blue marble in the black sky. This wasn’t about scientific advancement, not really. It was about a primal connection, a longing for the feel of a living creature beneath her, a rebellion against the sterile perfection of space travel.

The ride was…surreal. Each stride sent Eva floating slightly, Luna’s powerful legs propelling them in long, arcing leaps across the Sea of Tranquility. The landscape, normally a monochrome grey in photographs, was subtly textured, the dust catching
==========
Prompt: 29 tokens, 71.823 tokens-per-sec
Generation: 256 tokens, 15.306 tokens-per-sec
Peak memory: 60.045 GB

w/ spec cascade @ alpha 0.2:

python -m mlx_lm.generate \
    --model ./modelzoo/google_gemma-3-27b-it-mlx-bf16 \
    --draft-model .modelzoo/gemma-3-4b-it-qat-int4-unquantized-mlx-mixed_4_6 \
    --cascade-rule opt \
    --cascade-alpha 0.2 \
    --prompt "Write a detailed three-paragraph short story about a an astronaut who rides a horse on the moon." \
    --max-tokens 256 \
    --verbose True

[DEBUG] Using Speculative Cascade with rule: 'opt', alpha: 0.2

 [DEBUG: Turn Summary] Drafted 3, Accepted 0, Resampled 1.
The [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 lunar dust swirled [DEBUG: Turn Summary] Drafted 3, Accepted 1, Resampled 1.
 around Apollo [DEBUG: Turn Summary] Drafted 3, Accepted 0, Resampled 1.
’ [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
s boots as he [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
aved himself onto Bess [DEBUG: Turn Summary] Drafted 3, Accepted 0, Resampled 1.
ie [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
, a magnificent Pal [DEBUG: Turn Summary] Drafted 3, Accepted 0, Resampled 1.
om [DEBUG: Turn Summary] Drafted 3, Accepted 0, Resampled 1.
ino [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 mare he’d [DEBUG: Turn Summary] Drafted 3, Accepted 2, Resampled 1.
 brought along on [DEBUG: Turn Summary] Drafted 3, Accepted 0, Resampled 1.
 the [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 mission – a slightly [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 unorthodox addition to the [DEBUG: Turn Summary] Drafted 3, Accepted 0, Resampled 1.
 Artemis [DEBUG: Turn Summary] Drafted 3, Accepted 0, Resampled 1.
 VII [DEBUG: Turn Summary] Drafted 3, Accepted 0, Resampled 1.
 payload [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
. Officially, NASA [DEBUG: Turn Summary] Drafted 3, Accepted 1, Resampled 1.
 had signed [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 off on the “ [DEBUG: Turn Summary] Drafted 3, Accepted 0, Resampled 1.
Lunar [DEBUG: Turn Summary] Drafted 3, Accepted 0, Resampled 1.
 Equ [DEBUG: Turn Summary] Drafted 3, Accepted 0, Resampled 1.
ine [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
ering Project,” citing [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 the need for “ [DEBUG: Turn Summary] Drafted 3, Accepted 0, Resampled 1.
alternative [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 locomotion methods” and [DEBUG: Turn Summary] Drafted 3, Accepted 2, Resampled 1.
 “enhanced psychological [DEBUG: Turn Summary] Drafted 3, Accepted 0, Resampled 1.
 well [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
-being.” Uno [DEBUG: Turn Summary] Drafted 3, Accepted 2, Resampled 1.
 Uno, the [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 mission’s AI [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
, had insisted Bess [DEBUG: Turn Summary] Drafted 3, Accepted 1, Resampled 1.
ie’ [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
s rhythmic gait would [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 provide a grounding element [DEBUG: Turn Summary] Drafted 3, Accepted 0, Resampled 1.
 in [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 the sterile environment of [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 Tranquility Base. [DEBUG: Turn Summary] Drafted 3, Accepted 0, Resampled 1.
 But [DEBUG: Turn Summary] Drafted 3, Accepted 0, Resampled 1.
 really [DEBUG: Turn Summary] Drafted 3, Accepted 1, Resampled 1.
, Captain [DEBUG: Turn Summary] Drafted 3, Accepted 0, Resampled 1.
 Rex [DEBUG: Turn Summary] Drafted 3, Accepted 1, Resampled 1.
ford just [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 wanted to feel the [DEBUG: Turn Summary] Drafted 3, Accepted 0, Resampled 1.
 wind [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 whipping through his hair [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
, the thrill of [DEBUG: Turn Summary] Drafted 3, Accepted 0, Resampled 1.
 a [DEBUG: Turn Summary] Drafted 3, Accepted 0, Resampled 1.
 gall [DEBUG: Turn Summary] Drafted 3, Accepted 1, Resampled 1.
op, [DEBUG: Turn Summary] Drafted 3, Accepted 0, Resampled 1.
 even [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 if it was a [DEBUG: Turn Summary] Drafted 3, Accepted 0, Resampled 1.
 slow [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 gallop across the [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 grey expanse of the [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 moon. He adjusted [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 Bessie’s [DEBUG: Turn Summary] Drafted 3, Accepted 1, Resampled 1.
 saddle, [DEBUG: Turn Summary] Drafted 3, Accepted 0, Resampled 1.
 specially [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 designed with magnetic stabilizers [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 to counteract the lower [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 gravity, and gave [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 her a reassuring pat [DEBUG: Turn Summary] Drafted 3, Accepted 0, Resampled 1.
 on [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 the flank. “ [DEBUG: Turn Summary] Drafted 3, Accepted 1, Resampled 1.
Alright girl [DEBUG: Turn Summary] Drafted 3, Accepted 0, Resampled 1.
, [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 let’s see [DEBUG: Turn Summary] Drafted 3, Accepted 0, Resampled 1.
 if [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 you can handle a [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 little lunar adventure.” [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.


Bessie responded [DEBUG: Turn Summary] Drafted 3, Accepted 2, Resampled 1.
 with a sn [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
ort and a surprisingly [DEBUG: Turn Summary] Drafted 3, Accepted 2, Resampled 1.
 enthusiastic stomp, [DEBUG: Turn Summary] Drafted 3, Accepted 2, Resampled 1.
 kicking up a [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 plume of lunar dust [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 that shimmered in [DEBUG: Turn Summary] Drafted 3, Accepted 2, Resampled 1.
 the harsh sunlight [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
. Rexford chuckled [DEBUG: Turn Summary] Drafted 3, Accepted 0, Resampled 1.
 and [DEBUG: Turn Summary] Drafted 3, Accepted 0, Resampled 1.
 gently [DEBUG: Turn Summary] Drafted 3, Accepted 0, Resampled 1.
 urged [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 her forward, the [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 horse’s ho [DEBUG: Turn Summary] Drafted 3, Accepted 1, Resampled 1.
 hooves [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 making a soft crunch [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 sound against the lunar [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 surface. He wasn [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
’t alone. [DEBUG: Turn Summary] Drafted 3, Accepted 0, Resampled 1.
 Dr [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
. Anya
[DEBUG: FINAL STATS] Total Drafted: 282, Total Accepted: 164 (58.2% acceptance rate)

==========
Prompt: 29 tokens, 36.689 tokens-per-sec
Generation: 256 tokens, 7.294 tokens-per-sec
Peak memory: 60.402 GB

@ alpha 0.5:

python -m mlx_lm.generate \
    --model ./modelzoo/google_gemma-3-27b-it-mlx-bf16 \
    --draft-model .modelzoo/gemma-3-4b-it-qat-int4-unquantized-mlx-mixed_4_6 \
    --cascade-rule opt \
    --cascade-alpha 0.5 \
    --prompt "Write a detailed three-paragraph short story about a an astronaut who rides a horse on the moon." \
    --max-tokens 256 \
    --verbose True

[DEBUG] Using Speculative Cascade with rule: 'opt', alpha: 0.5

 [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
Dr. Elias Vance [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 wasn’t your [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 typical astronaut. He [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
’d always been [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 fascinated by equine physiology [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
, convinced that with [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 careful acclimatization, [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 horses could thrive in [DEBUG: Turn Summary] Drafted 3, Accepted 0, Resampled 1.
 low [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 gravity environments. After [DEBUG: Turn Summary] Drafted 3, Accepted 2, Resampled 1.
 years of lobbying [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 NASA and securing funding [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 for Project Lunar Equ [DEBUG: Turn Summary] Drafted 3, Accepted 0, Resampled 1.
itation [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 – a frankly ludicrous [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 endeavor – he finally [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 stood on the desolate [DEBUG: Turn Summary] Drafted 3, Accepted 0, Resampled 1.
 Sea [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 Tranquility, clad [DEBUG: Turn Summary] Drafted 3, Accepted 2, Resampled 1.
 in a modified [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 spacesuit equipped with [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 a reinforced saddle and [DEBUG: Turn Summary] Drafted 3, Accepted 2, Resampled 1.
 a surprisingly calm [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 Friesian mare named [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 Luna. The lunar [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 dust clung stubbornly to [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 Luna’s velvety [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 coat as Vance gently [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 guided her across the [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 grey expanse, a [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 ribbon of shimmering black [DEBUG: Turn Summary] Drafted 3, Accepted 1, Resampled 1.
 volcanic glass [DEBUG: Turn Summary] Drafted 3, Accepted 0, Resampled 1.
 crunch [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
ing beneath her ho [DEBUG: Turn Summary] Drafted 3, Accepted 0, Resampled 1.
oves [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
. It wasn’ [DEBUG: Turn Summary] Drafted 3, Accepted 1, Resampled 1.
t the [DEBUG: Turn Summary] Drafted 3, Accepted 1, Resampled 1.
 majestic gall [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
op he’d [DEBUG: Turn Summary] Drafted 3, Accepted 2, Resampled 1.
 envisioned, more [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 a slow, deliberate [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 trot, punctuated by [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 Luna’s soft [DEBUG: Turn Summary] Drafted 3, Accepted 0, Resampled 1.
 sn [DEBUG: Turn Summary] Drafted 3, Accepted 0, Resampled 1.
orts [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 and Vance’s [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 meticulous observations – recording [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 muscle activation patterns, [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 analyzing gait stability, [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 and documenting the mare [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
’s reaction to [DEBUG: Turn Summary] Drafted 3, Accepted 1, Resampled 1.
 the alien [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 landscape.

 [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
The initial skepticism from [DEBUG: Turn Summary] Drafted 3, Accepted 0, Resampled 1.
 mission [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 control had evaporated with [DEBUG: Turn Summary] Drafted 3, Accepted 0, Resampled 1.
 each [DEBUG: Turn Summary] Drafted 3, Accepted 0, Resampled 1.
 successful [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 step, each measured [DEBUG: Turn Summary] Drafted 3, Accepted 2, Resampled 1.
 stride. Luna [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
, Vance explained, [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 was responding remarkably well [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 to the reduced gravity [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
, exhibiting a fluidity [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 of movement that was [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 impossible on Earth. [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 He’d brought [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 a specially formulated lunar [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 feed, enriched with [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
anolides – compounds [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 known to reduce stress [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 – and Luna seemed [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 utterly unfazed by [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 the lack of atmosphere [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
. Vance wasn
[DEBUG: FINAL STATS] Total Drafted: 225, Total Accepted: 182 (80.9% acceptance rate)

==========
Prompt: 29 tokens, 27.478 tokens-per-sec
Generation: 256 tokens, 7.717 tokens-per-sec
Peak memory: 60.282 GB

@ alpha 0.9:

python -m mlx_lm.generate \
    --model ./modelzoo/google_gemma-3-27b-it-mlx-bf16 \
    --draft-model .modelzoo/gemma-3-4b-it-qat-int4-unquantized-mlx-mixed_4_6 \
    --cascade-rule opt \
    --cascade-alpha 0.9 \
    --prompt "Write a detailed three-paragraph short story about a an astronaut who rides a horse on the moon." \
    --max-tokens 256 \
    --verbose True

==========

[DEBUG] Using Speculative Cascade with rule: 'opt', alpha: 0.9

 [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
Dr. Elias Vance [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 wasn’t your [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 typical astronaut. He [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
’d always been [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 fascinated by equine physiology [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
, convinced that the [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 rhythmic movement of a [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 horse’s gait [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 could actually stimulate bone [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 density in space. [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 After years of relentless [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 lobbying and a frankly [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 baffling grant proposal involving [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 a specially designed lunar [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 buggy and a surprisingly [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 cooperative Icelandic horse named [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 Astrid, he finally [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 secured funding for Project [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 MoonStride – a [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 mission to prove his [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 theory. Strapped [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 into his bulky spaces [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
uit, Elias carefully [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 maneuvered Astrid onto [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 the lunar surface, [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 the horse’s [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 velvety hooves kicking [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 up puffs of lunar [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 dust. It was [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 surreal; the stark [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 grey expanse of Mare [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 Tranquillitatis stretching [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 endlessly beneath Astrid’ [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
s watchful gaze, [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 the low hum of [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 the rover’s [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 engines a counterpoint [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 to the horse’ [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
s gentle snorts [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
. He adjusted Astrid [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
’s saddle, [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 ensuring it was stable [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 on the uneven terrain [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
, and initiated a [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 slow, deliberate trot [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 – a movement he [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
aved with a mixture [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 of exhilaration and [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 utter disbelief.

 [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
The initial data readings [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 were astounding. Astrid [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
’s gait, [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 combined with the low [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 gravity, was generating [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 vibrations that Elias theor [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
ized would stimulate oste [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
oblasts – the cells [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 responsible for bone formation [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 – far more effectively [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 than any terrestrial exercise [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
. He meticulously recorded [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 the horse’s [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 movements, analyzing the [DEBUG: Turn Summary] Drafted 3, Accepted ALL, Final Sampled 1.
 subtle shifts in Astrid
[DEBUG: FINAL STATS] Total Drafted: 192, Total Accepted: 192 (100.0% acceptance rate)

==========
Prompt: 29 tokens, 27.563 tokens-per-sec
Generation: 256 tokens, 8.182 tokens-per-sec
Peak memory: 60.281 GB

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Made an attempt at implementing Speculative cascades #466

Uh oh!

{{title}}

Uh oh!

Replies: 0 comments

Select a reply

Uh oh!

Made an attempt at implementing Speculative cascades #466

Uh oh!

fblissjr Sep 15, 2025

Replies: 0 comments

fblissjr
Sep 15, 2025