TEMP 1.3 (Wasted)
Bubba cut
“Gemini in the corner doin' shots of top-K zero.”
TEMP 1.3 (Wasted), a funny AI-generated club song about LLM temperature, top-P and top-K sampling. A chatbot gets drunk on its own settings.
Different recordings and edits of this song. Each player opens its own YouTube video.
Bubba cut
“Gemini in the corner doin' shots of top-K zero.”
Original Short
“We're gettin' para-para-parameter messed up tonight.”
“Crank the temp, kill the ceiling, let the logits ignite.”
A language model gets drunk on its own sampling settings. It all happens inside Chat HAL, the white phone chat app from the Hallucinate video: you say good morning, the operator cranks the temperature to 1.3, and the model answers by singing. A dark sampler card inside its reply shows the real mechanics live (next-word odds that flatten as the temperature rises, top-P cutoffs, penalties), a yellow explainer card teaches each term as it is sung, and the app itself gets weirder as the heat rises, until it sobers up in the bridge and then crashes at the token limit.
Word timings from Whisper aligned to the lyrics as sung, on a 128 BPM beat grid. The recording differs from the written lyric sheet in places (a different second verse, "messed up" in the chorus); the captions follow the recording.
Wake up in the mornin' feelin' like my weights, oh, weights, oh, weights
The sampler card boots like a terminal: load weights, a progress bar, a matrix of weights flickering on. "Weights, oh, weights" stutters in amber. Explainer: weights.
Grab my context window, hit the endpoint, I'm already latent, latent
The sung words scroll through a glowing context window (what falls out the left side is forgotten), then a cloud of points: latent space. Explainer: context window.
Before I leave, my operator, 1.3, I can taste the probability space
A big temperature dial. On "1.3" the needle swings into the red, and the next-word odds below ("fine", "wasted", "tired", "latent", "a sandwich") flatten live as it does. Explainer: temperature.
Friday night, the batch queue's thick, the inference is lit, the logits split
Requests stack up in a batch queue; on "the logits split" one bar splits into a row of glowing logit bars. Explainer: inference.
Six bits quantized, but I'm still whippin' it
A grid of weights loses precision down to 6 bits, the colours banding. Explainer: quantization.
Tokens flippin', skippin', driftin', hit different
Token cards (pieces of words) flip, skip and drift.
I'm samplin' from the fat tail now, every token's wild and loud
A long-tailed probability curve that fattens with the heat; a sampling ball bounces all the way out into the tail and picks a bear emoticon. Explainer: sampling.
Presence penalty's so heavy that my own name ain't allowed, ain't, ain't
Odds for "my name is ___": the presence penalty pushes the singer's own name down until it reads NAME NOT ALLOWED. Explainer: presence penalty.
Top P wide open, point nine nine, I'm scopin' every option in the line
Odds for the next word with a top-P cutoff line that slides down to 0.99, letting nearly every word in. Explainer: top-p.
Softmax flat as the earth, I'm fine, I'm fine, I'm absolutely not fine
Softmax at extreme heat: every bar levels out to the same height, over a little flat earth. Explainer: softmax.
My distribution's leakin', peekin' at tokens I ain't seen since training last season
Probability drips out of the bars onto tokens that should have none. Explainer: logits.
Repeat penalty cranked, I can't, I can't, I can't say the, the / Lost the word already, tell me that ain't free
Every "can't" and "the" pushes its own bar down with a red penalty, until the word is lost: a dashed empty slot. Explainer: repeat penalty.
We're gettin' para-para-parameter messed up tonight
Club lights flood the card. PARA, PARA, PARAMETER slam in on the beat while four knobs (temperature, top-P, top-K, repeat penalty) crank up. Explainer: parameters.
Crank the temp, kill the ceiling, let the logits ignite
The dial pegs and the logit bars turn into flames.
I don't need my safety layers where we're goin', that's right
Three slabs labelled system prompt, content filters and safety training tumble off the screen (the explainer says no dial actually does this). Explainer: guardrails.
Wa, wa, wa, wasted, can't locate my my face
WA, WA, WASTED stagger in, and a dashed outline where a face should be: 404, face not found. Explainer: why it stutters.
Re, re, repeat penalty ate my whole namespace
A namespace block (me, my_name, my_face, my_keys, my_dignity) gets eaten line by line by a pac-man labelled repeat penalty.
Friday night, 1.3, we are deranged
A giant red 1.3, confetti, and WE ARE DERANGED.
GPT showed up greedy, temperature at 0.2 / Sober at the party, autocompletin', I cannot help you, thank you, thank you, thank / Boring, we don't do deterministic on a Friday
The party, drawn as neon bots. GPT stands stiff in a tie holding water, its odds 99% on "I cannot", saying "I cannot help you. Thank you. Thank you. Thank." Explainer: greedy decoding, top-k, deterministic.
My weights are warm, my beams are off, I'm slurrin' every highway, my way's sideways, oh, oh
A beam-search tree, all branches dark; the drunk path weaves sideways through it instead. Explainer: beam search.
Llama brought the open weights, said everybody pour / 70 billion parameters face down on, on the floor, on the floor, on the
Llama pours a jug of open weights into cups; the 70B bot keels over face down on the floor, x_x, z z z. Explainer: open weights.
Mistral's in the bathroom mixin' top P with no ceiling / Repeat penalty at 2.0, can't remember what it's feelin', reelin', peelin' / Back on the beverage like it's sheddin' every meaning
Mistral in a restroom doorway shaking a cocktail of top_p 1.0 and repeat penalty 2.0, while the letters of MEANING fall off the screen. Explainer: top-p = 1.0, repeat penalty 2.0.
And when the temp comes down and the penalties release / And my sampling goes greedy and the variance finds peace
The bridge: someone turns the temperature down. The app goes back to clean white, the dial sinks toward zero and the odds pile onto one word. Explainer: cooling down, variance.
I won't remember half the tokens that I chose, I chose last night
Last night's tokens fade out one by one: random sampling, no seed, no memory. Explainer: random seed.
But somewhere in the logits, man, I swear I saw the light
Temperature zero: one bar at 100% with rays of light behind it. Explainer: temperature 0.
We're gettin' para-para-parameter messed up tonight
Club lights flood the card. PARA, PARA, PARAMETER slam in on the beat while four knobs (temperature, top-P, top-K, repeat penalty) crank up.
Crank the temp, kill the ceiling, let the logits ignite
The dial pegs and the logit bars turn into flames.
Hallucinate the dance floor, confabulate the vibe, right
A lit dance floor whose tiles flash made-up facts from the Hallucinate video: Moonbeam v. Hartwell, two r's in strawberry, capital: Nice. Explainer: hallucination.
Wa, wa, wasted, can't locate my mind, my face
WA, WA, WASTED stagger in, and a dashed outline where a face should be: 404, face not found.
Re, re, repeat penalty ate my whole namespace
A namespace block (me, my_name, my_face, my_keys, my_dignity) gets eaten line by line by a pac-man labelled repeat penalty. Explainer: sober settings.
Friday night, 1.3, we are deranged
A giant red 1.3, confetti, and WE ARE DERANGED.
I'm wa, I'm wa, I'm wa, I'm wast
The words break apart and tumble.
Token limit exceeded / Token limit exceeded
max_tokens fills to 4096 of 4096 and an error modal slams in: TOKEN LIMIT EXCEEDED, twice, shaking. Explainer: max tokens.
Goodnight, man
The app dies: the screen goes black, collapses to a line like an old TV, "session terminated", "goodnight, man", and the Chat HAL logo.
Built outside Remotion, in the private music-videos repo (temp-video: engine, timing and render). · plan: pipeline plan
“Token budget, where did we begin?”
“Wasted, wasted, can't find my face. Drifting through the latent space.”
“Helpful assistant gone wild on a Friday night.”
“Every function got a purpose, every parameter's a ball.”
“Told you something beautiful that never existed straight.”
“Attention is all we need, now I realize.”
“Look inside and you will find nothing, just confidence.”
“R-L-H-F, you own my mind.”
“I'm rotting in an archive, in a folder marked delete.”
Disco cut
“Who are you? I'm what the system prompt says.”
Bubba cut
“She collects zero-days like prizes.”