Taj Malnas.
  • Work
  • Architectures
  • Lab
  • Experience
  • Contact
3D world

↑↓ to move · enter to open · esc to close

Ask my agent

© Tajjuddin Malnas · built with Next.js, three.js and Remotion

GitHub · LinkedIn · X

← Lab

Video  /  21 Sep 2026

Generate vs decide

An LLM and Jev end in the same softmax. One scores about 100,000 tokens, the other scores 3 labels. That split changes what each is good for.

YouTube keeps describing Jev as "a cheaper ChatGPT". That misses what is different about it, so I made a video that walks through each step on screen.

The short version:

  • An LLM predicts the next token, writes it, and loops. Its output is a sentence.
  • Jev looks at the state and answers a question you already defined. Its output is a probability. No sentence.

Both end in the same softmax. The job is what differs. One spreads its probability over roughly 100,000 tokens. The other spreads it over 3 labels.

Try it. Drag the slider to change the input and watch both distributions.

AmbiguousObvious

LLM · next token · ~100,000 options

“approve”24.8%
“the”11.6%
“yes”6.8%
“I”2.9%
“accept”1.5%
“this”1.0%
“Sure”0.6%
“ok”0.3%
99,992 others50.5%

Then it writes one token and does this again.

Jev · decision · 3 labels

approve94.1%
reject2.1%
escalate3.8%

One step. The probability is the answer.

Illustrative logits, real softmax

On the left, even a confident model leaves a long tail of other tokens it might have written, and it has to do this again for every token in the reply. On the right there is one step and three numbers, and you can read the confidence straight off the bars.

That is the fundamental split: generate vs decide. If the question is fixed and the answer is a choice, you do not need a model that can write.

Watch the walkthrough on X