Kv-cache

  • Published on
    Jev, the first model from TypeSafe AI, does not generate text. You give it a state and a set of typed questions, and it returns a probability distribution over the answers you defined, in a single parallel pass that costs you nothing for output. Your code then branches on the result, so Jev works as a smart if-statement rather than a chatbot. TypeSafe trains it with what it calls RLCD, Reinforcement Learning for Calibrated Decisions: a new training target, in the way RLHF was, whose goal is probabilities that mean what they say rather than text a rater likes or an answer a verifier accepts. This post explains what Jev is and how to use it, then goes through RLCD in pictures. It covers what calibration means, why RLHF's reward destroys it and why RLVR's reward cannot produce it, and why a proper scoring rule is the only objective that fits the stated goal. It also shows why that makes the 'reinforcement' in the name mostly a story about where the data comes from, and why the one number where Jev still leads its open clones is confidence ordering, which temperature scaling cannot fix. Nothing about RLCD has been published, so every claim is labelled by who made it.
  • Published on
    A looped transformer applies the same block of layers to a token several times over, so depth stops being a property of the weight file and becomes an argument you pass at inference. A rumour about OpenAI's Astra turned that idea into a fight about redlines, and almost nobody arguing had read the architecture. So this is the architecture, mechanically: the three-part forward pass and the two details every summary drops, why the initial state is random and the core is blind to which iteration it is on, how the test-time depth dial is manufactured during training by sampling r from a heavy-tailed distribution and truncating the backward pass to the last eight iterations, and what the loop actually costs — because it trades storage for time and creates no compute at all. The exchange rate has been measured: one recurrence is worth r^0.46 in equivalent parameters, real and comfortably sublinear. The genuinely strange result underneath is that looping moves reasoning without moving knowledge, confirmed independently by three groups using different methods, and the frontier of the idea is not a bigger loop count but a learned per-token router. Verdict: a real third scaling axis and a component rather than a paradigm — and on the monitorability argument, both camps were right about different questions.