A Buddhist monastery in Vermont called Maple wants to establish itself as Silicon Valley's spiritual authority while creating its own AI god. According to a New Yorker report, leader Soryu Forall's group records every breath its members take to train an AI in his image. Former members report manipulation and psychological breakdowns. The article Silicon Valley's growing obsession with AI doomsday is turning parts of the tech industry toward cult-like devotion appeared first on The Decoder.
OpenAI has released new prompt templates for GPT-6.2 Astra and Sol meant to fix common model behaviors such as overly brief answers, unnecessary follow-up questions, and excessive testing when coding. The API is changing as well, since editing a conversation's history can discard reasoning content and lower response quality. The article OpenAI shares new prompting tips for GPT-6.2 Astra and Sol to fix brief answers and unnecessary questions appeared first on The Decoder.
Thinking Machines Lab has released Inkling 2 Mini, an open-weight looped transformer with 26.4B total parameters. The model reuses its middle layers 3 times per token instead of adding more weights. That keeps the checkpoint near 20GB, small enough for a 32GB Mac or 1 NVIDIA DGX Spark. For developers, Inkling 2 Mini is a local option for agentic coding, tool use and document work. It ships under Apache 2.0 on Hugging Face, with hosted inference and fine-tuning on Tinker. TL;DR Size: 26.4B total, 3.4B active (5.4B effective per token with looping), up to 1M-token context. Runs on: Apple silicon with 32GB+ memory, 1 NVIDIA DGX Spark, or GPUs with 32GB+ VRAM. GGUF builds via Unsloth and llama.cpp. Performance: 20.1 on the Artificial Analysis Index, tied with Qwen3.8-27B (self-reported). Best: 79.2% on SWE-bench Verified (bash only). Worst: 15.2% on HLE-Diamond and 50.0% on MultiChallenge. Bottom line: Best: strong agentic coding from a 20GB checkpoint. Worst: weaker knowledge recall and multi-turn instruction following. What is Inkling 2 Mini? Inkling 2 Mini is a sparse Mixture-of-Experts model from Thinking Machines that loops its middle layers. It accepts text and images and returns text only. It follows Inkling 2 Small, a 594B-parameter model released on November 5. How does the looped transformer work? The model stores 24 layers, grouped into 4 blocks of 6. The first and last blocks run once. The 2 middle blocks run 3 times with shared weights. That gives 48 layer applications per token from 24 layers of weights. Each pass after the first receives a “message” from the previous pass. Thinking Machines carries it with Attention Residuals and a learned gate. Feed-forward layers use 128 experts, with 8 routed per token. Looping the middle layers gave a 1.51x to 1.91x compute-equivalent gain. Looping the last layers gave only 1.24x to 1.36x. The middle-loop variant won 27 of 28 evaluations. Looping costs training compute but saves inference. An unlooped baseline used 7.5% less training compute. It needed 140% more inference compute to match the looped model’s loss on 512k-token agentic traces. How was Inkling 2 Mini trained? Training began with 384 experts per layer, with 8 active per token. At midtraining, the team pruned two-thirds of them and kept the 128 most-used experts. A 1T-token distillation run from a larger internal Inkling model then healed the pruned model. Post-training used SFT, then RL over 2.2T tokens and 2,000 steps, plus on-policy distillation. Expert layers are trained and deployed in NVFP4. The last 4 layers use MXFP8. Thinking Machines says this removes quantization conversion loss. A research variant, TML-d24-varloop-research, trains with 1 to 5 passes. How does Inkling 2 Mini perform on benchmarks? All Inkling scores below are self-reported by Thinking Machines. Coding is the strongest area. Inkling 2 Mini scores 79.2% on SWE-bench Verified (bash only) and 77.9% on SWE-bench Pro v2 (Hard). It reaches 48.2% on DeepSWE v1.1, where Qwen’s own card lists Qwen3.8-27B at 42.2%. On Terminal Bench v2.1 it scores 71.6%, behind Qwen3.8-27B at 73.0%. Agentic search also holds up: 79.0% on BrowseComp with compaction and 82.7% on MCP Atlas. For documents and vision, it posts 92.8% on OmniDocBench v1.6 and 74.9% on MMMU Pro. On reasoning, it scores 86.6% on GPQA Diamond and 49.3% on ARC-AGI-2. Efficiency is the headline claim. On Stanford’s Intelligence per Watt metric, Thinking Machines reports 0.703 on a DGX Spark. It lists Qwen3.6-35B-A3B at 0.430 and Gemma-4-26B-A4B at 0.159. window.addEventListener("message",function(e){if(e.data&&e.data.mtpInk2mHeight){var f=document.getElementById("mtp-ink2m-frame");if(f&&e.source===f.contentWindow){f.style.height=e.data.mtpInk2mHeight+"px";}}}); How does Inkling 2 Mini compare with Qwen and Gemma? Each column uses the vendor’s own model card. Harnesses and settings differ, so treat cross-vendor gaps as directional. What hardware do you need to run Inkling 2 Mini? The checkpoint is about 20GB in Safetensors. Thinking Machines lists 3 supported setups: 1 NVIDIA DGX Spark, Apple silicon with 32GB+ memory, and other GPUs with 32GB+ VRAM. Quantized GGUF builds are available through Unsloth and llama.cpp. Serving support covers Transformers, vLLM, SGLang, Ollama, NVIDIA Dynamo and TokenSpeed. Tinker pricing for Mini is not disclosed in the launch materials. A vLLM quick start takes 1 command: vllm serve "thinkingmachines/Inkling-2-Mini". Where does Inkling 2 Mini fall short? Knowledge depends mostly on total parameters, and looping did not help knowledge benchmarks. Inkling 2 Mini scores -8.6 on AA-Omniscience, with a 63.4% non-hallucination rate. It is not the best small model for multi-turn chat or constraint-heavy prompts. It scores 50.0% on MultiChallenge and 33.4% on ComplexConstraints v1.1. It also trails larger models on HLE-Diamond (15.2%) and CritPt v2. Key Takeaways Inkling 2 Mini loops 24 stored layers into 48 layer passes per token. 26.4B total, 3.4B active, ~20GB, Apache 2.0, up to 1M context. Runs on a 32GB Mac or 1 DGX Spark via Ollama, vLLM or llama.cpp. Scores 79.2% on SWE-bench Verified and ties Qwen3.8-27B at 20.1 AA Index. Weak spots: knowledge recall, multi-turn chat and constraint-heavy prompts. Check out the technical blog, model card, model weights and Tinker Playground. You can check the deployment options and specs here through our GPULeaderboard.com chrome extension. Also, feel free to follow us on Twitter and don’t forget to join our 150k+ML SubReddit and Subscribe to our Newsletter. Wait! are you on telegram? now you can join us on telegram as well. Need to partner with us for promoting your GitHub Repo OR Hugging Face Page OR Product Release OR Webinar etc.? Connect with us The post Meet Thinking Machines Inkling 2 Mini: 26B Looped MoE Runs on a 32GB Mac appeared first on MarkTechPost.
OpenAI has made GPT-Live-1.1 available in its API under the model ID gpt-live-1.1. The GPT-Live-1.1 voice model is a full-duplex model for multilingual conversations. It can listen while it speaks. OpenAI team states that it speaks with more natural and consistent accents across languages and completes tasks more reliably. The release also adds standby, a cheaper billing state for idle sessions. For teams running voice agents, idle time on a call now costs less. You can check the deployment options and specs here through our GPULeaderboard.com chrome extension. TL;DR Size: Live sessions hold a 128,000-token default context window. Runs on: OpenAI’s cloud only, via v1/live/sessions. Clients connect over WebRTC or WebSocket. No open weights, no quantized variants. Performance: OpenAI claims better accents, transcription, letter and number handling, and task completion than GPT-Live-1. No scores published. Best: Standby bills idle WebRTC time at $0.02 per minute versus $0.05 active, a 60% lower rate. Worst: OpenAI published 0 benchmark scores for 1.1. Image, video and structured outputs are not supported. Bottom line: Best: cheaper always-on voice sessions. Worst: quality gains are self-reported with no numbers. What is GPT-Live-1.1? GPT-Live-1.1 is a full-duplex speech model from OpenAI that hears and speaks in 1 stream. It follows GPT-Live-1, which reached the API on September 10, 2026. As per the OpenAI forum announcement, it has powered ChatGPT Plus and Pro voice since October 15. Inputs and outputs are audio and text. Image and video are not supported. Streaming and function calling work. Structured outputs, fine-tuning and predicted outputs do not. How does GPT-Live-1.1 work? The GPT-Live family replaces the usual cascade of speech-to-text, an LLM and text-to-speech. OpenAI says the model reasons over incoming and outgoing audio together in a single model. It also handles turn detection and returns ASR transcripts natively. Deeper work is delegated. The voice model can hand reasoning and tool calls to a backend text model. OpenAI names GPT-6 Astra for complex issues and Luna for high-volume tasks. Third-party backends also work. The Live conversations guide sets delegation.type to client or responses. Responses mode uses OpenAI models. Client mode connects your own backend. Instructions can run up to 16,384 tokens. What changed from GPT-Live-1? OpenAI lists 4 improvement areas for 1.1: More natural and consistent accents across languages More accurate speech transcription Better handling of precise details like letters and numbers More reliable instruction following and task completion How does standby mode work? Standby pauses inference during silence while the WebRTC connection stays open. The guide documents 3 settings: session.wake_policy.type: set to speech, so inference waits for speech session.idle_timeout_s: a whole number from 5 to 60 seconds session.wake_policy.vad_threshold: optional, 0 to 1, default 0.5 After the timeout, the server emits session.paused. When the user speaks, session.resumed fires. The session ID and history are kept. OpenAI warns the first reply after a short utterance may be slower. Keep the microphone track active during standby. Standby works for both GPT-Live-1 and GPT-Live-1.1. How much does GPT-Live-1.1 cost? Voice sessions are billed by duration. The GPT-Live-1 model page says billing is per second. Backend model and tool usage are billed separately. That matters: a heavy backend can cost more than the voice layer. Deployment and availability The model is API-only. You switch an existing Live session by setting model to gpt-live-1.1. Changing the model requires a new session. Outbound SIP calling reached all organizations on November 2, so phone agents are supported. GPT-Live-1 and GPT-Live-1.1 have separate concurrent-session limits. Each limit applies across inference regions. The 1.1 page does not publish tier numbers. How does GPT-Live-1.1 compare? <iframe id="mtp-gl11-frame" title="GPT-Live-1.1 interactive explainer" loading="lazy" style="width:100%;height:600px;border:0;display:block;background:transparent;" srcdoc="<title>GPT-Live-1.1 explained | Marktechpost</title>html,body{margin:0;padding:0;background:transparent} #mtp-gl11{max-width:880px;margin:0 auto;background:#0d0d0d!important;color:#f2f2f2!important;border:1px solid #2a2a2a!important;border-radius:16px;font-family:Inter,system-ui,-apple-system,Segoe UI,Roboto,sans-serif;overflow:hidden;box-sizing:border-box} #mtp-gl11 *{box-sizing:border-box} #mtp-gl11 hr,#mtp-gl11 p:empty,#mtp-gl11 del,#mtp-gl11 s{display:none!important} #mtp-gl11 .hd{padding:22px 24px 14px;background:radial-gradient(circle at 92% 0%,rgba(240,160,106,.25),transparent 45%),radial-gradient(circle at 70% 120%,rgba(91,140,247,.22),transparent 50%)!important} #mtp-gl11 .tag{display:inline-block;font-size:11px;letter-spacing:.08em;text-transform:uppercase;color:#0d0d0d!important;background:#f2f2f2!important;border-radius:99px;padding:3px 10px;font-weight:700} #mtp-gl11 h3{margin:10px 0 4px;font-size:22px;line-height:1.25;color:#fff!important} #mtp-gl11 .sub{margin:0;color:#a9a9a9!important;font-size:14px} #mtp-gl11 .tabs{display:flex;gap:6px;padding:0 24px;border-bottom:1px solid #262626!important;flex-wrap:wrap} #mtp-gl11 .tab{background:transparent!important;color:#9a9a9a!important;border:0!important;border-bottom:2px solid transparent!important;padding:12px 10px;font:600 14px Inter,system-ui,sans-serif;cursor:pointer} #mtp-gl11 .tab.on{color:#fff!important;border-bottom-color:#F0A06A!important} #mtp-gl11 .pn{display:none;padding:20px 24px 8px;animation:gl11fade .35s ease} #mtp-gl11 .pn.on{display:block} @keyframes gl11fade{from{opacity:0;transform:translateY(6px)}to{opacity:1;transform:none}} #mtp-gl11 .row{display:flex;gap:10px;align-items:center;flex-wrap:wrap} #mtp-gl11 .btn{background:#f2f2f2!important;color:#0d0d0d!important;border:0!important;border-radius:99px;padding:8px 16px;font:700 13px Inter,system-ui,sans-serif;cursor:pointer} #mtp-gl11 .btn.gh{background:transparent!important;color:#f2f2f2!important;border:1px solid #3a3a3a!important} #mtp-gl11 .note{font-size:12px;color:#8a8a8a!important;margin:10px 0} #mtp-gl11 .box{background:#151515!important;border:1px solid #2a2a2a!important;border-radius:12px;padding:14px} #mtp-gl11 svg text{font-family:Inter,system-ui,sans-serif} #mtp-gl11 .node{transition:all .4s} #mtp-gl11 .flow{stroke-dasharray:6 6;animation:gl11dash 1s linear infinite} @keyframes gl11dash{to{stroke-dashoffset:-12}} #mtp-gl11 .pulse{animation:gl11pulse 1.6s ease-in-out infinite;transform-origin:center;transform-box:fill-box} @keyframes gl11pulse{0%,100%{transform:scale(1);opacity:1}50%{transform:scale(1.08);opacity:.85}} #mtp-gl11 .dim{opacity:.25} #mtp-gl11 .stepTxt{min-height:44px;font-size:14px;color:#ddd!important;margin:8px 0} #mtp-gl11 .tl{display:flex;height:34px;border-radius:8px;overflow:hidden;border:1px solid #2a2a2a!important;margin:12px 0 6px} #mtp-gl11 .seg{display:flex;align-items:center;justify-content:center;font-size:11px;font-weight:700;color:#0d0d0d!important;transition:flex-grow .6s,opacity .4s;opacity:.2;white-space:nowrap;overflow:hidden} #mtp-gl11 .seg.lit{opacity:1} #mtp-gl11 .log{font:12px/1.6 ui-monospace,Menlo,Consolas,monospace;background:#0a0a0a!important;color:#cfcfcf!important;border:1px solid #232323!important;border-radius:8px;padding:10px;min-height:96px;margin:0;white-space:pre-wrap;word-break:break-word} #mtp-gl11 .log b{color:#F0A06A!important} #mtp-gl11 input[type=range]{width:100%;accent-color:#F0A06A} #mtp-gl11 label{font-size:13px;color:#bbb!important;display:block;margin:10px 0 4px} #mtp-gl11 .val{color:#fff!important;font-weight:700} #mtp-gl11 .bars{margin-top:14px} #mtp-gl11 .bar{margin:8px 0} #mtp-gl11 .bar .lb{display:flex;justify-content:space-between;font-size:13px;margin-bottom:4px;color:#ddd!important} #mtp-gl11 .bar .tr{height:16px;background:#1c1c1c!important;border-radius:99px;overflow:hidden} #mtp-gl11 .bar .fl{height:100%;width:0;border-radius:99px;transition:width .8s cubic-bezier(.2,.8,.2,1)} #mtp-gl11 .grid{display:grid;grid-template-columns:1fr 1fr;gap:10px;align-items:start} #mtp-gl11 .card{background:#151515!important;border:1px solid #2a2a2a!important;border-radius:12px;padding:12px 14px;cursor:pointer;transition:border-color .25s,transform .25s} #mtp-gl11 .card:hover{border-color:#5B8CF7!important;transform:translateY(-2px)} #mtp-gl11 .card h4{margin:0;font-size:14px;color:#fff!important} #mtp-gl11 .card p{margin:6px 0 0;font-size:13px;color:#aaa!important;max-height:0;overflow:hidden;transition:max-height .4s} #mtp-gl11 .card.open p{max-height:120px} #mtp-gl11 .card .plus{float:right;color:#F0A06A!important;font-weight:700} #mtp-gl11 code{background:#1f1f1f!important;color:#F0A06A!important;border:0!important;padding:1px 5px;border-radius:4px;font-size:12px} #mtp-gl11 .ft{display:flex;justify-content:space-between;gap:10px;flex-wrap:wrap;padding:12px 24px 16px;border-top:1px solid #222!important;font-size:12px;color:#777!important;margin-top:12px} #mtp-gl11 .ft a{color:#9a9a9a!important} #mtp-gl11 .ft .brand{color:#76B900!important;font-weight:700} @media (max-width:640px){#mtp-gl11 .hd{padding:18px 16px 12px}#mtp-gl11 h3{font-size:19px}#mtp-gl11 .tabs{padding:0 12px}#mtp-gl11 .tab{font-size:12px;padding:10px 6px}#mtp-gl11 .pn{padding:16px}#mtp-gl11 .grid{grid-template-columns:1fr}#mtp-gl11 .seg{font-size:9px}#mtp-gl11 .ft{padding:12px 16px}} <div id="mtp-gl11"> <div class="hd"> <span class="tag">OpenAI · gpt-live-1.1</span> <h3>GPT-Live-1.1, explained</h3> <p class="sub">Full-duplex voice model in the API. $0.05/min active, $0.02/min standby.</p> </div> <div class="tabs" role="tablist"> <button class="tab on" data-t="0">How it works</button> <button class="tab" data-t="1">Standby mode</button> <button class="tab" data-t="2">Cost calculator</button> <button class="tab" data-t="3">What changed</button> </div> <div class="pn on" id="gl11p0"> User audio WebRTC / WebSocket / SIP GPT-Live-1.1 listens while speaking Backend model Astra · Luna · 3rd party speech in speech out delegate tools result <div class="stepTxt" id="gl11st">One model handles listening and speaking. No separate speech-to-text and text-to-speech chain.</div> <div class="row"> <button class="btn" id="gl11next">Step through ▸</button> <button class="btn gh" id="gl11all">Show all</button> <span class="note" id="gl11ct" style="margin:0">Overview</span> </div> <p class="note">Delegation modes: <code>delegation.type</code> = <code>client</code> (your backend) or <code>responses</code> (OpenAI models). Default context: 128,000 tokens.</p> </div> <div class="pn" id="gl11p1"> <label>Idle timeout <code>session.idle_timeout_s</code>: <span class="val" id="gl11tv">20</span> s (allowed 5 to 60)</label> <div class="tl"> <div class="seg" id="gl11s0" style="flex-grow:3;background:#F0A06A">Active · talking</div> <div class="seg" id="gl11s1" style="flex-grow:2;background:#d9c2b0">Silence (timeout)</div> <div class="seg" id="gl11s2" style="flex-grow:4;background:#7EA4FA">Standby · $0.02/min</div> <div class="seg" id="gl11s3" style="flex-grow:2;background:#F0A06A">Resumed</div> </div> <div class="row" style="margin:8px 0 10px"><button class="btn" id="gl11sim"> Simulate a call</button><button class="btn gh" id="gl11rst">Reset</button></div> <pre class="log" id="gl11log">Press Simulate to walk through the standby events.</pre> <p class="note">WebRTC only. Keep the mic track active. Session ID and history are kept. First reply after a short utterance may be slower.</p> </div> <div class="pn" id="gl11p2"> <label>Session length: <span class="val" id="gl11mv">60</span> min</label> <label>Share of the session that is idle (in standby): <span class="val" id="gl11iv">50</span>%</label> <div class="bars"> <div class="bar"><div class="lb"><span>All minutes at active rate ($0.05)</span><span class="val" id="gl11c0">$3.00</span></div><div class="tr"><div class="fl" id="gl11b0" style="background:#F0A06A"></div></div></div> <div class="bar"><div class="lb"><span>With standby ($0.02 on idle minutes)</span><span class="val" id="gl11c1">$2.10</span></div><div class="tr"><div class="fl" id="gl11b1" style="background:#7EA4FA"></div></div></div> </div> <p class="note" id="gl11sv">Voice layer only. Illustrative: the timeout window itself bills at the active rate, and backend model and tool usage are billed separately.</p> </div> <div class="pn" id="gl11p3"> <div class="grid"> <div class="card"><h4>Accents <span class="plus">+</span></h4><p>More natural and consistent accents across languages, per OpenAI.</p></div> <div class="card"><h4>Transcription <span class="plus">+</span></h4><p>Transcribes speech more accurately than GPT-Live-1, per the model page.</p></div> <div class="card"><h4>Letters and numbers <span class="plus">+</span></h4><p>Better handling of precise details like letters and numbers.</p></div> <div class="card"><h4>Task completion <span class="plus">+</span></h4><p>More reliable instruction following and task completion.</p></div> </div> <div class="bars"> <div class="bar"><div class="lb"><span>Active rate</span><span class="val">$0.05/min</span></div><div class="tr"><div class="fl gl11pb" data-w="100" style="background:#F0A06A"></div></div></div> <div class="bar"><div class="lb"><span>Standby rate (new, also on GPT-Live-1)</span><span class="val">$0.02/min</span></div><div class="tr"><div class="fl gl11pb" data-w="40" style="background:#7EA4FA"></div></div></div> </div> <p class="note">OpenAI published no benchmark scores for 1.1. All 4 gains above are self-reported.</p> </div> <div class="ft"> <span>Sources: <a href=" target=" rel="noopener">model page</a> · <a href=" target=" rel="noopener">Live guide</a></span> <span class="brand">Built by Marktechpost</span> </div> </div> (function(){ var R=document.getElementById('mtp-gl11'); function $(i){return document.getElementById(i)} function resize(){try{parent.postMessage({mtpFrame:'gl11',height:R.offsetHeight+40},'*')}catch(e){}} var tabs=R.querySelectorAll('.tab'); for(var i=0;i<tabs.length;i++){tabs[i].addEventListener('click',function(){ for(var j=0;j<tabs.length;j++){tabs[j].classList.remove('on');$('gl11p'+j).classList.remove('on')} this.classList.add('on');var t=this.getAttribute('data-t');$('gl11p'+t).classList.add('on'); if(t==='2')calc(); if(t==='3')priceBars(); setTimeout(resize,60); })} /* step-through */ var steps=[ {on:['gl11n0','gl11a0','gl11n1'],t:'1. Caller audio streams in. The model keeps listening even while it is speaking (full duplex).',c:'Step 1 of 3'}, {on:['gl11n1','gl11a2','gl11n2'],t:'2. For reasoning or tools, the voice model delegates to a backend model while the conversation continues.',c:'Step 2 of 3'}, {on:['gl11n2','gl11a3','gl11n1','gl11a1','gl11n0'],t:'3. The result returns and is spoken back. ASR transcripts and response text come back natively.',c:'Step 3 of 3'}]; var ids=['gl11n0','gl11n1','gl11n2','gl11a0','gl11a1','gl11a2','gl11a3'],si=-1; function showAll(){ids.forEach(function(x){$(x).classList.remove('dim')})} $('gl11next').addEventListener('click',function(){si=(si+1)%steps.length;var s=steps[si]; ids.forEach(function(x){$(x).classList.toggle('dim',s.on.indexOf(x)<0)});$('gl11st').textContent=s.t;$('gl11ct').textContent=s.c;}); $('gl11all').addEventListener('click',function(){si=-1;showAll();$('gl11st').textContent='One model handles listening and speaking. No separate speech-to-text and text-to-speech chain.';$('gl11ct').textContent='Overview'}); /* standby */ $('gl11to').addEventListener('input',function(){$('gl11tv').textContent=this.value;$('gl11s1').style.flexGrow=(1+this.value/15).toFixed(2)}); var timers=[]; function rst(){timers.forEach(clearTimeout);timers=[];for(var k=0;k<4;k++)$('gl11s'+k).classList.remove('lit');$('gl11log').innerHTML='Press Simulate to walk through the standby events.'} $('gl11rst').addEventListener('click',rst); $('gl11sim').addEventListener('click',function(){rst();var to=$('gl11to').value;var L=$('gl11log');L.innerHTML=''; var ev=[[0,'<b>session.resumed</b> first wake on speech, inference active ($0.05/min)'], [1,'silence detected, waiting '+to+' s (idle_timeout_s)'], [2,'<b>session.paused</b> standby, WebRTC call stays open ($0.02/min)'], [3,'user speaks, <b>session.resumed</b> same session ID, history restored']]; ev.forEach(function(e,n){timers.push(setTimeout(function(){$('gl11s'+e[0]).classList.add('lit');L.innerHTML+=(n?'n':'')+e[1];resize()},n*1100))}); }); /* calculator */ function money(v){return '$'+v.toFixed(2)} function calc(){var m=+$('gl11min').value,p=+$('gl11idle').value/100;$('gl11mv').textContent=m;$('gl11iv').textContent=Math.round(p*100); var a=m*0.05,b=m*(1-p)*0.05+m*p*0.02;$('gl11c0').textContent=money(a);$('gl11c1').textContent=money(b); $('gl11b0').style.width='100%';$('gl11b1').style.width=(a?b/a*100:0)+'%'; $('gl11sv').textContent='Saves '+money(a-b)+' ('+(a?((a-b)/a*100).toFixed(0):0)+'%) on the voice layer. Illustrative: the timeout window itself bills at the active rate, and backend model and tool usage are billed separately.'} $('gl11min').addEventListener('input',calc);$('gl11idle').addEventListener('input',calc); function priceBars(){var b=R.querySelectorAll('.gl11pb');for(var k=0;k<b.length;k++){b[k].style.width='0';(function(el){setTimeout(function(){el.style.width=el.getAttribute('data-w')+'%'},50)})(b[k])}} var cards=R.querySelectorAll('.card');for(var c=0;c<cards.length;c++){cards[c].addEventListener('click',function(){this.classList.toggle('open');this.querySelector('.plus').textContent=this.classList.contains('open')?'−':'+';setTimeout(resize,420)})} window.addEventListener('load',resize);window.addEventListener('resize',resize);setTimeout(resize,300); })(); "> window.addEventListener("message",function(e){if(e.data&&e.data.mtpFrame==="gl11"&&e.data.height){document.getElementById("mtp-gl11-frame").style.height=e.data.height+"px";}}); Key Takeaways GPT-Live-1.1 is live in the API as gpt-live-1.1. Standby cuts idle WebRTC billing from $0.05 to $0.02 per minute. Idle timeout is configurable from 5 to 60 seconds. Accent, transcription and task gains are self-reported, with no scores. Backend reasoning and tools are billed separately from voice minutes. Check out the model page, the Live conversations guide and the announcement. You can check the deployment options and specs here through our GPULeaderboard.com chrome extension. Also, feel free to follow us on Twitter and don’t forget to join our 150k+ML SubReddit and Subscribe to our Newsletter. Wait! are you on telegram? now you can join us on telegram as well. Need to partner with us for promoting your GitHub Repo OR Hugging Face Page OR Product Release OR Webinar etc.? Connect with us The post OpenAI Ships GPT-Live-1.1 for Voice Agents, Cuts Idle Cost to $0.02/Min appeared first on MarkTechPost.
Anthropic mathematician Levent Alpöge says he used Claude to prove the Riemann hypothesis, math's most famous open problem for 167 years, with a proof formalized in Lean that spans over 250,000 pages. Just hours later, Stanford researchers published an independent, entirely human competing proof, and mathematicians are now checking whether either one holds up. The article Hours after Anthropic claims a Claude proof of the Riemann hypothesis, Stanford releases an all-human competing draft appeared first on The Decoder.
Thinking Machines has released Inkling 2 Mini, an open looped transformer that runs 12 of its 24 layers three times per token. This lets the model reason internally for longer without generating extra text. On Artificial Analysis's Intelligence Index, it ties with Qwen3.8 27B at roughly six times lower cost. The article New open model Inkling 2 Mini thinks in loops to solve problems with fewer words and still runs on a laptop appeared first on The Decoder.
The Nasdaq 100 has slipped into a bear market after its worst weekly loss since the Covid-19 crisis. Nvidia plunged 14 percent as the SEC reviews its accounting, and Anthropic lost nearly all of its gains a day after its record IPO. AI doubts, scandals, rising interest rates, and political headwinds are hitting overheated valuations all at once. The article US technology stocks suffer their worst weekly loss since the pandemic as AI doubts pile up appeared first on The Decoder.
Bytedance and several US universities introduce Axion 1.0, an AI agent that rivals top commercial models from OpenAI and Anthropic on benchmarks after just three training phases. The researchers attribute the gains to carefully curated training data rather than ever more training steps. The model, data, and code are freely available. The article Bytedance argues most AI training phases are unnecessary and backs it up with a competitive open model appeared first on The Decoder.
Baseten has released bison-1 and groundhog-1, 2 open-weight decision models built on Google’s Gemma 4. Decision models do not write text. They return calibrated probabilities for yes/no, choice and score questions. The Baseten bison-1 decision model scores 76 on the Artificial Analysis Decision Index v2.1. That ranks #1 of 19. Both models raise context from 16k to 128k tokens and accept images. For routing, triage and guardrail pipelines, that means full policies and histories in one call. TL;DR Size: bison-1 is 31B dense. groundhog-1 is a 26B MoE with about 4B active. Both take 128k tokens (131,072). Runs on: Baseten Model APIs, plus open BF16 weights on Hugging Face. No inference GPU or quantized builds are listed. BF16 weights alone are about 62 GB (bison-1) and 52 GB (groundhog-1), by our arithmetic. Performance: bison-1 scores 76 on AA Decision Index v2.1, 1 point above Liquid AI’s d1.2-ultra (75). Best: When2Call, 98 (rank #1). Worst: AA-Omniscience-Decision v1.1, 60 (rank #11). Bottom line: Best: top-ranked, best-calibrated decisions (Brier 0.14) over 128k tokens at $0.10 per 1M input tokens. Worst: groundhog-1 has no official index score yet, and every number is self-reported. What are bison-1 and groundhog-1? bison-1 is a 31B decision model from Baseten that post-trains Gemma 4 31B to return calibrated probabilities. groundhog-1 is the cheaper sibling. It fine-tunes Gemma 4 26B-A4B, a mixture-of-experts model with about 4B active parameters per token. Both join Baseten’s existing lineup: mammoth-1 (27B), elephant-1 (9B) and joey-1 (2B). Those 3 sit on Qwen backbones. The new pair is Baseten’s first on what it calls an American backbone. How does a decision model work? A request carries 1 state and any number of questions. The state is text, optionally with images. Each question has a type: noul (yes/no), choice (named options) or score (ordered levels). The model answers every question in a single prefill pass. It returns P(yes), or the chosen option with a probabilities field. No output tokens are generated. Baseten’s earlier launch post lists ticket triage, spam detection, jailbreak guardrails and LLM routing as target tasks. Requests longer than the trained limit are refused, not truncated. Pipelines that assume silent truncation will need a length check. Why is bison-1 better calibrated? Baseten credits two sources: the Gemma base and more “soft labels” in the training mix. Soft labels use probability targets instead of 1 fixed correct answer. The model learns to report uncertainty that tracks how often it is right. The result is a Brier score of 0.14, the lowest on the index. Baseten puts d1.2-ultra at 0.15. Lower is better. How does bison-1 score on benchmarks? On AA Decision Index v2.1, bison-1 scores 76. Liquid AI’s d1.2-ultra scores 75 and mammoth-1 scores 71. The index blends 6 evaluations, led by AA-Paperclip at 30%. The bison-1 model card breaks out each component: When2Call: 98 (#1) EvalSafe-O*NET-AA: 93 (#1) AA-Symmetry v1.1: 89 (#1) AA-Paperclip: 73 (#2) HLE-MultiChoice v1.1: 51 (#1) AA-Omniscience-Decision v1.1: 60 (#11) bison-1 ranks first on 4 of 6 components. Knowledge-heavy decisions are its weak spot. On long context, Baseten reports LongMemEval M (128k) of 84.8 for bison-1 and 77.4 for groundhog-1. LongMemEval S reads 87.1 and 79.3. groundhog-1 has no official index score yet. Baseten expects it to match mammoth-1. #mtp-bsn-wrap hr,#mtp-bsn-wrap p:empty,#mtp-bsn-wrap del,#mtp-bsn-wrap s{display:none!important}#mtp-bsn-wrap iframe{display:block!important;width:100%!important;border:0!important;background:transparent!important} <iframe id="mtp-bsn-frame" title="Baseten bison-1 and groundhog-1 interactive explainer" loading="lazy" style="height:600px" srcdoc="html,body{margin:0;padding:0;background:transparent}<div id="mtp-bsn-x"> #mtp-bsn-x{--bg:#0E0F0C;--panel:#17191A;--line:#2A2D2B;--txt:#F4F1E8;--mut:#A9A79F;--grn:#5FD37C;--yel:#F5C754;--lil:#C7A6F2;--org:#F08A5D;font-family:Inter,system-ui,-apple-system,Segoe UI,Roboto,sans-serif;max-width:880px;margin:0 auto;background:var(--bg)!important;color:var(--txt)!important;border:1px solid var(--line)!important;border-radius:16px;padding:22px 22px 14px;box-sizing:border-box;line-height:1.45} #mtp-bsn-x *{box-sizing:border-box} #mtp-bsn-x hr,#mtp-bsn-x p:empty,#mtp-bsn-x del,#mtp-bsn-x s{display:none!important} #mtp-bsn-x code{background:#22251F!important;color:var(--grn)!important;border:1px solid var(--line)!important;padding:1px 6px;border-radius:5px;font-size:12px;font-family:ui-monospace,Menlo,monospace} #mtp-bsn-x .hd{display:flex;justify-content:space-between;align-items:flex-start;gap:12px;flex-wrap:wrap} #mtp-bsn-x .tag{display:inline-block;font-size:11px;letter-spacing:.12em;text-transform:uppercase;color:#0E0F0C!important;background:var(--grn)!important;padding:3px 8px;border-radius:4px;font-weight:700} #mtp-bsn-x h3{margin:8px 0 2px;font-size:22px;color:var(--txt)!important;font-weight:800;letter-spacing:-.01em} #mtp-bsn-x .sub{color:var(--mut)!important;font-size:13.5px;margin:0} #mtp-bsn-x .chips{display:flex;gap:6px;flex-wrap:wrap} #mtp-bsn-x .chip{font-size:12px;border:1px solid var(--line)!important;border-radius:999px;padding:4px 10px;color:var(--txt)!important;background:#141613!important} #mtp-bsn-x .chip b{color:var(--grn)!important} #mtp-bsn-x .tabs{display:flex;gap:6px;margin:16px 0 12px;border-bottom:1px solid var(--line);flex-wrap:wrap} #mtp-bsn-x .tab{background:transparent!important;border:0!important;color:var(--mut)!important;font:600 13.5px Inter,system-ui,sans-serif;padding:9px 12px;cursor:pointer;border-bottom:2px solid transparent!important;margin-bottom:-1px} #mtp-bsn-x .tab.on{color:var(--txt)!important;border-bottom-color:var(--grn)!important} #mtp-bsn-x .pane{display:none;animation:bsnIn .35s ease} #mtp-bsn-x .pane.on{display:block} @keyframes bsnIn{from{opacity:0;transform:translateY(6px)}to{opacity:1;transform:none}} #mtp-bsn-x .card{background:var(--panel)!important;border:1px solid var(--line)!important;border-radius:12px;padding:14px} #mtp-bsn-x .flow{display:grid;grid-template-columns:1.1fr 1fr 1.1fr;gap:12px;align-items:stretch} #mtp-bsn-x .node{background:#121411!important;border:1px solid var(--line)!important;border-radius:10px;padding:12px;transition:all .35s ease;opacity:.35;min-height:150px} #mtp-bsn-x .node.lit{opacity:1;border-color:var(--grn)!important;box-shadow:0 0 0 1px var(--grn),0 0 22px rgba(95,211,124,.18)} #mtp-bsn-x .node h4{margin:0 0 8px;font-size:12px;letter-spacing:.1em;text-transform:uppercase;color:var(--grn)!important} #mtp-bsn-x .st{font-size:12.5px;color:var(--txt)!important;background:#1B1E1A!important;border-radius:8px;padding:8px;border:1px dashed #3A3E38!important} #mtp-bsn-x .q{font-size:12px;margin-top:6px;display:flex;gap:6px;align-items:center} #mtp-bsn-x .qt{font-size:10.5px;font-weight:700;padding:1px 6px;border-radius:4px;color:#0E0F0C!important} #mtp-bsn-x .core{display:flex;flex-direction:column;justify-content:center;align-items:center;text-align:center} #mtp-bsn-x .orb{width:74px;height:74px;border-radius:50%;background:radial-gradient(circle at 35% 35%,var(--yel),#B88A1E)!important;display:flex;align-items:center;justify-content:center;font-weight:800;color:#0E0F0C!important;font-size:13px;margin:6px auto} #mtp-bsn-x .node.lit .orb{animation:bsnPulse 1.2s ease-in-out infinite} @keyframes bsnPulse{0%,100%{transform:scale(1)}50%{transform:scale(1.08);box-shadow:0 0 24px rgba(245,199,84,.5)}} #mtp-bsn-x .pr{margin-top:6px;font-size:12px} #mtp-bsn-x .pr .bar{height:8px;background:#23261F!important;border-radius:4px;overflow:hidden;margin-top:3px} #mtp-bsn-x .pr .fill{height:100%;width:0;background:var(--grn)!important;transition:width .9s cubic-bezier(.2,.8,.2,1)} #mtp-bsn-x .ctl{display:flex;align-items:center;gap:8px;margin-top:12px;flex-wrap:wrap} #mtp-bsn-x .btn{background:#1C1F1B!important;border:1px solid var(--line)!important;color:var(--txt)!important;border-radius:8px;padding:7px 12px;font:600 12.5px Inter,system-ui,sans-serif;cursor:pointer} #mtp-bsn-x .btn:hover{border-color:var(--grn)!important} #mtp-bsn-x .btn.pri{background:var(--grn)!important;color:#0E0F0C!important;border-color:var(--grn)!important} #mtp-bsn-x .cap{font-size:13px;color:var(--txt)!important;margin:10px 0 0;min-height:38px} #mtp-bsn-x .dots{display:flex;gap:5px;margin-left:auto} #mtp-bsn-x .dot{width:8px;height:8px;border-radius:50%;background:#33372F!important} #mtp-bsn-x .dot.on{background:var(--grn)!important} #mtp-bsn-x .seg{display:inline-flex;border:1px solid var(--line)!important;border-radius:8px;overflow:hidden;margin-bottom:12px;flex-wrap:wrap} #mtp-bsn-x .seg button{background:transparent!important;border:0!important;color:var(--mut)!important;padding:7px 12px;font:600 12.5px Inter,system-ui,sans-serif;cursor:pointer} #mtp-bsn-x .seg button.on{background:#23271F!important;color:var(--txt)!important} #mtp-bsn-x .row{display:grid;grid-template-columns:190px 1fr 60px;gap:10px;align-items:center;margin:9px 0;font-size:13px} #mtp-bsn-x .row .nm{color:var(--txt)!important} #mtp-bsn-x .row .tr{height:22px;background:#1B1D19!important;border-radius:5px;overflow:hidden;position:relative} #mtp-bsn-x .row .fl{height:100%;width:0;border-radius:5px;transition:width 1s cubic-bezier(.2,.8,.2,1)} #mtp-bsn-x .row .vl{font-weight:800;text-align:right;color:var(--txt)!important;font-variant-numeric:tabular-nums} #mtp-bsn-x .rk{font-size:10.5px;color:var(--mut)!important;margin-left:6px} #mtp-bsn-x .note{font-size:11.5px;color:var(--mut)!important;margin-top:8px} #mtp-bsn-x .grid2{display:grid;grid-template-columns:1fr 1fr;gap:12px} #mtp-bsn-x .dist{display:flex;align-items:flex-end;gap:10px;height:120px;padding:8px 4px 0;border-bottom:1px solid var(--line)} #mtp-bsn-x .dcol{flex:1;display:flex;flex-direction:column;align-items:center;justify-content:flex-end;height:100%} #mtp-bsn-x .dbar{width:100%;max-width:56px;border-radius:5px 5px 0 0;transition:height .7s cubic-bezier(.2,.8,.2,1);background:var(--lil)!important} #mtp-bsn-x .dlab{font-size:11px;color:var(--mut)!important;margin-top:4px} #mtp-bsn-x .dval{font-size:11.5px;font-weight:700;color:var(--txt)!important;margin-bottom:3px} #mtp-bsn-x .big{font-size:34px;font-weight:800;color:var(--grn)!important;line-height:1} #mtp-bsn-x .lineup{display:grid;grid-template-columns:repeat(5,1fr);gap:8px} #mtp-bsn-x .mdl{background:#121411!important;border:1px solid var(--line)!important;border-radius:10px;padding:10px;cursor:pointer;transition:all .25s ease;text-align:left;color:var(--txt)!important;font-family:inherit} #mtp-bsn-x .mdl:hover{transform:translateY(-2px)} #mtp-bsn-x .mdl.on{border-color:var(--grn)!important;box-shadow:0 0 0 1px var(--grn)} #mtp-bsn-x .mdl .n{font-weight:800;font-size:14px} #mtp-bsn-x .mdl .p{font-size:11.5px;color:var(--mut)!important} #mtp-bsn-x .mdl .new{font-size:9.5px;font-weight:800;color:#0E0F0C!important;background:var(--yel)!important;border-radius:3px;padding:1px 5px;margin-left:4px;vertical-align:middle} #mtp-bsn-x .det{margin-top:12px;display:grid;grid-template-columns:repeat(4,1fr);gap:8px} #mtp-bsn-x .kv{background:#121411!important;border:1px solid var(--line)!important;border-radius:8px;padding:9px} #mtp-bsn-x .kv .k{font-size:10.5px;text-transform:uppercase;letter-spacing:.08em;color:var(--mut)!important} #mtp-bsn-x .kv .v{font-size:15px;font-weight:800;margin-top:2px;color:var(--txt)!important} #mtp-bsn-x .foot{display:flex;justify-content:space-between;gap:10px;flex-wrap:wrap;margin-top:14px;padding-top:10px;border-top:1px solid var(--line);font-size:11px;color:var(--mut)!important} #mtp-bsn-x .foot a{color:var(--mut)!important} #mtp-bsn-x .brand{color:#76B900!important;font-weight:700} @media (max-width:640px){ #mtp-bsn-x{padding:16px 14px 12px} #mtp-bsn-x h3{font-size:18px} #mtp-bsn-x .flow{grid-template-columns:1fr} #mtp-bsn-x .node{min-height:0} #mtp-bsn-x .row{grid-template-columns:120px 1fr 44px;font-size:12px} #mtp-bsn-x .grid2{grid-template-columns:1fr} #mtp-bsn-x .lineup{grid-template-columns:repeat(2,1fr)} #mtp-bsn-x .det{grid-template-columns:repeat(2,1fr)} #mtp-bsn-x .tab{padding:8px 8px;font-size:12.5px} } <div class="hd"> <div> <span class="tag">Base Labs · Baseten</span> <h3>bison-1 + groundhog-1: decision models on Gemma 4</h3> <p class="sub">They return calibrated probabilities, not text. Released November 20, 2026.</p> </div> <div class="chips"> <span class="chip"><b>76</b> AA Decision Index v2.1</span> <span class="chip"><b>128k</b> context</span> <span class="chip"><b>0.14</b> Brier</span> </div> </div> <div class="tabs" role="tablist"> <button class="tab on" data-t="how">How it works</button> <button class="tab" data-t="bench">Benchmarks</button> <button class="tab" data-t="cal">Calibration</button> <button class="tab" data-t="line">Lineup & price</button> </div> <!-- HOW --> <div class="pane on" data-p="how"> <div class="flow"> <div class="node" data-s="0"> <h4>1 · State</h4> <div class="st">Policy doc + chat history (up to 128k tokens), optional images. Example: "My payouts have been failing for 3 days."</div> </div> <div class="node core" data-s="2"> <h4>3 · 1 prefill pass</h4> <div class="orb">bison-1</div> <div style="font-size:11.5px;color:#A9A79F">No output tokens generated</div> </div> <div class="node" data-s="3"> <h4>4 · Probabilities</h4> <div class="pr">urgent? P(yes)<div class="bar"><div class="fill" data-w="82"></div></div></div> <div class="pr">team: billing<div class="bar"><div class="fill" data-w="64"></div></div></div> <div class="pr">severity score<div class="bar"><div class="fill" data-w="47"></div></div></div> </div> </div> <div class="node" data-s="1" style="margin-top:12px;min-height:0"> <h4>2 · Questions (any number, 1 request)</h4> <div class="q"><span class="qt" style="background:#5FD37C">noul</span> Is this urgent? (yes/no)</div> <div class="q"><span class="qt" style="background:#F5C754">choice</span> Which team: billing, tech, sales?</div> <div class="q"><span class="qt" style="background:#C7A6F2">score</span> Rate severity on ordered levels</div> </div> <p class="cap" id="bsn-cap"></p> <div class="ctl"> <button class="btn" id="bsn-prev">← Back</button> <button class="btn pri" id="bsn-next">Next step →</button> <button class="btn" id="bsn-play"> Auto-play</button> <div class="dots"><span class="dot"></span><span class="dot"></span><span class="dot"></span><span class="dot"></span></div> </div> <p class="note">Output values in step 4 are illustrative. Request format from the bison-1 model card.</p> </div> <!-- BENCH --> <div class="pane" data-p="bench"> <div class="seg" id="bsn-seg"> <button class="on" data-b="idx">AA Decision Index v2.1</button> <button data-b="cmp">bison-1 components</button> <button data-b="lme">Long context (128k)</button> </div> <div class="card" id="bsn-bars"></div> <p class="note" id="bsn-bnote"></p> </div> <!-- CAL --> <div class="pane" data-p="cal"> <div class="grid2"> <div class="card"> <div style="font-size:12px;letter-spacing:.1em;text-transform:uppercase;color:#5FD37C;font-weight:700">Training target</div> <div class="seg" id="bsn-lab" style="margin-top:8px"> <button class="on" data-l="hard">Hard label</button> <button data-l="soft">Soft label</button> </div> <div class="dist"> <div class="dcol"><div class="dval" id="d0"></div><div class="dbar" id="b0"></div><div class="dlab">billing</div></div> <div class="dcol"><div class="dval" id="d1"></div><div class="dbar" id="b1"></div><div class="dlab">tech</div></div> <div class="dcol"><div class="dval" id="d2"></div><div class="dbar" id="b2"></div><div class="dlab">sales</div></div> </div> <p class="cap" id="bsn-lcap" style="min-height:0"></p> <p class="note">Target values are illustrative. Baseten says more soft labels in the mix drove a major calibration gain.</p> </div> <div class="card"> <div style="font-size:12px;letter-spacing:.1em;text-transform:uppercase;color:#5FD37C;font-weight:700">Brier score (lower is better)</div> <div class="row" style="grid-template-columns:110px 1fr 44px"><span class="nm">bison-1</span><div class="tr"><div class="fl" data-w="14" style="background:#F5C754"></div></div><span class="vl">0.14</span></div> <div class="row" style="grid-template-columns:110px 1fr 44px"><span class="nm">d1.2-ultra</span><div class="tr"><div class="fl" data-w="15" style="background:#5B5E58"></div></div><span class="vl">0.15</span></div> <p style="font-size:12.5px;margin:10px 0 0">Brier is the mean squared gap between stated confidence and being right, on a 0 to 1 scale. Bars are drawn on that full 0 to 1 scale.</p> <p class="note">bison-1 has the lowest Brier score on the index (self-reported). The d1.2-ultra figure is Baseten's.</p> </div> </div> </div> <!-- LINE --> <div class="pane" data-p="line"> <div class="lineup" id="bsn-line"></div> <div class="det" id="bsn-det"></div> <p class="note">Price is per 1M input tokens on Baseten Model APIs. Decision models produce no output tokens.</p> </div> <div class="foot"> <span>Sources: <a href=" target=" rel="noopener">Baseten blog</a> · <a href=" target=" rel="noopener">bison-1 card</a> · <a href=" target=" rel="noopener">groundhog-1 card</a> · <a href=" target=" rel="noopener">Liquid AI</a>. Scores self-reported.</span> <span class="brand">Built by Marktechpost</span> </div> (function(){ var R=document.getElementById('mtp-bsn-x'); function q(s){return R.querySelector(s)} function qa(s){return R.querySelectorAll(s)} function resize(){try{var h=R.offsetHeight+40;parent.postMessage({mtpEmbed:'mtp-bsn-x',height:h},'*')}catch(e){}} /* tabs */ qa('.tab').forEach(function(t){t.addEventListener('click',function(){ qa('.tab').forEach(function(x){x.classList.remove('on')});t.classList.add('on'); qa('.pane').forEach(function(p){p.classList.toggle('on',p.getAttribute('data-p')===t.getAttribute('data-t'))}); if(t.getAttribute('data-t')==='bench')drawBars(cur); if(t.getAttribute('data-t')==='cal'){setLab(lab);calBars()} setTimeout(resize,60); })}); /* how */ var caps=['The state holds the context: policies, conversation history and optional images, up to 128k tokens.','Attach any number of typed questions: noul (yes/no), choice (named options) or score (ordered levels).','The model reads everything in a single prefill pass. It never generates output tokens.','It returns P(yes), or the chosen option with a probabilities field. Your code branches on calibrated numbers.']; var step=0,timer=null; function show(s){step=s;qa('.node').forEach(function(n){var i=+n.getAttribute('data-s');n.classList.toggle('lit',i=3?f.getAttribute('data-w'):0)+'%'});} q('#bsn-next').addEventListener('click',function(){stop();show((step+1)%4)}); q('#bsn-prev').addEventListener('click',function(){stop();show((step+3)%4)}); function stop(){if(timer){clearInterval(timer);timer=null;q('#bsn-play').textContent=' Auto-play'}} q('#bsn-play').addEventListener('click',function(){if(timer){stop();return}q('#bsn-play').textContent='❚❚ Pause';timer=setInterval(function(){show((step+1)%4)},1800)}); show(0); /* bench */ var data={ idx:{max:100,rows:[['bison-1',76,'#1 of 19','#F5C754'],['Liquid d1.2-ultra',75,'','#5B5E58'],['mammoth-1',71,'','#5FD37C'],['groundhog-1',null,'Not yet scored','#C7A6F2']],note:'Artificial Analysis Decision Index v2.1, as reported by Baseten. Baseten expects groundhog-1 to match mammoth-1.'}, cmp:{max:100,rows:[['When2Call',98,'#1','#F5C754'],['EvalSafe-O*NET-AA',93,'#1','#F5C754'],['AA-Symmetry v1.1',89,'#1','#F5C754'],['AA-Paperclip',73,'#2','#F5C754'],['AA-Omniscience-Dec.',60,'#11','#F08A5D'],['HLE-MultiChoice v1.1',51,'#1','#F5C754']],note:'bison-1 component scores and ranks from its Hugging Face model card. Orange marks its weakest rank.'}, lme:{max:100,rows:[['bison-1 · M',84.8,'','#F5C754'],['groundhog-1 · M',77.4,'','#C7A6F2'],['bison-1 · S',87.1,'','#F5C754'],['groundhog-1 · S',79.3,'','#C7A6F2']],note:'LongMemEval M and S at 128k tokens, from Baseten's own runs (model cards).'} }; var cur='idx'; function drawBars(k){cur=k;var d=data[k],h=''; d.rows.forEach(function(r){h+='<div class="row"><span class="nm">'+r[0]+(r[2]?'<span class="rk">'+r[2]+'</span>':'')+'</span><div class="tr"><div class="fl" data-w="'+(r[1]===null?0:r[1]/d.max*100)+'" style="background:'+r[3]+'"></div></div><span class="vl">'+(r[1]===null?'n/a':r[1])+'</span></div>'}); q('#bsn-bars').innerHTML=h;q('#bsn-bnote').textContent=d.note; setTimeout(function(){qa('#bsn-bars .fl').forEach(function(f){f.style.width=f.getAttribute('data-w')+'%'})},40); qa('#bsn-seg button').forEach(function(b){b.classList.toggle('on',b.getAttribute('data-b')===k)});setTimeout(resize,80);} qa('#bsn-seg button').forEach(function(b){b.addEventListener('click',function(){drawBars(b.getAttribute('data-b'))})}); /* calibration */ var lab='hard',L={hard:[1,0,0],soft:[0.7,0.2,0.1]},LC={hard:'A hard label says billing is 100% right and the rest are 0%. The model learns to be overconfident.',soft:'A soft label spreads probability across plausible answers. The model learns to state uncertainty honestly.'}; function setLab(l){lab=l;L[l].forEach(function(v,i){q('#b'+i).style.height=(v*100)+'px';q('#d'+i).textContent=Math.round(v*100)+'%'});q('#bsn-lcap').textContent=LC[l]; qa('#bsn-lab button').forEach(function(b){b.classList.toggle('on',b.getAttribute('data-l')===l)})} qa('#bsn-lab button').forEach(function(b){b.addEventListener('click',function(){setLab(b.getAttribute('data-l'))})}); function calBars(){qa('.pane[data-p="cal"] .fl').forEach(function(f){f.style.width='0';setTimeout(function(){f.style.width=f.getAttribute('data-w')+'%'},40)})} /* lineup */ var M=[['joey-1','2B','Qwen3.5-2B','16k','$0.01','Latency or cost dominates',0],['elephant-1','9B','Qwen3.5-9B','16k','$0.035','Strong default at low latency',0],['mammoth-1','27B','Qwen3.5-27B','16k','$0.10','Knowledge-heavy decisions',0],['groundhog-1','26B MoE (~4B active)','Gemma 4 26B-A4B','128k','$0.035','Long context at low latency and cost',1],['bison-1','31B','Gemma 4 31B','128k','$0.10','Highest accuracy, long context',1]]; var lh='';M.forEach(function(m,i){lh+='<button class="mdl'+(i===4?' on':'')+'" data-i="'+i+'"><div class="n">'+m[0]+(m[6]?'<span class="new">NEW</span>':'')+'</div><div class="p">'+m[1]+' · '+m[4]+'</div></button>'}); q('#bsn-line').innerHTML=lh; function det(i){var m=M[i];q('#bsn-det').innerHTML='<div class="kv"><div class="k">Params</div><div class="v">'+m[1]+'</div></div><div class="kv"><div class="k">Backbone</div><div class="v">'+m[2]+'</div></div><div class="kv"><div class="k">Context</div><div class="v">'+m[3]+'</div></div><div class="kv"><div class="k">Per 1M tokens</div><div class="v">'+m[4]+'</div></div><div class="kv" style="grid-column:1/-1"><div class="k">Best for (per Baseten)</div><div class="v" style="font-size:13.5px">'+m[5]+'</div></div>'; qa('.mdl').forEach(function(b){b.classList.toggle('on',+b.getAttribute('data-i')===i)});setTimeout(resize,60)} qa('.mdl').forEach(function(b){b.addEventListener('click',function(){det(+b.getAttribute('data-i'))})}); det(4); window.addEventListener('load',resize);window.addEventListener('resize',resize);setTimeout(resize,300); })(); </div> "> window.addEventListener("message",function(e){var d=e.data;if(d&&d.mtpEmbed==="mtp-bsn-x"&&d.height){var f=document.getElementById("mtp-bsn-frame");if(f)f.style.height=d.height+"px";}}); How does it compare with other decision models? How can developers deploy bison-1 and groundhog-1? Both models are live on Baseten Model APIs. They use the same API as the older decision models, so switching means changing 1 model name. The IDs are decision-models/baseten-bison-latest and decision-models/baseten-groundhog-latest. Pricing mirrors the older pair. bison-1 costs $0.10 per 1M tokens, like mammoth-1. groundhog-1 costs $0.035, like elephant-1. The bison-1 library page lists that as an input price, since no output tokens are produced. Open BF16 weights sit on Hugging Face. Baseten lists no inference GPU or quantized builds. Training used 192 B200 GPUs for bison-1 and 128 for groundhog-1. Key Takeaways bison-1 tops AA Decision Index v2.1 at 76, 1 point over d1.2-ultra. Context jumps 8x to 128k, with image input on both models. groundhog-1 runs about 4B active params at $0.035 per 1M tokens. Soft-label training helps push bison-1’s Brier score to 0.14. Check out the launch post, the bison-1 and groundhog-1 model cards, and the Baseten docs. You can check the deployment options and specs here through our GPULeaderboard.com chrome extension. Also, feel free to follow us on Twitter and don’t forget to join our 150k+ML SubReddit and Subscribe to our Newsletter. Wait! are you on telegram? now you can join us on telegram as well. Need to partner with us for promoting your GitHub Repo OR Hugging Face Page OR Product Release OR Webinar etc.? Connect with us The post Baseten Releases Bison-1 and Groundhog-1, Topping Decision Model Index appeared first on MarkTechPost.
OpenAI has significantly strengthened safeguards against extracting internal reasoning from GPT-6.2 Astra and GPT-6.2 Sol. In adaptive red-teaming tests, the success rate for extracting protected reasoning fell from 54 percent to 0.2 percent. The company is also suspending thousands to tens of thousands of accounts each week over coordinated distillation campaigns. The article OpenAI makes it much harder for attackers to extract how its latest AI models think appeared first on The Decoder.