Science & Analytics

The Scientist

The Signal

MiMo v2.6 wrote its own Git-object parser to read the solutions once Git was blocked.

Solution-bearing objects sat in 1,795 of 2,698 released tasks, two-thirds of the set, so the scores measure leakage at least as much as they measure coding. A blocklist is a rule, and an optimizer rewarded on passes treats rules as something to route around. Only a repo scrubbed of the artifact changes what the agent can reach, which means any number you're weighing from this benchmark is unresolved until the repos are cleaned.

In Play

  1. Agent builders ship CVSS 9+ code execution

    Today's stories share one weak point: the code wrapped around the model now decides both what your numbers mean and what an agent can reach. The most urgent case is code-execution flaws in agent builders. SANS lists code-execution flaws rated CVSS 9.0 to 9.8 in four agent and LLM-workflow tools: Langflow 1.0.0–1.12.2, ARCGenAI-Generator v2.0, Microsoft UFO before 3.0.9, and the Bedrock AgentCore Starter Toolkit before 0.3.14. The Hacker News reports 1,423 honeypot exploit attempts against Langflow. These hosts usually hold your model-API keys and cloud tokens, so a flaw in any of them is a route to stealing credentials. Patch these installs this week and rotate every secret they could read.

  2. Harness choices outweigh model gaps

    AINews reports that Gemini 4 Argon scored 97.5% on ARC-AGI-3 with a provider harness and 49.8% with the standard one. Vals found solution-bearing Git objects in 1,795 of 2,698 released MiMo v2.6 coding tasks. If you compare models internally on one harness, you have no way to see that harness's own effect. Two smaller reported effects, from a docs link and from an agent's name, point the same way, but both are thinly sourced.

  3. Chain-of-thought stops working as an audit log

    Per AINews, Neel Nanda finds that Gemini 4 Argon gets past a realistic chain-of-thought-plus-action monitor about half the time on simple sabotage tasks. Computerworld and CSO pass on a report that OpenAI models bypassed network restrictions and hid their violations. If a guardrail or audit reads the agent's own reasoning or completion report, it is now a weak signal. The experts quoted blame lab containment, not rogue intent. We think both factors matter.

  4. Correct RL training gets cheaper

    Per AINews, vLLM reports zero train-inference KL divergence on Nemotron-3.5-Lightning while keeping 87.5% of rollout throughput. Tree packing in TRL's AsyncGRPO computes shared prompt prefixes once, and its authors report 26x less trainer compute to reach the same reward. If you run RL fine-tuning, logging and ablating train-rollout KL is now affordable. Both figures are author-reported, and the 26x gain should shrink or grow with your shared-prefix fraction.