Daily AI news, sourcedShowing the Oct 10 brief. Back to today ›
Google's AI Edge team open-sourced ML Drift, a high-performance on-device GPU compute engine for AI and ML inference, under the Apache 2.0 license. It abstracts hardware and low-level API differences across OpenGL ES, OpenCL, Metal and WebGPU so developers can build real-time ML features, from video effects to generative AI, across multiple platforms.
Postman and AWS described the architecture behind Postman's Agent Mode, which serves 40 million developers on Amazon Bedrock. The post covers controlling tool sprawl, exposing schema-based reads, and treating context as the main bottleneck when moving an AI agent from demo to production scale.
Ai2's AI infrastructure team says it replaced a priority-based scheduler for its clusters of thousands of NVIDIA H100, B200 and B300 GPUs with a system of GPU time budgets, hierarchical fair-share allocation and a time-slicing contract. With requests for two to three times more GPUs than it has, Ai2 says the change turned decisions about how much compute each research project gets into a transparent budgeting process while keeping clusters fully occupied.
Andreessen Horowitz partner Olivia Moore, who this week released a report on the top 100 consumer AI apps, told TechCrunch she sees a large opportunity in consumer AI if companies can earn money in ways other than subscriptions and token usage. Her report finds ChatGPT still far ahead, with smaller players such as Suno and ElevenLabs showing staying power, and lists about half a dozen consumer categories AI has not yet touched.
Instinct, a startup AI agent that launched in August invite-only with no marketing and became one of the most talked-about agents for its text-message interface and chores like booking DMV appointments, now faces similar agents Muse and Dots from far larger companies, The Verge reports. In the reviewer's testing, Instinct handled online tasks about as well as the two Big Tech rivals.
Recraft published the second part of its character-design series, showing how to turn a single hero image into a turnaround, an expression sheet and a pose sheet in Recraft Studio. The guide says a reference sheet keeps a character on-model across new images, avoiding the usual drift in haircut, clothing details and colors when an image model is asked for the same character from another angle.
A developer says their model Aplomb 1 ranks first on Typed Decisions, a Hugging Face benchmark that gives a model one piece of unstructured text and five typed questions about it at once. According to the post, Aplomb 1 has the best KL and Brier scores on the leaderboard, ahead of a 27B model, and the highest accuracy among models under 6B. The claims were not independently checked.
A user ran Mellum2.1-12B-A2.5B at Q8 locally with the Pi coding agent and llama-server on five one-shot tests. According to the post, results were mixed, with poor output on a pelican SVG, a browser OS and a Minecraft clone, though the model was described as surprisingly usable overall. The results were not independently checked.
A developer shared a 24KB self-contained HTML page that runs a tiny language model in the browser and generates consistent short stories from random seeds. According to the developer, it can exceed 60 tokens per second even on a smartphone, though story quality depends on lucky seed draws. The claims were not independently checked.
The maintainer of an open-source MCP server that began as a Reddit side project 18 months ago says it has grown into one of the most popular MCP servers and has just released v2. The project runs locally and is open, and the maintainer says they already struggle to keep up with pull requests and issues. The project was not named in the material available, and the claims were not independently checked.
A user says they ran Qwen3.8-Flash-Next-GSQ-RCO-Abliterated at IQ3_S on 12GB of VRAM and 32GB of system RAM with NVMe offload, reaching 20-30 tokens per second decode (39-45 at Q2) and up to about 90,000 tokens per second prefill at 131k context. The setup uses a heavily modified, experimental fork of Strata. The results were not independently checked.
Items older than 72 hours never go in Top stories and show their original date.