Daily AI news, sourcedUpdates / Chips & infra
Chips & infra: 115 updates tracked, 38% Official.
115updates tracked
since Sep 28
since Sep 28
By label all items · click to see the list
Most-tracked products & models by Official + Reported items, 2+ only
Updates Chips & infra · 115 items · newest issue first · page 1 of 6
AreaAllModelsAgents & codingApps & productsChips & infraResearchPricing & limitsBusiness & fundingPolicy & safetyOther
- AMD releases GAIA 0.25, its local AI agent app for Ryzen AI PCs, with a larger default model and a much smaller install
- Meta details Prometheus, the gigawatt-scale Ohio supercluster that trained Muse Wonder at more than 85% goodputOfficialEngineering at MetaOct 20Chips & infra
- doubleAI says its Maxwell code execution model made LTX-2.5 generate 4K video nearly 2x faster
- Hugging Face libraries now run natively on AWS Trainium through TorchNeuron, which enters public beta Oct. 20
- Kapitsa, an open-source inference engine for Apple Silicon Macs from Nace.ai developers, supports only Qwen and Nemotron modelsOfficialKapitsa (GitHub)Oct 19Chips & infra
- SGLang 0.5.22 speeds up DeepSeek-V4.1 serving by up to 2.3x on H200, adds a 10x faster model loader and runs on Apple Silicon
- Sugon 8000, described as China's first fully domestic 100,000-card AI supercluster, is shown at a Shenzhen HPC conference, per IT HomeReportedIT Home (in Chinese)Oct 19Chips & infra
- llama-doctor, a new open CLI and live dashboard, reads a llama.cpp server's metrics and grades what is wrongUnconfirmedr/LocalLLaMAOct 19Chips & infra
- chatllm.cpp adds support for InternLM's Intern-Decision models, text only for nowUnconfirmedr/LocalLLaMAOct 19Chips & infra
- Basalt inference engine adds native NVFP4 support for Qwen3.8 Flash-Next on Blackwell GPUs, alongside faster prefill workUnconfirmedr/LocalLLaMAOct 18Chips & infra
- vLLM 0.32.0 adds a structured-decision endpoint, NVFP4 KV cache on more GPUs and makes Model Runner V2 the ROCm default
- Ollama v0.40.7-rc0 adds PPLX Decider v1.2 support to its MLX backend and lets Responses requests set effort on non-thinking models
- llama.cpp merges faster CUDA matrix-vector kernels for low-bit quantizations, speeding up Q2_K and Q3_K generation on older GPUs
- Ollama v0.40.6 adds the q2_0 GGUF tensor type and fixes orphaned runner processes on Windows
- Nvidia's Jeff Fisher says the GeForce RTX 5090 is not discontinued and will keep shipping, per ComputerBaseReportedComputerBaseOct 17Chips & infra
- 4Paradigm open-sources ModelSphere, a production LLM deployment platform that schedules across Chinese AI chips
- PaddlePaddle releases FlashMask as a standalone attention library for long-context training, with PyTorch support
- Intel LLM-Scaler-vLLM 1.5 moves to vLLM 0.26 and adds Qwen3.8, Gemma 4, FP8 and MTP support on Intel GPUs
- The Verge spends a week on Nvidia RTX Spark N1X Windows Arm laptops from Asus, HP, Lenovo and Surface, per The VergeReportedThe VergeOct 17Chips & infra
- Artificial Analysis posts first AA-AgentPerf results for NVIDIA Vera Rubin NVL72, up to ~5.7x GB300 throughput per MWOfficialArtificial AnalysisOct 16Chips & infra