Daily AI news, sourcedUpdates / Chips & infra
Updates Chips & infra · 115 items · newest issue first · page 5 of 6
AreaAllModelsAgents & codingApps & productsChips & infraResearchPricing & limitsBusiness & fundingPolicy & safetyOther
- Basalt inference engine runs Qwen3.8 Flash-Next at 665 tok/s on an RTX 5090 plus 5060 TiUnconfirmedr/LocalLLaMAOct 10Chips & infra
- Huawei pitches OceanStor M900 Context Memory Storage for long-context AI inference
- LlamAmpere update runs Qwen3.8 27B with 200K context and MTP on 12GB Ampere GPUsUnconfirmedr/LocalLLaMAOct 10Chips & infra
- Ai2 replaces its priority-based GPU scheduler with time budgets and fair-share allocation
- LoRA-over-GGUF recipe trains Qwen3.8-Flash-Next in 40 GiB VRAM without CPU offloadUnconfirmedr/LocalLLaMAOct 9Chips & infra
- LocalLLaMA shares Vulkan llama.cpp GPU benchmarks sorted by price/performanceUnconfirmedr/LocalLLaMAOct 9Chips & infra
- User clusters six mismatched devices to run a 120B model none could load aloneUnconfirmedr/LocalLLaMAOct 9Chips & infra
- Builder runs Qwen3.8-Flash-Next at 60–100 t/s decode on eight Radeon Pro V620s with a custom vLLM forkUnconfirmedr/LocalLLaMAOct 9Chips & infra
- RTX 5070 Ti user reports a multi-hour CUDA job ending in an NVRM GPU lock watchdog errorUnconfirmedr/LocalLLaMAOct 9Chips & infra
- TechCrunch Disrupt 2026 to feature Ambrosia Energy and Bloom Energy on AI infrastructure opportunity, per TechCrunchReportedTechCrunchOct 9Chips & infra
- TornadoVM and jitLLM claim about 90% of llama.cpp local NVIDIA performance by compiling Java to CUDAUnconfirmedr/LocalLLaMAOct 9Chips & infra
- audio.cpp update cuts Higgs Audio TTS peak VRAM by about 48% and speeds HTDemucs and PocketTTSUnconfirmedr/LocalLLaMAOct 9Chips & infra
- Ollama 0.40.1 proxies cloud usage and balance APIs and fixes Windows reads past 2GiB
- Google launches its first Project Suncatcher test satellite with four TPUs in orbit
- r/LocalLLaMA thread looks for a name for hardware-specific inference engines like Strata and ninfer
- r/LocalLLaMA shares report that Micron's NVHBM moves the memory controller into the base dieUnconfirmedr/LocalLLaMAOct 8Chips & infra
- Reddit user's llama.cpp fork runs Qwen3.8-Flash-Next on six 3090s with 8-10x faster prefillUnconfirmedr/LocalLLaMAOct 8Chips & infra
- Reddit user asks how to put a spare RTX 2060 to work inside a Framework Desktop Strix Halo buildUnconfirmedr/LocalLLaMAOct 7Chips & infra
- Reddit user with a $1,700-1,800 budget weighs adding a second RTX 5060 Ti or upgrading the motherboard for local AIUnconfirmedr/LocalLLaMAOct 7Chips & infra
- Reddit user with dual Radeon 7900 XTX cards weighs a PCIe 4.0 or 5.0 motherboard upgrade for tensor-parallel inferenceUnconfirmedr/LocalLLaMAOct 7Chips & infra