What Happened
Recent llama.cpp changes focus on inference correctness, hardware coverage and API maintenance—not a new open-weight model release. Fixes address an Nvidia Vulkan flash-attention shared-memory overflow, WebGPU attention masks with multiple heads, an AMD matrix-operation abort on odd-width inputs, and 32-bit Vulkan compilation. HIP support was added for RDNA1 gfx1013, while a GDN MMA…
What Happened
Recent llama.cpp builds broaden model and modality support. They add MiniMax-M3.1 support, an audio-generation pipeline for zonos3-mini with voice cloning, and speech-to-text support for Higgs v3 and VibeVoice-ASR [7][3][1]. A Qwen3-VL loader change also enables Qwen3-ForcedAligner by reading its 5,000-class timestamp output head from the model tensor rather than assuming it matches vocabulary…
What Happened
The documented activity centers on llama.cpp rather than new model weights. Recent changes fix incorrect Qwen2-VL NVFP4 scaling that could produce unusable output, add IQ2_XXS and NVFP4 support to the Hexagon backend, and separate DFlash-family speculative-decoding implementations into distinct draft types [3][11][10]. Other fixes address video orientation, audio padding, chat-template behavior, and backend…
What Happened
llama.cpp and ggml reached 1.0.0, removing deprecated APIs and moving the NextN/speculative API into the public llama.h interface. The release adds support for several language, vision and speech models, alongside FP8 KV caches, a configurable host-memory MoE expert cache and external PLE shard loading. Its server adds an OpenAI-compatible speech endpoint and improves…
What Happened
Recent llama.cpp and ggml changes focus on inference correctness and platform support rather than new model weights. A backend fix prevents prefetching tensors before an earlier split’s copy callback updates them; it also avoids using a mixture-of-experts cache when its device cannot execute the cached operation [8]. Other changes address incorrect output from…
What Happened
The developments in these notes are concentrated in llama.cpp inference tooling, not new model weights. There is no substantiated new weight release or material update from Hugging Face, Ollama, vLLM, SGLang, EleutherAI or LAION to report.
llama.cpp added OCP FP8 support for CUDA, including KV-cache handling and optimized matrix operations. A reported test…
What Happened
The developments in these notes are llama.cpp engineering changes, not new open-weight model releases. They improve structured output, backend correctness, failure handling, and performance across selected inference paths.
JSON Schema generation now handles allOf with plain types such as integer, instead of producing an empty-object grammar. Tool-call argument normalization also escapes control characters…
What Happened
Recent llama.cpp and ggml work concentrates on model loading, compatibility, correctness and safety—not a newly announced open-weight model. A proposed loader change accepts external PLE files as additional shards and allows them to override tensors; another change passes NVFP4 weight scales through Granite feed-forward networks [1][7].
The server now applies a JSON schema…
What Happened
The documented activity is concentrated in llama.cpp and ggml inference tooling, not new open-weight model launches. The notes contain no verified model-weight release or substantive update from Hugging Face, Ollama, vLLM, SGLang, EleutherAI, or LAION.
A CUDA path for Zamba2-style state-space scans raised reported Zamba2-7B-Instruct throughput from 11 to 15.1 tokens per second…
What Happened
The developments in these notes are concentrated in llama.cpp, rather than new open-weight model releases. A Mixture-of-Experts (MoE) cache change adds an option to run a share of cache-miss experts on the CPU while device work continues. A tuning script estimates cache size and CPU share from measured upload and CPU speeds, then…
What Happened
The developments documented here are primarily llama.cpp inference-engine changes, not new open-weight model releases. They expand hardware support and address operational faults across its CPU, GPU, and NPU backends. Hexagon gained a 3D convolution path that reuses its tiled 2D implementation; OpenCL gained additional data types for the repeat operation; and WebGPU gained…
What Happened
Recent llama.cpp changes focus on inference compatibility and correctness, not a new open-weight model release. A Qwen2 fix passes NVFP4 scales into the feed-forward network; previously, converted models could load those scales but fail to apply them, leading to a sampler assertion. Other changes tune GEMV defaults for Adreno X2 and X2E, re-enable…