What Happened
llama.cpp 0.9.0 and ggml 0.29.0 broaden GGUF support to models including Mistral Large 4, Clover-35B-A3B-Preview and NVFP4 LFM3, while improving Gemma 4 and Qwen3-VL support. The release also adds audio paths for Chatterbox TTS, Nemotron 3.5 Transcribe and Pocket TTS voices. These are compatibility and inference updates, not announcements of new model weights.…
What Happened
Recent open-model activity is concentrated in inference tooling rather than a single headline model release. SGLang 0.5.23 adds support for models including Muse Spark Open, MiniMax-M3.1-Flash and MiniCPM-V 4.7, alongside new image and video models. It also expands distributed serving, caching, quantized MoE and accelerator support. Its release notes report workload-specific gains, including…
What Happened
Recent llama.cpp changes focus on inference backends and reliability rather than a new model-weight release. They include a fix for an imatrix crash with --nextn, Apple-platform memory-allocation changes with a host-buffer release test enabled by default, and host-buffer sharing for IBM zDNN [1][3][4]. Vulkan gained a tensor-parallel all-reduce implementation; on the reported RTX…
What Happened
The substantiated developments are in llama.cpp tooling, not new open-weight model releases. Recent changes add initial OpenCL support for the iq3_s and iq3_xxs quantization formats, including Adreno-specific execution paths [3]. Other changes fix Hexagon DMA addressing for strides of 16 MB or more, correct InternVL CLS-token ordering, enable tensor splitting for LFM3, and…
What Happened
The developments documented here are primarily llama.cpp inference-engine changes, not new open-weight model releases. They include a fix for shared decision prefixes that preserves output embeddings when tasks share option tokens [2], support for extra_params on the /v1/responses endpoint [3], revised Gemma 4 image resizing without letterbox padding [4], and handling of think…
What Happened
Recent llama.cpp changes focus on deployment reliability and model support rather than a new model release. A Gemma 3n and Gemma 4 loading change avoids retaining a tied embedding table twice when the input and output share a buffer type. In one CPU-only, non-mmap test of a quantized Gemma 4 model, reported model-buffer…
What Happened
The developments in these notes are primarily llama.cpp inference-engine changes, not new model-weight releases. They extend or optimize execution across several hardware backends:
Metal changes target faster MXFP4 matrix–vector operations and reduce threadgroup bottlenecks in decode-related operations; a separate fix addresses unary-kernel compilation on older toolchains. [1][5]
Hexagon gains UPSCALE support relevant to…
What Happened
A v0.8.0 release expanded support for model families including LiquidAI LFM3, DeepSeek V4.1 Flash, MiniCPM-OCR, and several audio, embedding, and decision models. It also added Hugging Face Hub discovery and downloads, experimental streaming audio, realtime conversation and transcription, a text-to-speech endpoint, and improvements to tool calling and router memory management [8]. The notes…
What Happened
Recent llama.cpp changes focus on serving and backend reliability rather than a new open-weight model release. The server adds --models-memory-max to unload models when loading another would exceed a per-device memory margin. It estimates memory in a measurement subprocess and avoids repeatedly retrying queued loads that cannot fit [6].
Backend work adds a…
What Happened
The developments in these notes are concentrated in llama.cpp and its ggml backends. They document inference and deployment tooling changes, not a new open-weight model release. There is no substantive update here to attribute to Ollama, vLLM, SGLang, EleutherAI, or LAION.
SYCL tensor-split loading now batches contiguous rows into pinned staging slots, with…
What Happened
Recent llama.cpp builds focus on reliability, model compatibility and targeted acceleration rather than a new model release. Fixes address truncated GGUF data during merge, dropped slices in 4D tensor quantization, excessive CPU and memory use in a sampling path, and grammar recursion that could overflow the stack. Qwen conversion and memory-cache behavior also…
What Happened
The developments documented here concern llama.cpp and ggml inference tooling, not a verified release of new model weights. A fix passes quantization scales into three feed-forward call sites for MiniMax M3.1 Flash; without them, routed-expert weights could overwhelm the residual and produce garbled output [3]. Related changes simplify mixture-of-experts (MoE) rescaling and block…