What Happened
Ollama v0.40.11 adds speech generation on macOS. Its command-line interface can play generated audio, and applications can stream it through the /v1/audio/speech endpoint. The release also adds the d3 family of vLLM Semantic Router decision models for classification, yes/no answers and probability scoring, in 2B, 4B, 9B and 27B sizes. No breaking change…
What Happened
Ollama 0.40.11 adds speech generation on macOS: the CLI can play replies as they are generated, and applications can stream speech through the OpenAI-compatible /v1/audio/speech endpoint. It also adds d3 decision models in 2B, 4B, 9B and 27B sizes for classification, yes/no answers and probability scoring. [1]
Ollama 0.40.9 extends Flint to Linux…
What Happened
Recent releases add local multimodal capabilities, broader generation pipelines, and several compatibility changes. The most consequential upgrade for existing applications is Diffusers 0.42.0; the Ollama 0.40.9–0.40.11 releases primarily add capabilities and fixes. [1] [2] [3] [6]
Diffusers 0.42.0: Adds FLUX.3 Image Klein, Bria Fibo 2.0, Kandinsky 6, Qwen-Image 2.1 modular pipelines, and other…
What Happened
Ollama v0.40.9 adds Phonon speech generation on Apple Silicon, including streamed playback and an OpenAI-compatible speech endpoint. It also adds the d3 decision-model family in 2B, 4B, 9B and 27B sizes, extends Flint support to Linux and Windows, and improves reporting for streamed-request failures and several tool-integration cases [1]. Phonon now uses GA…
What Happened
Ollama 0.40.7–0.40.9: Version 0.40.7 added the pplx-decider model, improved Responses conversations that switch between thinking and non-thinking models, fixed streaming tool-call ordering, and cancelled remote requests when clients disconnect. Version 0.40.8 brought the Flint coding model to Ollama on macOS. Its MLX work preserves tool JSON details needed for Flint prompts and adds…
What Happened
The clearest production-relevant changes are in LiteLLM. Patch release v1.104.4 restores Add Guardrail settings, team-scoped batch model access, Google request compatibility, and legacy token-count input precedence; it also backports token-count fixes. The v1.103.6, v1.105.2, and v1.106.1 notes describe patch releases and Docker image signing, but do not establish additional feature or breaking changes…
What Happened
Transformers v5.20.2 is a patch release with four notable fixes: it preserves input types during generation for multimodal models, corrects zero expert gradients in bfloat16 when expert parallelism uses ep_size < fsdp_size, fixes vision-language models that incorrectly declared text-only inputs, and avoids a host-to-device copy in eager_mask. The release notes do not identify…
What Happened
LiteLLM v1.106.0 is a stable release with broader provider support, updated model metadata and pricing, and changes to routing, retries, spend logging, rate limits, MCP behavior and guardrails. It also adds controls for encrypted secrets at rest, FIPS mode, pass-through deny lists and preventing LiteLLM keys from being forwarded to MCP servers. [2]…
What Happened
The v0.40.7 release notes report three changes in the v0.40.7-rc0 changelog: OpenAI Responses effort settings are allowed on non-thinking models, llama-server can infer the speculative-draft type, and the MLX backend adds PPLX Decider v1.2 support. The notes do not identify a breaking change. [1]
LiteLLM v1.103.5 backports fixes #46099 and #46109 to its…
What Happened
Four recent release entries affect model serving, agent events and application tooling:
Ollama v0.40.6: Fixes orphaned runners on Windows, adds GGUF q2_0 tensor and file types, and changes --ask question keys to identifiers. Its changelog also notes the launch of clef in Ollama’s cloud. [1]
langchain-core 1.6.12: Fixes propagation of extras on content-block-start…
What Happened
Transformers v5.20.0 adds seven models, broader quantized export support across Dynamo, ONNX, OpenVINO and ExecuTorch, and checkpoint portability across FSDP and tensor-parallel configurations. It also removes deprecated cache methods, raises the minimum kernels version to 0.17.2, changes LUKE/mLUKE entity-token handling, and moves image decoding to torchcodec. The release notes flag expert-parallel inference speed…
What Happened
Recent releases affect three parts of a typical AI application stack: model serving, agent orchestration, and the proxy that controls provider access. The most consequential changes are security and routing fixes in LiteLLM, decision-model support in Ollama, and narrower fixes in LangChain packages.
LiteLLM: Stable v1.105.1 backports two proxy fixes. Release candidate v1.106.0-rc.3…