Skip to content Skip to sidebar Skip to footer

Ollama Adds Streaming Speech and Decision Models; LiteLLM Fixes Proxy Startup Failures

What Happened Ollama v0.40.11 adds speech generation on macOS. Its command-line interface can play generated audio, and applications can stream it through the /v1/audio/speech endpoint. The release also adds the d3 family of vLLM Semantic Router decision models for classification, yes/no answers and probability scoring, in 2B, 4B, 9B and 27B sizes. No breaking change…

Read More

Ollama and LiteLLM Updates: What to Test Before Upgrading Production AI Apps

What Happened Ollama 0.40.11 adds speech generation on macOS: the CLI can play replies as they are generated, and applications can stream speech through the OpenAI-compatible /v1/audio/speech endpoint. It also adds d3 decision models in 2B, 4B, 9B and 27B sizes for classification, yes/no answers and probability scoring. [1] Ollama 0.40.9 extends Flint to Linux…

Read More

Illustration for the Kimbodo News & Research briefing “AI Library Releases: What to Upgrade, Test, and Pin Before Production” (GitHub Release Monitoring).

AI Library Releases: What to Upgrade, Test, and Pin Before Production

What Happened Recent releases add local multimodal capabilities, broader generation pipelines, and several compatibility changes. The most consequential upgrade for existing applications is Diffusers 0.42.0; the Ollama 0.40.9–0.40.11 releases primarily add capabilities and fixes. [1] [2] [3] [6] Diffusers 0.42.0: Adds FLUX.3 Image Klein, Bria Fibo 2.0, Kandinsky 6, Qwen-Image 2.1 modular pipelines, and other…

Read More

AI Library Updates: What to Test Before Upgrading Ollama and LangChain

What Happened Ollama v0.40.9 adds Phonon speech generation on Apple Silicon, including streamed playback and an OpenAI-compatible speech endpoint. It also adds the d3 decision-model family in 2B, 4B, 9B and 27B sizes, extends Flint support to Linux and Windows, and improves reporting for streamed-request failures and several tool-integration cases [1]. Phonon now uses GA…

Read More

Which AI Library Updates Need Action: Tool Streams, Model Support and Gateway Fixes

What Happened Ollama 0.40.7–0.40.9: Version 0.40.7 added the pplx-decider model, improved Responses conversations that switch between thinking and non-thinking models, fixed streaming tool-call ordering, and cancelled remote requests when clients disconnect. Version 0.40.8 brought the Flint coding model to Ollama on macOS. Its MLX work preserves tool JSON details needed for Flint prompts and adds…

Read More

Which AI Library Updates Need Action: LiteLLM Security Fixes, Packaging Changes, and Release Gaps

What Happened The clearest production-relevant changes are in LiteLLM. Patch release v1.104.4 restores Add Guardrail settings, team-scoped batch model access, Google request compatibility, and legacy token-count input precedence; it also backports token-count fixes. The v1.103.6, v1.105.2, and v1.106.1 notes describe patch releases and Docker image signing, but do not establish additional feature or breaking changes…

Read More

What the Latest Transformers Patch Means for Multimodal AI and Model Training

What Happened Transformers v5.20.2 is a patch release with four notable fixes: it preserves input types during generation for multimodal models, corrects zero expert gradients in bfloat16 when expert parallelism uses ep_size < fsdp_size, fixes vision-language models that incorrectly declared text-only inputs, and avoids a host-to-device copy in eager_mask. The release notes do not identify…

Read More

What LiteLLM’s Latest Releases Mean for Safer AI Gateways

What Happened LiteLLM v1.106.0 is a stable release with broader provider support, updated model metadata and pricing, and changes to routing, retries, spend logging, rate limits, MCP behavior and guardrails. It also adds controls for encrypted secrets at rest, FIPS mode, pass-through deny lists and preventing LiteLLM keys from being forwarded to MCP servers. [2]…

Read More

How to Upgrade AI Libraries Without Breaking Model Serving or Gateway Security

What Happened The v0.40.7 release notes report three changes in the v0.40.7-rc0 changelog: OpenAI Responses effort settings are allowed on non-thinking models, llama-server can infer the speculative-draft type, and the MLX backend adds PPLX Decider v1.2 support. The notes do not identify a breaking change. [1] LiteLLM v1.103.5 backports fixes #46099 and #46109 to its…

Read More

Which AI Library Updates Need Testing Before Your Next Production Deployment?

What Happened Four recent release entries affect model serving, agent events and application tooling: Ollama v0.40.6: Fixes orphaned runners on Windows, adds GGUF q2_0 tensor and file types, and changes --ask question keys to identifiers. Its changelog also notes the launch of clef in Ollama’s cloud. [1] langchain-core 1.6.12: Fixes propagation of extras on content-block-start…

Read More

Which AI Library Releases Need Regression Testing Before You Upgrade?

What Happened Transformers v5.20.0 adds seven models, broader quantized export support across Dynamo, ONNX, OpenVINO and ExecuTorch, and checkpoint portability across FSDP and tensor-parallel configurations. It also removes deprecated cache methods, raises the minimum kernels version to 0.17.2, changes LUKE/mLUKE entity-token handling, and moves image decoding to torchcodec. The release notes flag expert-parallel inference speed…

Read More

How to Upgrade AI Libraries Without Breaking Production Agents and Model Gateways

What Happened Recent releases affect three parts of a typical AI application stack: model serving, agent orchestration, and the proxy that controls provider access. The most consequential changes are security and routing fixes in LiteLLM, decision-model support in Ollama, and narrower fixes in LangChain packages. LiteLLM: Stable v1.105.1 backports two proxy fixes. Release candidate v1.106.0-rc.3…

Read More

Engineering Founded & Customer Focused

KIMBODO LLC. © 2026. All Rights Reserved.