Skip to content Skip to sidebar Skip to footer

How to Upgrade LiteLLM, Streamlit and Ollama Without Surprising Production Users

What Happened LiteLLM v1.106.0-dev.3 adds provider and model support, including Bedrock Mantle prompt-cache breakpoints, TwelveLabs Pegasus 1.5 inference profiles, MongoDB-key routing for VoyageAI, and Vertex AI inline-tools beta forwarding. Its proxy changes include workload identity federation configuration, MCP OAuth metadata and request translation, guardrail stream scopes, and rate-limit gauges. It also fixes fallback routing, batch…

Read More

Which AI Library Updates Matter for Production Apps: Gradio, LangChain and LiteLLM

What Happened Gradio 6.30.0: gr.Workflow gained an app view. “Run this node” now reuses current upstream results; Shift+click forces a full rerun. Fixes cover ImageEditor transparency, hidden Accordions, Chatbot custom tags and LaTeX rendering. Corresponding component packages were also released. [1][2][3][4][5][6][7] LangChain: Version 1.4.4 retries SummarizationMiddleware when its summary step exceeds context and raises the…

Read More

Which AI Library Updates Need Action Before Your Next Production Deployment?

What Happened The most consequential changes are in LiteLLM and two LangChain partner packages. LiteLLM’s 1.106.0-dev.1 build adds providers and integrations, a unified /v1/decisions endpoint, and controls for MCP, secrets, model limits and PII. It also changes failure behavior: proxy startup now fails if database or Prisma setup fails. This is a development release, not…

Read More

What Recent AI Library Releases Mean for Model Serving, Agents and Image Pipelines

What Happened Several releases change the capabilities and upgrade requirements of production AI stacks: Apple Silicon model serving: In v0.40.0, supported architectures use the MLX runtime by default on Apple Silicon. The supported list includes Qwen and Gemma models, decision models, and EmbeddingGemma 2. The accompanying MLX implementation accepts per-item media in /api/embed requests and…

Read More

How to Track AI Library Releases Without Mistaking Pre-Releases for Production Upgrades

What Happened Two release candidates, v0.40.0-rc4 and v0.40.0-rc5, include MLX-related changes. The rc4 notes report an MLX version bump and added unit-test scopes intended to reduce memory use [2]. The rc5 notes describe a fix to a patch following a recent MLX update, tracked as #18812, but give no implementation details [1]. The notes do…

Read More

What New Ollama and LiteLLM Releases Mean for Production AI Deployments

What Happened Ollama v0.40.0 runs models with MLX-supported architectures on MLX by default on Apple Silicon. The supported list includes qwen3.8, gemma4, qwen3.6 and qwen3.5, alongside several decision models. Its release candidate also refined MLX tokenization to match publisher behavior, covering Unicode boundaries, added tokens and BPE merges. The published changelog spans v0.34.4 through the…

Read More

What LiteLLM’s Latest Releases Mean for Secure AI Gateways and Upgrade Planning

What Happened LiteLLM 1.103.3 makes the proxy migration check mandatory by default and prevents migration checks from creating hand-built SpendLogs indexes. It also updates dependencies, bumps litellm-proxy-extras to 0.4.100.post1, and backports fixes. Its Docker image is signed with cosign; LiteLLM recommends verifying it with the public key from immutable commit 0112e53046018d726492c814b3644b7d376029d0 [1]. LiteLLM 1.104.0 adds…

Read More

Which AI Library Updates Need Action Before Your Next Production Release?

What Happened Several releases affect application behavior, model serving, and gateway operations. Streamlit 1.65.0 adds on_change="ignore" to several widgets, broader alt-text support, required inputs, URL-bound tabs and expanders, and side-drawer dialogs. It also fixes browser navigation state, forms, dates, and widget behavior. The changelog covers changes since 1.64.0 [1]. Ollama 0.35.1 supports Clef decision models…

Read More

How to Track AI Library Releases Without Breaking Production Applications

What Happened LiteLLM v1.103.2 backports proxy and Anthropic fixes to its stable branch. LiteLLM v1.101.4 syncs its stable branch to v1.101.3 and backports three changes; the release notes do not identify those changes. Both releases state that LiteLLM Docker images are signed with cosign and recommend verifying against a public key pinned to commit 0112e53046018d726492c814b3644b7d376029d0,…

Read More

Track New AI/ML Library Releases Without Breaking Production: a Practical, Risk‑Averse Playbook

What Happened Major model/runtime release (5.18.0) — Added new multimodal and diarization models (Nemotron3 Diarization, NemotronH Omni, HyperCLOVAX Vision V2, GTE embeddings), broad bug and tokenizer fixes, memory/offload and parallelism improvements (FSDP2, 2‑D device mesh, MoE GGUF support), hardware/kernel fixes (MPS/FP8, XPU kernels), and many CI/tooling updates [1]. …

Read More

GitHub Release Monitoring — September 28, 2026

Findings [1] 2026-09-29 v0.35.0 Decision models Ollama now supports decision models through /v1/systemone, based on TypeSafe’s Jev API. Decision models return choices, probabilities, and scores instead of text. Use them for tasks such as ticket triage, model routing, and content classification. Available models: Nimble from Bespoke Labs Tev1 from Together AI ollama pull nimble…

Read More

Engineering Founded & Customer Focused

KIMBODO LLC. © 2026. All Rights Reserved.