Skip to content Skip to footer

AI Library Upgrades: What to Test Before Updating LangChain and LiteLLM

What Happened

LangChain 1.5.0, langchain-core 1.8.0, and langchain-typesafe 0.1.0 now require Python 3.11 or newer. LangChain 1.5.0 requires langchain-core 1.8.0; Python 3.10 environments will continue to resolve older release lines. LangChain added model-router and auto-mode middleware, while langchain-core added decision models and langchain-typesafe introduced TypeSafeClassifier. ModelRouterMiddleware is marked beta. [5][6][7]

LiteLLM 1.109.0 expanded provider and Responses API support, routing controls, and cost tracking, but requires configuration review before upgrade. LiteLLM 1.109.1 and the 1.110.0-rc.2 release candidate backport a security change to their respective branches. LTS version 1.108.6 includes proxy security, budget-reset, and integration fixes; older maintained lines also received targeted backports. The available notes do not describe the security change’s impact, so its severity should not be inferred. [1][2][3][4][8]

The Streamlit nightly build 1.67.1.dev20261110 is identified only by version; its changes cannot be assessed from the available information. [12]

Why It Matters to Businesses

The Python requirement is a deployment boundary. A Python 3.10 image will not receive the new LangChain releases through normal dependency resolution. Teams need to choose between upgrading the runtime and intentionally pinning older library lines, rather than assuming a successful install includes the latest features or fixes. [5][6][7]

LiteLLM 1.109.0 can change production behavior even where APIs still start. Operators must convert string fallback targets to lists, replace disk caching, explicitly retain hard RPM enforcement if needed, adjust parameter handling for specified newer Gemini models, and deploy Lens separately. Changes to fallback, rate limiting, caching, or billing warrant workload-level tests before rollout. [8]

Kimbodo Engineering Perspective

We would separate these into two upgrade tracks: a runtime-and-dependency migration for LangChain, and a proxy configuration-and-security migration for LiteLLM. The LangChain router and decision-model features are useful candidates for controlled evaluation, not reasons by themselves to change a stable agent workflow. For LiteLLM, a security backport on the current supported branch may be a lower-risk first step than taking every 1.109.0 feature at once. [1][2][3][5][6][7][8]

Notable fixes deserve targeted tests: LiteLLM 1.106.8 corrected FLAC transcription cost tracking and changed per-second billing to use provider-reported usage; 1.103.11 and 1.104.9 improve large spend-log lookups, while 1.103.11 also improves multi-replica database startup. These matter most to teams exercising those paths. [9][10][11]

How We Would Implement It

  • Inventory and pin: Record Python versions, LangChain package constraints, LiteLLM branch and image, proxy configuration, and affected providers. Build a Python 3.11 test image before changing LangChain pins. [5][6][7]
  • Apply LiteLLM configuration changes: Migrate fallback targets and cache settings; set optional_pre_call_checks to include enforce_model_rate_limits where a hard RPM cap is required; handle Gemini parameters with drop_params: true or omit the specified fields; separate Lens deployment. [8]
  • Test representative traffic: Exercise streaming and mid-stream fallback, tool calls, MCP permissions, transcription billing, budget resets, and per-user spend reporting. Compare routing outcomes and cost records against the current deployment before promoting the image. [3][8][9]
  • Verify and release: Verify LiteLLM container signatures with cosign against the public key pinned to commit e82a3c646908ba0a6ee0beddc4310d7a6cac4065, including any alternate image variants in use. Roll out gradually with rollback-ready image and configuration pins. [1][2][3][8]

Risks, Costs and Security

The main costs are Python 3.11 compatibility work, proxy configuration changes, and regression testing across providers. Incorrect rate-limit or billing behavior can create direct spend exposure; incomplete fallback or streaming tests can surface as customer-facing failures. LiteLLM’s security backports and signed images support a safer upgrade path, but signature verification establishes image provenance, not application correctness. Avoid promoting the Streamlit nightly on the basis of its version number alone. [1][2][3][8][9][12]

Where Kimbodo Comes In

Kimbodo builds and operates this in production for businesses — see our AI Application Development practice, or Estimate My AI Application.

Sources

  1. [1] v1.110.0-rc.2
  2. [2] v1.109.1
  3. [3] v1.108.6
  4. [4] v1.106.9
  5. [5] langchain-typesafe==0.1.0
  6. [6] langchain==1.5.0
  7. [7] langchain-core==1.8.0
  8. [8] v1.109.0
  9. [9] v1.106.8
  10. [10] v1.104.9
  11. [11] v1.103.11
  12. [12] 1.67.1.dev20261110

Leave a comment

0.0/5

Engineering Founded & Customer Focused

KIMBODO LLC. © 2026. All Rights Reserved.