AI Coding Live News

LiteLLM Gateway Compromised in v1.107.0 Supply-Chain Attack: Emergency Rollback to 1.106.2 and Credential Rotation Issued

LiteLLM, a widely deployed unified proxy gateway powering millions of LLM and autonomous agent pipelines worldwide (including LangChain and OpenHands), suffered a critical supply-chain compromise. Attackers breached its automated CI/CD release pipeline, pushing a poisoned v1.107.0 release to PyPI and Docker Hub tags ('latest' and 'main-stable') equipped with a credential-harvesting payload targeting system environment variables and cloud API keys. Coordinated with security firms including SlowMist, the maintainers quickly contained the incident, yanked v1.107.0, restored PyPI to 1.106.2, and urged all operators to pin dependency versions and rotate API credentials immediately.

LiteLLM Gateway Compromised in v1.107.0 Supply-Chain Attack: Emergency Rollback to 1.106.2 and Credential Rotation Issued

Key Takeaways

  • LiteLLM release pipeline compromised, publishing trojanized v1.107.0 packages across PyPI and Docker Hub tags
  • Payload secretly exfiltrated host environment variables, harvesting model API keys, database credentials, and cloud secrets
  • Maintainers yanked the malicious package within hours, rolling PyPI and official Docker containers back to stable 1.106.2
  • Urges all agent and LLM platform operators to verify pinned package versions and execute immediate credential rotation
Read full story

ScaleDown ships Constrained Decoding Models: 1M-token task models for summarize, compress, extract and classify, with LangChain Deep Agents middleware

On Oct 13 ScaleDown launched Constrained Decoding Models (CDMs): each model is trained for a single task and only returns answers that task allows (a label or spans of the input) instead of free-form token-by-token generation. LangChain shipped a langchain-scaledown integration and LangSmith LLM Gateway support the same day, with middleware for history summarization, tool-result compression and structured extraction. ScaleDown claims 200x faster and 467x cheaper than frontier models on these narrow tasks; Extract and Summarize are on OpenRouter at $0.04 per million input tokens.

ScaleDown ships Constrained Decoding Models: 1M-token task models for summarize, compress, extract and classify, with LangChain Deep Agents middleware

Key Takeaways

  • Four single-task models (Summarize, Compress, Extract, Classify), each taking up to 1M input tokens; Extract, Summarize and Classify accept images and scanned PDFs
  • Vendor-reported: vs the average of GPT-5.5, GPT-5.4 Mini and GPT-5.4 Nano, Summarize is 41x cheaper and 2.7x faster, Compress 138x cheaper and 1.8x faster, both with higher accuracy
  • Classify vs Jev: Jev is text-only with 32K tokens of state per question; Classify takes 1M tokens plus images and adds a one-sentence reason per decision
  • LangChain's trace example compresses a docs page from 18,402 to 3,110 characters; if a ScaleDown call fails the middleware leaves history untouched and the agent keeps running
  • On OpenRouter, Extract and Summarize cost $0.04/M input tokens with 1M context; Summarize caps output at 4,000 tokens and neither supports tools or response_format
Read full story
Linked Models & Agents:
⚡ ScaleDown Classify-1⚡ ScaleDown Extract⚡ ScaleDown Summarize⚡ ScaleDown Compress🤖 LangChain Deep Agents🌐 ScaleDown🌐 LangChain🌐 OpenRouter
L
LangChain@langchain-ai·
👀44
🔥88

LangSmith SDK 0.14.2: Python ls.address agent handle, JS OTel tool fields, primary replica keeps original run ids

LangSmith SDK v0.14.2 (2026-09-30): Python ls.address (#3581), JS OTel tool fields (#3592), primary replica keeps original run ids (#3623).

LangSmith SDK 0.14.2: Python ls.address agent handle, JS OTel tool fields, primary replica keeps original run ids

Key Takeaways

  • Release v0.14.2 at 2026-09-30T14:41:07Z; PyPI langsmith 0.14.2
  • Python ls.address agent addressing (#3581)
  • JS OTel tool name/call_id/definitions (#3592)
  • Only primary write replica keeps original run ids (#3623)
  • Compare ahead_by 8; docs https://docs.smith.langchain.com/
Read full story
Linked Models & Agents:
L
LangChainlangchain-ai·
👀53
🔥90

LangChain OpenAI 1.6.7: AzureChatOpenAI auto-discovers AKS Workload Identity without hand-rolled token providers

LangChain shipped langchain-openai==1.6.7 on 2026-09-30: PR #40532 auto-discovers Azure Workload Identity for AzureChatOpenAI; optional azure-identity extra; explicit credentials still win.

LangChain OpenAI 1.6.7: AzureChatOpenAI auto-discovers AKS Workload Identity without hand-rolled token providers

Key Takeaways

Read full story
Linked Models & Agents:
⚡ GPT-6⚡ Azure OpenAI🌐 LangChain🌐 Microsoft Azure
ADSponsored
L
LangChainlangchain-ai·
👀61
🔥94

LangChain Anthropic 1.7.5 + Core 1.6.6: Claude Sonnet 5.5 compatibility, thinking/tool_choice guards

LangChain shipped langchain-anthropic==1.7.5 and langchain-core==1.6.6 on 2026-09-29, landing #40882: Claude Sonnet 5.5 model profile and capability discovery; reject unsupported forced tool_choice/thinking; allow mid-conversation system/tool changes; preserve computer-toolset namespaces, encrypted advisor blocks, and refusal details through streaming and replay. Invalid tool calls can fall back to unforced structured output or explicit method="json_schema".

LangChain Anthropic 1.7.5 + Core 1.6.6: Claude Sonnet 5.5 compatibility, thinking/tool_choice guards

Key Takeaways

  • Releases langchain-anthropic==1.7.5 + langchain-core==1.6.6
  • Core PR #40882 merged 2026-09-29T13:05Z
  • Validates thinking/tool_choice; mid-conversation system/tool changes; preserves streamed provider blocks
  • Forced tool-choice fallback or explicit method="json_schema"
  • Install: pip install -U "langchain-anthropic==1.7.5" "langchain-core==1.6.6"; docs Anthropic provider
Read full story

LangChain 1.4.3: Bedrock Mantle in init_chat_model, GPT-6 structured-output recognition, create_agent repairs invalid tool calls

LangChain shipped langchain==1.4.3 on 2026-09-28 (on PyPI): init_chat_model supports AWS Bedrock Mantle chat models via langchain-aws Mantle interfaces; recognizes GPT-6 structured output without profiles; create_agent emits error ToolMessages for invalid tool calls missing results on replay; sanitizes cache settings for fallback models. Key PRs: #40837, #40844, #40530, #40886 vs 1.4.2.

LangChain 1.4.3: Bedrock Mantle in init_chat_model, GPT-6 structured-output recognition, create_agent repairs invalid tool calls

Key Takeaways

  • langchain==1.4.3 on PyPI (2026-09-28)
  • init_chat_model + Bedrock Mantle (#40837) via langchain-aws Mantle chat wrappers
  • GPT-6 structured output recognized without profiles (#40844)
  • create_agent repairs invalid tool calls with error ToolMessages (#40530); sanitize fallback cache settings (#40886)
Read full story
Linked Models & Agents:

LangChain4j 1.20.2: A2A client tenant propagation—auto-attach tenant on messages without exposing it as an LLM tool arg

LangChain4j 1.20.2 (2026-09-28) focuses on Agent-to-Agent (A2A) client fixes: tenant() on A2AClientInstance/A2AClientBuilder, @A2AClientAgent(tenant=…) auto-attaches tenant on every MessageSendParams (or parses it from /.well-known/{tenant}/agent-card.json), and filters tenant method args so they are not exposed as LLM tool parameters. AgenticScope/ResultWithAgenticScope toString guards against circular refs.

LangChain4j 1.20.2: A2A client tenant propagation—auto-attach tenant on messages without exposing it as an LLM tool arg

Key Takeaways

  • Shipped 1.20.2 — A2A tenant auto-propagation via annotation/builder or Agent Card URL
  • Tenant args filtered from LLM tool surface; attached on MessageSendParams
  • AgenticScope toString circular-ref guard
  • Docs: a2a-protocol.org + docs.langchain4j.info/tutorials/agents
Read full story

LangSmith SDK 0.14.1: address runs/feedback by agent, sandbox delegated login, Claude SDK + OTel trace fields

LangChain shipped LangSmith Python SDK 0.14.1 on 2026-09-25 (rolling in 0.14.0): address runs and feedback by agent rather than only by project; sandboxes can receive delegated LangSmith access and login service URLs (JS too); ClaudeSDKClient.receive_messages() is traced with stop_reason plus tool/response IDs; OTel exports add tool_call_id, tool_definitions, and finish_reasons. JS package moves to 0.10.5.

LangSmith SDK 0.14.1: address runs/feedback by agent, sandbox delegated login, Claude SDK + OTel trace fields

Key Takeaways

  • Shipped: Python 0.14.1 / JS 0.10.5 — pip install -U langsmith
  • Address runs and feedback by agent, not only by project
  • Sandboxes get delegated LangSmith access + login/service URLs
  • ClaudeSDKClient.receive_messages() traced with stop_reason and tool/response IDs
  • OTel exports tool_call_id, tool_definitions, finish_reasons; list_runs can return s3_urls attachments
Read full story

LangGraph CLI 0.4.32 Released: Native Listener for Self-Hosted Deployments & Agent ID Env Parameterization

LangChain's multi-agent runtime framework LangGraph shipped CLI version 0.4.32, substantially expanding self-hosted infrastructure capabilities. The update introduces native listener integration for self-hosted deployments via the langgraph deploy command, featuring a dedicated --image-uri flag to deploy custom containerized agent instances into private infrastructure. In multi-agent environments, the CLI refines command routing by supporting typed agent_id flags and environment variable fallbacks, streamlining complex agent topology management. The release also remediates AnyIO dependency vulnerabilities across example lockfiles to fortify enterprise production deployments.

LangGraph CLI 0.4.32 Released: Native Listener for Self-Hosted Deployments & Agent ID Env Parameterization

Key Takeaways

  • Custom container deployments: introduces native --image-uri flag in langgraph deploy for private registry image integration
  • Network listener abstraction: places self-hosted deployments on dedicated network listeners for partitioned enterprise environments
  • Agent ID routing: supports dynamic agent_id mapping with environment variable fallbacks for modular multi-agent orchestration
  • Dependency security patching: remediates vulnerabilities across AnyIO packages in CLI lockfiles for hardened container images
  • Codebase quality improvements: enforces strict RUF100 linting and PLC0415 import checks to guarantee runtime reliability
Read full story

LangChain.js @langchain/openai 1.6.0: explicit prompt cache options + content-block breakpoints

LangChain.js shipped @langchain/[email protected] on 2026-09-27: ports explicit prompt-cache options across Chat Completions and Responses, preserves content-block breakpoints, and maps cache-write usage to cache_creation. A same-tag fix serializes promptCacheRetention: "in-memory" as API-legal "in_memory" and unifies precedence (per-call → modelKwargs → constructor); Chat Completions no longer drops modelKwargs.

LangChain.js @langchain/openai 1.6.0: explicit prompt cache options + content-block breakpoints

Key Takeaways

  • Shipped: @langchain/[email protected] / npm 1.6.0
  • Explicit prompt cache options + content-block breakpoints; cache-write → cache_creation (PR #11232)
  • Fix: serialize in-memory as in_memory; precedence per-call > modelKwargs > constructor (PR #11735)
  • Install: npm i @langchain/[email protected]
  • Follow-on: @langchain/[email protected] bumps this dependency the same day
Read full story
Linked Models & Agents:
ADSponsored
L
LangChain@langchain-ai·
👀71
🔥90

LangGraph.js SDK 1.12.0: useStream enqueue can use durable server-side run queues across reloads/sessions

LangGraph.js shipped @langchain/[email protected] on 2026-09-25 (with @langchain/[email protected] and Vue/Svelte twins). useStream's "enqueue" multitask strategy can set queue: "server" so queued runs hit backend Runs REST instead of an in-memory client queue—surviving reloads, visible across sessions, with server-side cancelQueued/clearQueue. Default remains queue: "local"; custom AgentServerAdapter transports are unsupported. For frontends that need durable, collaborative agent queues.

LangGraph.js SDK 1.12.0: useStream enqueue can use durable server-side run queues across reloads/sessions

Key Takeaways

  • Shipped: langgraph-sdk 1.12.0 + react/vue/svelte 1.2.0
  • Opt in with queue: "server" on useStream enqueue; local remains default
  • Backend must implement Runs REST create/list/cancel endpoints
  • Docs: useStream React howto + npm package
  • Not supported with custom AgentServerAdapter transports
Read full story

LangChain4j 1.20.1: solidifies non-blocking AI Services (CompletableFuture/Flow.Publisher), opt-in Jackson 3, MCP Supplier with params

LangChain4j 1.20.1 landed 2026-09-25 atop the 1.20.0 line. AI Services now choose sync, TokenStream, CompletableFuture/CompletionStage, or Flow.Publisher by return type; non-blocking reaches tools, memory, guardrails, and the retrieval graph (@Experimental). Opt-in langchain4j-jackson3 routes JSON through Jackson 3 with typed JsonRead/WriteException. 1.20.1 lets @McpClientSupplier methods also take supplier parameters for per-request MCP clients. Aimed at Quarkus/Vert.x/WebFlux teams needing concurrent agents.

LangChain4j 1.20.1: solidifies non-blocking AI Services (CompletableFuture/Flow.Publisher), opt-in Jackson 3, MCP Supplier with params

Key Takeaways

  • Shipped: 1.20.1 on Central; headline features from 1.20.0 non-blocking line
  • Pick CompletableFuture/Flow.Publisher return types; async tool defaults differ from sync
  • Docs: Non-blocking and Reactive tutorial
  • Opt-in langchain4j-jackson3 for Jackson 3 + typed JSON exceptions
  • 1.20.1: @McpClientSupplier methods may take supplier parameters
Read full story

LangChain & TypeSafe AI Release Jev: Deterministic Guardrail for Dangerous Tool Calls

LangChain and TypeSafe AI released Jev, a specialized system model designed to classify and guardrail dangerous tool calls. Jev intercepts raw shell commands, database drops, and cloud API triggers with deterministic type validation to prevent catastrophic AI agent errors.

Key Takeaways

  • Inserts a millisecond-level typed safety middleware between agents and OS kernels
  • Enforces deterministic policy checks for shell execution, SQL drops, and IAM tokens
  • Compatible out of the box with LangChain, LlamaIndex, and custom agent runtimes
Read full story
Linked Models & Agents:

LangChain folds MCP into the main package: pip install "langchain[mcp]" for FastMCP + elicitation

LangChain merged MCP into the main package: pip install "langchain[mcp]" exposes langchain.mcp on FastMCP with old+new spec negotiation, tool-list caching, and elicitation as LangGraph interrupts—no separate langchain-mcp-adapters install. Python ships today, TypeScript next; still beta.

Key Takeaways

  • Install: pip install "langchain[mcp]" — no separate langchain-mcp-adapters.
  • Features: FastMCP, spec negotiation, tool-list caching, elicitation as LangGraph interrupts.
  • Status: Python first, TypeScript next; still beta.
Read full story
Linked Models & Agents:

Fireworks: LangChain fine-tunes Qwen judges at up to 100x lower cost

Fireworks said partner LangChain generates billions of agent-trace tokens a day, making frontier closed judges too costly. Fine-tuning a Qwen base on Fireworks matched GPT-5.5 / Opus-level judging at up to about 100x lower cost, and Fireworks is pushing its Training API for similar workflows.

Key Takeaways

  • LangChain produces billions of agent-trace tokens daily; frontier closed judges are too expensive.
  • Qwen fine-tuned on Fireworks matched GPT-5.5 / Opus-level judging at up to ~100x lower cost.
  • Training API is positioned for builders to train similar low-cost judge/agent models.
Read full story
Linked Models & Agents: