Bookmarks

    Nothing saved yet. Use the bookmark on any article. Bookmarks are kept on this device only: they stay private and work without an account.

    Settings

    Appearance

    Reading mode

    Font size

    Content width

    Line spacing

    Keyboard shortcuts

    /
    Search
    j k
    Next / previous story
    ← →
    Previous / next section (columns)
    b
    Bookmarks
    s
    Settings
    r
    Columns / scroll
    t
    Light / dark

    Saved in this browser only.

    Ping2Prompt
    Subscribe to the Weekly Brief Sign in
    A glowing wireframe network of interconnected nodes floats above a metallic pedestal on a purple grid surface.
    Photo by Growtika on Unsplash

    LiteLLM v1.108.9 backports Bedrock, Azure and Vertex AI fixes to LTS

    LiteLLM

    What changed

    LiteLLM v1.108.9 is a backport release on the lts/1.108.x branch. It bumps the version to 1.108.9 and adds fixes and features for Responses, Bedrock, Azure AI, Vertex AI and Vercel AI Gateway.

    A separate release, v1.106.10, stops Google MCP servers from asking users to sign in again when the access token expires.

    What it does

    • Responses: keeps mixed reasoning and answer output, and adds cache_control breakpoints on the chat-to-Responses bridge.
    • Bedrock: supports s3:// media sources in Converse and maps OpenAI vector store search filters.
    • Azure AI: sends reasoning_effort to Foundry Kimi K3 and keeps its reasoning_content.
    • Azure: adds Foundry project and resource /openai/v1 Responses bases.
    • Vertex AI: adds caller identity labels to Vertex requests.
    • Decisions: adds Vercel AI Gateway decision models.

    What is verified

    Every item above comes from BerriAI's own release notes, which cite pull requests such as #50401 and #51748. The v1.106.10 notes say "No action needed to upgrade".

    Running it

    The image is ghcr.io/berriai/litellm:v1.108.9, signed with cosign using the key introduced in commit e82a3c6. To verify it, run cosign verify --key against cosign.pub at the pinned commit e82a3c646908ba0a6ee0beddc4310d7a6cac4065, which is the recommended route, or at the v1.108.9 tag. The commands come from the documentation listed under Sources; check them against the version you run before using them. The v1.106.10 images verify the same way, and the same command applies to the litellm-database, litellm-non_root and docker.io/litellm/* images.

    What it means for you

    If you run the LTS branch and use any of these providers, read the list against your setup before you upgrade. Verify the image signature first, then roll it out as you would any proxy update. If your users keep getting signed out of Google MCP servers, the separate fix is the one to look at.

    What the sources don't cover

    The sources give no release date, licence, price or hardware requirements, and no upgrade notes for this release. They do not explain what the Vertex AI caller identity labels or the Vercel AI Gateway decision models do. No independent evaluation exists yet.

    Sources

    Image: Photo by Growtika on Unsplash


    This story was produced with AI assistance from the sources listed above and fact-checked against them before publication. Read our editorial methodology and the corrections log. Spotted an error? Email [email protected].

    Continue

    Share on Bluesky · Mastodon · Email ·

    Discussion