468 Index 9a1811fe

Name: 468 Index 9a1811fe
Author: tools-only

ASecurity

import Image from '@theme/IdealImage'; import Tabs from '@theme/Tabs'; import TabItem from '@theme/TabItem';

4 stars

0 votes

0 copies

0 views

Added 6/1/2026

ai-agentspythongofastapirailsdocker

Works with

cliapimcp

Security Analysis

A96/100

mediumInstalls packages at runtime which could introduce malicious dependencies

Scanned 6/1/2026

Install to Claude Code

$npx -y skills add tools-only/X-Skills --skill 468-index_9a1811fe --agent claude-code

Installs into .claude/skills of the current project.

Are you the author of 468 Index 9a1811fe?

Add the live security badge to your README — it updates automatically with every re-scan.

Security grade badge for 468 Index 9a1811fe

[![Security: A — Skills Directory](https://www.skillsdirectory.com/api/skills/tools-only-468-index-9a1811fe/badge)](https://www.skillsdirectory.com/skills/tools-only-468-index-9a1811fe)

More formats (shields.io, HTML) on the badges page.

Files

skill.md

---
title: "v1.79.1-stable - Guardrail Playground"
slug: "v1-79-1"
date: 2025-11-01T10:00:00
authors:
  - name: Krrish Dholakia
    title: CEO, LiteLLM
    url: https://www.linkedin.com/in/krish-d/
    image_url: https://pbs.twimg.com/profile_images/1298587542745358340/DZv3Oj-h_400x400.jpg
  - name: Ishaan Jaff
    title: CTO, LiteLLM
    url: https://www.linkedin.com/in/reffajnaahsi/
    image_url: https://pbs.twimg.com/profile_images/1613813310264340481/lz54oEiB_400x400.jpg
hide_table_of_contents: false
---

import Image from '@theme/IdealImage';
import Tabs from '@theme/Tabs';
import TabItem from '@theme/TabItem';

## Deploy this version

<Tabs>
<TabItem value="docker" label="Docker">

``` showLineNumbers title="docker run litellm"
docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
docker.litellm.ai/berriai/litellm:v1.79.1-stable
```

</TabItem>

<TabItem value="pip" label="Pip">

``` showLineNumbers title="pip install litellm"
pip install litellm==1.80.0
```

</TabItem>
</Tabs>

---

## Key Highlights

- **Container API Support** - End-to-end OpenAI Container API support with proxy integration, logging, and cost tracking
- **FAL AI Image Generation** - Native support for FAL AI image generation models with cost tracking
- **UI Enhancements** - Guardrail Playground, Cache Settings, Tag Routing, SSO Settings
- **Batch API Rate Limiting** - Input-based rate limits support for Batch API requests
- **Vector Store Expansion** - Milvus vector store support and Azure AI virtual indexes
- **Memory Leak Fixes** - Resolved issues accounting for 90% of memory leaks on Python SDK & AI Gateway

---

## Dependency Upgrades

- **Dependencies**
    - Build(deps): bump starlette from 0.47.2 to 0.49.1 - [PR #16027](https://github.com/BerriAI/litellm/pull/16027)
    - Build(deps): bump fastapi from 0.116.1 to 0.120.1 - [PR #16054](https://github.com/BerriAI/litellm/pull/16054)
    - Build(deps): bump hono from 4.9.7 to 4.10.3 in /litellm-js/spend-logs - [PR #15915](https://github.com/BerriAI/litellm/pull/15915)


## New Models / Updated Models

#### New Model Support

| Provider | Model | Context Window | Input ($/1M tokens) | Output ($/1M tokens) | Features |
| -------- | ----- | -------------- | ------------------- | -------------------- | -------- |
| Mistral | `mistral/codestral-embed` | 8K | $0.15 | - | Embeddings |
| Mistral | `mistral/codestral-embed-2505` | 8K | $0.15 | - | Embeddings |
| Gemini | `gemini/gemini-embedding-001` | 2K | $0.15 | - | Embeddings |
| FAL AI | `fal_ai/fal-ai/flux-pro/v1.1-ultra` | - | - | - | Image generation - $0.0398/image |
| FAL AI | `fal_ai/fal-ai/imagen4/preview` | - | - | - | Image generation - $0.0398/image |
| FAL AI | `fal_ai/fal-ai/recraft/v3/text-to-image` | - | - | - | Image generation - $0.0398/image |
| FAL AI | `fal_ai/fal-ai/stable-diffusion-v35-medium` | - | - | - | Image generation - $0.0398/image |
| FAL AI | `fal_ai/bria/text-to-image/3.2` | - | - | - | Image generation - $0.0398/image |
| OpenAI | `openai/sora-2-pro` | - | - | - | Video generation - $0.30/video/second |

#### Features

- **[Anthropic](../../docs/providers/anthropic)**
    - Extended Claude 3-7 Sonnet deprecation date from 2026-02-01 to 2026-02-19 - [PR #15976](https://github.com/BerriAI/litellm/pull/15976)
    - Extended Claude Opus 4-0 deprecation date from 2025-03-01 to 2026-05-01 - [PR #15976](https://github.com/BerriAI/litellm/pull/15976)
    - Removed Claude Haiku 3-5 deprecation date (previously 2025-03-01) - [PR #15976](https://github.com/BerriAI/litellm/pull/15976)
    - Added Claude Opus 4-1, Claude Opus 4-0 20250513, Claude Sonnet 4 20250514 deprecation dates - [PR #15976](https://github.com/BerriAI/litellm/pull/15976)
    - Added web search support for Claude Opus 4-1 - [PR #15976](https://github.com/BerriAI/litellm/pull/15976)

- **[Bedrock](../../docs/providers/bedrock)**
    - Fix empty assistant message handling in AWS Bedrock Converse API to prevent 400 Bad Request errors - [PR #15850](https://github.com/BerriAI/litellm/pull/15850)
    - Allow using ARNs when generating images via Bedrock - [PR #15789](https://github.com/BerriAI/litellm/pull/15789)
    - Add per model group header forwarding for Bedrock Invoke API - [PR #16042](https://github.com/BerriAI/litellm/pull/16042)
    - Preserve Bedrock inference profile IDs in health checks - [PR #15947](https://github.com/BerriAI/litellm/pull/15947)
    - Added fallback logic for detecting file content-type when S3 returns generic type - When using Bedrock with S3-hosted files, if the S3 object's Content-Type is not correctly set (e.g., binary/octet-stream instead of image/png), Bedrock can now handle it correctly - [PR #15635](https://github.com/BerriAI/litellm/pull/15635)

- **[Azure](../../docs/providers/azure)**
    - Add deprecation dates for Azure OpenAI models (gpt-4o-2024-08-06, gpt-4o-2024-11-20, gpt-4.1 series, o3-2025-04-16, text-embedding-3-small) - [PR #15976](https://github.com/BerriAI/litellm/pull/15976)
    - Fix Azure OpenAI ContextWindowExceededError mapping from Azure errors - [PR #15981](https://github.com/BerriAI/litellm/pull/15981)
    - Add handling for `v1` under Azure API versions - [PR #15984](https://github.com/BerriAI/litellm/pull/15984)
    - Fix azure doesn't accept extra body param - [PR #16116](https://github.com/BerriAI/litellm/pull/16116)

- **[OpenAI](../../docs/providers/openai)**
    - Add deprecation dates for gpt-3.5-turbo-1106, gpt-4-0125-preview, gpt-4-1106-preview, o1-mini-2024-09-12 - [PR #15976](https://github.com/BerriAI/litellm/pull/15976)
    - Add extended Sora-2 modality support (text + image inputs) - [PR #15976](https://github.com/BerriAI/litellm/pull/15976)
    - Updated OpenAI Sora-2-Pro pricing to $0.30/video/second - [PR #15976](https://github.com/BerriAI/litellm/pull/15976)

- **[OpenRouter](../../docs/providers/openrouter)**
    - Add Claude Haiku 4.5 pricing for OpenRouter - [PR #15909](https://github.com/BerriAI/litellm/pull/15909)
    - Add base_url config with environment variables documentation - [PR #15946](https://github.com/BerriAI/litellm/pull/15946)

- **[Mistral](../../docs/providers/mistral)**
    - Add codestral-embed-2505 embedding model - [PR #16071](https://github.com/BerriAI/litellm/pull/16071)

- **[Gemini (Google AI Studio + Vertex AI)](../../docs/providers/gemini)**
    - Fix gemini request mutation for tool use - [PR #16002](https://github.com/BerriAI/litellm/pull/16002)
    - Add gemini-embedding-001 pricing entry for Google GenAI API - [PR #16078](https://github.com/BerriAI/litellm/pull/16078)
    - Changes to fix frequency_penalty and presence_penalty issue for gemini-2.5-pro model - [PR #16041](https://github.com/BerriAI/litellm/pull/16041)

- **[DeepInfra](../../docs/providers/deepinfra)**
    - Add vision support for Qwen/Qwen3-chat-32b model - [PR #15976](https://github.com/BerriAI/litellm/pull/15976)

- **[Vercel AI Gateway](../../docs/providers/vercel_ai_gateway)**
    - Fix vercel_ai_gateway entry for glm-4.6 (moved from vercel_ai_gateway/glm-4.6 to vercel_ai_gateway/zai/glm-4.6) - [PR #16084](https://github.com/BerriAI/litellm/pull/16084)

- **[Fireworks](../../docs/providers/fireworks_ai)**
    - Don't add "accounts/fireworks/models" prefix for Fireworks Provider - [PR #15938](https://github.com/BerriAI/litellm/pull/15938)

- **[Cohere](../../docs/providers/cohere)**
    - Add OpenAI-compatible annotations support for Cohere v2 citations - [PR #16038](https://github.com/BerriAI/litellm/pull/16038)

- **[Deepgram](../../docs/providers/deepgram)**
    - Handle Deepgram detected language when available - [PR #16093](https://github.com/BerriAI/litellm/pull/16093)

### Bug Fixes

- **[Xai](../../docs/providers/xai)**
    - Add Xai websearch cost tracking - [PR #16001](https://github.com/BerriAI/litellm/pull/16001)

#### New Provider Support

- **[FAL AI](../../docs/image_generation)**
    - Add FAL AI Image Generation support - [PR #16067](https://github.com/BerriAI/litellm/pull/16067)

- **[OCI (Oracle Cloud Infrastructure)](../../docs/providers/oci)**
    - Add OCI Signer Authentication support - [PR #16064](https://github.com/BerriAI/litellm/pull/16064)

---

## LLM API Endpoints

#### Features

- **[Container API](../../docs/containers)**
    - Add end-to-end OpenAI Container API support to LiteLLM SDK - [PR #16136](https://github.com/BerriAI/litellm/pull/16136)
    - Add proxy support for container APIs - [PR #16049](https://github.com/BerriAI/litellm/pull/16049)
    - Add logging support for Container API - [PR #16049](https://github.com/BerriAI/litellm/pull/16049)
    - Add cost tracking support for containers with documentation - [PR #16117](https://github.com/BerriAI/litellm/pull/16117)

- **[Responses API](../../docs/response_api)**
    - Respect `LiteLLM-Disable-Message-Redaction` header for Responses API - [PR #15966](https://github.com/BerriAI/litellm/pull/15966)
    - Add /openai routes for responses API (Azure OpenAI SDK Compatibility) - [PR #15988](https://github.com/BerriAI/litellm/pull/15988)
    - Redact reasoning summaries in ResponsesAPI output when message logging is disabled - [PR #15965](https://github.com/BerriAI/litellm/pull/15965)
    - Support text.format parameter in Responses API for providers without native ResponsesAPIConfig - [PR #16023](https://github.com/BerriAI/litellm/pull/16023)
    - Add LLM provider response headers to Responses API - [PR #16091](https://github.com/BerriAI/litellm/pull/16091)

- **[Video Generation API](../../docs/video_generation)**
    - Add `custom_llm_provider` support for video endpoints (non-generation) - [PR #16121](https://github.com/BerriAI/litellm/pull/16121)
    - Fix documentation for videos - [PR #15937](https://github.com/BerriAI/litellm/pull/15937)
    - Add OpenAI client usage documentation for videos and fix navigation visibility - [PR #15996](https://github.com/BerriAI/litellm/pull/15996)

- **[Moderations API](../../docs/moderations)**
    - Moderations endpoint now respects `api_base` configuration parameter - [PR #16087](https://github.com/BerriAI/litellm/pull/16087)

- **[Vector Stores](../../docs/vector_stores)**
    - Milvus - search vector store support - [PR #16035](https://github.com/BerriAI/litellm/pull/16035)
    - Azure AI Vector Stores - support "virtual" indexes + create vector store on passthrough API - [PR #16160](https://github.com/BerriAI/litellm/pull/16160)

- **[Passthrough Endpoints](../../docs/pass_through/vertex_ai)**
    - Support multi-part form data on passthrough - [PR #16035](https://github.com/BerriAI/litellm/pull/16035)


---

## Management Endpoints / UI

#### Features

- **Virtual Keys**
    - Validation for Proxy Base URL in SSO Settings - [PR #16082](https://github.com/BerriAI/litellm/pull/16082)
    - Test Key UI Embeddings support - [PR #16065](https://github.com/BerriAI/litellm/pull/16065)
    - Add Key Type Select in Key Settings - [PR #16034](https://github.com/BerriAI/litellm/pull/16034)
    - Key Already Exist Error Notification - [PR #15993](https://github.com/BerriAI/litellm/pull/15993)

- **Models + Endpoints**
    - Changed API Base from Select to Input in New LLM Credentials - [PR #15987](https://github.com/BerriAI/litellm/pull/15987)
    - Remove limit from admin UI numerical input - [PR #15991](https://github.com/BerriAI/litellm/pull/15991)
    - Config Models should not be editable - [PR #16020](https://github.com/BerriAI/litellm/pull/16020)
    - Add tags in model creation - [PR #16138](https://github.com/BerriAI/litellm/pull/16138)
    - Add Tags to update model - [PR #16140](https://github.com/BerriAI/litellm/pull/16140)

- **Guardrails**
    - Add Apply Guardrail Testing Playground - [PR #16030](https://github.com/BerriAI/litellm/pull/16030)
    - Config Guardrails should not be editable and guardrail info fix - [PR #16142](https://github.com/BerriAI/litellm/pull/16142)

- **Cache Settings**
    - Allow setting cache settings on UI - [PR #16143](https://github.com/BerriAI/litellm/pull/16143)

- **Routing**
    - Allow setting all routing strategies, tag filtering on UI - [PR #16139](https://github.com/BerriAI/litellm/pull/16139)

- **Admin Settings**
    - Add license metadata to health/readiness endpoint - [PR #15997](https://github.com/BerriAI/litellm/pull/15997)
    - Litellm Backend SSO Changes - [PR #16029](https://github.com/BerriAI/litellm/pull/16029)



---

## Logging / Guardrail / Prompt Management Integrations

#### Features

- **[OpenTelemetry](../../docs/proxy/logging#opentelemetry)**
    - Enable OpenTelemetry context propagation by external tracers - [PR #15940](https://github.com/BerriAI/litellm/pull/15940)
    - Ensure error information is logged on OTEL - [PR #15978](https://github.com/BerriAI/litellm/pull/15978)

- **[Langfuse](../../docs/proxy/logging#langfuse)**
    - Fix duplicate trace in langfuse_otel - [PR #15931](https://github.com/BerriAI/litellm/pull/15931)
    - Support tool usage messages with Langfuse OTEL integration - [PR #15932](https://github.com/BerriAI/litellm/pull/15932)

- **[DataDog](../../docs/proxy/logging#datadog)**
    - Ensure key's metadata + guardrail is logged on DD - [PR #15980](https://github.com/BerriAI/litellm/pull/15980)

- **[Opik](../../docs/proxy/logging#opik)**
    - Enhance requester metadata retrieval from API key auth - [PR #15897](https://github.com/BerriAI/litellm/pull/15897)
    - User auth key metadata Documentation - [PR #16004](https://github.com/BerriAI/litellm/pull/16004)

- **[SQS](../../docs/proxy/logging#sqs)**
    - Add Base64 handling for SQS Logger - [PR #16028](https://github.com/BerriAI/litellm/pull/16028)

- **General**
    - Fix: User API key and team id and user id missing from custom callback is not misfiring - [PR #15982](https://github.com/BerriAI/litellm/pull/15982)

#### Guardrails

- **[IBM Guardrails](../../docs/proxy/guardrails)**
    - Update IBM Guardrails to correctly use SSL Verify argument - [PR #15975](https://github.com/BerriAI/litellm/pull/15975)
    - Add additional detail to ibm_guardrails.md documentation - [PR #15971](https://github.com/BerriAI/litellm/pull/15971)

- **[Model Armor](../../docs/proxy/guardrails)**
    - Support during_call for model armor guardrails - [PR #15970](https://github.com/BerriAI/litellm/pull/15970)

- **[Lasso Security](../../docs/proxy/guardrails)**
    - Upgrade to Lasso API v3 and fix ULID generation - [PR #15941](https://github.com/BerriAI/litellm/pull/15941)

- **[PANW Prisma AIRS](../../docs/proxy/guardrails)**
    - Add per-request profile overrides to PANW Prisma AIRS - [PR #16069](https://github.com/BerriAI/litellm/pull/16069)

- **[Grayswan](../../docs/proxy/guardrails)**
    - Improve Grayswan guardrail documentation - [PR #15875](https://github.com/BerriAI/litellm/pull/15875)

- **[Pillar AI](../../docs/proxy/guardrails)**
    - Graceful degradation for pillar service when using litellm - [PR #15857](https://github.com/BerriAI/litellm/pull/15857)

- **General**
    - Ensure Key Guardrails are applied - [PR #16025](https://github.com/BerriAI/litellm/pull/16025)

#### Prompt Management

- **[GitLab](../../docs/prompt_management)**
    - Add GitlabPromptCache and enable subfolder access - [PR #15712](https://github.com/BerriAI/litellm/pull/15712)

---

## Spend Tracking, Budgets and Rate Limiting

- **Cost Tracking**
    - Fix spend tracking for OCR/aOCR requests (log `pages_processed` + recognize `OCRResponse`) - [PR #16070](https://github.com/BerriAI/litellm/pull/16070)

- **Rate Limiting**
    - Add support for Batch API Rate limiting - PR1 adds support for input based rate limits - [PR #16075](https://github.com/BerriAI/litellm/pull/16075)
    - Handle multiple rate limit types per descriptor and prevent IndexError - [PR #16039](https://github.com/BerriAI/litellm/pull/16039)

---

## MCP Gateway

- **OAuth**
    - Add support for dynamic client registration - [PR #15921](https://github.com/BerriAI/litellm/pull/15921)
    - Respect X-Forwarded- headers in OAuth endpoints - [PR #16036](https://github.com/BerriAI/litellm/pull/16036)

---

## Performance / Loadbalancing / Reliability improvements

- **Memory Leak Fixes**
    - Fix: prevent httpx DeprecationWarning memory leak in AsyncHTTPHandler - [PR #16024](https://github.com/BerriAI/litellm/pull/16024)
    - Fix: resolve memory accumulation caused by Pydantic 2.11+ deprecation warnings - [PR #16110](https://github.com/BerriAI/litellm/pull/16110)
    - Fix(apscheduler): prevent memory leaks from jitter and frequent job intervals - [PR #15846](https://github.com/BerriAI/litellm/pull/15846)

- **Configuration**
    - Remove minimum validation for cache control injection index - [PR #16149](https://github.com/BerriAI/litellm/pull/16149)
    - Fix prompt_caching.md: wrong prompt_tokens definition - [PR #16044](https://github.com/BerriAI/litellm/pull/16044)


---

## Documentation Updates

- **Provider Documentation**
    - Use custom-llm-provider header in examples - [PR #16055](https://github.com/BerriAI/litellm/pull/16055)
    - Litellm docs readme fixes - [PR #16107](https://github.com/BerriAI/litellm/pull/16107)
    - Readme fixes add supported providers - [PR #16109](https://github.com/BerriAI/litellm/pull/16109)

- **Model References**
    - Add supports vision field to qwen-vl models in model_prices_and_context_window.json - [PR #16106](https://github.com/BerriAI/litellm/pull/16106)

- **General Documentation**
    - 1-79-0 docs - [PR #15936](https://github.com/BerriAI/litellm/pull/15936)
    - Add minimum resource requirement for production - [PR #16146](https://github.com/BerriAI/litellm/pull/16146)

---

## New Contributors

* @RobGeada made their first contribution in [PR #15975](https://github.com/BerriAI/litellm/pull/15975)
* @shanto12 made their first contribution in [PR #15946](https://github.com/BerriAI/litellm/pull/15946)
* @dima-hx430 made their first contribution in [PR #15976](https://github.com/BerriAI/litellm/pull/15976)
* @m-misiura made their first contribution in [PR #15971](https://github.com/BerriAI/litellm/pull/15971)
* @ylgibby made their first contribution in [PR #15947](https://github.com/BerriAI/litellm/pull/15947)
* @Somtom made their first contribution in [PR #15909](https://github.com/BerriAI/litellm/pull/15909)
* @rodolfo-nobrega made their first contribution in [PR #16023](https://github.com/BerriAI/litellm/pull/16023)
* @bernata made their first contribution in [PR #15997](https://github.com/BerriAI/litellm/pull/15997)
* @AlbertDeFusco made their first contribution in [PR #15881](https://github.com/BerriAI/litellm/pull/15881)
* @komarovd95 made their first contribution in [PR #15789](https://github.com/BerriAI/litellm/pull/15789)
* @langpingxue made their first contribution in [PR #15635](https://github.com/BerriAI/litellm/pull/15635)
* @OrionCodeDev made their first contribution in [PR #16070](https://github.com/BerriAI/litellm/pull/16070)
* @sbinnee made their first contribution in [PR #16078](https://github.com/BerriAI/litellm/pull/16078)
* @JetoPistola made their first contribution in [PR #16106](https://github.com/BerriAI/litellm/pull/16106)
* @gvioss made their first contribution in [PR #16093](https://github.com/BerriAI/litellm/pull/16093)
* @pale-aura made their first contribution in [PR #16084](https://github.com/BerriAI/litellm/pull/16084)
* @tanvithakur94 made their first contribution in [PR #16041](https://github.com/BerriAI/litellm/pull/16041)
* @li-boxuan made their first contribution in [PR #16044](https://github.com/BerriAI/litellm/pull/16044)
* @1stprinciple made their first contribution in [PR #15938](https://github.com/BerriAI/litellm/pull/15938)
* @raghav-stripe made their first contribution in [PR #16137](https://github.com/BerriAI/litellm/pull/16137)
* @steve-gore-snapdocs made their first contribution in [PR #16149](https://github.com/BerriAI/litellm/pull/16149)

---

## Full Changelog

**[View complete changelog on GitHub](https://github.com/BerriAI/litellm/compare/v1.79.0-stable...v1.80.0-stable)**

468 Index 9a1811fe

Works with

Security Analysis

Attribution

Comments (0)