All authors
Claude Skills by tools-only
github.com/tools-only19,166 skills18 installs6,168 views
- 1178 Name Skill F3ed6951Provides AWS Lambda integration patterns for Java with cold start optimization. Use when deploying Java functions to AWS Lambda, choosing between Micronaut and Raw Java approaches, optimizing cold starts below 1 second, configuring API Gateway or ALB integration, or implementing serverless Java applications. Triggers include "create lambda java", "deploy java lambda", "micronaut lambda aws", "java lambda cold start", "aws lambda java performance", "java serverless framework".Votes: 0GitHub stars: 9
- 1178 Name Skill F78f007fManage API inventory, metadata, and governance in Azure API Center.Votes: 0GitHub stars: 9
- 1178 Name Skill Fbf3ef60Centralized API inventory and governance SDK for managing APIs across your organization.Votes: 0GitHub stars: 9
- 1178 Name Skill Fcd643bfЗагрузка изменений из Git в базу 1С. Используй когда пользователь просит загрузить изменения из гита, обновить базу из репозитория, partial load из коммитаVotes: 0GitHub stars: 9
- 1206 Migration V1 To V2 A13ded21This guide helps migrate your JamAIBase instance from v1 to v2.Votes: 0GitHub stars: 9
- 1207 Pgaudit Guide 8b7130581. PostgreSQL cluster wide auditing is set by pgaudit params in cnpg-cluster-deploy.yaml 2. Object auditing is set in owl db/\_\_init\_\_.py ---Votes: 0GitHub stars: 9
- 1210 Distribution Ready 88463316**Date:** 2026-01-29 **Status:** ✅ **READY for GitHub distribution** (with minor cleanup recommendations) ---Votes: 0GitHub stars: 9
- 1211 Deploy Docs 0b19f901Validate and prepare documentation for GitHub Pages deploymentVotes: 0GitHub stars: 9
- 1212 Mcp Tool Design 54c4e772<overview> How to design MCP tools following prompt-native principles. Tools should be primitives that enable capability, not workflows that encode decisions. **Core principle:** Whatever a user can do, the agent should be able to do. Don't artificially limit the agent—give it the same primitives a power user would have. </overview> <principle name="primitives-not-workflows">Votes: 0GitHub stars: 9
- 1213 Gems 57bd212e<what_they_use>Votes: 0GitHub stars: 9
- 1214 Braintrust Prompt Wrapper Readme 8c917fb4This directory contains a wrapper server that enables LiteLLM to use prompts from [Braintrust](https://www.braintrust.dev/) through the generic prompt management API.Votes: 0GitHub stars: 9
- 1215 Release Notes Generation Instructions 0dc50c74This document provides comprehensive instructions for AI agents to generate release notes for LiteLLM following the established format and style.Votes: 0GitHub stars: 9
- 1215 Release Notes Generation Instructions 65a0ecf2This document provides comprehensive instructions for AI agents to generate release notes for LiteLLM following the established format and style.Votes: 0GitHub stars: 9
- 1216 Health Check Client Readme A8237f0eA health check tool for testing all configured models on a LiteLLM proxy. Tests each model with completion/embedding requests and reports health status, errors, and response times.Votes: 0GitHub stars: 9
- 1217 Benchmarks 338dd937Benchmarks for LiteLLM Gateway (Proxy Server) tested against a fake OpenAI endpoint.Votes: 0GitHub stars: 9
- 1217 Benchmarks 512a4012Benchmarks for LiteLLM Gateway (Proxy Server) tested against a fake OpenAI endpoint.Votes: 0GitHub stars: 9
- 1217 Benchmarks 8f2f42d5Benchmarks for LiteLLM Gateway (Proxy Server) tested against a fake OpenAI endpoint. Use this config for testing: ```yaml model_list: - model_name: "fake-openai-endpoint" litellm_params: model: openai/any api_base: https://your-fake-openai-endpoint.com/chat/completions api_key: "test" ``` In these tests the baseline latency characteristics are measured against a fake-openai-endpoint. | **Type** | **Name** | **Median (ms)** | **95%ile (ms)** | **99%ile (ms)** | **Average (ms)** | **Current RPS...Votes: 0GitHub stars: 9
- 1218 Data Security F2b3b047At LiteLLM, **safeguarding your data privacy and security** is our top priority. We recognize the critical importance of the data you share with us and handle it with the highest level of diligence. With LiteLLM Cloud, we handle: - Deployment - Scaling - Upgrades and security patches - Ensuring high availability <iframe src="https://status.litellm.ai/badge?theme=light" width="250" height="30" className="inline-block dark:hidden" style={{ colorScheme: "light", marginTop: "5px", }} ></iframe>Votes: 0GitHub stars: 9
- 1219 Enterprise B4869263:::info - ✨ SSO is free for up to 5 users. After that, an enterprise license is required. [Get Started with Enterprise here](https://www.litellm.ai/enterprise) - Who is Enterprise for? Companies giving access to 100+ users **OR** 10+ AI use-cases. If you're not sure, [get in touch with us](https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat) to discuss your needs. ::: For companies that need SSO, user management and professional support for LiteLLM Proxy :::info Get free 7-day tria...Votes: 0GitHub stars: 9
- 1219 Enterprise C4631482:::info - ✨ SSO is free for up to 5 users. After that, an enterprise license is required. [Get Started with Enterprise here](https://www.litellm.ai/enterprise) - Who is Enterprise for? Companies giving access to 100+ users **OR** 10+ AI use-cases. If you're not sure, [get in touch with us](https://calendly.com/d/cx9p-5yf-2nm/litellm-introductions) to discuss your needs. ::: For companies that need SSO, user management and professional support for LiteLLM Proxy :::info Get free 7-day trial key...Votes: 0GitHub stars: 9
- 1220 Response Api A482d759LiteLLM provides an endpoint in the spec of [OpenAI's `/responses` API](https://platform.openai.com/docs/api-reference/responses) Requests to /chat/completions may be bridged here automatically when the provider lacks support for that endpoint. The model’s default `mode` determines how bridging works.(see `model_prices_and_context_window`) | Feature | Supported | Notes | |---------|-----------|--------| | Cost Tracking | ✅ | Works with all supported models | | Logging | ✅ | Works across all i...Votes: 0GitHub stars: 9
- 1221 Knowledgebase A57e85ea<Image img={require('../../img/kb.png')} style={{width: '100%', display: 'block', margin: '2rem auto'}} /> <p style={{textAlign: 'left', color: '#666'}}> Use Vector Stores with any LiteLLM supported model </p> LiteLLM integrates with vector stores, allowing your models to access your organization's data for more accurate and contextually relevant responses.Votes: 0GitHub stars: 9
- 1222 Contributing Code 13d01605Here are the core requirements for any PR submitted to LiteLLMVotes: 0GitHub stars: 9
- 1222 Contributing Code 66f1042aHere are the core requirements for any PR submitted to LiteLLM:Votes: 0GitHub stars: 9
- 1223 Mlflow 2ab91084import Image from '@theme/IdealImage';Votes: 0GitHub stars: 9
- 1224 Azure Ai 8c28d9cfLiteLLM supports all models on Azure AI StudioVotes: 0GitHub stars: 9
- 1225 Admin Ui Sso 8a1677fb:::info From v1.76.0, SSO is now Free for up to 5 users. ::: :::info ✨ SSO is on LiteLLM Enterprise [Enterprise Pricing](https://www.litellm.ai/#pricing) [Get free 7-day trial key](https://www.litellm.ai/enterprise#trial) ::: <Tabs> <TabItem value="okta" label="Okta SSO"> 1. Add Okta credentials to your .env ```bash GENERIC_CLIENT_ID = "<your-okta-client-id>" GENERIC_CLIENT_SECRET = "<your-okta-client-secret>" GENERIC_AUTHORIZATION_ENDPOINT = "<your-okta-domain>/authorize" # https://dev-2kqkc...Votes: 0GitHub stars: 9
- 1225 Admin Ui Sso Da202e37:::info From v1.76.0, SSO is now Free for up to 5 users. ::: :::info ✨ SSO is on LiteLLM Enterprise [Enterprise Pricing](https://www.litellm.ai/#pricing) [Get free 7-day trial key](https://www.litellm.ai/enterprise#trial) ::: <Tabs> <TabItem value="okta" label="Okta SSO"> In your Okta Admin Console, create a new **OIDC Web Application**. See [Okta's guide on creating OIDC app integrations](https://help.okta.com/en-us/content/topics/apps/apps_app_integration_wizard_oidc.htm) for detailed instr...Votes: 0GitHub stars: 9
- 1225 Admin Ui Sso F706b0e4:::info From v1.76.0, SSO is now Free for up to 5 users. ::: :::info ✨ SSO is on LiteLLM Enterprise [Enterprise Pricing](https://www.litellm.ai/#pricing) [Get free 7-day trial key](https://www.litellm.ai/enterprise#trial) ::: <Tabs> <TabItem value="okta" label="Okta SSO"> In your Okta Admin Console, create a new **OIDC Web Application**. See [Okta's guide on creating OIDC app integrations](https://help.okta.com/en-us/content/topics/apps/apps_app_integration_wizard_oidc.htm) for detailed instr...Votes: 0GitHub stars: 9
- 1226 Config Settings 84faec39```yaml environment_variables: {} model_list: - model_name: string litellm_params: {} model_info: id: string mode: embedding input_cost_per_token: 0 output_cost_per_token: 0 max_tokens: 2048 base_model: gpt-4-1106-preview additionalProp1: {} litellm_settings: success_callback: ["langfuse"] # list of success callbacks failure_callback: ["sentry"] # list of failure callbacks callbacks: ["otel"] # list of callbacks - runs on success and failure service_callbacks: ["datadog", "prometheus"] # ...Votes: 0GitHub stars: 9
- 1226 Config Settings 850e6b61```yaml environment_variables: {} model_list: - model_name: string litellm_params: {} model_info: id: string mode: embedding input_cost_per_token: 0 output_cost_per_token: 0 max_tokens: 2048 base_model: gpt-4-1106-preview additionalProp1: {} litellm_settings: success_callback: ["langfuse"] # list of success callbacks failure_callback: ["sentry"] # list of failure callbacks callbacks: ["otel"] # list of callbacks - runs on success and failure service_callbacks: ["datadog", "prometheus"] # ...Votes: 0GitHub stars: 9
- 1226 Config Settings 85376b14```yaml environment_variables: {} model_list: - model_name: string litellm_params: {} model_info: id: string mode: embedding input_cost_per_token: 0 output_cost_per_token: 0 max_tokens: 2048 base_model: gpt-4-1106-preview additionalProp1: {} litellm_settings: success_callback: ["langfuse"] # list of success callbacks failure_callback: ["sentry"] # list of failure callbacks callbacks: ["otel"] # list of callbacks - runs on success and failure service_callbacks: ["datadog", "prometheus"] # ...Votes: 0GitHub stars: 9
- 1226 Config Settings 8d041fed```yaml environment_variables: {} model_list: - model_name: string litellm_params: {} model_info: id: string mode: embedding input_cost_per_token: 0 output_cost_per_token: 0 max_tokens: 2048 base_model: gpt-4-1106-preview additionalProp1: {} litellm_settings: success_callback: ["langfuse"] # list of success callbacks failure_callback: ["sentry"] # list of failure callbacks callbacks: ["otel"] # list of callbacks - runs on success and failure service_callbacks: ["datadog", "prometheus"] # ...Votes: 0GitHub stars: 9
- 1226 Config Settings A882cf5b```yaml environment_variables: {} model_list: - model_name: string litellm_params: {} model_info: id: string mode: embedding input_cost_per_token: 0 output_cost_per_token: 0 max_tokens: 2048 base_model: gpt-4-1106-preview additionalProp1: {} litellm_settings: success_callback: ["langfuse"] # list of success callbacks failure_callback: ["sentry"] # list of failure callbacks callbacks: ["otel"] # list of callbacks - runs on success and failure service_callbacks: ["datadog", "prometheus"] # ...Votes: 0GitHub stars: 9
- 1226 Config Settings Bc896b79```yaml environment_variables: {} model_list: - model_name: string litellm_params: {} model_info: id: string mode: embedding input_cost_per_token: 0 output_cost_per_token: 0 max_tokens: 2048 base_model: gpt-4-1106-preview additionalProp1: {} litellm_settings: success_callback: ["langfuse"] # list of success callbacks failure_callback: ["sentry"] # list of failure callbacks callbacks: ["otel"] # list of callbacks - runs on success and failure service_callbacks: ["datadog", "prometheus"] # ...Votes: 0GitHub stars: 9
- 1226 Config Settings C8840435```yaml environment_variables: {} model_list: - model_name: string litellm_params: {} model_info: id: string mode: embedding input_cost_per_token: 0 output_cost_per_token: 0 max_tokens: 2048 base_model: gpt-4-1106-preview additionalProp1: {} litellm_settings: success_callback: ["langfuse"] # list of success callbacks failure_callback: ["sentry"] # list of failure callbacks callbacks: ["otel"] # list of callbacks - runs on success and failure service_callbacks: ["datadog", "prometheus"] # ...Votes: 0GitHub stars: 9
- 1226 Config Settings D8cbede5```yaml environment_variables: {} model_list: - model_name: string litellm_params: {} model_info: id: string mode: embedding input_cost_per_token: 0 output_cost_per_token: 0 max_tokens: 2048 base_model: gpt-4-1106-preview additionalProp1: {} litellm_settings: success_callback: ["langfuse"] # list of success callbacks failure_callback: ["sentry"] # list of failure callbacks callbacks: ["otel"] # list of callbacks - runs on success and failure service_callbacks: ["datadog", "prometheus"] # ...Votes: 0GitHub stars: 9
- 1226 Config Settings E912576b```yaml environment_variables: {} model_list: - model_name: string litellm_params: {} model_info: id: string mode: embedding input_cost_per_token: 0 output_cost_per_token: 0 max_tokens: 2048 base_model: gpt-4-1106-preview additionalProp1: {} litellm_settings: success_callback: ["langfuse"] # list of success callbacks failure_callback: ["sentry"] # list of failure callbacks callbacks: ["otel"] # list of callbacks - runs on success and failure service_callbacks: ["datadog", "prometheus"] # ...Votes: 0GitHub stars: 9
- 1227 Configs 2e235505Set model list, `api_base`, `api_key`, `temperature` & proxy server settings (`master-key`) on the config.yaml. | Param Name | Description | |----------------------|---------------------------------------------------------------| | `model_list` | List of supported models on the server, with model-specific configs | | `router_settings` | litellm Router settings, example `routing_strategy="least-busy"` [**see all**](#router-s...Votes: 0GitHub stars: 9
- 1227 Configs 40652549Set model list, `api_base`, `api_key`, `temperature` & proxy server settings (`master-key`) on the config.yaml. | Param Name | Description | |----------------------|---------------------------------------------------------------| | `model_list` | List of supported models on the server, with model-specific configs | | `router_settings` | litellm Router settings, example `routing_strategy="least-busy"` [**see all**](#router-s...Votes: 0GitHub stars: 9
- 1228 Custom Pricing 485f0e83import Image from '@theme/IdealImage';Votes: 0GitHub stars: 9
- 1229 Custom Root Ui D8c2f9b8💥 Use this when you want to serve LiteLLM on a custom base url path like `https://localhost:4000/api/v1` :::info Requires v1.72.3 or higher. ::: Limitations: - This does not work in [litellm non-root](./deploy#non-root---without-internet-connection) images, as it requires write access to the UI files.Votes: 0GitHub stars: 9
- 1230 Deploy 424b4e5c[English Version](./deploy_en.md) > 完整的从零开始部署指南，涵盖 PyPI 安装、源码安装、大模型配置、IM 通道接入Votes: 0GitHub stars: 9
- 1230 Deploy 4672f894:::info No Limits on LiteLLM OSS There are **no limits** on the number of users, keys, or teams you can create on LiteLLM OSS. ::: You can find the Dockerfile to build litellm proxy [here](https://github.com/BerriAI/litellm/blob/main/Dockerfile) > Note: Production requires at least 4 CPU cores and 8 GB RAM.Votes: 0GitHub stars: 9
- 1230 Deploy 4a663e05[English Version](./deploy_en.md) > 完整的从零开始部署指南，涵盖 PyPI 安装、源码安装、大模型配置、IM 通道接入Votes: 0GitHub stars: 9
- 1230 Deploy 4cb3552e[English Version](./deploy_en.md) > 完整的从零开始部署指南，涵盖 PyPI 安装、源码安装、大模型配置、IM 通道接入Votes: 0GitHub stars: 9
- 1230 Deploy 928d7fea[English Version](./deploy_en.md) > 完整的从零开始部署指南，涵盖 PyPI 安装、源码安装、大模型配置、IM 通道接入Votes: 0GitHub stars: 9
- 1230 Deploy B89179ca[English Version](./deploy_en.md) > 完整的从零开始部署指南，涵盖 PyPI 安装、源码安装、大模型配置、IM 通道接入Votes: 0GitHub stars: 9
- 1230 Deploy Ff29e11f[English Version](./deploy_en.md) > 完整的从零开始部署指南，涵盖 PyPI 安装、源码安装、大模型配置、IM 通道接入Votes: 0GitHub stars: 9
- 1231 Load Balancing D55b14c2Load balance multiple instances of the same model The proxy will handle routing requests (using LiteLLM's Router). **Set `rpm` in the config if you want maximize throughput** :::info For more details on routing strategies / params, see [Routing](../routing.md) :::Votes: 0GitHub stars: 9