From 6b023df4fc5cae6cd711d6ae2fd70c9cd6ef66f3 Mon Sep 17 00:00:00 2001 From: rishiraj Date: Thu, 14 Aug 2025 01:04:33 +0530 Subject: [PATCH] =?UTF-8?q?=F0=9F=A4=96=20docs:=20Add=20Truefoundry=20Cust?= =?UTF-8?q?om=20Endpoint=20Example=20(#374)?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit * added truefoundry mdx * docs: update TrueFoundry configuration with model naming and structured features * docs: simplify TrueFoundry documentation by removing Key Features section * updated tfy docs for librechat * added truefoundry ai gateway in docs --- .../ai_endpoints/truefoundry.mdx | 31 +++++++++++++++++++ 1 file changed, 31 insertions(+) create mode 100644 pages/docs/configuration/librechat_yaml/ai_endpoints/truefoundry.mdx diff --git a/pages/docs/configuration/librechat_yaml/ai_endpoints/truefoundry.mdx b/pages/docs/configuration/librechat_yaml/ai_endpoints/truefoundry.mdx new file mode 100644 index 0000000..9f53a7e --- /dev/null +++ b/pages/docs/configuration/librechat_yaml/ai_endpoints/truefoundry.mdx @@ -0,0 +1,31 @@ +--- +title: TrueFoundry AI Gateway +--- + +TrueFoundry AI Gateway is the proxy layer that sits between your applications and the LLM providers and MCP Servers. It is an enterprise-grade platform that enables users to access 1000+ LLMs using a unified interface while taking care of observability and governance. + +## Configuration Details + +To use [TrueFoundry's AI Gateway](https://www.truefoundry.com/ai-gateway) follow the quick start guide [here](https://docs.truefoundry.com/gateway/quick-start). + +### Getting Base URL and Model Names + +- **Base URL and Model Names**: Get your TrueFoundry AI Gateway endpoint URL and model name from the unified code snippet (ensure you have added the same model name) +- **PAT**: Generate from your TrueFoundry Personal Access Token [PAT](https://docs.truefoundry.com/gateway/authentication#personal-access-token-pat) + +## Using TrueFoundry AI Gateway with any LLM model +```yaml filename="librechat.yaml" + - name: "TrueFoundry" + apiKey: "${TRUEFOUNDRY_API_KEY}" + baseURL: "${TRUEFOUNDRY_GATEWAY_URL}" + models: + default: ["openai-main/gpt-4o-mini", "openai-main/gpt-4o"] + fetch: true + titleConvo: true + titleModel: "current_model" + summarize: false + summaryModel: "current_model" + forcePrompt: false + modelDisplayLabel: "TrueFoundry:OpenAI" +``` +For more details you can check: [TrueFoundry Docs](https://docs.truefoundry.com/docs/introduction) \ No newline at end of file