Fortinet FortiAIGate
Innovate confidently. Optimize and secure LLMs at runtime

Overview:

Secure by Design Agentic AI Runtime Protection

As enterprises and service providers embrace Large Language Models (LLMs) and Agentic AI applications, they face a new class of AI-specific threats including prompt injections, data leakage, and model manipulation.

FortiAIGate is an enterprise-grade LLM Gateway purpose-built to protect business-critical AI Factory and Agentic AI applications. Combining advanced AI inspection, intelligent routing, and cloud-native security, FortiAIGate helps to create a comprehensive defense layer for modern Agentic AI systems.

Designed for security and engineered for performance, FortiAIGate provides a secure, fast, and simple centralized point for Agentic AI applications to interact with multiple back API providers and LLMs. Built-in comprehensive usage logs, analytics, and cost management enable better tracking of AI token usage, costs, and latency.

---

Highlights

Designed for Security

All aspects of the FortiAIGate security controls from model input validation, data access control, and model output filtering are purposefully designed to prevent prompt injection, data leakage, and unauthorized access throughout the AI Factory interaction lifecycle.

Engineered for Performance

Leveraging multiple GPU acceleration to handle high-volume, low-latency traffic without compromising security, FortiAIGate handles continuous LLM inspection, inference, and content filtering tasks, ensuring high performance and rapid response times even under heavy workloads.

Guarded against Anomalous Activities

Using an ensemble of effective classification techniques, FortiAIGate can identify unusual usage patterns, including potential insider threats or attempts to exfiltrate sensitive, proprietary, or confidential data from the AI systems.

Crafted for Simplicity

Its modern, intuitive GUI streamlines configuration, monitoring, and policy management. FortiAIGate administrators can easily visualize traffic flows, enforce security rules, and manage multiple LLM integrations through a unified dashboard—without needing complex commandline operations.

Developed for Sovereign AI

Many jurisdictions have legal requirements for AI infrastructure and data sovereignty, control and governance to ensure compliance. AI is increasingly part of a national cyber security and defense critical infrastructure making Sovereign AI a key strategic imperative. FortiAIGate is developed from the onset with Sovereign AI First principle, enabling AI Factory builders and providers to host their own AI Factory infrastructure, data, workforce, and governance securely without reliance on cloud-based or foreign-controlled platforms. All parts of FortiAIGate from control plane, management plane, data plane, and logs can fully reside within the provider’s own infrastructure.

Built for Visibility and Compliance

FortiAIGate monitors all inbound and outbound LLM interactions with full logging and auditing allowing the AI teams to understand model behavior, verify performance, identify potential biases, and understand how the LLM generates outputs.

Capabilities

Secure LLM Proxy

FortiAIGate acts as a secure AI proxy between LLM apps and backend AI providers, such as OpenAI, Anthropic, Azure AI Foundry, and AWS Bedrock Converse. This function provides a central point for managing and optimizing interactions with LLMs, enabling features like request routing, security policy enforcement, and cost tracking.

---

Single Client API

Agentic AI applications simply connect to FortiAIGate using OpenAI API regardless of the API used by the backend AI providers. FortiAIGate automatically translates the inbound OpenAI API requests to the corresponding backend AI provider APIs and vice versa.

---

Static LLM Routing

For Agentic AI applications requiring consistent routing behavior, FortiAIGate can also statically route inbound requests to a pre-defined AI provider and LLM based on a simple API request path definition. The AI application can switch to another AI provider and LLM by simply changing its API request path.

---

Intelligent LLM Routing

Agentic AI applications do not need to specify which backend AI provider and LLM model they want to use for specialized functions. FortiAIGate can intelligently detect the contents in the user prompts and automatically route them to the correct backend AI providers and models that best serve the requests. The intelligent routing can be based on human languages, programming languages, HTTP headers, and model names detected in the user prompts.

---

Prompt Injection and Jailbreaking Attack Mitigation

FortiAIGate continuously scans LLM inputs against malicious prompt injection attempts to prevent overriding of systems instructions and block jailbreaking attacks to bypass LLM safety mechanisms. Using its GPU-powered Input Guard and Output Guard, FortiAIGate introduces minimal latencies allowing fast and secure LLM interactions.

---

Data Leak Prevention (DLP)

With its fast GPU-powered DLP engine, FortiAIGate constantly scans and redacts sensitive data and PII in user prompts to prevent them from being accidentally leaked to public LLM. FortiAIGate also performs continuous detection and classification of sensitive data and PII in the LLM output to prevent them from being accidentally disclosed to unauthorized users.

---

Toxicity Detection

In promoting the safe and responsible use of AI, FortiAIGate analyzes the toxicity of the inbound user prompt to prevent harmful or offensive content to align with company security policies. In the outbound direction, the toxicity detection prevents LLM from generating harmful or offensive output, including insecure or malicious code generation from being presented to the users.

---

LLM Cost Tracking

The ability for a FortiAIGate administrator to enter input and output prices for different backend AI API providers and models allows tracking and prevents excessive use of expensive LLM resources. It provides fine-grained monitoring and tracking of LLM cost of each interaction for sustainable AI deployment.

Features:

Specifications:

Documentation:

Download the Fortinet FortiAIGate Datasheet (PDF).