Skip to navigation
LLM Proxy API

API Overview

View as Markdown

HiddenLayer LLM-Proxy is a service that provides detection and response capabilities for Generative AI solutions in the HiddenLayer AI Security Platform.

Locally deployed AI Runtime Security proxy in Hybrid mode
  • The LLM Proxy API endpoint is supported only for a locally deployed AI Runtime Security proxy running in Hybrid mode. This API is not supported in HiddenLayer SaaS.
  • The documentation is presented here on the documentation portal to help reduce confusion between a locally running proxy and the SaaS proxy.
  • For more API documentation, see the HiddenLayer Developer Portal.
Prefer the SDK?

For most Python integrations, calling the Interactions endpoint via the HiddenLayer Python SDK is simpler than wiring up the proxy API directly. See Getting Started with Interactions and the Python SDK guide. The SDK works against both SaaS and a locally-running container — point base_url at your container, e.g. http://localhost:8000.