Skip to navigation

Evaluate Request

View as Markdown

[BETA] This endpoint is not GA or Production ready and is subject to changes at any time. Breaking changes may occur.

Analyzes an LLM request payload for security threats before it is sent to the model.

Accepts any valid provider request payload and returns:

  • If detect or redact action: the request payload (potentially modified) in the provider’s request format
  • If block action: a canned block message in the provider’s response format

Use this endpoint inline in your LLM pipeline to evaluate prompts before they reach the model.

Supported provider formats:

Authentication

AuthorizationBearer

Bearer authentication of the form Bearer <token>, where token is your auth token.

Headers

HL-Project-IdstringOptional
The ID or alias for the Project to govern the request processing.
HL-Runtime-Session-IdstringOptional

An externally-defined session identifier to group interactions in separate requests into a single session. The identifier should be unique across the all sessions.

Request

This endpoint expects a map from strings to any.

Response headers

HL-Runtime-ActionstringOptional

The action recommended by the policy engine evaluation outcome. It is set to BLOCK when a detection rule is triggered for a block action.

Response

Successful evaluation. Returns the (potentially modified) provider request payload, or if a block action was taken, a provider response payload.