Responses

POST https://api.runinfra.ai/v1/responses

RunInfra /v1/responses is a chat-completions compatibility adapter for LLM and vision-language deployments. The gateway converts supported input and instructions fields into chat messages, forwards the request through the same serving path as /v1/chat/completions, then wraps the result in a Responses-shaped envelope.

This endpoint does not implement full OpenAI Responses state, include, reasoning, tool, conversation-item, or background-job semantics. Use /v1/chat/completions when your app needs tool calls today.

Minimal request

import os
from openai import OpenAI

client = OpenAI(
    base_url=os.environ.get("RUNINFRA_BASE_URL", "https://api.runinfra.ai/v1"),
    api_key=os.environ["RUNINFRA_GATEWAY_KEY"],
)

response = client.responses.create(
    model=os.environ["RUNINFRA_MODEL"],
    input="Write a one-sentence deployment health check.",
)

print(response.output_text)

import OpenAI from "openai";

const client = new OpenAI({
  baseURL: process.env.RUNINFRA_BASE_URL ?? "https://api.runinfra.ai/v1",
  apiKey: process.env.RUNINFRA_GATEWAY_KEY,
});

const response = await client.responses.create({
  model: process.env.RUNINFRA_MODEL,
  input: "Write a one-sentence deployment health check.",
});

console.log(response.output_text);

curl https://api.runinfra.ai/v1/responses \
  -H "Authorization: Bearer ${RUNINFRA_GATEWAY_KEY:?Set RUNINFRA_GATEWAY_KEY}" \
  -H "Content-Type: application/json" \
  -d "{\"model\":\"${RUNINFRA_MODEL:?Set RUNINFRA_MODEL from GET /v1/models}\",\"input\":\"Write a one-sentence deployment health check.\"}"

Streaming

Set stream: true to receive server-sent events. The stream uses OpenAI-shaped Responses event names for text deltas and terminal completion events when the selected deployment supports streaming.

import os
from openai import OpenAI

client = OpenAI(
    base_url=os.environ.get("RUNINFRA_BASE_URL", "https://api.runinfra.ai/v1"),
    api_key=os.environ["RUNINFRA_GATEWAY_KEY"],
)

stream = client.responses.create(
    model=os.environ["RUNINFRA_MODEL"],
    input="Count to five.",
    stream=True,
)

for event in stream:
    if event.type == "response.output_text.delta":
        print(event.delta, end="", flush=True)

Supported request fields

string

required

Model id returned by GET /v1/models, or default for a pipeline-scoped snippet.

string | object[]

required

Prompt text, or an array of supported Responses input message objects.

string

System-level instruction text. The adapter maps this into a system message.

boolean

default:"false"

Return a server-sent event stream instead of one JSON response.

integer

Maximum generated output tokens. The adapter maps this to the serving backend’s chat completion token limit.

number

Sampling temperature for compatible LLM deployments.

number

Nucleus sampling cutoff for compatible LLM deployments.

object

Structured output format passed through to the chat-completions serving path. Support depends on the selected deployment.

object[]

OpenAI chat-completions tool definitions accepted as pass-through input for compatible deployments. This adapter does not execute hosted tools or manage a stateful tool loop.

string | object

Tool-selection preference passed through to compatible chat-completions deployments.

Not shipped on this adapter

Stateful response retrieval or deletion.
include, reasoning, hosted tools, conversation items, file search, web search, computer use, and background jobs.
Stateful tool execution or hosted tool orchestration. Use Chat completions for production tool loops.

Retry semantics

The native RunInfra SDK treats non-streaming responses.create() as replay-safe only when you provide an idempotency key. Streaming Responses requests are sent once because a partial stream may already have reached your app.

Getting started

Endpoints

Reference

Minimal request

Streaming

Supported request fields

Not shipped on this adapter

Retry semantics

Next steps

Chat completions

RunInfra SDK

​Minimal request

​Streaming

​Supported request fields

​Not shipped on this adapter

​Retry semantics

​Next steps

Chat completions

RunInfra SDK

Minimal request

Streaming

Supported request fields

Not shipped on this adapter

Retry semantics

Next steps