Invoke model with streaming (Bedrock format)

Invokes a model with streaming using AWS Bedrock InvokeModelWithResponseStream API format.

POST /bedrock/model/{modelId}/invoke-with-response-stream

Error

A valid request URL is required to generate request examples

200

{}

Authorizations

BearerAuthBasicAuthVirtualKeyAuthApiKeyAuth

Authorization · string · header · required

Bearer token authentication. Use your provider API key or Bifrost authentication token. Virtual keys (prefixed with sk-bf-) can also be passed here.

Path Parameters

modelId · string · required

Model ID (e.g., anthropic.claude-3-sonnet-20240229-v1:0)

Body

application/json

Raw model invocation request. The body format depends on the model provider. For Anthropic models, use Anthropic format. For other models, use their native format.

prompt · string

Text prompt to complete

max_tokens · integer

max_tokens_to_sample · integer

Anthropic-style max tokens

temperature · number

top_p · number

top_k · integer

stop · string[]

stop_sequences · string[]

Anthropic-style stop sequences

messages · object[]

For Claude 3 models

system · string string[]

System prompt (string or array of strings)

anthropic_version · string

Response

200

application/x-amz-eventstream

Successful streaming response

AWS event stream format