LLM

LLM for Livepeer gateways.

POST /llm

LLM

cURL

curl --request POST \
  --url https://dream-gateway.livepeer.cloud/llm \
  --header 'Authorization: Bearer <token>' \
  --header 'Content-Type: application/json' \
  --data '
{
  "messages": [
    {
      "role": "<string>",
      "content": "<string>"
    }
  ],
  "model": "",
  "temperature": 0.7,
  "max_tokens": 256,
  "top_p": 1,
  "top_k": -1,
  "stream": false
}
'

200

{
  "id": "<string>",
  "model": "<string>",
  "created": 123,
  "usage": {
    "prompt_tokens": 123,
    "completion_tokens": 123,
    "total_tokens": 123
  },
  "choices": [
    {
      "index": 123,
      "finish_reason": "",
      "delta": {
        "role": "<string>",
        "content": "<string>"
      },
      "message": {
        "role": "<string>",
        "content": "<string>"
      }
    }
  ]
}

Authorizations

Authorization · string · header · required

Bearer authentication header of the form Bearer <token>, where <token> is your auth token.

Body

application/json

messages · LLMMessage · object[] · required

Show child attributes

model · string · default: ""

temperature · number · default: 0.7

max_tokens · integer · default: 256

top_p · number · default: 1

top_k · integer · default: -1

stream · boolean · default: false

Response

200

application/json

Successful Response

id · string · required

model · string · required

created · integer · required

usage · LLMTokenUsage · object · required

Show child attributes

choices · LLMChoice · object[] · required

Show child attributes