OpenAI Messages API
documentedOpenAI-compatible chat API for TGI endpoints (example path shown in docs).
POST /v1/chat/completionsText Generation Inferenceno implementation yet0 runsInput
hf_host*
HF OpenAI-compatible host (base hostname, without https://)
your-endpoint.huggingface.cloud
model*
Model identifier
tgi
system_message
System message
You are a helpful assistant.
user_message*
User message
What is deep learning?
stream
Stream responses (true/false)
true
max_tokens
Max tokens
256
temperature
Temperature
0.7
Calls Hugging Face as you (your API key is your account); keychains.dev holds the credentials.