Helicone
Helicone 帮助您通过 AI 网关和 LLM 可观测性能力构建可靠的 AI 应用。 官方网站:helicone.ai
1.1 API 配置
方式一:Helicone AI 网关
Helicone AI 网关通过 Helicone-Target-URL 请求头将请求转发到您的 API:
import openai
client = openai.OpenAI(
api_key="YOUR_HPC_AI_API_KEY",
base_url="https://ai-gateway.helicone.ai/v1",
default_headers={
"Helicone-Auth": "Bearer YOUR_HELICONE_API_KEY",
"Helicone-Target-URL": "https://api.luchentech.com/inference/v1"
}
)
response = client.chat.completions.create(
model="minimax/minimax-m2.5",
messages=[{"role": "user", "content": "Hello!"}]
)
方式二:自托管 Helicone
export HPC_AI_API_KEY="sk-your-luchentech-key"
export HELICONE_API_KEY="sk-helicone..."
curl --request POST \
--url http://localhost:8585/v1/gateway/oai/v1/chat/completions \
--header "Authorization: Bearer $HPC_AI_API_KEY" \
--header "Helicone-Auth: Bearer $HELICONE_API_KEY" \
--header "Helicone-Target-URL: https://api.luchentech.com/inference/v1" \
--header "Content-Type: application/json" \
--data '{
"model": "minimax/minimax-m2.5",
"messages": [{"role": "user", "content": "Hello!"}]
}'