LlamaIndex
SDKs & frameworksRAG and agents over your data, with OpenAILike for the LLM.
Fill the guide with your values
Stays in this browser tab — never sent or stored by us. Sign in to create one
Setup
- 1Install
llama-index-llms-openai-likeand set it as the default LLM.
# pip install llama-index-llms-openai-like llama-index-embeddings-openai
import os
from llama_index.core import Settings
from llama_index.llms.openai_like import OpenAILike
from llama_index.embeddings.openai import OpenAIEmbedding
Settings.llm = OpenAILike(
model="grok-4.7",
api_base="https://api.ultragpt.pro/v1",
api_key=os.environ["ULTRAGPT_API_KEY"],
is_chat_model=True,
is_function_calling_model=True,
context_window=128000,
)
Settings.embed_model = OpenAIEmbedding(
model_name="qwen3-embedding-8b",
api_base="https://api.ultragpt.pro/v1",
api_key=os.environ["ULTRAGPT_API_KEY"],
)Tips
- Any model id from Models works; suffixes like :online (web search) and :nitro work too.
- Give each tool its own key with a spend limit, so usage shows separately in Activity.
- Something off? Error codes · Support