Instructions to use sarath-om/sarath_om with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use sarath-om/sarath_om with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf sarath-om/sarath_om # Run inference directly in the terminal: llama cli -hf sarath-om/sarath_om
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf sarath-om/sarath_om # Run inference directly in the terminal: llama cli -hf sarath-om/sarath_om
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf sarath-om/sarath_om # Run inference directly in the terminal: ./build/bin/llama cli -hf sarath-om/sarath_om
Use Docker
docker model run hf.co/sarath-om/sarath_om
- Llama new
- LM Studio
- Jan
- vLLM
How to use sarath-om/sarath_om with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "sarath-om/sarath_om" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "sarath-om/sarath_om", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/sarath-om/sarath_om
- Ollama
How to use sarath-om/sarath_om with Ollama:
ollama run hf.co/sarath-om/sarath_om
- Unsloth Desktop
- Pi
How to use sarath-om/sarath_om with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf sarath-om/sarath_om
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "sarath-om/sarath_om" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use sarath-om/sarath_om with Docker Model Runner:
docker model run hf.co/sarath-om/sarath_om
- Lemonade
How to use sarath-om/sarath_om with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull sarath-om/sarath_om
Run and chat with the model
lemonade run user.sarath_om-{{QUANT_TAG}}List all available models
lemonade list
- Hermes Agent
How to use sarath-om/sarath_om with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf sarath-om/sarath_om
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default sarath-om/sarath_om
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use sarath-om/sarath_om with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf sarath-om/sarath_om
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "sarath-om/sarath_om" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
- β‘ Sarath OM
- π Overview
- β¨ Published Model Information
- π Model Specifications
- π― Intended Use
- π¦ Getting Started with Ollama
- π» API Integration
- π οΈ Tool Calling
- π Compatible Application Integrations
- βοΈ Context and Runtime Configuration
- π§ͺ Evaluation and Performance
- π Limitations and Risks
- π Responsible Use and Security
- π§ Resources β Ollama and Hugging Face
- π¨βπ» Owner Details
- π Sarath AI β Official Social Media
- π Version Information
β‘ Sarath OM
Intelligence. Innovation. Possibility.
Sarath OM β AI-powered software and technology ecosystem
Ollama Model Β· Hugging Face Model Β· Official Website Β· GitHub
π Overview
Sarath OM is a model listing in the Sarath OM ecosystem, available through the Ollama runtime.
The published Ollama listing describes the project as designed for greater capability, faster inference, higher throughput, and scaling to larger models. Its current published variant is listed with text input, a 128K context window, and approximately 2.0 GB model size.
This Model Card documents the model listing, setup instructions, integration examples, intended evaluation areas, limitations, and official resources.
Project Scope
Sarath AI is a software application and integration platform, not an AI model-development or model-training organization.
Sarath AI does not claim to create, train, or fine-tune proprietary foundation models. Its software connects application workflows with supported external AI providers, model runtimes, APIs, and services.
The inclusion of Sarath OM in the ecosystem does not imply ownership or authorship of the underlying foundation model. Architecture, upstream origin, training provenance, and model-weight ownership must be established from the actual published model configuration and upstream documentation.
β¨ Published Model Information
| Capability | Published details |
|---|---|
| Text input | Listed |
| Tool support | Advertised |
| Image input | Not listed |
| Vision | Not listed |
| Context window | 128K tokens |
| Model size | Approximately 2.0 GB |
| Available variant | latest |
| Runtime | Ollama |
Capabilities should be tested against the actual published model and runtime configuration.
π Model Specifications
| Property | Details |
|---|---|
| Model name | Sarath OM |
| Hugging Face repository | sarath-om/sarath-om |
| Ollama identifier | sarath-om/sarath-om |
| Ollama namespace | sarath-om |
| Default tag | latest |
| Project | Sarath OM |
| Developer and project owner | Rishabh Srivastava |
| Distribution runtime | Ollama |
| Listed model size | Approximately 2.0 GB |
| Listed context window | 128K tokens |
| Input modality | Text |
| Tool support | Advertised on Ollama |
| Architecture | Not independently documented here |
| Base model | Not yet verified |
| Parameter count | Not yet confirmed |
| Quantization | Confirm from model configuration |
| Training datasets | Not documented |
| Evaluation benchmarks | No independently verified results included |
| Hardware requirements | Depend on model configuration and runtime |
| License | Verify model and upstream distribution terms |
The listed download size is not a guarantee of required RAM or VRAM. Actual memory consumption depends on runtime configuration, context length, and hardware.
π― Intended Use
Potential applications to evaluate, depending on the verified model behavior, include:
- Text-based conversational interfaces.
- General instruction-following workflows.
- Developer productivity applications.
- Tool-assisted application workflows.
- Structured information processing.
- Long-context text interaction.
- AI application prototypes and experimentation.
These are potential evaluation areas, not guarantees that the model performs every task accurately.
π¦ Getting Started with Ollama
Ollama is the documented runtime for this model listing.
1. Install Ollama
Download Ollama:
Verify the installation:
ollama --version
2. Download Sarath OM
ollama pull sarath-om/sarath-om
3. Run Sarath OM
ollama run sarath-om/sarath-om
Try a prompt:
Hello! Introduce yourself and explain what you can help me with.
Use /bye to exit the interactive session.
4. Inspect the Model
ollama show sarath-om/sarath-om
List downloaded models:
ollama list
Check running models:
ollama ps
Inspect detailed metadata through the local API:
curl http://localhost:11434/api/show \
-H "Content-Type: application/json" \
-d '{
"model": "sarath-om/sarath-om",
"verbose": true
}'
π» API Integration
Ollama provides a local HTTP API for connecting the model to applications.
cURL β Chat API
curl http://localhost:11434/api/chat \
-H "Content-Type: application/json" \
-d '{
"model": "sarath-om/sarath-om",
"messages": [
{
"role": "system",
"content": "You are a helpful assistant. Provide clear and accurate responses."
},
{
"role": "user",
"content": "Explain modern software architecture."
}
],
"stream": false
}'
The generated response is available in message.content.
Python Integration
Install the Ollama Python package:
pip install ollama
Example:
from ollama import chat
MODEL = "sarath-om/sarath-om"
def main() -> None:
response = chat(
model=MODEL,
messages=[
{
"role": "system",
"content": "You are a helpful assistant.",
},
{
"role": "user",
"content": "Explain how modern APIs work.",
},
],
stream=False,
)
print(response.message.content or "")
if __name__ == "__main__":
main()
JavaScript / Node.js Integration
Install the Ollama JavaScript package:
npm install ollama
Example:
import ollama from "ollama";
const MODEL = "sarath-om/sarath-om";
async function main() {
try {
const response = await ollama.chat({
model: MODEL,
messages: [
{
role: "user",
content: "Explain modern application architecture.",
},
],
stream: false,
});
console.log(response.message.content);
} catch (error) {
console.error("Ollama request failed:", error);
process.exitCode = 1;
}
}
main();
π οΈ Tool Calling
The Ollama listing advertises tool support.
Tool calling allows an application to provide function definitions that the model can request during a conversation.
A production application should:
- Define available functions and their input schemas.
- Send the function definitions with the conversation.
- Inspect any tool calls returned by the model.
- Validate function names and arguments.
- Check user permissions and authorization.
- Execute only approved application functions.
- Return tool results to the conversation.
Never execute arbitrary shell commands, external API calls, or sensitive actions merely because a model requested them.
π Compatible Application Integrations
The Ollama listing provides launch examples for compatible developer applications:
| Application | Launch command |
|---|---|
| Claude Code | ollama launch claude --model sarath-om/sarath-om |
| OpenCode | ollama launch opencode --model sarath-om/sarath-om |
| Hermes Agent | ollama launch hermes --model sarath-om/sarath-om |
| OpenClaw | ollama launch openclaw --model sarath-om/sarath-om |
These integrations depend on compatible application versions and Ollama configuration.
βοΈ Context and Runtime Configuration
The Ollama listing displays a 128K context window.
Actual usable context and resource consumption depend on the model configuration, runtime settings, and available system memory.
Inspect model metadata:
ollama show sarath-om/sarath-om
For advanced runtime configuration, see:
Measure memory usage and latency on the target hardware before selecting production settings.
π§ͺ Evaluation and Performance
No independently verified benchmark scores or comparative performance results are included in this card.
A reproducible evaluation should examine:
- Instruction-following accuracy.
- Text generation quality.
- Long-context retrieval and consistency.
- Structured output reliability.
- Tool selection and argument accuracy.
- Latency and hardware utilization.
- Failure cases and known limitations.
Record the model identifier, runtime version, hardware, context configuration, test dataset, and evaluation methodology.
The listing's design description is not a measured performance benchmark.
π Limitations and Risks
- AI-generated responses may be incorrect, incomplete, or inconsistent.
- Model quality can vary with prompts, context length, runtime settings, and hardware.
- Image and vision support are not listed for the current Ollama variant.
- Tool calls require application-side validation and authorization.
- Bias, privacy, reliability, and misuse risks should be evaluated before deployment.
- The model should not be the sole authority for high-impact medical, legal, or financial decisions.
π Responsible Use and Security
- Keep API credentials out of frontend code and public repositories.
- Protect local Ollama endpoints from untrusted network access.
- Validate tool calls, arguments, and external actions.
- Apply authorization, rate limits, and request timeouts.
- Review cloud and external service data-handling policies before submitting sensitive information.
- Verify important AI-generated information independently.
- Respect applicable licenses and third-party rights.
π§ Resources β Ollama and Hugging Face
Ollama Resources
- Sarath OM model: https://ollama.com/sarath-om/sarath-om
- Sarath OM profile: https://ollama.com/sarath-om
- Ollama download: https://ollama.com/download
- Ollama documentation: https://docs.ollama.com/
- Ollama API reference: https://docs.ollama.com/api
- Ollama Python library: https://github.com/ollama/ollama-python
- Ollama JavaScript library: https://github.com/ollama/ollama-js
Hugging Face Resources
- Sarath OM model repository: https://huggingface.co/sarath-om/sarath-om
- Sarath OM profile: https://huggingface.co/sarath-om
- Hugging Face Models: https://huggingface.co/models
- Hugging Face documentation: https://huggingface.co/docs
- Model Cards documentation: https://huggingface.co/docs/hub/model-cards
Official Sarath OM Resources
- Website: https://sarath.openflip.in/
- GitHub organization: https://github.com/Sarath-Om
- LinkedIn company page: https://www.linkedin.com/company/sarath-ai
π¨βπ» Owner Details
Project: Sarath OM
Developer and Project Owner: Rishabh Srivastava
Developer Portfolio and Social Media
- Portfolio: https://rishabhsrivastava.figma.site/
- X: https://x.com/RishabhSrivast_
- Instagram: https://www.instagram.com/rishabh__.srivastava/
- Threads: https://www.threads.com/@rishabh__.srivastava
- Facebook: https://www.facebook.com/rishabhsrivastava.i/
- LinkedIn: https://www.linkedin.com/in/rishabh-srivastava-rishabh
- GitHub: https://github.com/rishabhsrivastavarishabh
- YouTube: https://www.youtube.com/@RISHABH_SRIVASTAVA_OFFICIAL
- Kaggle: https://www.kaggle.com/rishabhsrivastava2
π Sarath AI β Official Social Media
- Website: https://sarath.openflip.in/
- GitHub: https://github.com/Sarath-Om
- LinkedIn: https://www.linkedin.com/company/sarath-ai
- Instagram: https://www.instagram.com/sarath_ai/
- Threads: https://www.threads.com/@sarath_ai
- Facebook: https://www.facebook.com/sarath.ai.om
- YouTube: https://www.youtube.com/@Sarath_Ai
π Version Information
| Field | Value |
|---|---|
| Model | Sarath OM |
| Repository | sarath-om/sarath-om |
| Ollama identifier | sarath-om/sarath-om |
| Published variant | latest |
| Listed size | 2.0 GB |
| Listed context | 128K |
| Runtime | Ollama |
Keep this Model Card synchronized with the actual published model configuration, available variants, verified capabilities, and applicable license terms.
β‘ SARATH OM
Intelligence. Innovation. Possibility.
Building useful digital experiences through practical technology and responsible integration.
- Downloads last month
- 324
We're not able to determine the quantization variants.