Hugging Face's logo

AGofficial
/
AgGPT-9

GGUF
English
conversational
Model card Files
xet
 Community
How to use from
llama.cpp
Install (macOS, Linux) 
curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf AGofficial/AgGPT-9
# Run inference directly in the terminal:
llama cli -hf AGofficial/AgGPT-9
Install from WinGet (Windows) 
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf AGofficial/AgGPT-9
# Run inference directly in the terminal:
llama cli -hf AGofficial/AgGPT-9
Build from source code 
git clone https://github.com/ggml-org/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-app
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama serve -hf AGofficial/AgGPT-9
# Run inference directly in the terminal:
./build/bin/llama cli -hf AGofficial/AgGPT-9
Use Docker 
docker model run hf.co/AGofficial/AgGPT-9
Quick Links

AgGPT-9 and AgGPT-6m - Local AI Models

Overview

This repository contains two versions of the AgGPT model:

  • AgGPT-9: The full version of the AgGPT model, offering advanced AI capabilities for high-performance systems.
  • AgGPT-6m: A lighter version of AgGPT, optimized for devices with less computing power.

Both models are designed for local use and provide advanced AI assistance.

Features

  • AgGPT-9:

    • High-performance model optimized for more capable systems.
    • Suitable for intensive computational tasks.
    • Can process larger context windows and generate high-quality responses.

  • AgGPT-6m:

    • A lighter, more efficient version for less computing-capable devices.
    • Optimized for devices with lower memory and processing power.
    • Provides similar functionality to AgGPT-9, but with reduced resource demands.

Requirements

Before running the models, make sure your system meets the following requirements:

  • Python 3.11.7 or higher
  • llama_cpp library installed (use pip install llama_cpp)
  • A compatible device for running the models (refer to individual model requirements below)

AgGPT-9 Requirements:

  • High-performance machine
  • 8GB+ RAM
  • NPU recommended

AgGPT-6m Requirements:

  • 1GB+ RAM
  • Sufficient storage

License

The software is released under the AGGPT-9 Software License Agreement. For full details, please refer to the LICENSE file.

Downloads last month
10
GGUF
Model size
7B params
Architecture
llama
Hardware compatibility
Log In to add your hardware

We're not able to determine the quantization variants.

View all variants
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support