YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

๐Ÿš€ Dexter

The Ultimate Ecosystem to Spin Up, Run, and Fine-Tune Large Language Models

Hugging Face Modular MAX Mojo Python


Dexter provides a straight line from your first API call to autonomous AI research loops and production endpoints. Designed for Gemma-4-31B and optimized for cheap, high-performance cloud GPUs.

๐ŸŽฎ The Dexter OS (Start Here!)

The easiest way to interact with the entire ecosystem, run labs, and manage your cloud swarm is through the interactive Dexter OS CLI.

# Clone the repository
git clone https://github.com/lyffseba/dexter.git
cd dexter

# Boot up the Dexter OS
python3 dexter_cli.py

The OS will guide you through running the local Mojo labs and deploying the cloud inference endpoints automatically.

๐Ÿ—‚๏ธ Ecosystem Structure

dexter/
โ”œโ”€โ”€ scripts/                 # Deployment scripts for Inference (Modular MAX)
โ””โ”€โ”€ labs/                    # Interactive Tinkering & Fine-Tuning Labs
    โ”œโ”€โ”€ docs/                      # ๐Ÿ“– Dedicated documentation per lab
    โ”œโ”€โ”€ 00_getting_started.ipynb   # ๐ŸŸข START HERE: Data, Tokenizers & Mojo setup
    โ”œโ”€โ”€ 01_inference_test.ipynb    # ๐Ÿ’ฌ API Prompting & Generation
    โ”œโ”€โ”€ 02_qlora_finetuning.ipynb  # ๐Ÿง  QLoRA fine-tuning 31B models
    โ””โ”€โ”€ autoresearch/              # ๐Ÿค– Autonomous AI Agent Research Loop (PyTorch -> Mojo port)

๐ŸŒŸ The Best Platform: Modular Cloud

For cost-to-performance, Modular Cloud is currently the best platform. They have the fastest inference speeds for Gemma-4 using MAX, their GenAI native modeling & serving framework, completely outperforming vLLM on both NVIDIA and AMD platforms.

While Modular Cloud is ideal for inference and deployment, RunPod (RTX 3090/4090) remains the best value for bare-metal SSH access required for the autonomous PyTorch training labs.


๐Ÿ› ๏ธ Getting Started on Modular Cloud

1. Account Setup

  1. Go to the Modular Console and sign up.
  2. Modular Cloud gives you a straight line from the first API call to a production endpoint.

2. Running Gemma-4-31B (Inference)

Inside your cloud environment, install the Modular CLI and MAX framework:

bash scripts/01_setup_inference.sh

Then start the MAX engine server:

bash scripts/02_start_server.sh

Now you can interact with the model via Python or using any OpenAI-compatible UI!


๐Ÿ”ฌ Tinkering & Fine-Tuning Labs

Check the labs/ directory for Jupyter Notebooks designed to let you play with the model locally and in the cloud.

  • [START HERE] labs/00_getting_started.ipynb: An interactive, local introduction to AI data, tokenizers, and compiling Mojo. Start here to learn the fundamentals!
  • labs/01_inference_test.ipynb: Test prompting and generating text against your MAX endpoint.
  • labs/02_qlora_finetuning.ipynb: Learn how to fine-tune Gemma-4-31B on your own custom data using LoRA.
  • labs/autoresearch/: An autonomous AI agent loop that tweaks LLM architectures. Includes the ongoing project to port the framework from PyTorch to Mojo ๐Ÿ”ฅ & MAX.

Built with โค๏ธ by lyffseba and the autonomous swarm
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support