YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

Aya-Test-Model-V2 GGUF Quantized Models

Technical Details

  • Quantization Tool: llama.cpp
  • Version: version: 5191 (295354ea)

Model Information

Available Files

πŸš€ Download πŸ”’ Type πŸ“ Description
Download Q4 0 Standard 4-bit (fast on ARM)
Download Q4 K M 4-bit balanced (recommended default)

πŸ’‘ Q4 K M provides the best balance for most use cases

Downloads last month
2
GGUF
Model size
8B params
Architecture
command-r
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support