Instructions to use luclima/mythos-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use luclima/mythos-models with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf luclima/mythos-models:Q4_K_M # Run inference directly in the terminal: llama cli -hf luclima/mythos-models:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf luclima/mythos-models:Q4_K_M # Run inference directly in the terminal: llama cli -hf luclima/mythos-models:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf luclima/mythos-models:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf luclima/mythos-models:Q4_K_M
Use Docker
docker model run hf.co/luclima/mythos-models:Q4_K_M
- Llama new
- LM Studio
- Jan
- Ollama
How to use luclima/mythos-models with Ollama:
ollama run hf.co/luclima/mythos-models:Q4_K_M
- Unsloth Desktop
- Docker Model Runner
How to use luclima/mythos-models with Docker Model Runner:
docker model run hf.co/luclima/mythos-models:Q4_K_M
- Lemonade
How to use luclima/mythos-models with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull luclima/mythos-models:Q4_K_M
Run and chat with the model
lemonade run user.mythos-models-Q4_K_M
List all available models
lemonade list
- Atomic Chat
Upload folder using huggingface_hub (part 27)
Browse filesThis view is limited to 50 files because it contains too many changes. See raw diff
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_AdaptiveLogSoftmax +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_Conv1d_circular_stride2_pad2 +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_Conv1d_reflect_stride2_pad2 +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_Conv1d_replicate_stride2_pad2 +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_Conv2d_circular_stride2_pad2 +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_Conv2d_reflect_stride2_pad2 +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_Conv2d_replicate_stride2_pad2 +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_Conv3d_circular_stride2_pad2 +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_Conv3d_replicate_stride2_pad2 +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_CosineEmbeddingLoss_no_batch_dim_mean +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_CosineEmbeddingLoss_no_batch_dim_none +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_CosineEmbeddingLoss_no_batch_dim_sum +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_EmbeddingBag_sparse +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_Embedding_sparse +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_HingeEmbeddingLoss_margin_no_reduce +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_HingeEmbeddingLoss_no_batch_dim_mean +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_HingeEmbeddingLoss_no_batch_dim_none +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_HingeEmbeddingLoss_no_batch_dim_sum +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_HingeEmbeddingLoss_no_reduce +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_Linear +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_Linear_no_batch_dim +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_Linear_no_bias +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_MarginRankingLoss_no_batch_dim_mean +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_MarginRankingLoss_no_batch_dim_none +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_MarginRankingLoss_no_batch_dim_sum +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_Mish_no_batch_dim +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_MultiLabelSoftMarginLoss_no_batch_dim_mean +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_MultiLabelSoftMarginLoss_no_batch_dim_none +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_MultiLabelSoftMarginLoss_no_batch_dim_sum +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_MultiLabelSoftMarginLoss_no_reduce +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_MultiLabelSoftMarginLoss_weights_no_reduce +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_PairwiseDistance +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_PairwiseDistance_broadcast_lhs +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_PairwiseDistance_broadcast_rhs +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_PairwiseDistance_no_batch_dim +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_PairwiseDistance_with_non_default_args +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_PoissonNLLLoss_no_batch_dim_mean +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_PoissonNLLLoss_no_batch_dim_none +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_PoissonNLLLoss_no_batch_dim_sum +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_PoissonNLLLoss_no_reduce +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_SiLU_no_batch_dim +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_Softsign_no_batch_dim +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_Tanhshrink_no_batch_dim +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_TransformerDecoderLayer_gelu_activation +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_TransformerDecoderLayer_relu_activation +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_TransformerEncoderLayer_gelu_activation +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_TransformerEncoderLayer_relu_activation +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_Transformer_multilayer_coder +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_TripletMarginLoss_no_batch_dim_mean +0 -0
- western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_TripletMarginLoss_no_batch_dim_none +0 -0
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_AdaptiveLogSoftmax
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_Conv1d_circular_stride2_pad2
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_Conv1d_reflect_stride2_pad2
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_Conv1d_replicate_stride2_pad2
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_Conv2d_circular_stride2_pad2
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_Conv2d_reflect_stride2_pad2
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_Conv2d_replicate_stride2_pad2
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_Conv3d_circular_stride2_pad2
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_Conv3d_replicate_stride2_pad2
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_CosineEmbeddingLoss_no_batch_dim_mean
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_CosineEmbeddingLoss_no_batch_dim_none
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_CosineEmbeddingLoss_no_batch_dim_sum
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_EmbeddingBag_sparse
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_Embedding_sparse
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_HingeEmbeddingLoss_margin_no_reduce
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_HingeEmbeddingLoss_no_batch_dim_mean
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_HingeEmbeddingLoss_no_batch_dim_none
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_HingeEmbeddingLoss_no_batch_dim_sum
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_HingeEmbeddingLoss_no_reduce
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_Linear
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_Linear_no_batch_dim
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_Linear_no_bias
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_MarginRankingLoss_no_batch_dim_mean
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_MarginRankingLoss_no_batch_dim_none
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_MarginRankingLoss_no_batch_dim_sum
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_Mish_no_batch_dim
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_MultiLabelSoftMarginLoss_no_batch_dim_mean
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_MultiLabelSoftMarginLoss_no_batch_dim_none
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_MultiLabelSoftMarginLoss_no_batch_dim_sum
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_MultiLabelSoftMarginLoss_no_reduce
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_MultiLabelSoftMarginLoss_weights_no_reduce
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_PairwiseDistance
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_PairwiseDistance_broadcast_lhs
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_PairwiseDistance_broadcast_rhs
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_PairwiseDistance_no_batch_dim
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_PairwiseDistance_with_non_default_args
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_PoissonNLLLoss_no_batch_dim_mean
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_PoissonNLLLoss_no_batch_dim_none
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_PoissonNLLLoss_no_batch_dim_sum
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_PoissonNLLLoss_no_reduce
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_SiLU_no_batch_dim
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_Softsign_no_batch_dim
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_Tanhshrink_no_batch_dim
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_TransformerDecoderLayer_gelu_activation
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_TransformerDecoderLayer_relu_activation
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_TransformerEncoderLayer_gelu_activation
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_TransformerEncoderLayer_relu_activation
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_Transformer_multilayer_coder
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_TripletMarginLoss_no_batch_dim_mean
ADDED
|
File without changes
|
western_ai/usa/pytorch/test/compiled_autograd_skips/TestNN.test_TripletMarginLoss_no_batch_dim_none
ADDED
|
File without changes
|