Hugging Face
Search models, datasets, users...
Ctrl K
Models
Datasets
Spaces
Buckets
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
ConceptModels
/
fmac-lobotomy
Like
1
fmac
cognitive-graph
data-distillation
cosmopedia
smoltalk
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Copy to bucket
fMAC-v4: Data-Distilled Cognitive Graph
fMAC-v4: Data-Distilled Cognitive Graph
Architecture:
Cellular Nodes with Shared Dense SwiGLU Core
Distillation Source:
Cosmopedia-v2 (Mixtral-8x22B) & SmolTalk (Llama-3.1-70B)
Training Step:
2000 / 4000
Loss:
3.5633
Active Parameters per token:
~34M (out of 56.5M total)
Downloads last month
113
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
๐
Ask for provider support