Spaces:
Configuration error
Configuration error
|
Download README.md from open-weights/README: direct link, hf CLI and curl.
- Browser
- Download file 30.5 kB
-
https://huggingface.co/spaces/open-weights/README/resolve/main/README.md
- Command line
-
hf download hf://spaces/open-weights/README/README.md
-
curl -L -o README.md https://huggingface.co/spaces/open-weights/README/resolve/main/README.md
30.5 kB
| # Open Weights | |
| ### A practical reference layer for open-weight AI models, licensing, deployment and model access | |
| **Open Weights** is an independent Hugging Face organization focused on the rapidly growing ecosystem of downloadable AI model weights. | |
| The goal is to make open-weight models easier to: | |
| - discover | |
| - understand | |
| - compare | |
| - evaluate | |
| - self-host | |
| - deploy | |
| - inspect from a licensing perspective | |
| - integrate into modern AI infrastructure | |
| > **Open weights are not the same thing as open source.** | |
| That distinction is central to this organization. | |
| A model may provide downloadable weights while still using: | |
| - a custom community license | |
| - gated access | |
| - restricted redistribution terms | |
| - additional acceptable-use conditions | |
| - special commercial-use requirements | |
| - model-specific legal terms | |
| For that reason, **Open Weights** separates: | |
| ```text | |
| WEIGHT ACCESS | |
| + | |
| LICENSE | |
| + | |
| ACCESS CONDITIONS | |
| + | |
| MODIFICATION RIGHTS | |
| + | |
| REDISTRIBUTION RIGHTS | |
| + | |
| SELF-HOSTING | |
| + | |
| DEPLOYMENT METADATA | |
| ``` | |
| instead of reducing models to a single βopen / closedβ label. | |
| --- | |
| # Start Here | |
| The Open Weights ecosystem is organized around a simple workflow: | |
| ```text | |
| REGISTRY | |
| β | |
| EXPLORE | |
| β | |
| COMPARE | |
| β | |
| CHECK | |
| β | |
| ASSESS | |
| β | |
| DEPLOY | |
| ``` | |
| ## 1. Registry | |
| Start with the structured model registry: | |
| **Dataset:** `open-weights/open-weight-model-registry` | |
| The registry is the data layer of the organization. | |
| It contains source-linked metadata such as: | |
| - repository | |
| - publisher | |
| - model family | |
| - architecture | |
| - modalities | |
| - total parameters | |
| - active parameters | |
| - context length | |
| - access status | |
| - license | |
| - license class | |
| - self-hosting status | |
| - commercial-use status | |
| - modification status | |
| - redistribution status | |
| - weight formats | |
| - documented runtimes | |
| - verification date | |
| - primary source links | |
| --- | |
| ## 2. Explore | |
| Use: | |
| **Space:** `open-weights/open-weights-explorer` | |
| for a broader introduction to open-weight models, terminology, model families, deployment considerations and the surrounding ecosystem. | |
| --- | |
| ## 3. Compare | |
| Use: | |
| **Space:** `open-weights/open-weight-model-registry` | |
| for a data-driven model catalog with: | |
| - registry filtering | |
| - compact model detail views | |
| - direct model-to-model comparison | |
| - access-status comparison | |
| - licensing comparison | |
| - architecture comparison | |
| - parameter comparison | |
| - context-length comparison | |
| - self-hosting comparison | |
| The comparison interface is deliberately descriptive. | |
| It does not rank models or select a winner. | |
| --- | |
| ## 4. Check | |
| Use: | |
| **Space:** `open-weights/open-weight-model-check` | |
| to inspect whether a model fits the characteristics typically associated with an open-weight release. | |
| Use: | |
| **Space:** `open-weights/open-weight-license-explorer` | |
| to understand the difference between: | |
| - permissive open-source licenses | |
| - custom community licenses | |
| - model-specific terms | |
| - gated access | |
| - redistribution conditions | |
| - modification conditions | |
| - commercial-use conditions | |
| --- | |
| ## 5. Assess | |
| Use: | |
| **Space:** `open-weights/open-weights-deployment-readiness` | |
| to think through whether an open-weight model is operationally ready for a specific deployment environment. | |
| --- | |
| # Core Open Weights Resources | |
| ## Open-Weight Model Registry β Dataset | |
| **`open-weights/open-weight-model-registry`** | |
| The registry provides the structured, machine-readable foundation for the organization. | |
| It is designed to answer practical questions such as: | |
| - Are the model weights downloadable? | |
| - Is the repository public or gated? | |
| - Which license applies? | |
| - Is the license permissive or custom? | |
| - Can the model be self-hosted? | |
| - What architecture does the model use? | |
| - How large is the model? | |
| - What context length is documented? | |
| - Which modalities are supported? | |
| - Which runtimes are documented? | |
| - When was the record last checked? | |
| The registry intentionally separates facts that are often incorrectly merged into one label. | |
| --- | |
| ## Open-Weight Model Registry β Space | |
| **`open-weights/open-weight-model-registry`** | |
| The interactive registry transforms the structured dataset into a practical browsing and comparison interface. | |
| Current capabilities include: | |
| - full-text search | |
| - filtering by license | |
| - filtering by access status | |
| - filtering by license class | |
| - filtering by architecture | |
| - filtering by modality | |
| - filtering by minimum context length | |
| - filtering by maximum parameter count | |
| - compact model detail views | |
| - direct side-by-side comparison | |
| - source links | |
| - verification dates | |
| The Space attempts to use the registry dataset as its live data source. | |
| --- | |
| ## Open Weights Explorer | |
| **`open-weights/open-weights-explorer`** | |
| A broader conceptual entry point into: | |
| - open-weight models | |
| - model families | |
| - model access | |
| - self-hosting | |
| - inference | |
| - deployment | |
| - licensing | |
| - infrastructure | |
| --- | |
| ## Open Weight Model Check | |
| **`open-weights/open-weight-model-check`** | |
| A practical reference tool for checking characteristics around model-weight availability and openness. | |
| --- | |
| ## Open Weight License Explorer | |
| **`open-weights/open-weight-license-explorer`** | |
| A focused resource for understanding the licensing layer behind open-weight models. | |
| --- | |
| ## Open Weights Deployment Readiness | |
| **`open-weights/open-weights-deployment-readiness`** | |
| A deployment-oriented reference for thinking about whether a model is operationally ready for a specific environment. | |
| --- | |
| # What Are Open Weights? | |
| An **open-weight model** is generally understood as an AI model whose trained weights are available for download or direct use outside a closed hosted API. | |
| This typically enables at least some degree of: | |
| - local inference | |
| - private hosting | |
| - custom deployment | |
| - quantization | |
| - fine-tuning | |
| - model inspection | |
| - infrastructure experimentation | |
| - offline use | |
| - edge deployment | |
| But the exact rights depend on the model license and access conditions. | |
| --- | |
| # Open Weights β Open Source | |
| The distinction matters. | |
| A model can make its weights downloadable without making all of the following open: | |
| - training code | |
| - training data | |
| - data filtering pipeline | |
| - preprocessing pipeline | |
| - full training configuration | |
| - evaluation pipeline | |
| - model architecture implementation | |
| - optimizer state | |
| - intermediate checkpoints | |
| - source code | |
| - licensing rights | |
| A simplified view: | |
| ```text | |
| OPEN WEIGHTS | |
| β | |
| OPEN SOURCE | |
| ``` | |
| A more useful model is: | |
| ```text | |
| Model Openness | |
| βββ Weight Availability | |
| βββ License | |
| βββ Source Code | |
| βββ Training Data | |
| βββ Training Method | |
| βββ Evaluation Data | |
| βββ Reproducibility | |
| βββ Deployment Freedom | |
| ``` | |
| --- | |
| # Why Open Weights Matter | |
| Open-weight models matter because they allow AI systems to move beyond hosted API dependency. | |
| Potential advantages include: | |
| - local control | |
| - privacy | |
| - infrastructure independence | |
| - reproducible deployment | |
| - custom optimization | |
| - lower marginal inference cost at scale | |
| - offline execution | |
| - specialized hardware support | |
| - regulated-environment deployment | |
| - private enterprise deployment | |
| - edge inference | |
| - research access | |
| - fine-tuning | |
| - quantization | |
| - model experimentation | |
| --- | |
| # Open Weights and AI Infrastructure | |
| Open weights create an ecosystem around the model itself. | |
| A typical stack may include: | |
| ```text | |
| MODEL WEIGHTS | |
| β | |
| MODEL FORMAT | |
| β | |
| QUANTIZATION | |
| β | |
| RUNTIME | |
| β | |
| INFERENCE ENGINE | |
| β | |
| MODEL SERVER | |
| β | |
| ROUTER | |
| β | |
| APPLICATION / AGENT | |
| ``` | |
| Each layer introduces different compatibility requirements. | |
| --- | |
| # Model Registry Architecture | |
| The Open Weights registry is designed as a structured reference layer: | |
| ```text | |
| Model Publisher | |
| β | |
| Official Model Repository | |
| β | |
| Primary Metadata | |
| β | |
| Verification | |
| β | |
| Open-Weight Model Registry | |
| β | |
| Interactive Registry Space | |
| β | |
| Search / Filter / Compare | |
| ``` | |
| This architecture is intentionally data-first. | |
| --- | |
| # Registry Philosophy | |
| The registry follows five principles: | |
| ```text | |
| VERIFY FIRST | |
| RECORD UNCERTAINTY | |
| LINK THE SOURCE | |
| SEPARATE FACTS FROM INTERPRETATION | |
| DO NOT TURN LICENSING INTO A SCORE | |
| ``` | |
| --- | |
| # Registry Schema | |
| The registry may include fields such as: | |
| ```text | |
| repo_id | |
| organization | |
| model_family | |
| model_name | |
| architecture_class | |
| modalities | |
| total_parameters_b | |
| active_parameters_b | |
| context_length_native_tokens | |
| context_length_extended_tokens | |
| weights_available | |
| weight_format | |
| access_status | |
| license_id | |
| license_class | |
| commercial_use_status | |
| modification_status | |
| redistribution_status | |
| self_hosting_status | |
| documented_runtimes | |
| verification_status | |
| last_verified | |
| source_urls | |
| notes | |
| ``` | |
| --- | |
| # Weight Availability | |
| The registry treats weight availability as its own property. | |
| Possible states may include: | |
| ```text | |
| available | |
| gated | |
| restricted | |
| unavailable | |
| unknown | |
| ``` | |
| Weight availability does not automatically determine licensing rights. | |
| --- | |
| # Access Status | |
| Access can be: | |
| ## Public | |
| The repository can be accessed without a model-specific approval step. | |
| ## Gated | |
| Access requires: | |
| - acknowledgement | |
| - acceptance of terms | |
| - approval | |
| - authentication | |
| - other publisher-defined conditions | |
| ## Restricted | |
| Additional requirements may apply beyond normal gated access. | |
| --- | |
| # License Classes | |
| The registry distinguishes broad license categories. | |
| ## Permissive Open Source | |
| Examples may include licenses such as: | |
| - Apache-2.0 | |
| - MIT | |
| These generally provide broad rights, but the actual license always controls. | |
| ## Custom Community License | |
| A model-specific community license may provide some broad usage rights but is not equivalent to Apache-2.0 or MIT. | |
| ## Custom Terms | |
| Some model families are governed by dedicated use terms. | |
| --- | |
| # Commercial Use | |
| Commercial-use status must be treated separately. | |
| Potential states may include: | |
| ```text | |
| permitted_by_license | |
| subject_to_custom_license_terms | |
| subject_to_model_terms | |
| unclear | |
| unknown | |
| ``` | |
| The registry does not provide legal advice. | |
| --- | |
| # Modification | |
| Modification rights may cover: | |
| - fine-tuning | |
| - adapters | |
| - merging | |
| - quantization | |
| - derivative checkpoints | |
| - architecture adaptation | |
| But these rights depend on the applicable license. | |
| --- | |
| # Redistribution | |
| Redistribution matters when users want to: | |
| - mirror weights | |
| - distribute quantized versions | |
| - publish derivative checkpoints | |
| - package models | |
| - bundle models with software | |
| The ability to download weights does not automatically mean unrestricted redistribution. | |
| --- | |
| # Self-Hosting | |
| Self-hosting is one of the most important practical reasons to use open-weight models. | |
| Potential deployment environments include: | |
| - workstation | |
| - local server | |
| - private cloud | |
| - public cloud | |
| - GPU cluster | |
| - sovereign infrastructure | |
| - edge device | |
| - embedded hardware | |
| --- | |
| # Model Architecture | |
| The registry may classify models as: | |
| - dense decoder-only | |
| - Mixture-of-Experts | |
| - multimodal | |
| - reasoning model | |
| - vision-language model | |
| - audio-language model | |
| - specialized model | |
| Architecture affects: | |
| - memory | |
| - throughput | |
| - latency | |
| - routing | |
| - hardware | |
| - serving strategy | |
| --- | |
| # Dense Models | |
| Dense models generally activate the full parameter set for each token. | |
| Simplified: | |
| ```text | |
| Input | |
| β | |
| All Layers | |
| β | |
| All Parameters | |
| β | |
| Output | |
| ``` | |
| --- | |
| # Mixture-of-Experts | |
| MoE models contain multiple experts while activating only a subset during inference. | |
| Simplified: | |
| ```text | |
| Token | |
| β | |
| Router | |
| βββ Expert A | |
| βββ Expert B | |
| βββ Expert C | |
| βββ Expert D | |
| β | |
| Selected Experts | |
| β | |
| Output | |
| ``` | |
| That creates an important distinction between: | |
| - total parameters | |
| - active parameters | |
| The registry records these separately where available. | |
| --- | |
| # Total vs Active Parameters | |
| For dense models: | |
| ```text | |
| Total Parameters | |
| β | |
| Active Parameters | |
| ``` | |
| For MoE models: | |
| ```text | |
| Total Parameters | |
| > | |
| Active Parameters per token | |
| ``` | |
| This distinction matters for: | |
| - storage | |
| - memory planning | |
| - inference | |
| - throughput | |
| - serving architecture | |
| --- | |
| # Context Length | |
| Context length is a key model property. | |
| The registry distinguishes between: | |
| - native context | |
| - optional extended context | |
| This matters because a model may support a longer context only with: | |
| - RoPE scaling | |
| - YaRN | |
| - runtime configuration | |
| - special inference settings | |
| - additional memory | |
| --- | |
| # Modalities | |
| Open-weight models increasingly support multiple modalities. | |
| Possible inputs may include: | |
| - text | |
| - image | |
| - audio | |
| - video | |
| - sensor data | |
| Multimodal models introduce additional runtime requirements. | |
| --- | |
| # Model Formats | |
| Common model formats may include: | |
| - Safetensors | |
| - GGUF | |
| - GPTQ | |
| - AWQ | |
| - FP8 | |
| - BF16 | |
| - FP16 | |
| - INT8 | |
| - INT4 | |
| - MXFP4 | |
| Model format affects: | |
| - compatibility | |
| - memory | |
| - throughput | |
| - deployment tooling | |
| --- | |
| # Safetensors | |
| Safetensors is widely used for storing model weights in the Hugging Face ecosystem. | |
| Advantages include: | |
| - structured tensor storage | |
| - fast loading | |
| - safer deserialization characteristics than arbitrary pickle-based formats | |
| --- | |
| # GGUF | |
| GGUF is common in local inference workflows. | |
| It is often associated with: | |
| - llama.cpp | |
| - desktop inference | |
| - CPU inference | |
| - Apple Silicon | |
| - quantized local models | |
| --- | |
| # Quantization | |
| Quantization reduces model precision to lower: | |
| - VRAM requirements | |
| - RAM requirements | |
| - bandwidth | |
| - inference cost | |
| Common quantization levels include: | |
| ```text | |
| FP16 | |
| BF16 | |
| FP8 | |
| INT8 | |
| INT4 | |
| ``` | |
| Quantization can affect: | |
| - quality | |
| - throughput | |
| - compatibility | |
| - latency | |
| --- | |
| # Hardware Requirements | |
| Model deployment depends on more than parameter count. | |
| Relevant factors include: | |
| - precision | |
| - quantization | |
| - context length | |
| - KV cache | |
| - batch size | |
| - architecture | |
| - number of experts | |
| - active experts | |
| - runtime | |
| - tensor parallelism | |
| - pipeline parallelism | |
| Therefore the registry avoids presenting a simplistic hardware estimate unless the assumptions are explicit. | |
| --- | |
| # VRAM | |
| A rough weight-only memory estimate is sometimes approximated as: | |
| ```text | |
| Parameters Γ Bytes per Parameter | |
| ``` | |
| But real deployment memory can also include: | |
| - KV cache | |
| - runtime overhead | |
| - CUDA memory | |
| - activations | |
| - temporary buffers | |
| - graph capture | |
| - batching overhead | |
| --- | |
| # Inference Runtimes | |
| Open-weight models may be deployed using runtimes such as: | |
| - Transformers | |
| - vLLM | |
| - SGLang | |
| - llama.cpp | |
| - TensorRT-LLM | |
| - Ollama | |
| - LM Studio | |
| - MLX | |
| - OpenVINO | |
| The registry records only runtimes explicitly documented or verified for a model. | |
| --- | |
| # Inference Engines | |
| Inference engines optimize model execution. | |
| Important considerations include: | |
| - throughput | |
| - latency | |
| - batching | |
| - prefix caching | |
| - speculative decoding | |
| - tensor parallelism | |
| - quantization support | |
| - distributed serving | |
| --- | |
| # Model Servers | |
| A model server exposes local or remote inference. | |
| Common interfaces may include: | |
| ```text | |
| HTTP | |
| OpenAI-compatible API | |
| gRPC | |
| WebSocket | |
| local IPC | |
| ``` | |
| --- | |
| # OpenAI-Compatible APIs | |
| Many inference runtimes provide OpenAI-compatible endpoints. | |
| This allows applications to switch from hosted APIs to self-hosted models with relatively small code changes. | |
| --- | |
| # Model Routing | |
| A modern AI system may use several open-weight models simultaneously. | |
| Example: | |
| ```text | |
| Request | |
| β | |
| Router | |
| βββ Fast Model | |
| βββ Reasoning Model | |
| βββ Coding Model | |
| βββ Vision Model | |
| βββ Local Fallback | |
| ``` | |
| Open-weight model registries can become useful routing metadata sources. | |
| --- | |
| # Open Weights and Agents | |
| AI agents can benefit from open-weight models when organizations require: | |
| - local execution | |
| - privacy | |
| - predictable infrastructure | |
| - custom fine-tuning | |
| - specialized tools | |
| - lower API dependency | |
| --- | |
| # Open Weights and Orchestration | |
| Open-weight systems increasingly require orchestration across: | |
| - models | |
| - runtimes | |
| - GPUs | |
| - tools | |
| - agents | |
| - memory | |
| - inference providers | |
| This connects Open Weights directly to the broader AI systems layer. | |
| --- | |
| # Open Weights and Interoperability | |
| Interoperability matters because open-weight models may need to work across: | |
| - model formats | |
| - inference engines | |
| - APIs | |
| - agent frameworks | |
| - tool protocols | |
| - orchestration systems | |
| - hardware platforms | |
| --- | |
| # Open Weights and Observability | |
| Production deployment requires visibility into: | |
| - model selected | |
| - model version | |
| - latency | |
| - tokens | |
| - throughput | |
| - cost | |
| - errors | |
| - GPU utilization | |
| - fallback behavior | |
| This makes observability a natural companion to open-weight deployment. | |
| --- | |
| # Open Weights and Validation | |
| Validation helps answer: | |
| - Does the model behave as expected? | |
| - Is the quantized model still acceptable? | |
| - Does the deployed runtime preserve output quality? | |
| - Is the model compatible with the target workload? | |
| --- | |
| # Open Weights and Evaluation | |
| Evaluation may cover: | |
| - reasoning | |
| - coding | |
| - retrieval | |
| - instruction following | |
| - multimodal understanding | |
| - safety | |
| - domain-specific performance | |
| - latency | |
| - throughput | |
| The Open Weights organization does not rank models globally. | |
| Different workloads require different trade-offs. | |
| --- | |
| # Open Weights and Fine-Tuning | |
| Open weights enable adaptation methods such as: | |
| - full fine-tuning | |
| - LoRA | |
| - QLoRA | |
| - adapters | |
| - instruction tuning | |
| - preference optimization | |
| - domain adaptation | |
| Rights to modify or redistribute derivatives still depend on the model license. | |
| --- | |
| # Open Weights and Synthetic Data | |
| Open-weight models can be used to create: | |
| - synthetic instruction data | |
| - reasoning traces | |
| - classification data | |
| - domain-specific corpora | |
| - agent trajectories | |
| This creates a feedback loop: | |
| ```text | |
| Open-Weight Model | |
| β | |
| Synthetic Data | |
| β | |
| Fine-Tuning | |
| β | |
| New Model | |
| β | |
| Evaluation | |
| ``` | |
| --- | |
| # Open Weights and Enterprise AI | |
| Enterprise use cases may include: | |
| - internal assistants | |
| - private RAG | |
| - code assistants | |
| - document analysis | |
| - customer-service systems | |
| - agentic workflows | |
| - domain-specific reasoning | |
| - data extraction | |
| - process automation | |
| --- | |
| # Data Sovereignty | |
| Open weights can support: | |
| - on-premises inference | |
| - regional cloud deployment | |
| - sovereign AI infrastructure | |
| - offline environments | |
| - regulated data handling | |
| --- | |
| # Privacy | |
| Local deployment can reduce the need to send sensitive inputs to external model APIs. | |
| Privacy still depends on: | |
| - infrastructure configuration | |
| - logging | |
| - telemetry | |
| - access controls | |
| - storage | |
| - agent tools | |
| - data retention | |
| --- | |
| # Edge AI | |
| Smaller open-weight models can run on: | |
| - laptops | |
| - phones | |
| - edge servers | |
| - industrial devices | |
| - embedded systems | |
| - robotics platforms | |
| This is particularly important for: | |
| - latency-sensitive applications | |
| - offline operation | |
| - robotics | |
| - Physical AI | |
| --- | |
| # Open Weights and Physical AI | |
| Physical AI systems may use open-weight models for: | |
| - perception | |
| - planning | |
| - reasoning | |
| - control | |
| - multimodal fusion | |
| - robotics | |
| Open weights can make hardware-level integration easier to customize. | |
| --- | |
| # Model Provenance | |
| Model provenance can include: | |
| - publisher | |
| - base model | |
| - fine-tuning method | |
| - dataset lineage | |
| - quantization source | |
| - derivative chain | |
| Future registry versions may expand provenance metadata. | |
| --- | |
| # Reproducibility | |
| Weights improve reproducibility because the model artifact can be preserved. | |
| But full reproducibility may still require: | |
| - tokenizer | |
| - configuration | |
| - runtime version | |
| - inference settings | |
| - prompt format | |
| - quantization details | |
| - hardware context | |
| --- | |
| # Verification | |
| Registry records should be periodically rechecked. | |
| Reasons include: | |
| - changed model cards | |
| - updated licenses | |
| - renamed repositories | |
| - new runtimes | |
| - new quantizations | |
| - changed gating | |
| - revised context limits | |
| Each registry record should therefore include: | |
| ```text | |
| verification_status | |
| last_verified | |
| source_urls | |
| ``` | |
| --- | |
| # Registry Versioning | |
| The registry should evolve through explicit versions. | |
| Example: | |
| ```text | |
| 0.1.0 | |
| 0.2.0 | |
| 0.3.0 | |
| 1.0.0 | |
| ``` | |
| A changelog should record: | |
| - new models | |
| - removed models | |
| - corrected metadata | |
| - schema changes | |
| - license updates | |
| - access changes | |
| --- | |
| # Data Quality | |
| Registry quality depends on: | |
| - source quality | |
| - update frequency | |
| - consistent schema | |
| - transparent uncertainty | |
| - source links | |
| - change tracking | |
| --- | |
| # Avoiding False Precision | |
| The registry intentionally avoids presenting uncertain information as exact fact. | |
| Examples: | |
| - inferred hardware requirements | |
| - undocumented runtime support | |
| - assumed commercial rights | |
| - guessed context length | |
| - estimated active parameters without source support | |
| If uncertain, the correct value may be: | |
| ```text | |
| unknown | |
| ``` | |
| --- | |
| # Open Weights Knowledge Graph | |
| ```text | |
| Open Weights | |
| CONTAINS β Model Weights | |
| ASSOCIATES WITH β Licenses | |
| SUPPORTS β Self-Hosting | |
| SUPPORTS β Fine-Tuning | |
| SUPPORTS β Quantization | |
| SUPPORTS β Local Inference | |
| SUPPORTS β Private Deployment | |
| CONNECTS TO β Inference | |
| CONNECTS TO β Orchestration | |
| CONNECTS TO β Observability | |
| CONNECTS TO β Validation | |
| CONNECTS TO β Interoperability | |
| CONNECTS TO β Agents | |
| CONNECTS TO β Physical AI | |
| ``` | |
| --- | |
| # Open-Weight Model Registry Knowledge Graph | |
| ```text | |
| Registry | |
| RECORDS β Models | |
| RECORDS β Publishers | |
| RECORDS β Architectures | |
| RECORDS β Parameter Counts | |
| RECORDS β Context Length | |
| RECORDS β Licenses | |
| RECORDS β Access Status | |
| RECORDS β Weight Formats | |
| RECORDS β Runtimes | |
| RECORDS β Verification Date | |
| LINKS TO β Primary Sources | |
| ENABLES β Discovery | |
| ENABLES β Comparison | |
| ENABLES β Deployment Research | |
| ``` | |
| --- | |
| # Open Weights Maturity Model | |
| ## Level 1 β Downloadable Weights | |
| The model weights are available. | |
| ## Level 2 β Documented Model | |
| The model provides: | |
| - architecture | |
| - tokenizer | |
| - configuration | |
| - usage instructions | |
| ## Level 3 β Deployable Model | |
| The model works with documented inference runtimes. | |
| ## Level 4 β Operational Model | |
| Deployment guidance covers: | |
| - quantization | |
| - serving | |
| - hardware | |
| - context | |
| - scaling | |
| ## Level 5 β Production-Ready Ecosystem | |
| The model has: | |
| - multiple runtimes | |
| - observability | |
| - evaluation | |
| - deployment tooling | |
| - community support | |
| - reproducible infrastructure | |
| This maturity model is descriptive, not a score. | |
| --- | |
| # Deployment Checklist | |
| A practical open-weight deployment checklist: | |
| ```text | |
| [ ] Repository verified | |
| [ ] License reviewed | |
| [ ] Access conditions reviewed | |
| [ ] Weight format confirmed | |
| [ ] Tokenizer confirmed | |
| [ ] Context length confirmed | |
| [ ] Runtime confirmed | |
| [ ] Quantization selected | |
| [ ] Hardware capacity validated | |
| [ ] Throughput tested | |
| [ ] Latency tested | |
| [ ] Quality evaluated | |
| [ ] Logging configured | |
| [ ] Observability configured | |
| [ ] Security reviewed | |
| [ ] Privacy reviewed | |
| [ ] Rollback plan prepared | |
| ``` | |
| --- | |
| # Open Weight Selection Questions | |
| Before selecting a model, ask: | |
| 1. Are the weights downloadable? | |
| 2. Is the repository gated? | |
| 3. Which license applies? | |
| 4. Is commercial use permitted? | |
| 5. Can derivatives be redistributed? | |
| 6. What is the model architecture? | |
| 7. How many total parameters does it have? | |
| 8. How many active parameters does it use? | |
| 9. What context length is documented? | |
| 10. Which modalities are supported? | |
| 11. Which weight formats are available? | |
| 12. Which runtimes are documented? | |
| 13. Can the model be self-hosted? | |
| 14. What hardware is required? | |
| 15. Has the deployment been evaluated for the intended workload? | |
| --- | |
| # Open Weight Research Questions | |
| Important questions include: | |
| 1. How should open-weight models be classified consistently? | |
| 2. What metadata should every model release provide? | |
| 3. How should license conditions be represented in registries? | |
| 4. How should gated access be represented? | |
| 5. How should native and extended context be distinguished? | |
| 6. How should MoE active parameters be represented? | |
| 7. How should hardware requirements be reported? | |
| 8. How should quantized derivatives be linked to base models? | |
| 9. How should runtime compatibility be verified? | |
| 10. How can open-weight registries become machine-readable infrastructure? | |
| --- | |
| # SEO & GEO Topic Map | |
| This organization is structured around: | |
| - Open Weights | |
| - Open Weight Models | |
| - Open-Weight Models | |
| - Open Models | |
| - Open Source AI | |
| - downloadable AI models | |
| - model weights | |
| - model registry | |
| - AI model registry | |
| - open-weight model registry | |
| - Hugging Face models | |
| - open-weight LLMs | |
| - local LLMs | |
| - self-hosted AI | |
| - local inference | |
| - AI inference | |
| - model deployment | |
| - model serving | |
| - model quantization | |
| - GGUF | |
| - Safetensors | |
| - vLLM | |
| - SGLang | |
| - llama.cpp | |
| - AI licensing | |
| - model licensing | |
| - model access | |
| - gated models | |
| - Apache-2.0 models | |
| - MIT licensed models | |
| - community licensed models | |
| - commercial AI models | |
| - self-hosted LLMs | |
| - private AI | |
| - sovereign AI | |
| - enterprise AI | |
| - open-weight agents | |
| - Physical AI | |
| - multimodal open-weight models | |
| - MoE models | |
| - context length | |
| - model parameters | |
| - model comparison | |
| - model deployment readiness | |
| --- | |
| # Frequently Asked Questions | |
| ## What are open weights? | |
| Open weights generally refers to AI models whose trained parameters are made available for download or self-hosting. | |
| ## Are open weights the same as open source? | |
| No. Weight availability does not automatically mean that source code, training data, or usage rights are open. | |
| ## Can open-weight models be used commercially? | |
| It depends on the applicable license and terms. | |
| ## Can open-weight models be modified? | |
| It depends on the license and the model-specific terms. | |
| ## Can open-weight models be redistributed? | |
| It depends on the license and downstream conditions. | |
| ## Are gated models still open-weight models? | |
| A model may still provide downloadable weights while requiring access approval or acceptance of terms. The registry records gating separately. | |
| ## Why does the registry separate total and active parameters? | |
| Mixture-of-Experts models may contain many more total parameters than are activated for each token. | |
| ## Why does the registry separate native and extended context? | |
| Some models support longer context only through runtime-specific scaling or configuration. | |
| ## Does Open Weights rank models? | |
| No. The organization is designed to provide structured information and tools, not a universal model ranking. | |
| ## Is the registry legal advice? | |
| No. Always review the actual license and current publisher terms. | |
| --- | |
| # Dataset | |
| ## Open-Weight Model Registry | |
| **Dataset:** `open-weights/open-weight-model-registry` | |
| The dataset is the machine-readable reference layer behind the registry. | |
| Current file structure may include: | |
| ```text | |
| README.md | |
| CHANGELOG.md | |
| schema.json | |
| data/ | |
| train.jsonl | |
| registry.csv | |
| ``` | |
| The dataset is intended to evolve over time through: | |
| - verified additions | |
| - corrections | |
| - source updates | |
| - schema extensions | |
| - license updates | |
| - runtime updates | |
| --- | |
| # Interactive Registry | |
| ## Open-Weight Model Registry | |
| **Space:** `open-weights/open-weight-model-registry` | |
| The Space provides: | |
| ```text | |
| SEARCH | |
| + | |
| FILTER | |
| + | |
| DETAIL VIEW | |
| + | |
| DIRECT COMPARISON | |
| ``` | |
| This turns the registry from documentation into a practical model-discovery interface. | |
| --- | |
| # Open Weights Resource Map | |
| ```text | |
| OPEN WEIGHTS | |
| β | |
| βββ Open-Weight Model Registry β Dataset | |
| β βββ Structured model metadata | |
| β | |
| βββ Open-Weight Model Registry β Space | |
| β βββ Search | |
| β βββ Filter | |
| β βββ Detail View | |
| β βββ Direct Comparison | |
| β | |
| βββ Open Weights Explorer | |
| β βββ Concepts and ecosystem | |
| β | |
| βββ Open Weight Model Check | |
| β βββ Model openness characteristics | |
| β | |
| βββ Open Weight License Explorer | |
| β βββ Licensing and usage conditions | |
| β | |
| βββ Open Weights Deployment Readiness | |
| βββ Operational deployment assessment | |
| ``` | |
| --- | |
| # Collaboration & Partnerships | |
| **Open Weights** is open to collaboration with companies, research teams, universities and open-source projects working on open-weight AI systems. | |
| Relevant collaboration areas include: | |
| - open-weight model releases | |
| - model metadata | |
| - model registries | |
| - inference runtimes | |
| - model serving | |
| - quantization | |
| - hardware | |
| - deployment | |
| - AI licensing metadata | |
| - self-hosting | |
| - local inference | |
| - enterprise AI | |
| - sovereign AI | |
| - model interoperability | |
| - observability | |
| - validation | |
| Possible collaboration formats include: | |
| - verified registry contributions | |
| - runtime compatibility data | |
| - technical integrations | |
| - joint Hugging Face Spaces | |
| - ecosystem maps | |
| - deployment examples | |
| - model format integrations | |
| - benchmark integrations | |
| - clearly disclosed partnerships and sponsorships | |
| ## Collaboration Contact | |
| **agenten@magenta.de** | |
| --- | |
| # For Model Developers | |
| Model developers can help improve the registry by providing clear, source-linked metadata. | |
| Useful information includes: | |
| - official repository | |
| - license | |
| - architecture | |
| - parameter counts | |
| - context length | |
| - supported modalities | |
| - weight formats | |
| - inference runtimes | |
| - quantization guidance | |
| - deployment guidance | |
| - gating requirements | |
| --- | |
| # For Inference Providers | |
| Inference providers can contribute: | |
| - runtime support | |
| - deployment examples | |
| - compatibility notes | |
| - quantization support | |
| - model-serving guidance | |
| - performance methodology | |
| --- | |
| # For Hardware Companies | |
| Relevant collaboration topics include: | |
| - model deployment profiles | |
| - memory requirements | |
| - quantization | |
| - throughput | |
| - local inference | |
| - edge inference | |
| - accelerator compatibility | |
| --- | |
| # For Research Organizations | |
| Relevant collaboration topics include: | |
| - open-model ecosystem studies | |
| - licensing analysis | |
| - model openness | |
| - reproducibility | |
| - deployment research | |
| - model registries | |
| - benchmarking methodology | |
| --- | |
| # Independence | |
| **Open Weights** is an independent Hugging Face community organization. | |
| It is not an official project of: | |
| - Hugging Face | |
| - any model publisher | |
| - any AI laboratory | |
| - any inference provider | |
| - any hardware manufacturer | |
| - any observability company | |
| - any cloud provider | |
| Model names, trademarks and repository names belong to their respective owners. | |
| --- | |
| # Legal Disclaimer | |
| The information in this organization is provided for technical and informational purposes. | |
| It is not legal advice. | |
| Licenses, access rules and model terms may change. | |
| Always review the current official: | |
| - model card | |
| - license | |
| - repository | |
| - publisher documentation | |
| - access conditions | |
| before using, modifying, redistributing or commercially deploying a model. | |
| --- | |
| # Long-Term Vision | |
| The long-term goal of **Open Weights** is to become a practical reference layer for the open-weight AI ecosystem. | |
| Not simply: | |
| ```text | |
| a list of models | |
| ``` | |
| but a structured system connecting: | |
| ```text | |
| MODEL | |
| + | |
| WEIGHTS | |
| + | |
| LICENSE | |
| + | |
| ACCESS | |
| + | |
| ARCHITECTURE | |
| + | |
| CONTEXT | |
| + | |
| FORMAT | |
| + | |
| RUNTIME | |
| + | |
| DEPLOYMENT | |
| + | |
| VERIFICATION | |
| ``` | |
| into one reusable reference layer. | |
| The most useful future version of Open Weights is not a static directory. | |
| It is a continuously improving, machine-readable map of the open-weight AI ecosystem. | |
| --- | |
| # Open Weights | |
| ### Discover. Compare. Verify. Deploy. | |
| **Registry β Explore β Compare β Check β Assess β Deploy** | |