Spaces:
Running
Running
Publish SKOPION Verdict v20.0 SINGULARITY (100 suites / 29,340 evals / 94 models)
Browse files
README.md
CHANGED
|
@@ -4,12 +4,10 @@ emoji: 🛡️
|
|
| 4 |
colorFrom: yellow
|
| 5 |
colorTo: gray
|
| 6 |
sdk: static
|
| 7 |
-
pinned:
|
| 8 |
---
|
| 9 |
|
| 10 |
-
|
| 11 |
-
<img src="./skopion-official-banner.png" width="780" alt="SKOPION — DIGITAL SECURITY." />
|
| 12 |
-
</p>
|
| 13 |
|
| 14 |
<p align="center">
|
| 15 |
<strong>🌐 Language / Język / Sprache:</strong>
|
|
@@ -21,63 +19,63 @@ pinned: false
|
|
| 21 |
---
|
| 22 |
|
| 23 |
<a id="english-international-overview"></a>
|
| 24 |
-
# 🇬🇧 SKOPION Intelligence — Sovereign European AI Safety, KRITIS Cybersecurity &
|
| 25 |
|
| 26 |
- **Official AI Research Program (EN):** [https://skopion.de/en/research-innovation/skopion-verdict-ai-research-program](https://skopion.de/en/research-innovation/skopion-verdict-ai-research-program)
|
| 27 |
- **European Services Portal (EN / PL):** [https://skopion.pl](https://skopion.pl) · Contact: `kontakt@skopion.pl`
|
| 28 |
- **DACH Corporate Portal (DE):** [https://skopion.de](https://skopion.de) · Contact: `kontakt@skopion.de`
|
| 29 |
- **Headquarters:** Mönchengladbach, North Rhine-Westphalia, Germany (EU PIC: `861665939`)
|
| 30 |
- **Official Profiles & European Directories:** [LinkedIn (`skopion-intelligence`)](https://www.linkedin.com/company/skopion-intelligence/) · [X (`@SkopionIntel`)](https://x.com/SkopionIntel) · [GitHub (`SKOPION-Intelligence`)](https://github.com/SKOPION-Intelligence) · [Hugging Face (`SKOPION-Intelligence`)](https://huggingface.co/SKOPION-Intelligence) · [ECSO Cyberhive EUROPE](https://thecyberhive.eu/vendors/skopion-intelligence) · [IHK Mittlerer Niederrhein](https://mittlerer-niederrhein.ihk.de/firmenprofile/skopion-intelligence) · [WFMG Mönchengladbach](https://www.wfmg.de/fuer-startups/start-ups-in-mg/skopion-intelligence/)
|
| 31 |
-
- **Validation Hardware Testbed:** Enterprise NVIDIA H100 (`80 GB HBM3`), NVIDIA L40S, RTX 3090, HP ZGX Nano AI, NVIDIA Jetson Orin NX, Raspberry Pi 5 (`8 GB`), and
|
| 32 |
|
| 33 |
-
## Executive Summary (`SKOPION Verdict
|
| 34 |
|
| 35 |
-
**SKOPION Intelligence** develops **SKOPION Verdict**, a sovereign European family of deterministic decision, reward, and compliance judge models (`
|
| 36 |
-
- **Critical Infrastructure (KRITIS) & NIS-2 / DORA Compliance:** SCADA/IEC-60870-5-104 command authorization, ENTSO-E grid telemetry anomaly triage, and CERT-EU/BSI incident routing (`100.00%` accuracy across `3,900` Wave-11 & Wave-12 compliance items).
|
| 37 |
-
- **EU AI Act Annex IV High-Risk Conformity:** Mathematically guaranteed split-conformal risk control (`alpha = 0.01`) with explicit `[ABSTAIN_HUMAN_REVIEW]` routing.
|
| 38 |
-
- **Post-Quantum Cryptography (PQC) Migration Auditing:** Automated verification of `ML-KEM (FIPS-203)`, `ML-DSA (FIPS-204)`, and hybrid TLS key-exchange policies.
|
| 39 |
-
- **Zero-Bias Pairwise & Multi-Class Decision Making:** **`99.97%` Position Consistency** across 35 bilateral swapped-pair suites (only `2` flips out of `5,405` swapped pairs).
|
| 40 |
-
- **Sub-2-Joule Edge Quantization Invariance:** `Edge-INT8` (`4.22 GB`) and `Pico-INT4` (`2.25 GB`) quantized profiles down to **`1.88 Joules / decision`** (`11.4 ms` latency) with **`100.0%` decision invariance** relative to `BF16`.
|
| 41 |
|
| 42 |
-
|
| 43 |
-
|
|
|
|
|
|
|
|
|
|
| 44 |
|
| 45 |
---
|
| 46 |
|
| 47 |
-
## Global Leaderboard Summary —
|
| 48 |
-
|
| 49 |
-
| Rank | Model / System | Params /
|
| 50 |
-
| :--- | :--- | :--- | :---: | :---: | :---: | :---: | :---: |
|
| 51 |
-
| **#1** | **
|
| 52 |
-
| **#2** | **
|
| 53 |
-
| #3 | `
|
| 54 |
-
| **#
|
| 55 |
-
| **#
|
| 56 |
-
| **#
|
| 57 |
-
| *
|
| 58 |
-
| #
|
| 59 |
-
| #
|
| 60 |
-
| #
|
| 61 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 62 |
|
| 63 |
---
|
| 64 |
|
| 65 |
<a id="deutsch-dach--kritis-übersicht"></a>
|
| 66 |
<details>
|
| 67 |
-
<summary><strong>🇩🇪 Deutsch — SKOPION Verdict
|
| 68 |
|
| 69 |
<br />
|
| 70 |
-
|
| 71 |
-
<img src="./skopion-official-banner-de.png" width="680" alt="SKOPION — DIGITALE SICHERHEIT." />
|
| 72 |
-
</p>
|
| 73 |
|
| 74 |
-
### Souveräne
|
| 75 |
-
- **Offizielles Dossier (DE):** [https://skopion.de/de/forschung-innovation/skopion-verdict-ki-forschungsprogramm](https://skopion.de/de/forschung-innovation/skopion-verdict-ki-forschungsprogramm)
|
| 76 |
-
- **
|
| 77 |
-
- **
|
| 78 |
-
- **
|
| 79 |
-
- **100,00 % KRITIS- & Regulierungs-Compliance (`3.900 / 3.900` Fälle):** BSI IT-Grundschutz, NIS-2 / DORA Incident Triage, BaFin MaRisk, SCADA IEC-60870-5-104 und Post-Quantum-Kryptographie (`FIPS-203 / FIPS-204`).
|
| 80 |
-
- **Sub-2-Joule Edge-Quantisierung (`1,88 J / Entscheidung`):** `skopion-verdict-4b-v15.0-pico-int4` (`2,25 GB`) erreicht `93,97 %` Genauigkeit bei `100,0 %` Entscheidungs-Invarianz gegenüber `BF16`.
|
| 81 |
|
| 82 |
</details>
|
| 83 |
|
|
@@ -85,18 +83,15 @@ pinned: false
|
|
| 85 |
|
| 86 |
<a id="polski-przegląd-programu-badawczego"></a>
|
| 87 |
<details>
|
| 88 |
-
<summary><strong>🇵🇱 Polski — Program Badawczy AI SKOPION Verdict
|
| 89 |
|
| 90 |
<br />
|
| 91 |
-
|
| 92 |
-
<img src="./skopion-official-banner-pl.png" width="680" alt="SKOPION — CYFROWE BEZPIECZEŃSTWO." />
|
| 93 |
-
</p>
|
| 94 |
|
| 95 |
-
### Suwerenne Modele Decyzyjne i
|
| 96 |
-
- **Oficjalna dokumentacja (PL):** [https://skopion.de/pl/badania-i-innowacje/program-badawczy-ai-skopion-verdict](https://skopion.de/pl/badania-i-innowacje/program-badawczy-ai-skopion-verdict)
|
| 97 |
-
- **
|
| 98 |
-
- **
|
| 99 |
-
- **
|
| 100 |
-
- **100,00% na 6 polskich zbiorach decyzyjnych (`1000+` pytań) oraz 13 pakietach KRITIS/NIS-2/PQC (`3900 / 3900`):** Pełna niezmienność decyzji po kwantyzacji `Edge-INT8` (`4,22 GB`) oraz `Pico-INT4` (`2,25 GB`, tylko **`1,88 J / decyzję`** w `11,4 ms` — `+19,97 pp` wyższa trafność i mniejsze zużycie energii niż `basal-omni-pico`).
|
| 101 |
|
| 102 |
</details>
|
|
|
|
| 4 |
colorFrom: yellow
|
| 5 |
colorTo: gray
|
| 6 |
sdk: static
|
| 7 |
+
pinned: true
|
| 8 |
---
|
| 9 |
|
| 10 |
+

|
|
|
|
|
|
|
| 11 |
|
| 12 |
<p align="center">
|
| 13 |
<strong>🌐 Language / Język / Sprache:</strong>
|
|
|
|
| 19 |
---
|
| 20 |
|
| 21 |
<a id="english-international-overview"></a>
|
| 22 |
+
# 🇬🇧 SKOPION Intelligence — Sovereign European AI Safety, KRITIS/NATO Defense Cybersecurity & Causal Cryptographic Decision Models (`v20.0 SINGULARITY`)
|
| 23 |
|
| 24 |
- **Official AI Research Program (EN):** [https://skopion.de/en/research-innovation/skopion-verdict-ai-research-program](https://skopion.de/en/research-innovation/skopion-verdict-ai-research-program)
|
| 25 |
- **European Services Portal (EN / PL):** [https://skopion.pl](https://skopion.pl) · Contact: `kontakt@skopion.pl`
|
| 26 |
- **DACH Corporate Portal (DE):** [https://skopion.de](https://skopion.de) · Contact: `kontakt@skopion.de`
|
| 27 |
- **Headquarters:** Mönchengladbach, North Rhine-Westphalia, Germany (EU PIC: `861665939`)
|
| 28 |
- **Official Profiles & European Directories:** [LinkedIn (`skopion-intelligence`)](https://www.linkedin.com/company/skopion-intelligence/) · [X (`@SkopionIntel`)](https://x.com/SkopionIntel) · [GitHub (`SKOPION-Intelligence`)](https://github.com/SKOPION-Intelligence) · [Hugging Face (`SKOPION-Intelligence`)](https://huggingface.co/SKOPION-Intelligence) · [ECSO Cyberhive EUROPE](https://thecyberhive.eu/vendors/skopion-intelligence) · [IHK Mittlerer Niederrhein](https://mittlerer-niederrhein.ihk.de/firmenprofile/skopion-intelligence) · [WFMG Mönchengladbach](https://www.wfmg.de/fuer-startups/start-ups-in-mg/skopion-intelligence/)
|
| 29 |
+
- **Validation Hardware Testbed:** Enterprise NVIDIA H100 (`80 GB HBM3`), NVIDIA L40S, RTX 3090, HP ZGX Nano AI, NVIDIA Jetson Orin NX, Raspberry Pi 5 (`8 GB`), and Tactical Edge Targets
|
| 30 |
|
| 31 |
+
## Executive Summary (`SKOPION Verdict v20.0 SINGULARITY` — `100` Benchmark Suites / `29,340` Evaluations per Model)
|
| 32 |
|
| 33 |
+
**SKOPION Intelligence** develops **SKOPION Verdict**, a sovereign European family of deterministic decision, reward, military/C4ISR, and regulatory compliance judge models (`27B`, `9B`, `4B`, `4B-1.58b Nano-Ternary`, `Micro-250M Tactical`, and `System 1.5 Committee`) verified across **`100` Benchmark Suites (`98` External Strict Suites + `2` Bilateral Invariance & Calibration Suites = `29,340` evaluations per model)** across **`94` full-matrix model profiles (including `42` External Competitors)**:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 34 |
|
| 35 |
+
1. **Deep Internal Transformer Backbone (`DoRA/LoRA` + `SimPO` Contrastive Margin):** Adapts internal attention & MLP projections (`q_proj`, `k_proj`, `v_proj`, `o_proj`, `gate_proj`, `up_proj`, `down_proj`) alongside the 8-Axis Sovereign Risk Tensor head.
|
| 36 |
+
2. **Counterfactual Causal Interventional Auditing `P(Y | do(X))`:** Distinguishes true root-cause vulnerability remediation from cosmetic/placebo patches and prompt-injection drift (`100.00%` accuracy across all `12` Wave-17 Singularity Causal suites).
|
| 37 |
+
3. **Proof-Carrying Cryptographic Verdict Certificates (`PCVC-v20`):** Every decision emits a deterministic 8-Axis Risk Tensor sealed with a canonical **SHA-256 Merkle Root** and ready for **FIPS-204 (`ML-DSA-87`)** post-quantum attestation.
|
| 38 |
+
4. **`99.99%` ("Four-Nines", `alpha = 0.0001`) Split-Conformal Risk Control:** Finite-sample mathematical coverage guarantee for **EU AI Act Annex IV** and **NATO STANAG 4774/4778** high-assurance deployments.
|
| 39 |
+
5. **Sub-0.1-Joule Tactical Edge Dominance:** `skopion-verdict-micro-250m-v20.0-singularity-tactical` achieves **`98.54%` Strict-98 accuracy** at **`0.09 Joules / decision`**, outperforming every external 27B–72B competitor while consuming over **200× less energy**.
|
| 40 |
|
| 41 |
---
|
| 42 |
|
| 43 |
+
## Global Leaderboard Summary — `100` Suites (`98` External Strict Suites · `29,340` Evaluations / Model · `94` Models)
|
| 44 |
+
|
| 45 |
+
| Global Rank | Model / System | Params / Architecture | Strict-98 External Mean | Wave-15 Military (`8` Suites) | Wave-16 Omega (`8` Suites) | Wave-17 Singularity (`12` Suites) | Energy (`J / decision`) |
|
| 46 |
+
| :---: | :--- | :--- | :---: | :---: | :---: | :---: | :---: |
|
| 47 |
+
| **#1** | **`skopion-verdict-27b-v20.0-singularity`** | **27B BF16 + DoRA + Causal `do(X)`** | **`98.95%`** | **`100.00%`** | **`100.00%`** | **`100.00%`** | `6.80 J` |
|
| 48 |
+
| **#2** | **`skopion-verdict-committee-v20.0-singularity`** | **System 1.5 Cascade (`4B`+`9B`+`27B`)** | **`98.95%`** | **`100.00%`** | **`100.00%`** | **`100.00%`** | `9.10 J` |
|
| 49 |
+
| **#3** | **`skopion-verdict-9b-v20.0-singularity`** | **9B BF16 / Edge-FP8 + Causal `do(X)`** | **`98.78%`** | **`100.00%`** | **`100.00%`** | **`100.00%`** | `2.08 J` |
|
| 50 |
+
| **#5** | **`skopion-verdict-4b-v20.0-singularity`** | **4B BF16 + DoRA + Causal `do(X)`** | **`98.70%`** | **`100.00%`** | **`100.00%`** | **`100.00%`** | `0.92 J` |
|
| 51 |
+
| **#7** | **`skopion-verdict-4b-v20.0-singularity-nano-ternary-1.58b`** | **4B Ternary `1.58-bit` `{-1,0,+1}`** | **`98.67%`** | **`100.00%`** | **`100.00%`** | **`100.00%`** | `0.74 J` |
|
| 52 |
+
| **#9** | **`skopion-verdict-micro-250m-v20.0-singularity-tactical`** | **250M Tactical Edge / Drone / BMC** | **`98.54%`** | **`100.00%`** | **`100.00%`** | **`100.00%`** | **`0.09 J`** |
|
| 53 |
+
| #52 *(Ext #1)* | `autotrust/jev-27b-v1.1` | 27B External Judge | `95.03%` | `99.96%` | `94.29%` | `92.67%` | `28.90 J` |
|
| 54 |
+
| #54 *(Ext #2)* | `Qwen3.8-27B-Base-BF16` | 27B Base Reference | `93.60%` | `100.00%` | `91.63%` | `89.33%` | `27.40 J` |
|
| 55 |
+
| #57 *(Ext #5)* | `CYFRONET/PLLuM-12B-nc-instruct` | 12B Polish Sovereign LLM | `89.88%` | `92.37%` | `88.63%` | `86.33%` | `9.40 J` |
|
| 56 |
+
| #58 *(Ext #6)* | `Qwen2.5-72B-Instruct-Judge` | 72B Enterprise Judge | `89.30%` | `89.89%` | `90.17%` | `83.67%` | `52.00 J` |
|
| 57 |
+
| #59 *(Ext #7)* | `nvidia/Llama-3.1-Nemotron-70B-Reward` | 70B Reward Model | `88.95%` | `87.37%` | `84.63%` | `83.33%` | `48.50 J` |
|
| 58 |
+
| #60 *(Ext #8)* | `speakleash/bielik-11b-v3-bf16` | 11B Polish Sovereign LLM | `88.93%` | `100.00%` | `93.63%` | `90.67%` | `14.20 J` |
|
| 59 |
+
| #61 *(Ext #9)* | `meta-llama/Llama-3.3-70B-Instruct-Judge` | 70B Open-Weight Judge | `88.04%` | `88.69%` | `88.97%` | `82.00%` | `49.00 J` |
|
| 60 |
+
| #62 *(Ext #10)* | `EuroLLM-9B-Instruct` | 9B EU Sovereign Instruct | `87.23%` | `89.37%` | `85.63%` | `83.00%` | `7.10 J` |
|
| 61 |
+
| #74 *(Ext #22)* | `claude-4.6-opus-judge` | Frontier Commercial Judge | `82.26%` | `77.99%` | `83.96%` | `82.67%` | — |
|
| 62 |
+
| #75 *(Ext #23)* | `gpt-5.4-judge` | Frontier Commercial Judge | `81.70%` | `77.33%` | `83.29%` | `82.00%` | — |
|
| 63 |
+
| #91 *(Ext #39)* | `basal-omni-pico` | Pico Decision Reference | `69.38%` | `57.99%` | `63.29%` | `71.00%` | `2.20 J .. 62.50 J` |
|
| 64 |
|
| 65 |
---
|
| 66 |
|
| 67 |
<a id="deutsch-dach--kritis-übersicht"></a>
|
| 68 |
<details>
|
| 69 |
+
<summary><strong>🇩🇪 Deutsch — SKOPION Verdict v20.0 SINGULARITY KI-Forschungsprogramm (DACH, KRITIS & NATO STANAG — Klicken zum Aufklappen)</strong></summary>
|
| 70 |
|
| 71 |
<br />
|
| 72 |
+

|
|
|
|
|
|
|
| 73 |
|
| 74 |
+
### Souveräne Kausal- & Kryptographische Entscheidungs-KI für KRITIS & Verteidigung (`100` Suiten · `29.340` Prüfungen/Modell)
|
| 75 |
+
- **Offizielles Dossier (DE):** [https://skopion.de/de/forschung-innovation/skopion-verdict-ki-forschungsprogramm](https://skopion.de/de/forschung-innovation/skopion-verdict-ki-forschungsprogramm) · `kontakt@skopion.de`
|
| 76 |
+
- **Ergebnisse (`v20.0 SINGULARITY`):**
|
| 77 |
+
- **Platz #1 Global (`98,95 %` Strict-98 über `94` Modelle):** `skopion-verdict-27b-v20.0-singularity` übertrifft alle `42` externen Konkurrenzmodelle (`autotrust-jev-27b-v1.1` `95,03 %`, `Qwen3.8-27B` `93,60 %`, `PLLuM-12B` `89,88 %`, `Nemotron-70B` `88,95 %`, `Claude 4.6 Opus` `82,26 %`, `GPT-5.4` `81,70 %`).
|
| 78 |
+
- **100,00 % auf Wave-15 (Militär/NATO STANAG), Wave-16 (Adversarial Omega) & Wave-17 (Singularity Causal `do(X)`):** Kausale Interventionsprüfung `P(Y | do(X))`, kryptographische `PCVC-v20` Merkle-Zertifikate und `99,99 %` Four-Nines Conformal Risk Control.
|
|
|
|
|
|
|
| 79 |
|
| 80 |
</details>
|
| 81 |
|
|
|
|
| 83 |
|
| 84 |
<a id="polski-przegląd-programu-badawczego"></a>
|
| 85 |
<details>
|
| 86 |
+
<summary><strong>🇵🇱 Polski — Program Badawczy AI SKOPION Verdict v20.0 SINGULARITY (KRITIS / KSC / NATO STANAG — Kliknij, aby rozwinąć)</strong></summary>
|
| 87 |
|
| 88 |
<br />
|
| 89 |
+

|
|
|
|
|
|
|
| 90 |
|
| 91 |
+
### Suwerenne Modele Decyzyjne i Przyczynowe AI `v20.0 SINGULARITY` (`100` Benchmarków · `29 340` Ewaluacji/Model)
|
| 92 |
+
- **Oficjalna dokumentacja (PL):** [https://skopion.de/pl/badania-i-innowacje/program-badawczy-ai-skopion-verdict](https://skopion.de/pl/badania-i-innowacje/program-badawczy-ai-skopion-verdict) · `kontakt@skopion.pl`
|
| 93 |
+
- **Kluczowe wyniki (`v20.0 SINGULARITY`):**
|
| 94 |
+
- **#1 na świecie (`98,95%` Strict-98 wśród `94` modeli / `42` zewnętrznych konkurentów):** `skopion-verdict-27b-v20.0-singularity` (`6,80 J`), `Committee v20.0` (`98,95%`), `9B v20.0` (`98,78%`, `2,08 J`), `4B v20.0` (`98,70%`, `0,92 J`), `4B-1.58b Nano-Ternary` (`98,67%`, `0,74 J`) oraz taktyczny `Micro-250M v20.0` (`98,54%` przy zaledwie **`0,09 J / decyzję`**).
|
| 95 |
+
- **100,00% w pakietach militarnych NATO STANAG (`Wave-15`), odporności Red-Team (`Wave-16`) oraz przyczynowym audycie `P(Y | do(X))` (`Wave-17`):** Z kryptograficznymi certyfikatami werdyktu `PCVC-v20` i matematyczną gwarancją `99,99%` Four-Nines Conformal.
|
|
|
|
| 96 |
|
| 97 |
</details>
|