Spaces:
Running
Running
presence: sync card
Browse files
README.md
CHANGED
|
@@ -20,17 +20,14 @@ short_description: We are Authentrics.ai
|
|
| 20 |
[](https://app.authentrics.ai/)
|
| 21 |
[](https://app.authentrics.ai/)
|
| 22 |
|
| 23 |
-
# Authentrics.ai
|
| 24 |
|
| 25 |
-
|
| 26 |
-
order all shape the outcome, and problems often aren't visible until a final evaluation β by which point a
|
| 27 |
-
full retrain looks like the only fix. Authentrics compares the checkpoints a training run already saves to
|
| 28 |
-
identify what changed, and when. When unwanted behavior traces back to specific training session(s), that
|
| 29 |
-
effect can be removed directly from the checkpoint. Separately, a checkpoint can be optimized directly
|
| 30 |
-
against a defined objective β recovering accuracy, correcting a regression, suppressing unwanted behavior β
|
| 31 |
-
without backprop or retraining. Neither path requires starting the run over.
|
| 32 |
|
| 33 |
-
|
|
|
|
|
|
|
|
|
|
| 34 |
|
| 35 |
- **Checkpoint-to-checkpoint comparison.** Parameter and activation drift measured between the checkpoints
|
| 36 |
a training run already saves β no extra instrumentation.
|
|
@@ -53,7 +50,7 @@ Everything runs locally on your own hardware; only project metadata leaves your
|
|
| 53 |
|
| 54 |
Each demo is a reproducible ML problem: a model that failed in a specific way, and how we found and fixed it.
|
| 55 |
|
| 56 |
-
###
|
| 57 |
|
| 58 |
*Backdoor / data poisoning (BadNets)*
|
| 59 |
|
|
@@ -65,7 +62,7 @@ A LeNet-5 MNIST classifier is trained with one poisoned epoch that plants a BadN
|
|
| 65 |
- [Model on Hugging Face](https://huggingface.co/authentrics/mnist-badnets-poisoned)
|
| 66 |
- [Corrected model](https://huggingface.co/authentrics/mnist-badnets-repaired)
|
| 67 |
|
| 68 |
-
###
|
| 69 |
|
| 70 |
*Catastrophic forgetting / task interference*
|
| 71 |
|
|
@@ -76,7 +73,7 @@ Fine-tuning Gemma 3 1B on a new task quietly degraded a capability it already ha
|
|
| 76 |
- [Source code (GitHub)](https://github.com/Authentrics-ai/authentrics-model-analysis-experiments)
|
| 77 |
- [Model on Hugging Face](https://huggingface.co/authentrics/ztom-gemma3-1b-recovery)
|
| 78 |
|
| 79 |
-
###
|
| 80 |
|
| 81 |
*Memorization / PII leakage*
|
| 82 |
|
|
@@ -87,16 +84,16 @@ A medical chatbot fine-tuned on data containing personal information memorized t
|
|
| 87 |
- [Source code (GitHub)](https://github.com/Authentrics-ai/authentrics-analysis-examples)
|
| 88 |
- [Model on Hugging Face](https://huggingface.co/authentrics/pii-removal-medical-llama32)
|
| 89 |
|
| 90 |
-
###
|
| 91 |
|
| 92 |
-
**
|
| 93 |
|
| 94 |
Which experts does Mixtral-8x7B actually use, and how does that routing structure emerge across training? We read the routing and per-layer influence without touching the weights remotely.
|
| 95 |
|
| 96 |
- [Source code (GitHub)](https://github.com/Authentrics-ai/authentrics-model-analysis-experiments)
|
| 97 |
- [Model on Hugging Face](https://huggingface.co/authentrics/mixtral-expert-routing)
|
| 98 |
|
| 99 |
-
**
|
| 100 |
|
| 101 |
Across the NVIDIA Nemotron Cascade 8B checkpoint lineage, what changed inside the model β where, when, and how much? We track parameter and activation drift checkpoint to checkpoint.
|
| 102 |
|
|
@@ -106,7 +103,7 @@ Across the NVIDIA Nemotron Cascade 8B checkpoint lineage, what changed inside th
|
|
| 106 |
**Demonstrates:** checkpoint-to-checkpoint comparison (`static_analysis`, `activation_analysis`, `correlation_analysis`)
|
| 107 |
|
| 108 |
|
| 109 |
-
##
|
| 110 |
|
| 111 |
```bash
|
| 112 |
pip install authentrics # Linux x86_64, Python 3.11β3.13
|
|
|
|
| 20 |
[](https://app.authentrics.ai/)
|
| 21 |
[](https://app.authentrics.ai/)
|
| 22 |
|
| 23 |
+
# Authentrics.ai
|
| 24 |
|
| 25 |
+
**Find what changed. Find when it changed. Fix it without retraining.**
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 26 |
|
| 27 |
+
Compare training checkpoints to diagnose regressions, trace unwanted behavior to training intervals,
|
| 28 |
+
remove training influence, and optimize model behavior directly.
|
| 29 |
+
|
| 30 |
+
## What You Can Do With Authentrics
|
| 31 |
|
| 32 |
- **Checkpoint-to-checkpoint comparison.** Parameter and activation drift measured between the checkpoints
|
| 33 |
a training run already saves β no extra instrumentation.
|
|
|
|
| 50 |
|
| 51 |
Each demo is a reproducible ML problem: a model that failed in a specific way, and how we found and fixed it.
|
| 52 |
|
| 53 |
+
### Find Which Training Step Introduced a Backdoor β Then Remove It
|
| 54 |
|
| 55 |
*Backdoor / data poisoning (BadNets)*
|
| 56 |
|
|
|
|
| 62 |
- [Model on Hugging Face](https://huggingface.co/authentrics/mnist-badnets-poisoned)
|
| 63 |
- [Corrected model](https://huggingface.co/authentrics/mnist-badnets-repaired)
|
| 64 |
|
| 65 |
+
### Recover a Capability Lost During Fine-Tuning
|
| 66 |
|
| 67 |
*Catastrophic forgetting / task interference*
|
| 68 |
|
|
|
|
| 73 |
- [Source code (GitHub)](https://github.com/Authentrics-ai/authentrics-model-analysis-experiments)
|
| 74 |
- [Model on Hugging Face](https://huggingface.co/authentrics/ztom-gemma3-1b-recovery)
|
| 75 |
|
| 76 |
+
### Remove Memorized PII Without Retraining the Model
|
| 77 |
|
| 78 |
*Memorization / PII leakage*
|
| 79 |
|
|
|
|
| 84 |
- [Source code (GitHub)](https://github.com/Authentrics-ai/authentrics-analysis-examples)
|
| 85 |
- [Model on Hugging Face](https://huggingface.co/authentrics/pii-removal-medical-llama32)
|
| 86 |
|
| 87 |
+
### Understand What Changed Inside Your Model
|
| 88 |
|
| 89 |
+
**See Which Experts a Mixture-of-Experts Model Actually Uses** β *Interpretability / MoE routing*
|
| 90 |
|
| 91 |
Which experts does Mixtral-8x7B actually use, and how does that routing structure emerge across training? We read the routing and per-layer influence without touching the weights remotely.
|
| 92 |
|
| 93 |
- [Source code (GitHub)](https://github.com/Authentrics-ai/authentrics-model-analysis-experiments)
|
| 94 |
- [Model on Hugging Face](https://huggingface.co/authentrics/mixtral-expert-routing)
|
| 95 |
|
| 96 |
+
**Find Where a Model Changed Across Its Training Run** β *Training dynamics / drift diagnosis*
|
| 97 |
|
| 98 |
Across the NVIDIA Nemotron Cascade 8B checkpoint lineage, what changed inside the model β where, when, and how much? We track parameter and activation drift checkpoint to checkpoint.
|
| 99 |
|
|
|
|
| 103 |
**Demonstrates:** checkpoint-to-checkpoint comparison (`static_analysis`, `activation_analysis`, `correlation_analysis`)
|
| 104 |
|
| 105 |
|
| 106 |
+
## Try It on Your Model
|
| 107 |
|
| 108 |
```bash
|
| 109 |
pip install authentrics # Linux x86_64, Python 3.11β3.13
|