{% extends "base.html" %} {% set nav = 'models' %} {% block title %}{{ job.name }} — NanoDex{% endblock %} {% block body %} ← {{ 'My models' if owner else 'Explore' }}

{{ job.name }}

{{ job.tier_label }} · {{ "{:,}".format(job.n_params) }} parameters · by @{{ job.username }}

{% if owner %}
{% endif %}
Progress —
Tokens seen
—
 
Step
—
 
Loss
—
 
Throughput
—
 

Loss curve

cross-entropy vs tokens seen

Architecture

ClassLlamaForCausalLM
Layers{{ job.arch.layers }}
Hidden size{{ job.arch.hidden }}
Attention heads{{ job.arch.heads }} ({{ job.arch.kv_heads }} KV, head dim {{ job.arch.head_dim }})
FFN size{{ job.arch.ffn }}
Context{{ job.arch.ctx }} tokens
Vocabulary{{ "{:,}".format(job.arch.vocab) }}
Parameters{{ "{:,}".format(job.n_params) }}

Run

Datasetfineweb-edu
Token budget—
OptimizerAdamW β=0.9/0.95 wd=0.1
Schedule2% warmup → cosine
Learning rate—
Best loss—
Worker—
Queued—
{% if owner %} {% endif %}

Logs

waiting…
{% endblock %} {% block scripts %} {% endblock %}