-
Upload folder using huggingface_hub
-
Delete logs/output_run_20260202_novo_furnage.log
-
Delete logs/output_run_20260202_placater_lyricism.log
-
Delete logs/output_run_20260202_unplace_stormer.log
-
Delete logs/output_run_20260202_paeonia_snout.log
-
Upload folder using huggingface_hub
-
Upload folder using huggingface_hub
-
Upload folder using huggingface_hub
-
Upload folder using huggingface_hub
-
Upload folder using huggingface_hub
-
Upload folder using huggingface_hub
-
Upload folder using huggingface_hub
-
Upload folder using huggingface_hub
-
Upload folder using huggingface_hub
-
Upload folder using huggingface_hub
-
Upload folder using huggingface_hub
-
Upload folder using huggingface_hub
-
Upload folder using huggingface_hub
-
Upload folder using huggingface_hub
-
Upload folder using huggingface_hub
-
Upload folder using huggingface_hub
-
Upload folder using huggingface_hub
-
Upload folder using huggingface_hub
-
Upload folder using huggingface_hub
-
Upload folder using huggingface_hub
-
Upload folder using huggingface_hub
-
Delete logs/output_run_20260201_lycidae_foots.log
-
Delete logs/output_run_20260201_aval_culpa.log
-
Upload folder using huggingface_hub
-
Upload folder using huggingface_hub
-
Upload folder using huggingface_hub
-
Delete logs/run_20260131_alpinia_oxphony_train.csv
-
Delete logs/output_run_20260131_phialide_snub.log
-
Delete logs/output_run_20260130_unhinge_northing.log
-
Delete logs/output_run_20260131_alpinia_oxphony.log
-
Delete model_checkpoints
-
Upload folder using huggingface_hub
-
Upload folder using huggingface_hub
-
Upload folder using huggingface_hub
-
Upload folder using huggingface_hub
-
Upload 14 files
Model:
Tiny_MoE_2_Config(
name='Tiny_MoE_2',
dtype=jax.numpy.bfloat16,
param_dtype=jax.numpy.float32,
block_size=2048,
vocab_size=49152,
n_layer=30,
n_head=12,
n_kv_head=4,
n_embed=672,
n_experts=8,
mesh=None,
top_k=2,
load_factor=5,
expert_weight_priority=False,
load_balance_loss_coeff=0.01,
z_loss_coeff=0.001,
n_mlp_hidden=2048,
mlp_bias=False,
attention_bias=False,
moe_bias=False,
ln_epsilon=1e-05,
glu_activation='silu',
sdpa_implementation='cudnn',
rope_theta=0,
init_stddev=0.02,
use_cache=False,
pad_token='<pad>',
glu_fc_kernel_sharding=(None,),
glu_fc_bias_sharding=(None,),
glu_gate_kernel_sharding=(None,),
glu_gate_bias_sharding=(None,),
glu_proj_kernel_sharding=(None,),
glu_proj_bias_sharding=(None,),
attn_wq_kernel_sharding=(None,),
attn_wq_bias_sharding=(None,),
attn_wkv_kernel_sharding=(None,),
attn_wkv_bias_sharding=(None,),
attn_wproj_kernel_sharding=(None,),
attn_wproj_bias_sharding=(None,),
embed_partition_spec=(None,),
rmsnorm_partition_spec=(None,),
)
Dataset:
Hugging… -
Delete run_20250827_hart_narendra
-
Upload 13 files
Model:
Tiny_MoE_2_Config(
name='Tiny_MoE_2',
dtype=jax.numpy.bfloat16,
param_dtype=jax.numpy.float32,
block_size=2048,
vocab_size=49152,
n_layer=30,
n_head=12,
n_kv_head=4,
n_embed=672,
n_experts=8,
mesh=None,
top_k=2,
load_factor=5,
expert_weight_priority=False,
load_balance_loss_coeff=0.01,
z_loss_coeff=0.001,
n_mlp_hidden=2048,
mlp_bias=False,
attention_bias=False,
moe_bias=False,
ln_epsilon=1e-05,
glu_activation='silu',
sdpa_implementation='cudnn',
rope_theta=0,
init_stddev=0.02,
use_cache=False,
pad_token='<pad>',
glu_fc_kernel_sharding=(None,),
glu_fc_bias_sharding=(None,),
glu_gate_kernel_sharding=(None,),
glu_gate_bias_sharding=(None,),
glu_proj_kernel_sharding=(None,),
glu_proj_bias_sharding=(None,),
attn_wq_kernel_sharding=(None,),
attn_wq_bias_sharding=(None,),
attn_wkv_kernel_sharding=(None,),
attn_wkv_bias_sharding=(None,),
attn_wproj_kernel_sharding=(None,),
attn_wproj_bias_sharding=(None,),
embed_partition_spec=(None,),
rmsnorm_partition_spec=(None,),
)
Dataset:
https:/… -
initial commit
