jasonfan
/

FST_code

Model card Files Files and versions

FST_code / config /size /7b.yaml

jasonfan's picture

2026-03-19

3b2d368 verified 5 months ago

History Blame Contribute Delete

135 Bytes

	defaults:
	- _base
	- _self_

	# Size Identity
	size_name: 7b

	# Dimensions
	n_layers: 32
	n_heads: 32
	hidden_dim: 4096
	max_seq_len: 4096