--- language: - en --- its so stupid LMAOOO # McConversationBot V3 Package: `McConversationBot-V3-62.1M` ## Identity - Model family: `McConversationBot` - Model version: `V3` - Parameters: `62.1M` - Architecture: `McConversationBotV3` - Architecture base: `V15-compatible` ## Architecture - Total vocabulary: `4099` - BPE vocabulary: `4096` - Embedding size: `640` - Layers: `12` - Attention heads: `8` - KV heads: `8` - Context length: `512` - Dropout: `0.05` - RMSNorm: `True` - RoPE: `True` - SwiGLU: `True` - GQA: `False` - Bias: `False` - RoPE theta: `10000.0` - MLP ratio: `2.6666667` ## Special tokens - `<|user|>` = `4096` - `<|assistant|>` = `4097` - `<|end|>` = `4098` ## Verification Architecture verified: `True` Checkpoint SHA256: `C99FEEEE7CB7CBBDC90C7AAD89BF9F23FE0ABB9E99980A981498C51D836CA573` Tokenizer SHA256: `F70E2F2465E9DE7CECC84E78FFD4CD269A8CA590CAEA033C32F04B82F7CAFBDB` ## Checkpoints ### Pretrain checkpoint - File: `pretrain.pt` - SHA256: `15B6921708A11C90F470260E299EBCF6AF04F9A4CE3DA0D93F19AD353CE58B3D` - Size: `248489225` bytes ### Instruct checkpoint - File: `instruct.pt` - SHA256: `C99FEEEE7CB7CBBDC90C7AAD89BF9F23FE0ABB9E99980A981498C51D836CA573` - Size: `745487819` bytes ## Runtime files - `model.pt`: default inference checkpoint. - `instruct.pt`: instruction-stage checkpoint. - `pretrain.pt`: pretraining-stage checkpoint, if available. - `tokenizer.json`: tokenizer. - `metadata.json`: machine-readable model metadata. - `model_config.json`: model configuration. - `model_card.json`: compact model card. - `special_tokens.json`: special-token mapping. This package belongs to the McConversationBot model family.