| --- |
| language: |
| - en |
| --- |
| its so stupid LMAOOO |
| # McConversationBot V3 |
|
|
| Package: `McConversationBot-V3-62.1M` |
|
|
| ## Identity |
|
|
| - Model family: `McConversationBot` |
| - Model version: `V3` |
| - Parameters: `62.1M` |
| - Architecture: `McConversationBotV3` |
| - Architecture base: `V15-compatible` |
|
|
| ## Architecture |
|
|
| - Total vocabulary: `4099` |
| - BPE vocabulary: `4096` |
| - Embedding size: `640` |
| - Layers: `12` |
| - Attention heads: `8` |
| - KV heads: `8` |
| - Context length: `512` |
| - Dropout: `0.05` |
| - RMSNorm: `True` |
| - RoPE: `True` |
| - SwiGLU: `True` |
| - GQA: `False` |
| - Bias: `False` |
| - RoPE theta: `10000.0` |
| - MLP ratio: `2.6666667` |
|
|
| ## Special tokens |
|
|
| - `<|user|>` = `4096` |
| - `<|assistant|>` = `4097` |
| - `<|end|>` = `4098` |
|
|
| ## Verification |
|
|
| Architecture verified: `True` |
|
|
| Checkpoint SHA256: |
|
|
| `C99FEEEE7CB7CBBDC90C7AAD89BF9F23FE0ABB9E99980A981498C51D836CA573` |
|
|
| Tokenizer SHA256: |
|
|
| `F70E2F2465E9DE7CECC84E78FFD4CD269A8CA590CAEA033C32F04B82F7CAFBDB` |
|
|
| ## Checkpoints |
|
|
| ### Pretrain checkpoint |
|
|
| - File: `pretrain.pt` |
| - SHA256: `15B6921708A11C90F470260E299EBCF6AF04F9A4CE3DA0D93F19AD353CE58B3D` |
| - Size: `248489225` bytes |
|
|
| ### Instruct checkpoint |
|
|
| - File: `instruct.pt` |
| - SHA256: `C99FEEEE7CB7CBBDC90C7AAD89BF9F23FE0ABB9E99980A981498C51D836CA573` |
| - Size: `745487819` bytes |
|
|
| ## Runtime files |
|
|
| - `model.pt`: default inference checkpoint. |
| - `instruct.pt`: instruction-stage checkpoint. |
| - `pretrain.pt`: pretraining-stage checkpoint, if available. |
| - `tokenizer.json`: tokenizer. |
| - `metadata.json`: machine-readable model metadata. |
| - `model_config.json`: model configuration. |
| - `model_card.json`: compact model card. |
| - `special_tokens.json`: special-token mapping. |
|
|
| This package belongs to the McConversationBot model family. |
