File size: 1,675 Bytes
ee6d0d6 8587811 ee6d0d6 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 | ---
language:
- en
---
its so stupid LMAOOO
# McConversationBot V3
Package: `McConversationBot-V3-62.1M`
## Identity
- Model family: `McConversationBot`
- Model version: `V3`
- Parameters: `62.1M`
- Architecture: `McConversationBotV3`
- Architecture base: `V15-compatible`
## Architecture
- Total vocabulary: `4099`
- BPE vocabulary: `4096`
- Embedding size: `640`
- Layers: `12`
- Attention heads: `8`
- KV heads: `8`
- Context length: `512`
- Dropout: `0.05`
- RMSNorm: `True`
- RoPE: `True`
- SwiGLU: `True`
- GQA: `False`
- Bias: `False`
- RoPE theta: `10000.0`
- MLP ratio: `2.6666667`
## Special tokens
- `<|user|>` = `4096`
- `<|assistant|>` = `4097`
- `<|end|>` = `4098`
## Verification
Architecture verified: `True`
Checkpoint SHA256:
`C99FEEEE7CB7CBBDC90C7AAD89BF9F23FE0ABB9E99980A981498C51D836CA573`
Tokenizer SHA256:
`F70E2F2465E9DE7CECC84E78FFD4CD269A8CA590CAEA033C32F04B82F7CAFBDB`
## Checkpoints
### Pretrain checkpoint
- File: `pretrain.pt`
- SHA256: `15B6921708A11C90F470260E299EBCF6AF04F9A4CE3DA0D93F19AD353CE58B3D`
- Size: `248489225` bytes
### Instruct checkpoint
- File: `instruct.pt`
- SHA256: `C99FEEEE7CB7CBBDC90C7AAD89BF9F23FE0ABB9E99980A981498C51D836CA573`
- Size: `745487819` bytes
## Runtime files
- `model.pt`: default inference checkpoint.
- `instruct.pt`: instruction-stage checkpoint.
- `pretrain.pt`: pretraining-stage checkpoint, if available.
- `tokenizer.json`: tokenizer.
- `metadata.json`: machine-readable model metadata.
- `model_config.json`: model configuration.
- `model_card.json`: compact model card.
- `special_tokens.json`: special-token mapping.
This package belongs to the McConversationBot model family. |