its so stupid LMAOOO

McConversationBot V3

Package: McConversationBot-V3-62.1M

Identity

  • Model family: McConversationBot
  • Model version: V3
  • Parameters: 62.1M
  • Architecture: McConversationBotV3
  • Architecture base: V15-compatible

Architecture

  • Total vocabulary: 4099
  • BPE vocabulary: 4096
  • Embedding size: 640
  • Layers: 12
  • Attention heads: 8
  • KV heads: 8
  • Context length: 512
  • Dropout: 0.05
  • RMSNorm: True
  • RoPE: True
  • SwiGLU: True
  • GQA: False
  • Bias: False
  • RoPE theta: 10000.0
  • MLP ratio: 2.6666667

Special tokens

  • <|user|> = 4096
  • <|assistant|> = 4097
  • <|end|> = 4098

Verification

Architecture verified: True

Checkpoint SHA256:

C99FEEEE7CB7CBBDC90C7AAD89BF9F23FE0ABB9E99980A981498C51D836CA573

Tokenizer SHA256:

F70E2F2465E9DE7CECC84E78FFD4CD269A8CA590CAEA033C32F04B82F7CAFBDB

Checkpoints

Pretrain checkpoint

  • File: pretrain.pt
  • SHA256: 15B6921708A11C90F470260E299EBCF6AF04F9A4CE3DA0D93F19AD353CE58B3D
  • Size: 248489225 bytes

Instruct checkpoint

  • File: instruct.pt
  • SHA256: C99FEEEE7CB7CBBDC90C7AAD89BF9F23FE0ABB9E99980A981498C51D836CA573
  • Size: 745487819 bytes

Runtime files

  • model.pt: default inference checkpoint.
  • instruct.pt: instruction-stage checkpoint.
  • pretrain.pt: pretraining-stage checkpoint, if available.
  • tokenizer.json: tokenizer.
  • metadata.json: machine-readable model metadata.
  • model_config.json: model configuration.
  • model_card.json: compact model card.
  • special_tokens.json: special-token mapping.

This package belongs to the McConversationBot model family.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support