samueldc commited on
Commit
03420ea
·
verified ·
1 Parent(s): 904e981

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -10
README.md CHANGED
@@ -1,16 +1,21 @@
1
  ---
2
- title: Mobilemoe
3
- emoji: 💬
4
- colorFrom: yellow
5
- colorTo: purple
6
  sdk: gradio
7
- sdk_version: 6.5.1
8
  app_file: app.py
9
  pinned: false
10
- hf_oauth: true
11
- hf_oauth_scopes:
12
- - inference-api
13
- license: mit
14
  ---
15
 
16
- An example chatbot using [Gradio](https://gradio.app), [`huggingface_hub`](https://huggingface.co/docs/huggingface_hub/v0.22.2/en/index), and the [Hugging Face Inference API](https://huggingface.co/docs/api-inference/index).
 
 
 
 
 
 
 
 
1
  ---
2
+ title: MobileMoE-L-Base Demo
3
+ emoji: 📱
4
+ colorFrom: blue
5
+ colorTo: indigo
6
  sdk: gradio
7
+ sdk_version: 5.20.0
8
  app_file: app.py
9
  pinned: false
10
+ license: other
11
+ short_description: Interactive text continuation demo for Meta MobileMoE-L-Base
 
 
12
  ---
13
 
14
+ # MobileMoE-L (Base) Demo
15
+
16
+ Interactive demo for Meta's **MobileMoE-L-Base** on-device Mixture-of-Experts (MoE) foundation model.
17
+
18
+ - **Total Parameters:** 5.3B
19
+ - **Active Parameters:** 922M (sub-billion compute per token)
20
+ - **Architecture:** 60 routed experts (4 active per token) + 1 shared expert, QK-Norm, RoPE ($\theta = 500,000$)
21
+ - **Model Type:** Pre-trained Base model (optimized for text completion, code continuation, and few-shot in-context learning).