laxmareddyp commited on
Commit
370d760
·
verified ·
1 Parent(s): f696145

Update README.md with new model card content

Browse files
Files changed (1) hide show
  1. README.md +1 -17
README.md CHANGED
@@ -1,22 +1,6 @@
1
  ---
2
  library_name: keras-hub
3
  ---
4
- This is a [`ModernBert` model](https://keras.io/api/keras_hub/models/modern_bert) uploaded using the KerasHub library and can be used with JAX, TensorFlow, and PyTorch backends.
5
- This model is related to a `TextEmbedder` task.
6
 
7
- Model config:
8
- * **name:** modern_bert_backbone
9
- * **trainable:** True
10
- * **dtype:** {'module': 'keras', 'class_name': 'DTypePolicy', 'config': {'name': 'float32'}, 'registered_name': None}
11
- * **vocabulary_size:** 50368
12
- * **hidden_dim:** 768
13
- * **intermediate_dim:** 1152
14
- * **num_layers:** 22
15
- * **num_heads:** 12
16
- * **local_attention_window:** 128
17
- * **global_attn_every_n_layers:** 3
18
- * **rotary_max_wavelength:** 160000.0
19
- * **local_rotary_max_wavelength:** 10000.0
20
- * **layer_norm_epsilon:** 1e-05
21
 
22
- This model card has been generated automatically and should be completed by the model author. See [Model Cards documentation](https://huggingface.co/docs/hub/model-cards) for more information.
 
1
  ---
2
  library_name: keras-hub
3
  ---
4
+ ### Model Overview
 
5
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
6