Token Classification
Transformers
Safetensors
English
mistral
text-generation
custom_code
text-generation-inference
Instructions to use LeroyDyer/Mixtral_AI_TokenClassification_Project with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use LeroyDyer/Mixtral_AI_TokenClassification_Project with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("token-classification", model="LeroyDyer/Mixtral_AI_TokenClassification_Project", trust_remote_code=True)# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("LeroyDyer/Mixtral_AI_TokenClassification_Project", trust_remote_code=True) model = AutoModelForCausalLM.from_pretrained("LeroyDyer/Mixtral_AI_TokenClassification_Project", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -11,7 +11,7 @@ Currently Adding Token Classification to mistral model ;
|
|
| 11 |
Still need some kinks sorting out -on the way - Testing
|
| 12 |
|
| 13 |
```
|
| 14 |
-
|
| 15 |
from transformers import AutoModelForTokenClassification, AutoTokenizer
|
| 16 |
import torch
|
| 17 |
|
|
|
|
| 11 |
Still need some kinks sorting out -on the way - Testing
|
| 12 |
|
| 13 |
```
|
| 14 |
+
! pip install flash_attn
|
| 15 |
from transformers import AutoModelForTokenClassification, AutoTokenizer
|
| 16 |
import torch
|
| 17 |
|