Instructions to use THemidli/applied-ner-stage4-bert-tiny-improved with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use THemidli/applied-ner-stage4-bert-tiny-improved with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("token-classification", model="THemidli/applied-ner-stage4-bert-tiny-improved")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForTokenClassification tokenizer = AutoTokenizer.from_pretrained("THemidli/applied-ner-stage4-bert-tiny-improved") model = AutoModelForTokenClassification.from_pretrained("THemidli/applied-ner-stage4-bert-tiny-improved", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Upload artifacts/stage4_cpu_benchmark.json with huggingface_hub
Browse files
artifacts/stage4_cpu_benchmark.json
ADDED
|
@@ -0,0 +1,20 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"stage": 4,
|
| 3 |
+
"model_path": "models/stage4-bert-tiny-ner-improved",
|
| 4 |
+
"device": "cpu",
|
| 5 |
+
"torch_threads": 8,
|
| 6 |
+
"parameter_count": 4371601,
|
| 7 |
+
"parameter_memory_mb": 17.486404,
|
| 8 |
+
"artifact_size_mb": 18.209406,
|
| 9 |
+
"rss_before_load_mb": 442.400768,
|
| 10 |
+
"rss_after_load_mb": 474.218496,
|
| 11 |
+
"model_load_rss_delta_mb": 31.817728,
|
| 12 |
+
"rss_after_inference_mb": 483.885056,
|
| 13 |
+
"inference_rss_delta_mb": 41.484288,
|
| 14 |
+
"benchmark_examples": 2000,
|
| 15 |
+
"batch_size": 32,
|
| 16 |
+
"elapsed_seconds": 0.1722599580007227,
|
| 17 |
+
"throughput_examples_per_second": 11610.359268702534,
|
| 18 |
+
"mean_latency_ms_per_example_at_batch_size": 0.08612997900036135,
|
| 19 |
+
"scope": "end-to-end fast-tokenizer plus PyTorch CPU forward pass on the 40 wild probes"
|
| 20 |
+
}
|