Instructions to use brainventures/deplot_kr with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use brainventures/deplot_kr with Transformers:
# Use a pipeline as a high-level helper # Warning: Pipeline type "image-to-text" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # pip install "transformers<5.0.0" from transformers import pipeline pipe = pipeline("image-to-text", model="brainventures/deplot_kr")# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("brainventures/deplot_kr") model = AutoModelForMultimodalLM.from_pretrained("brainventures/deplot_kr", device_map="auto") - Notebooks
- Google Colab
- Kaggle
dltjwl commited on
Commit ยท
c5c962e
1
Parent(s): 0b2fee3
Modify : Code and Evaluation Result
Browse files
README.md
CHANGED
|
@@ -20,13 +20,10 @@ Model predict the data table of text form in the image.
|
|
| 20 |
์ด๋ฏธ์ง๋ฅผ ๋ชจ๋ธ์ ์
๋ ฅํ๋ฉด ๋ชจ๋ธ์ ์ด๋ฏธ์ง๋ก๋ถํฐ ํ ํํ์ ๋ฐ์ดํฐ ํ
์ด๋ธ์ ์์ธกํฉ๋๋ค.
|
| 21 |
|
| 22 |
```python
|
| 23 |
-
from transformers import Pix2StructForConditionalGeneration,
|
| 24 |
from PIL import Image
|
| 25 |
|
| 26 |
-
|
| 27 |
-
tokenizer = AutoTokenizer.from_pretrained("brainventures/deplot_kr")
|
| 28 |
-
processor = Pix2StructProcessor(image_processor=image_processor, tokenizer=tokenizer)
|
| 29 |
-
|
| 30 |
model = Pix2StructForConditionalGeneration.from_pretrained("brainventures/deplot_kr")
|
| 31 |
|
| 32 |
image_path = "IMAGE_PATH"
|
|
@@ -76,8 +73,10 @@ This model achieves the following results:
|
|
| 76 |
|
| 77 |
|metrics name | % |
|
| 78 |
|:---|---:|
|
| 79 |
-
| RNSS (Relative Number Set Similarity)|
|
| 80 |
-
|
|
|
|
|
|
|
|
| 81 |
|
| 82 |
## Contact
|
| 83 |
|
|
|
|
| 20 |
์ด๋ฏธ์ง๋ฅผ ๋ชจ๋ธ์ ์
๋ ฅํ๋ฉด ๋ชจ๋ธ์ ์ด๋ฏธ์ง๋ก๋ถํฐ ํ ํํ์ ๋ฐ์ดํฐ ํ
์ด๋ธ์ ์์ธกํฉ๋๋ค.
|
| 21 |
|
| 22 |
```python
|
| 23 |
+
from transformers import Pix2StructForConditionalGeneration, AutoProcessor
|
| 24 |
from PIL import Image
|
| 25 |
|
| 26 |
+
processor = AutoProcessor.from_pretrained("brainventures/deplot_kr")
|
|
|
|
|
|
|
|
|
|
| 27 |
model = Pix2StructForConditionalGeneration.from_pretrained("brainventures/deplot_kr")
|
| 28 |
|
| 29 |
image_path = "IMAGE_PATH"
|
|
|
|
| 73 |
|
| 74 |
|metrics name | % |
|
| 75 |
|:---|---:|
|
| 76 |
+
| RNSS (Relative Number Set Similarity)| 98.1615 |
|
| 77 |
+
|RMS (Relative Mapping Similarity) Precision | 83.1615 |
|
| 78 |
+
|RMS Recall | 26.3549 |
|
| 79 |
+
| RMS F1 Score | 31.5633 |
|
| 80 |
|
| 81 |
## Contact
|
| 82 |
|