Flova
/

omr_transformer

vision-encoder-decoder

image-text-to-text

Model card Files Files and versions

Flova commited on Mar 16, 2023

Commit

4e07994

·

1 Parent(s): c291256

Add demo to README

Files changed (1) hide show

README.md +12 -0

README.md CHANGED Viewed

@@ -11,4 +11,16 @@ pipeline_tag: image-to-text
 <!-- Provide a quick summary of what the model is/does. [Optional] -->
 Image-To-Text model for optical music recognition. The model is trained to predict simple notes in the lilypond format from a given image. Training data consists of artificial, handwritten and white board images.
 Repo: https://github.com/UHHRobotics22-23/robot_project/tree/main/marimbabot_vision

 <!-- Provide a quick summary of what the model is/does. [Optional] -->
 Image-To-Text model for optical music recognition. The model is trained to predict simple notes in the lilypond format from a given image. Training data consists of artificial, handwritten and white board images.
+## Demo
+![White Board Sample](sample1.png)
+Prediction: `c'2 a''8 c''8 r4 c'1 e'8 c'8 c'8 a''8 f'4 a'8 c'8`
+![White Board Sample](sample2.png)
+Prediction: `d'8 g'8 c''8 a'8 d'2 c'8 f''8 d'4 c''4 e'8 r8 g'8 b'8 e'8 g'8 d'2`
 Repo: https://github.com/UHHRobotics22-23/robot_project/tree/main/marimbabot_vision