File size: 2,076 Bytes
2fdaf42
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
---
license: cc-by-nc-4.0
pipeline_tag: audio-classification
tags:
  - audio
  - audio-classification
  - torchscript
  - music
  - playing-techniques
  - real-time
  - max-msp
---

# ipt_models

Pretrained instrumental playing-technique recognition models for [ipt~](https://github.com/DYCI2/ipt_tilde), `pipo.ipt` and any host built on [libipt](https://github.com/nbrochec/libipt).

Models are TorchScript (`.ts`) files trained and exported with [ipt_recognition](https://github.com/nbrochec/ipt_recognition). Documentation, classes and specifications of each model live in the [ipt_models](https://github.com/DYCI2/ipt_models) GitHub repository.

| Model | Instrument | Classes | Sample rate | Latency floor | Dataset | Card |
|---|---|---|---|---|---|---|
| `eguitar_ircam.ts` | Electric guitar | 14 | 8 kHz | 896 ms | [EG-IPT](https://doi.org/10.5281/zenodo.15205644) | [card](https://github.com/DYCI2/ipt_models/blob/main/cards/eguitar_ircam.md) |
| `flute_ircam.ts` | Flute | 11 | 44.1 kHz | 333 ms | [GFD](https://doi.org/10.5281/zenodo.14712391) | [card](https://github.com/DYCI2/ipt_models/blob/main/cards/flute_ircam.md) |
| `trumpet_ircam.ts` | Trumpet | 14 | 44.1 kHz | 333 ms | T-IPT (not public yet) | [card](https://github.com/DYCI2/ipt_models/blob/main/cards/trumpet_ircam.md) |
| `trumpet_harmon_ircam.ts` | Trumpet, harmon mute | 14 | 44.1 kHz | 333 ms | T-IPT (not public yet) | [card](https://github.com/DYCI2/ipt_models/blob/main/cards/trumpet_harmon_ircam.md) |

## Usage

Download a `.ts` file, put it in Max's search path (or give an absolute path), then:

```
ipt~ flute_ircam.ts
pipo~ ipt @ipt.model flute_ircam.ts
```

Or from the command line:

```
hf download nbrochec/ipt_models flute_ircam.ts --local-dir .
```

A model takes `(batch, 1, segment_length)` float32 raw audio and returns logits `(batch, num_classes)`; it exports `get_sr()`, `get_seglen()` and `get_classnames()`. Exported with torch 2.4.1, the version libipt links against.

## License

CC-BY-NC-4.0.

## Contact

Please write to `nicolas.brochec[at]ircam.fr` for any questions.