File size: 1,811 Bytes
70f9fce
2ba230e
 
d8dc976
 
 
 
70f9fce
d8dc976
 
 
eccf08b
d8dc976
e41cdf3
 
d8dc976
 
 
 
 
 
 
e41cdf3
 
 
 
 
 
d8dc976
 
 
 
 
 
e41cdf3
d8dc976
 
 
 
 
 
 
e41cdf3
d8dc976
 
 
eccf08b
d8dc976
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
---
license: mit
pipeline_tag: other
tags:
- music
- SSL
- pytorch
---

## Frequency-Aware Self-Supervised Music Representation Learning

This is the official Hugging Face model repository for the paper **"[Frequency-Aware Self-Supervised Music Representation Learning](https://arxiv.org/abs/2606.25713)"**.

- **Project Page:** https://www.yichenggu.com/PupuM2D/
- **GitHub Repository:** https://github.com/sizigi/PupuM2D/

## Model Checkpoints

This repository contains the following checkpoints:

| Model Name        | Directory                    | Description                                       |
| ----------------- | ---------------------------- | ------------------------------------------------- |
| **PupuM2D-Tiny**            | `./PupuM2DV2_25Hz_tiny/*`            | 5M parameter tiny version of PupuM2D.   |
| **PupuM2D-Small**            | `./PupuM2DV2_25Hz_small/*`            | 22M parameter small version of PupuM2D.   |
| **PupuM2D-Base**            | `./PupuM2DV2_25Hz_base/*`            | 86M parameter base version of PupuM2D.   |
| **PupuM2D-Large**            | `./PupuM2DV2_25Hz_large/*`            | 307M parameter large version of PupuM2D.   |
| **PupuM2D-Huge**            | `./PupuM2DV2_25Hz_huge/*`            | 632M parameter huge version of PupuM2D.   |
| **PupuM2D-giant**            | `./PupuM2DV2_25Hz_giant/*`            | 1.1B parameter giant version of PupuM2D.   |

## How to use

You need to put the pretrained models in:

```bash
  PupuM2D/experiments
```

of our official repository.

## Citation

```bibtex
@article{PupuM2D,
  title        = {Frequency-Aware Self-Supervised Music Representation Learning},
  author       = {Yicheng Gu and Junan Zhang and Jerry Li and Zhizheng Wu and Lauri Juvela},
  year         = {2026},
  journal      = {arXiv:2606.25713},
}
```