Future ReadyArt dataset changes

#18
by FrenzyBiscuit - opened
Ready.Art org

Been working hard on updating the generator and getting the new antislop tool to work correctly.

Antislop was broken, but I managed to get it working with qwen. Had to fork their repo. Now I need to convert 1500+ slop words over to it, since it uses token ids. You're going to notice slop because that conversion is going to take time. Also it filters not_x_but_y from our datasets as well.

As for the generator, LOTS of changes. I haven't started genning zaire v0.15 as the generator is under active work currently.

Here is a sneak peak at zaire v0.15:

image

Ready.Art org

The amount of work that just went into the synthetic dataset generator is quite impressive (thanks everyone who contributed!)

We even have a judge LLM now for roleplay stuff built into the generator.

I'll leave these sneak peeks here.

Screenshot_20261028_201047

Screenshot_20261028_201116

The dataset generator is cool, thanks for making it. I've made a few simple small models but at my new job I have access to some H100's so looking forward to see what I can make with this.

Ready.Art org

The dataset generator is cool, thanks for making it. I've made a few simple small models but at my new job I have access to some H100's so looking forward to see what I can make with this.

If you have questions about the generator please open a github issue or discussion.

Sign up or log in to comment