Spaces:
Running
Running
Introduce Simillusion as an organization
Browse files- README.md +23 -7
- index.html +15 -7
README.md
CHANGED
|
@@ -7,11 +7,19 @@ sdk: static
|
|
| 7 |
pinned: false
|
| 8 |
---
|
| 9 |
|
| 10 |
-
#
|
| 11 |
|
| 12 |
-
**
|
| 13 |
|
| 14 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 15 |
|
| 16 |
- **Models:** Dreamer (V1/V2), PlaNet, IRIS, DIAMOND, Genie, plus DiT and I-JEPA as building blocks, with more being added
|
| 17 |
- **One `WorldModel` interface:** `encode` / `step` / `rollout` / `decode`, the same for every family
|
|
@@ -22,9 +30,17 @@ pinned: false
|
|
| 22 |
pip install simulusion
|
| 23 |
```
|
| 24 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 25 |
## Demo models
|
| 26 |
|
| 27 |
-
Every model
|
| 28 |
|
| 29 |
<table>
|
| 30 |
<tr>
|
|
@@ -52,11 +68,11 @@ from simulusion.world_model import load_world_model
|
|
| 52 |
wm = load_world_model(snapshot_download("simillusion/iris-atari-boxing"), "iris")
|
| 53 |
```
|
| 54 |
|
| 55 |
-
##
|
|
|
|
|
|
|
| 56 |
|
| 57 |
- π Website: [simulusion.vercel.app](https://simulusion.vercel.app)
|
| 58 |
- π» GitHub: [ParamThakkar123/simulusion](https://github.com/ParamThakkar123/simulusion)
|
| 59 |
- π Docs and video gallery: [paramthakkar123.github.io/simulusion](https://paramthakkar123.github.io/simulusion/)
|
| 60 |
- π¦ PyPI: [simulusion](https://pypi.org/project/simulusion/)
|
| 61 |
-
|
| 62 |
-
Feedback is very welcome: tell us what would make Simulusion useful in your work, or which models we should add next, in a [GitHub issue](https://github.com/ParamThakkar123/simulusion/issues).
|
|
|
|
| 7 |
pinned: false
|
| 8 |
---
|
| 9 |
|
| 10 |
+
# Simillusion
|
| 11 |
|
| 12 |
+
**Open tools for building, training and sharing world models.**
|
| 13 |
|
| 14 |
+
World models are neural networks that learn how an environment behaves: given what an agent sees and the action it takes, they predict what happens next. Agents can then plan, learn and explore by imagining inside them instead of the real world. They're one of the most promising directions in AI, from games and video generation to robotics.
|
| 15 |
+
|
| 16 |
+
Building with them is still hard. Every paper ships its own codebase, training loop and data format, and most results need a cluster to reproduce. **Simillusion exists to change that.** We build open-source tools that make world models easier to train, compare and use, on hardware people actually have.
|
| 17 |
+
|
| 18 |
+
## What we're building
|
| 19 |
+
|
| 20 |
+
### π§ Simulusion: the library
|
| 21 |
+
|
| 22 |
+
[Simulusion](https://github.com/ParamThakkar123/simulusion) is our open-source PyTorch library that puts the major world-model families behind one API:
|
| 23 |
|
| 24 |
- **Models:** Dreamer (V1/V2), PlaNet, IRIS, DIAMOND, Genie, plus DiT and I-JEPA as building blocks, with more being added
|
| 25 |
- **One `WorldModel` interface:** `encode` / `step` / `rollout` / `decode`, the same for every family
|
|
|
|
| 30 |
pip install simulusion
|
| 31 |
```
|
| 32 |
|
| 33 |
+
### π¦ Pretrained world models
|
| 34 |
+
|
| 35 |
+
The models on this page, trained with Simulusion and ready to download. Each model card links its paper, reports what the run reached, and shows how to load it.
|
| 36 |
+
|
| 37 |
+
### π An end-to-end platform for world models *(coming soon)*
|
| 38 |
+
|
| 39 |
+
Everything from data to training to deployment, in one place. Follow this organization or visit [simulusion.vercel.app](https://simulusion.vercel.app) for updates.
|
| 40 |
+
|
| 41 |
## Demo models
|
| 42 |
|
| 43 |
+
Every model below was trained from scratch on a **single 4 GB laptop GPU** (RTX 3050) in one to two hours, by the scripts in [`demos/`](https://github.com/ParamThakkar123/simulusion/tree/main/demos). They show what each model does on a small budget; they are not reproductions of the papers' results.
|
| 44 |
|
| 45 |
<table>
|
| 46 |
<tr>
|
|
|
|
| 68 |
wm = load_world_model(snapshot_download("simillusion/iris-atari-boxing"), "iris")
|
| 69 |
```
|
| 70 |
|
| 71 |
+
## Get involved
|
| 72 |
+
|
| 73 |
+
We'd love to hear from researchers and developers working with world models, model-based RL, robotics or video generation. What would make our tools useful in your work? Which models should we add next? Open an [issue on GitHub](https://github.com/ParamThakkar123/simulusion/issues), or start a discussion on any model here.
|
| 74 |
|
| 75 |
- π Website: [simulusion.vercel.app](https://simulusion.vercel.app)
|
| 76 |
- π» GitHub: [ParamThakkar123/simulusion](https://github.com/ParamThakkar123/simulusion)
|
| 77 |
- π Docs and video gallery: [paramthakkar123.github.io/simulusion](https://paramthakkar123.github.io/simulusion/)
|
| 78 |
- π¦ PyPI: [simulusion](https://pypi.org/project/simulusion/)
|
|
|
|
|
|
index.html
CHANGED
|
@@ -3,14 +3,18 @@
|
|
| 3 |
<head>
|
| 4 |
<meta charset="utf-8">
|
| 5 |
<meta name="viewport" content="width=device-width, initial-scale=1">
|
| 6 |
-
<title>
|
| 7 |
<link rel="stylesheet" href="style.css">
|
| 8 |
</head>
|
| 9 |
<body>
|
| 10 |
<main>
|
| 11 |
-
<h1>
|
| 12 |
-
<p><strong>
|
| 13 |
-
<p>
|
|
|
|
|
|
|
|
|
|
|
|
|
| 14 |
<ul>
|
| 15 |
<li><strong>Models:</strong> Dreamer (V1/V2), PlaNet, IRIS, DIAMOND, Genie, plus DiT and I-JEPA as building blocks, with more being added</li>
|
| 16 |
<li><strong>One <code>WorldModel</code> interface:</strong> <code>encode</code> / <code>step</code> / <code>rollout</code> / <code>decode</code>, the same for every family</li>
|
|
@@ -19,8 +23,12 @@
|
|
| 19 |
</ul>
|
| 20 |
<pre><code class="language-bash">pip install simulusion
|
| 21 |
</code></pre>
|
|
|
|
|
|
|
|
|
|
|
|
|
| 22 |
<h2>Demo models</h2>
|
| 23 |
-
<p>Every model
|
| 24 |
<table>
|
| 25 |
<tr>
|
| 26 |
<td width="33%" valign="top"><a href="https://huggingface.co/simillusion/dreamer-dmc-cartpole-swingup"><img src="https://huggingface.co/simillusion/dreamer-dmc-cartpole-swingup/resolve/main/dreamer_dream.gif" alt="Dreamer" width="100%"></a><br><b>Dreamer</b>: DMC cartpole swing-up</td>
|
|
@@ -83,14 +91,14 @@ from simulusion.world_model import load_world_model
|
|
| 83 |
|
| 84 |
wm = load_world_model(snapshot_download("simillusion/iris-atari-boxing"), "iris")
|
| 85 |
</code></pre>
|
| 86 |
-
<h2>
|
|
|
|
| 87 |
<ul>
|
| 88 |
<li>π Website: <a href="https://simulusion.vercel.app">simulusion.vercel.app</a></li>
|
| 89 |
<li>π» GitHub: <a href="https://github.com/ParamThakkar123/simulusion">ParamThakkar123/simulusion</a></li>
|
| 90 |
<li>π Docs and video gallery: <a href="https://paramthakkar123.github.io/simulusion/">paramthakkar123.github.io/simulusion</a></li>
|
| 91 |
<li>π¦ PyPI: <a href="https://pypi.org/project/simulusion/">simulusion</a></li>
|
| 92 |
</ul>
|
| 93 |
-
<p>Feedback is very welcome: tell us what would make Simulusion useful in your work, or which models we should add next, in a <a href="https://github.com/ParamThakkar123/simulusion/issues">GitHub issue</a>.</p>
|
| 94 |
</main>
|
| 95 |
</body>
|
| 96 |
</html>
|
|
|
|
| 3 |
<head>
|
| 4 |
<meta charset="utf-8">
|
| 5 |
<meta name="viewport" content="width=device-width, initial-scale=1">
|
| 6 |
+
<title>Simillusion</title>
|
| 7 |
<link rel="stylesheet" href="style.css">
|
| 8 |
</head>
|
| 9 |
<body>
|
| 10 |
<main>
|
| 11 |
+
<h1>Simillusion</h1>
|
| 12 |
+
<p><strong>Open tools for building, training and sharing world models.</strong></p>
|
| 13 |
+
<p>World models are neural networks that learn how an environment behaves: given what an agent sees and the action it takes, they predict what happens next. Agents can then plan, learn and explore by imagining inside them instead of the real world. They're one of the most promising directions in AI, from games and video generation to robotics.</p>
|
| 14 |
+
<p>Building with them is still hard. Every paper ships its own codebase, training loop and data format, and most results need a cluster to reproduce. <strong>Simillusion exists to change that.</strong> We build open-source tools that make world models easier to train, compare and use, on hardware people actually have.</p>
|
| 15 |
+
<h2>What we're building</h2>
|
| 16 |
+
<h3>π§ Simulusion: the library</h3>
|
| 17 |
+
<p><a href="https://github.com/ParamThakkar123/simulusion">Simulusion</a> is our open-source PyTorch library that puts the major world-model families behind one API:</p>
|
| 18 |
<ul>
|
| 19 |
<li><strong>Models:</strong> Dreamer (V1/V2), PlaNet, IRIS, DIAMOND, Genie, plus DiT and I-JEPA as building blocks, with more being added</li>
|
| 20 |
<li><strong>One <code>WorldModel</code> interface:</strong> <code>encode</code> / <code>step</code> / <code>rollout</code> / <code>decode</code>, the same for every family</li>
|
|
|
|
| 23 |
</ul>
|
| 24 |
<pre><code class="language-bash">pip install simulusion
|
| 25 |
</code></pre>
|
| 26 |
+
<h3>π¦ Pretrained world models</h3>
|
| 27 |
+
<p>The models on this page, trained with Simulusion and ready to download. Each model card links its paper, reports what the run reached, and shows how to load it.</p>
|
| 28 |
+
<h3>π An end-to-end platform for world models <em>(coming soon)</em></h3>
|
| 29 |
+
<p>Everything from data to training to deployment, in one place. Follow this organization or visit <a href="https://simulusion.vercel.app">simulusion.vercel.app</a> for updates.</p>
|
| 30 |
<h2>Demo models</h2>
|
| 31 |
+
<p>Every model below was trained from scratch on a <strong>single 4 GB laptop GPU</strong> (RTX 3050) in one to two hours, by the scripts in <a href="https://github.com/ParamThakkar123/simulusion/tree/main/demos"><code>demos/</code></a>. They show what each model does on a small budget; they are not reproductions of the papers' results.</p>
|
| 32 |
<table>
|
| 33 |
<tr>
|
| 34 |
<td width="33%" valign="top"><a href="https://huggingface.co/simillusion/dreamer-dmc-cartpole-swingup"><img src="https://huggingface.co/simillusion/dreamer-dmc-cartpole-swingup/resolve/main/dreamer_dream.gif" alt="Dreamer" width="100%"></a><br><b>Dreamer</b>: DMC cartpole swing-up</td>
|
|
|
|
| 91 |
|
| 92 |
wm = load_world_model(snapshot_download("simillusion/iris-atari-boxing"), "iris")
|
| 93 |
</code></pre>
|
| 94 |
+
<h2>Get involved</h2>
|
| 95 |
+
<p>We'd love to hear from researchers and developers working with world models, model-based RL, robotics or video generation. What would make our tools useful in your work? Which models should we add next? Open an <a href="https://github.com/ParamThakkar123/simulusion/issues">issue on GitHub</a>, or start a discussion on any model here.</p>
|
| 96 |
<ul>
|
| 97 |
<li>π Website: <a href="https://simulusion.vercel.app">simulusion.vercel.app</a></li>
|
| 98 |
<li>π» GitHub: <a href="https://github.com/ParamThakkar123/simulusion">ParamThakkar123/simulusion</a></li>
|
| 99 |
<li>π Docs and video gallery: <a href="https://paramthakkar123.github.io/simulusion/">paramthakkar123.github.io/simulusion</a></li>
|
| 100 |
<li>π¦ PyPI: <a href="https://pypi.org/project/simulusion/">simulusion</a></li>
|
| 101 |
</ul>
|
|
|
|
| 102 |
</main>
|
| 103 |
</body>
|
| 104 |
</html>
|