File size: 1,548 Bytes
1ec0485 2777a69 1ec0485 2777a69 a7e6da0 2777a69 2c52608 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 | ---
license: mit
tags:
- relational-deep-learning
- relational-databases
- relational-data
- tabular
- tabular-classification
- tabular-regression
- foundation-model
- world-model
- in-context-learning
- few-shot
- pretraining
- synthetic-data
library_name: pytorch
---
# TabWM
TabWM (Tabular World Model) is a relational world model introduced in *[Relational Learning as World Modeling](https://arxiv.org/abs/2610.16763)*. Given a few observed executions from a relational system, it predicts the structured edits that a new action makes to the database, without updating its parameters. The model is pretrained on WorldRel, a generator of executable relational worlds, and its encoder is initialized from the [RT-PluRel](https://huggingface.co/stanford-star/rt-plurel) Relational Transformer.
- **Code:** [github.com/oooranz/TabWM](https://github.com/oooranz/TabWM)
Architecture: 24.7M parameters, float32, 12 Relational Transformer blocks, d_model 256, 8 heads, d_ff 1024, context length 4096. The repository contains `model.safetensors` (weights) and `config.json` (architecture).
## Installation
```bash
pip install git+https://github.com/oooranz/TabWM
```
## Usage
```python
from tabwm import TabWM
model = TabWM.from_pretrained("oooranz/TabWM")
```
Examples for building behavioral context from WorldRel and running inference are provided in the [GitHub repository](https://github.com/oooranz/TabWM).
## License
MIT. The weights are partly initialized from the PluRel paper checkpoint, whose MIT notice is included in `LICENSE`. |