XiaoboX commited on
Commit
a3132ac
·
verified ·
1 Parent(s): 836a134

Update model card

Browse files
Files changed (1) hide show
  1. README.md +19 -6
README.md CHANGED
@@ -12,13 +12,25 @@ tags:
12
 
13
  # TabPilot
14
 
15
- Trained agents of [TabPilot](https://github.com/fearlessAAA/TabPilot), which answers
16
- natural-language tabular prediction requests with two Qwen3.5-4B agents and a frozen tabular
17
- foundation model (TabPFN v3.5).
 
 
 
 
 
 
 
 
 
 
 
 
18
 
19
  | Folder | Model |
20
  |---|---|
21
- | `execution-agent/fold<k>/` | Execution Agent: full Qwen3.5-4B weights after PS-OPSD and SA-GRPO |
22
  | `response-agent/fold<k>/` | Response Agent: TTRD LoRA adapter (rank 32) for `Qwen/Qwen3.5-4B` |
23
 
24
  There is one model pair per fold `k` of the five-fold cross-validation over TopBench source tables
@@ -31,8 +43,9 @@ tables, so evaluate it only on fold `k`'s test tables.
31
  hf download XiaoboX/TabPilot --include "execution-agent/fold0/*" "response-agent/fold0/*" --local-dir checkpoints
32
  ```
33
 
34
- Serve both agents with vLLM and run TabPilot as described in the code repository's README. Both
35
- agents run in non-thinking mode.
 
36
 
37
  ## License
38
 
 
12
 
13
  # TabPilot
14
 
15
+ **TabPilot: Empowering Small Language Models for Natural-Language Tabular Prediction via
16
+ Declarative Query Compilation, Privileged Distillation, and Structure-Aware Rewards**
17
+ · Code: [github.com/fearlessAAA/TabPilot](https://github.com/fearlessAAA/TabPilot)
18
+
19
+ TabPilot is an agentic framework that couples a 4B small language model with a **plug-and-play
20
+ frozen tabular foundation model (TFM)** through **declarative predictive query compilation**. An
21
+ **Execution Agent** iteratively compiles each natural-language request into a structured
22
+ prediction query and validates it through leakage-safe tools; the frozen TFM executes the query
23
+ by in-context inference; a **Response Agent** synthesizes the TFM predictions into a grounded
24
+ answer. The agents are trained for unseen tables with a three-stage local-to-global curriculum:
25
+ **Privileged Semantic On-Policy Self-Distillation (PS-OPSD)**, **Structure-Aware GRPO (SA-GRPO)**
26
+ with an outcome-label-free, TFM-agnostic structural reward, and **Teacher-Guided Tabular Response
27
+ Distillation (TTRD)**.
28
+
29
+ This repository holds the trained agents (backbone: Qwen3.5-4B, non-thinking mode):
30
 
31
  | Folder | Model |
32
  |---|---|
33
+ | `execution-agent/fold<k>/` | Execution Agent: full weights after PS-OPSD → SA-GRPO |
34
  | `response-agent/fold<k>/` | Response Agent: TTRD LoRA adapter (rank 32) for `Qwen/Qwen3.5-4B` |
35
 
36
  There is one model pair per fold `k` of the five-fold cross-validation over TopBench source tables
 
43
  hf download XiaoboX/TabPilot --include "execution-agent/fold0/*" "response-agent/fold0/*" --local-dir checkpoints
44
  ```
45
 
46
+ Serve both agents with vLLM and run TabPilot as described in the code repository's README. The
47
+ TFM is plug-and-play: the agents were trained without calling it, and the code repository uses
48
+ TabPFN v3.5 by default.
49
 
50
  ## License
51