AdarshSingh7647 commited on
Commit
3f7b2be
·
verified ·
1 Parent(s): df7596b

Rebuild card: fix cross-links to renamed repos, simplify

Browse files
Files changed (1) hide show
  1. README.md +11 -24
README.md CHANGED
@@ -3,29 +3,19 @@ license: apache-2.0
3
  base_model: Qwen/Qwen3-8B
4
  library_name: transformers
5
  pipeline_tag: text-generation
6
- tags:
7
- - table-ranking
8
- - listwise-reranking
9
- - table-retrieval
10
- - table-question-answering
11
- - qwen3
12
  language:
13
  - en
14
  ---
15
 
16
- # TabRank — Naive (Answer-Only)
17
 
18
- Part of the [TabRank](https://huggingface.co/collections/AdarshSingh7647/tabrank-qwen3-8b-table-rerankers) family: Qwen3-8B checkpoints for **single-call generative listwise table reranking**. Given a question and a list of candidate tables, the model reads them all in one prompt and returns the full ranking in a single generation — no pairwise scoring, no cross-encoder passes.
19
 
20
  ![TabRank: question and candidate tables go into a single Qwen3-8B call, which reasons and emits a ranked list](tabrank_task.png)
21
 
22
- This checkpoint is the **Naive (Answer-Only)** variant: fine-tuned to output the ranking directly, with no reasoning trace, so it is the fastest of the three objectives at inference time. It is trained on **NQ Tables + MultiTabQA**.
23
 
24
- For the reasoning variants trained on the same data, see [TabRankStandardSFT](https://huggingface.co/AdarshSingh7647/TabRankStandardSFT) (standard CoT SFT) and [TabRank](https://huggingface.co/AdarshSingh7647/TabRank) (our best method). Family: **TabRankNaive** (this model) · [TabRankStandardSFT](https://huggingface.co/AdarshSingh7647/TabRankStandardSFT) · [TabRank](https://huggingface.co/AdarshSingh7647/TabRank).
25
-
26
- ## How it works
27
-
28
- TabRank is trained on 6,728 chain-of-thought reasoning traces distilled from a teacher model reasoning about table relevance. This variant drops the reasoning trace and trains only on the final ranking, so at inference it goes straight from input to output. The training mix adds MultiTabQA questions that require reasoning over more than one table, which is where this data mix helps generalization the most (see the [paper](https://arxiv.org/abs/2607.25182)).
29
 
30
  ## Input / output format
31
 
@@ -61,9 +51,9 @@ Map the numbers back to your own table ids to get the reranked list — position
61
 
62
  ## Evaluation
63
 
64
- This card does not publish a verified in-distribution results table (SQA/TAT-QA/HybridQA/TabFact) for the Naive objective on this training mix — earlier published numbers for this specific checkpoint could not be confirmed against source eval logs, so rather than risk repeating an error we're leaving them out until they're re-run and verified.
65
 
66
- For a trustworthy, fully-verified comparison, see the results tables on [TabRankStandardSFT](https://huggingface.co/AdarshSingh7647/TabRankStandardSFT) and [TabRank](https://huggingface.co/AdarshSingh7647/TabRank) (our best method), which include both in-distribution results and out-of-distribution results on 8 benchmarks from the [IBM table-text-ir-evaluation suite](https://huggingface.co/collections/ibm-research/table-text-ir-evaluation). Source eval code and logs are in the [GitHub repo](https://github.com/AdarshSingh7647/TabRanker).
67
 
68
  ## Usage with vLLM
69
 
@@ -108,20 +98,17 @@ out = model.generate(**inputs, max_new_tokens=2048, temperature=0.6, top_p=0.95,
108
  print(tok.decode(out[0][inputs.input_ids.shape[1]:], skip_special_tokens=True))
109
  ```
110
 
111
- For full training and evaluation code, dataset builders, and the reasoning-trace dataset, see the [TabRanker GitHub repo](https://github.com/AdarshSingh7647/TabRanker).
112
 
113
  ## Model details
114
 
115
  * Base model: Qwen3-8B
116
- * Method: LoRA rank 16 fine-tuning, merged into the base weights so it loads directly
117
- * Precision: bfloat16, single-file safetensors, ~16 GB
118
- * Training data: NQ Tables + MultiTabQA (single- and multi-table retrieval)
119
- * Family: three TabRank checkpoints — **TabRankNaive** (this model — no reasoning, fastest), [TabRankStandardSFT](https://huggingface.co/AdarshSingh7647/TabRankStandardSFT) (standard CoT SFT), and [TabRank](https://huggingface.co/AdarshSingh7647/TabRank) (reasoning-conditioned, best generalization)
120
 
121
  ## Citation
122
 
123
- If you use these models, please cite the TabRank paper:
124
-
125
  ```bibtex
126
  @misc{singh2026tabrank,
127
  title={TabRank: Chain-of-Thought Distillation for Table Re-Rankers},
@@ -134,7 +121,7 @@ If you use these models, please cite the TabRank paper:
134
  }
135
  ```
136
 
137
- The MultiTabQA data in this checkpoint's training mix comes from RAG over Tables. If your usage relies specifically on the multi-table data, please also cite:
138
 
139
  ```bibtex
140
  @misc{zou2025ragtableshierarchicalmemory,
 
3
  base_model: Qwen/Qwen3-8B
4
  library_name: transformers
5
  pipeline_tag: text-generation
 
 
 
 
 
 
6
  language:
7
  - en
8
  ---
9
 
10
+ # TabRankNaive
11
 
12
+ Qwen3-8B, fine-tuned for **single-call generative listwise table reranking**. Given a question and a list of candidate tables, it reads them all in one prompt and returns the full ranking in a single generation — no pairwise scoring, no cross-encoder passes.
13
 
14
  ![TabRank: question and candidate tables go into a single Qwen3-8B call, which reasons and emits a ranked list](tabrank_task.png)
15
 
16
+ This checkpoint is the **Answer-Only** variant: fine-tuned to output the ranking directly with no reasoning trace, so it's the fastest of the three objectives at inference.
17
 
18
+ Related: [TabRank](https://huggingface.co/AdarshSingh7647/TabRank) (same data, reasoning-conditioned, our best method) · [TabRankStandardSFT](https://huggingface.co/AdarshSingh7647/TabRankStandardSFT) (same data, standard CoT SFT).
 
 
 
 
19
 
20
  ## Input / output format
21
 
 
51
 
52
  ## Evaluation
53
 
54
+ This card does not publish a verified results table for the Answer-Only objective on this training mix — earlier published numbers for this checkpoint could not be confirmed against source eval logs, so they're left out rather than risk repeating an error.
55
 
56
+ For a fully-verified comparison, see [TabRankStandardSFT](https://huggingface.co/AdarshSingh7647/TabRankStandardSFT) and [TabRank](https://huggingface.co/AdarshSingh7647/TabRank), which include in-distribution results (SQA, TAT-QA, HybridQA, TabFact, NQ-Tables) and out-of-distribution results on 7 benchmarks from the [IBM table-text-ir-evaluation suite](https://huggingface.co/collections/ibm-research/table-text-ir-evaluation). Source eval code and logs: [GitHub](https://github.com/AdarshSingh7647/TabRanker).
57
 
58
  ## Usage with vLLM
59
 
 
98
  print(tok.decode(out[0][inputs.input_ids.shape[1]:], skip_special_tokens=True))
99
  ```
100
 
101
+ Full training and eval code: [github.com/AdarshSingh7647/TabRanker](https://github.com/AdarshSingh7647/TabRanker).
102
 
103
  ## Model details
104
 
105
  * Base model: Qwen3-8B
106
+ * Method: LoRA rank 16, merged into base weights
107
+ * Precision: bfloat16, ~16 GB
108
+ * Training data: NQ Tables + MultiTabQA
 
109
 
110
  ## Citation
111
 
 
 
112
  ```bibtex
113
  @misc{singh2026tabrank,
114
  title={TabRank: Chain-of-Thought Distillation for Table Re-Rankers},
 
121
  }
122
  ```
123
 
124
+ The MultiTabQA data in this checkpoint's training mix comes from RAG over Tables:
125
 
126
  ```bibtex
127
  @misc{zou2025ragtableshierarchicalmemory,