Text Classification
Transformers
Joblib
ONNX
Safetensors
English
bert
masterformat
masterformat-classifier
csi-masterformat
construction
construction-technology
sequence-classification
tfidf
ensemble
specs
spec-writing
specifications
takeoff
estimating
cost-code
ufgs
public-domain
Eval Results (legacy)
text-embeddings-inference
Instructions to use constructelligence/masterformat-classifier with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use constructelligence/masterformat-classifier with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="constructelligence/masterformat-classifier")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForSequenceClassification tokenizer = AutoTokenizer.from_pretrained("constructelligence/masterformat-classifier") model = AutoModelForSequenceClassification.from_pretrained("constructelligence/masterformat-classifier", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Add pipeline and results diagrams to model card
Browse files- .gitattributes +2 -0
- README.md +5 -0
- figures/masterformat-pipeline.png +3 -0
- figures/masterformat-results.png +3 -0
.gitattributes
CHANGED
|
@@ -33,3 +33,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
+
figures/masterformat-pipeline.png filter=lfs diff=lfs merge=lfs -text
|
| 37 |
+
figures/masterformat-results.png filter=lfs diff=lfs merge=lfs -text
|
README.md
CHANGED
|
@@ -134,6 +134,8 @@ the fp32 export is the safer default. Reproduce with `python scripts/export_onnx
|
|
| 134 |
|
| 135 |
## Results
|
| 136 |
|
|
|
|
|
|
|
| 137 |
All numbers are measured in this project on held-out data. The `line_items`, `manuals` and `manual_sections`
|
| 138 |
sets are **fixed**, so those columns are directly comparable for every scorer. `val` is the **v2** UFGS split
|
| 139 |
(11,598 units).
|
|
@@ -174,6 +176,9 @@ reaches **0.702** and is the production candidate; see *Ensemble*.
|
|
| 174 |
|
| 175 |
## Ensemble (closing the line-item gap)
|
| 176 |
|
|
|
|
|
|
|
|
|
|
| 177 |
The transformer is trained on specification prose, so on **short, terse estimate line items** a lexical
|
| 178 |
TF-IDF model is still stronger (0.696 vs 0.597 top-1). To close that gap without giving up the transformer's
|
| 179 |
long-text accuracy, this repo ships a **log-probability ensemble** of `mf-0.2` and a TF-IDF + SGD scorer:
|
|
|
|
| 134 |
|
| 135 |
## Results
|
| 136 |
|
| 137 |
+

|
| 138 |
+
|
| 139 |
All numbers are measured in this project on held-out data. The `line_items`, `manuals` and `manual_sections`
|
| 140 |
sets are **fixed**, so those columns are directly comparable for every scorer. `val` is the **v2** UFGS split
|
| 141 |
(11,598 units).
|
|
|
|
| 176 |
|
| 177 |
## Ensemble (closing the line-item gap)
|
| 178 |
|
| 179 |
+

|
| 180 |
+
|
| 181 |
+
|
| 182 |
The transformer is trained on specification prose, so on **short, terse estimate line items** a lexical
|
| 183 |
TF-IDF model is still stronger (0.696 vs 0.597 top-1). To close that gap without giving up the transformer's
|
| 184 |
long-text accuracy, this repo ships a **log-probability ensemble** of `mf-0.2` and a TF-IDF + SGD scorer:
|
figures/masterformat-pipeline.png
ADDED
|
Git LFS Details
|
figures/masterformat-results.png
ADDED
|
Git LFS Details
|