Amicus Humanizer v1 (ONNX INT8)

This is the highly optimized, CPU-ready ONNX INT8 quantized version of the Amicus Humanizer v1 model. It has been specifically fine-tuned and quantized for the Dockase ecosystem to rewrite dense, complex legal jargon into plain, easily understandable English.

Model Details

  • Architecture: Seq2Seq (Encoder-Decoder) based on FLAN-T5
  • Task: Text-to-Text Generation (Legal text simplification)
  • Format: ONNX
  • Quantization: INT8 (Dynamic Quantization with AVX512 optimization)
  • Target Deployment: Fast inference on CPU servers

Usage

This model is designed to be run using optimum.onnxruntime or raw ONNX Runtime inference servers.

Downloads last month
12
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for WhiteRoomProdigy/amicus-humanizer-v1-onnx

Quantizations
1 model