Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

FluidInference
/
unlimited-ocr-mlx-coreml

Image-Text-to-Text
MLX
Core ML
apple
ocr
document-parsing
multi-page
deepseek-ocr
Mixture of Experts
fluidinference
Model card Files Files and versions
xet
Community

Instructions to use FluidInference/unlimited-ocr-mlx-coreml with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

  • Libraries
  • MLX

    How to use FluidInference/unlimited-ocr-mlx-coreml with MLX:

    # Make sure mlx-vlm is installed
    # pip install --upgrade mlx-vlm
    
    from mlx_vlm import load, generate
    from mlx_vlm.prompt_utils import apply_chat_template
    from mlx_vlm.utils import load_config
    
    # Load the model
    model, processor = load("FluidInference/unlimited-ocr-mlx-coreml")
    config = load_config("FluidInference/unlimited-ocr-mlx-coreml")
    
    # Prepare input
    image = ["http://images.cocodataset.org/val2017/000000039769.jpg"]
    prompt = "Describe this image."
    
    # Apply chat template
    formatted_prompt = apply_chat_template(
        processor, config, prompt, num_images=1
    )
    
    # Generate output
    output = generate(model, processor, formatted_prompt, image)
    print(output)
  • Notebooks
  • Google Colab
  • Kaggle
  • Local Apps Settings
  • LM Studio
  • Atomic Chat
unlimited-ocr-mlx-coreml
9.27 GB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 8 commits
alexwengg's picture
alexwengg
Card: turbo decoder
4568571 verified about 3 hours ago
  • UnlimitedOcrDecoder.mlpackage
    Decoder: concatenate attention scores instead of K/V (no per-layer cache copy, ~17% faster decode, same output) 1 day ago
  • UnlimitedOcrPageEncoder.mlpackage
    Unlimited-OCR Core ML: fp16 page encoder + int8 stateful multi-page decoder 1 day ago
  • mlx-turbo
    MLX turbo decoder: routed experts 4-bit (group 32), rest 8-bit; ~10-17% faster, text within ~1 pt of 8-bit about 4 hours ago
  • mlx
    MLX text decoder (8-bit affine g64, decoder only; page encoder stays Core ML): ~5x faster decode about 7 hours ago
  • .gitattributes
    1.57 kB
    Unlimited-OCR Core ML: fp16 page encoder + int8 stateful multi-page decoder 1 day ago
  • LICENSE
    1.06 kB
    Unlimited-OCR Core ML: fp16 page encoder + int8 stateful multi-page decoder 1 day ago
  • README.md
    5.1 kB
    Card: turbo decoder about 3 hours ago
  • config.json
    704 Bytes
    Unlimited-OCR Core ML: fp16 page encoder + int8 stateful multi-page decoder 1 day ago
  • embeddings.f16
    331 MB
    xet
    Unlimited-OCR Core ML: fp16 page encoder + int8 stateful multi-page decoder 1 day ago
  • tokenizer.json
    9.98 MB
    Unlimited-OCR Core ML: fp16 page encoder + int8 stateful multi-page decoder 1 day ago