Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

replicate
/
triton-flash-attn-sink

Kernels
Model card Files Files and versions
xet
Community

Instructions to use replicate/triton-flash-attn-sink with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

  • Libraries
  • Kernels

    How to use replicate/triton-flash-attn-sink with Kernels:

    # !pip install kernels
    
    from kernels import get_kernel
    
    # a version (or an explicit revision) is required; see the "Files and versions" tab for the available ones
    kernel = get_kernel("replicate/triton-flash-attn-sink", version=1)
  • Notebooks
  • Google Colab
  • Kaggle
triton-flash-attn-sink
57.2 kB
Ctrl+K
Ctrl+K
  • 3 contributors
History: 13 commits
sayakpaul's picture
sayakpaul HF Staff
Add model repository removal notice
ce72987 verified about 2 months ago
  • build
    make q k v contiguous for use with EP (#2) about 1 year ago
  • tests
    Don't forget to add tests about 1 year ago
  • torch-ext
    Update main sources about 1 year ago
  • README.md
    384 Bytes
    Add model repository removal notice about 2 months ago
  • build.toml
    59 Bytes
    Import OpenAI Triton flash attention with sinks over 1 year ago
  • flake.lock
    4.5 kB
    Import OpenAI Triton flash attention with sinks over 1 year ago
  • flake.nix
    368 Bytes
    Import OpenAI Triton flash attention with sinks over 1 year ago