Post
6,221
who's working on an NVFP4 version of Kimi-K3?
- 4 replies
AI & ML interests
None defined yet.
julien-cย
submitted a
paper to Daily Papers 9 months ago
Post
900
GH200 cooking time ๐งโ๐ณ๐ฅ!
We just updated GPU-fryer ๐ณ to run on Grace Hopper Superchip (GH200) - fully optimized for ARM-based systems!
With this release, we switched to cuBLASLt to support running FP8 benchmarks. You can monitor GPU throttling, TFLOPS outliers, HBM memory health, and ensure that you get the most of your hardware setup.
Perfect for stress testing and tuning datacenter GPUs.
Check it out on Github ๐ https://github.com/huggingface/gpu-fryer
We just updated GPU-fryer ๐ณ to run on Grace Hopper Superchip (GH200) - fully optimized for ARM-based systems!
With this release, we switched to cuBLASLt to support running FP8 benchmarks. You can monitor GPU throttling, TFLOPS outliers, HBM memory health, and ensure that you get the most of your hardware setup.
Perfect for stress testing and tuning datacenter GPUs.
Check it out on Github ๐ https://github.com/huggingface/gpu-fryer
Post
12,038
BOOOOM: Today I'm dropping TINY AGENTS
the 50 lines of code Agent in Javascript ๐ฅ
I spent the last few weeks working on this, so I hope you will like it.
I've been diving into MCP (Model Context Protocol) to understand what the hype was all about.
It is fairly simple, but still quite powerful: MCP is a standard API to expose sets of Tools that can be hooked to LLMs.
But while doing that, came my second realization:
Once you have a MCP Client, an Agent is literally just a while loop on top of it. ๐คฏ
โก๏ธ read it exclusively on the official HF blog: https://huggingface.co/blog/tiny-agents
the 50 lines of code Agent in Javascript ๐ฅ
I spent the last few weeks working on this, so I hope you will like it.
I've been diving into MCP (Model Context Protocol) to understand what the hype was all about.
It is fairly simple, but still quite powerful: MCP is a standard API to expose sets of Tools that can be hooked to LLMs.
But while doing that, came my second realization:
Once you have a MCP Client, an Agent is literally just a while loop on top of it. ๐คฏ
โก๏ธ read it exclusively on the official HF blog: https://huggingface.co/blog/tiny-agents
- 1 reply
hlarcherย
authored a
paper over 1 year ago
Post
4,573
Important notice ๐จ
For Inference Providers who have built support for our Billing API (currently: Fal, Novita, HF-Inference โ with more coming soon), we've started enabling Pay as you go (=PAYG)
What this means is that you can use those Inference Providers beyond the free included credits, and they're charged to your HF account.
You can see it on this view: any provider that does not have a "Billing disabled" badge, is PAYG-compatible.
For Inference Providers who have built support for our Billing API (currently: Fal, Novita, HF-Inference โ with more coming soon), we've started enabling Pay as you go (=PAYG)
What this means is that you can use those Inference Providers beyond the free included credits, and they're charged to your HF account.
You can see it on this view: any provider that does not have a "Billing disabled" badge, is PAYG-compatible.
- 10 replies
hlarcherย
authored a
paper over 1 year ago
Post
1,183
We are introducing multi-backend support in Hugging Face Text Generation Inference!
With new TGI architecture we are now able to plug new modeling backends to get best performances according to selected model and available hardware. This first step will very soon be followed by the integration of new backends (TRT-LLM, llama.cpp, vLLM, Neuron and TPU).
We are polishing the TensorRT-LLM backend which achieves impressive performances on NVIDIA GPUs, stay tuned ๐ค !
Check out the details: https://huggingface.co/blog/tgi-multi-backend
With new TGI architecture we are now able to plug new modeling backends to get best performances according to selected model and available hardware. This first step will very soon be followed by the integration of new backends (TRT-LLM, llama.cpp, vLLM, Neuron and TPU).
We are polishing the TensorRT-LLM backend which achieves impressive performances on NVIDIA GPUs, stay tuned ๐ค !
Check out the details: https://huggingface.co/blog/tgi-multi-backend
Post
11,721
After some heated discussion ๐ฅ, we clarify our intent re. storage limits on the Hub
TL;DR:
- public storage is free, and (unless blatant abuse) unlimited. We do ask that you consider upgrading to PRO and/or Enterprise Hub if possible
- private storage is paid above a significant free tier (1TB if you have a paid account, 100GB otherwise)
docs: https://huggingface.co/docs/hub/storage-limits
We optimize our infrastructure continuously to scale our storage for the coming years of growth in Machine learning, to the benefit of the community ๐ฅ
cc: @reach-vb @pierric @victor and the HF team
TL;DR:
- public storage is free, and (unless blatant abuse) unlimited. We do ask that you consider upgrading to PRO and/or Enterprise Hub if possible
- private storage is paid above a significant free tier (1TB if you have a paid account, 100GB otherwise)
docs: https://huggingface.co/docs/hub/storage-limits
We optimize our infrastructure continuously to scale our storage for the coming years of growth in Machine learning, to the benefit of the community ๐ฅ
cc: @reach-vb @pierric @victor and the HF team
- 29 replies
Post
3,321
wow ๐ฎ
INTELLECT-1 is the first collaboratively trained 10 billion parameter language model trained from scratch on 1 trillion tokens of English text and code.
PrimeIntellect/INTELLECT-1-Instruct
INTELLECT-1 is the first collaboratively trained 10 billion parameter language model trained from scratch on 1 trillion tokens of English text and code.
PrimeIntellect/INTELLECT-1-Instruct
Post
5,307
Hey it was good meeting you yesterday @MaziyarPanahi ๐ฅ
thanks @mishig for setting this up
Let's make the Hub as useful as possible for the community โค๏ธ
thanks @mishig for setting this up
Let's make the Hub as useful as possible for the community โค๏ธ
- 1 reply
Post
7,009
text-generation-inference (TGI) is now fully open-source again!
Along with text-embeddings-inference.
We just switched both of those repos' license back to Apache 2. ๐ฅ
Along with text-embeddings-inference.
We just switched both of those repos' license back to Apache 2. ๐ฅ
Post
3,261
Very glad to welcome @josefprusa , pioneer of 3D printing and open source hardware, founder of https://www.prusa3d.com/, to the HF Hub ๐
AI applied to 3D printing could be big.
AI applied to 3D printing could be big.
- 1 reply
Post
671 authors ๐คฏ
Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context (2403.05530) Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context
Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context (2403.05530) Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context
- 2 replies
Post
What if you could casually access your remote GPU in HF Spaces from the comfort of your local VSCode ๐คฏ
- 8 replies
Post
๐ฃ NEW on HF
the Dataset Viewer is now available on *private datasets* too
You need to be a PRO or a Enterprise Hub user. ๐ฅ
Great work from our Datasets team ๐ฅฐ: @lhoestq @severo @polinaeterna @asoria @albertvillanova and the whole team ๐ฅฐ
the Dataset Viewer is now available on *private datasets* too
You need to be a PRO or a Enterprise Hub user. ๐ฅ
Great work from our Datasets team ๐ฅฐ: @lhoestq @severo @polinaeterna @asoria @albertvillanova and the whole team ๐ฅฐ
- 1 reply
julien-cย
authored 3
papers over 3 years ago
TransferTransfo: A Transfer Learning Approach for Neural Network Based Conversational Agents
Paper โข 1901.08149 โข Published โข 4
Continuous Learning in a Hierarchical Multiscale Neural Network
Paper โข 1805.05758 โข Published โข 2
Meta-Learning a Dynamical Language Model
Paper โข 1803.10631 โข Published โข 1