Hugging Face's logo
Green Cookie's picture

Green Cookie

greencookies
1
·

AI & ML interests

Pushing creative boundaries by leveraging AI techniques.

Recent Activity

liked a model 10 days ago
mlx-community/Qwen3.8-27B-4bit
reacted to multimodalart's post with 🤯 over 2 years ago
It seems February started with a fully open source AI renaissance 🌟 Models released with fully open dataset, training code, weights ✅ LLM - https://huggingface.co/collections/allenai/olmo-suite-65aeaae8fe5b6b2122b46778 🧠 Embedding - https://huggingface.co/nomic-ai/nomic-embed-text-v1 📚 (sota!) And it's literally February 1st - can't wait to see what else the community will bring 👀
reacted to chansung's post with ❤️ over 2 years ago
As a GPU poor, I found a nice open source project. dstackai is the perfect open source project for GPU poor. Simply specify resource requirements (GPU RAM, spot, ...), then will suggest the cheapest options among the popular GPU cloud providers (AWS, GCP, Azure, Lambda Labs, TensorDock, and vast.ai) Provision VM instances in 3 different use cases. These are the essential for any ML projects. - Dev: connect provisioned VM instance to your fav IDE (including Jupyter) - Task: run experiments (training, fine-tuning, ...) via SSH - Service: run your model in production via HTTPS dstack is 100% open source, but you need to have your own accounts for each GPU cloud provider, enough GPU quota, configure credentials, etc., all by yourself. Luckily, dstack will announce dstack cloud which let you not worried about all the hassles. The price is almost as same as you directly connect to each cloud with your account. The attached code snippet shows you how to provision a Mistral-7B model in Text Generation Inference(TGI) on the cheapest VM instance (of having 24GB of VRAM). Then you get the HTTPS connection to it, and play with it as usual with TGI client library as attached in the second code snippet. If you want to learn more about dstack, check out the official website. Without GPU sponsors, as an individual open source contributor in ML, this kind of project is pretty important. : https://dstack.ai/ If you are looking for an alternative, there is SkyPilot project as well : https://github.com/skypilot-org/skypilot
View all activity

Organizations

MLX Community's profile picture