Ash PRO
Hoglet-33
AI & ML interests
Open source AI, datasets, parameter efficiency, SLMs, AI for the betterment of humanity. Contact at ash@basicallyai.co
Recent Activity
reacted to theirpost with 👀 19 minutes ago
Everything going on here at basically AI:
1. Pebble 1.5
We're working on Pebble 1.5. Here's what we know so far:
- They will be better than the last generation. 99.99% certain.
- Expanded context lengths of at least 16,384 tokens, with the flagship potentially reaching 32,768.
- A Mamba3-based architecture with some other new architectural designs we're experimenting with.
- Native CPU compatibility — something we failed at with the last generation.
- Natively multilingual and multimodal???
2. SmolCodeBench
A code benchmark designed specifically for small models, because there really isn't a good one right now.
3. SENTRY
VOID is working on something called SENTRY — System for Evaluating Neural Threats, Responses, and Yields.
More on that soon.
4. basically OS
It's an operating system/app/harness. We're still deciding.
5. Finances
Trying to balance the finances after purchasing a Hugging Face Pro subscription.
Follow us for updates:
@Hoglet-33
https://huggingface.co/basically-ai
https://huggingface.co/basically-experimental
https://huggingface.co/void-research reacted to theirpost with 🔥 19 minutes ago
Everything going on here at basically AI:
1. Pebble 1.5
We're working on Pebble 1.5. Here's what we know so far:
- They will be better than the last generation. 99.99% certain.
- Expanded context lengths of at least 16,384 tokens, with the flagship potentially reaching 32,768.
- A Mamba3-based architecture with some other new architectural designs we're experimenting with.
- Native CPU compatibility — something we failed at with the last generation.
- Natively multilingual and multimodal???
2. SmolCodeBench
A code benchmark designed specifically for small models, because there really isn't a good one right now.
3. SENTRY
VOID is working on something called SENTRY — System for Evaluating Neural Threats, Responses, and Yields.
More on that soon.
4. basically OS
It's an operating system/app/harness. We're still deciding.
5. Finances
Trying to balance the finances after purchasing a Hugging Face Pro subscription.
Follow us for updates:
@Hoglet-33
https://huggingface.co/basically-ai
https://huggingface.co/basically-experimental
https://huggingface.co/void-researchOrganizations
