moonshotai/Kimi-K3
Image-Text-to-Text • 2.8T • Updated • 2.85k • • 5.7k
Ernigma Bhallz
Ernigma
·
AI & ML interests
LLM models for personal assistants
Recent Activity
liked a model 5 days ago
moonshotai/Kimi-K3 new activity 16 days ago
extraltodeus/Qwen3.5-9B-Nikusui-v1:Very cool liked a model 16 days ago
extraltodeus/Qwen3.5-9B-Nikusui-v1Organizations
None yet
liked a
model 5 days ago
liked a
model 16 days ago
commented a
paper 2 months ago
upvoted a paper 2 months ago
Whats new with the v2?
1
#1 opened 4 months ago
by Ernigma
liked a
dataset 6 months ago
🚩 Report: Illegal or restricted content
🤝 1
5
#1 opened 7 months ago
by 
yukiarimo
No base model
👍 15
8
#2 opened 11 months ago
by 
ricardo-rei
liked 2
datasets 11 months ago
reacted to elinas's post with 🚀👀 almost 2 years ago
Post
3180
We conducted an experiment in an effort to revive LLaMA 1 33B as it had unique prose and a lack of "GPT-isms" and "slop" in its pretraining data, as well as being one of the favorites at the time. With multiple finetune runs, we were able to extend the model from it's pretrained base of 2048 to ~12,000 tokens adding approx. 500M tokens in the process. The effective length is 16,384 but it's better to keep it on the lower range. It writes well and in multiple formats. In the future, we have some ideas like implementing GQA. Please take a look and we would love to hear your feedback!
ZeusLabs/Chronos-Divergence-33B
ZeusLabs/Chronos-Divergence-33B