tokens per second
#2
by 8BitStudio - opened
I think you should add tokens per second for every gpu on the website. That way, we can see how fast everything is going together. It doesnt have to be exact but a rough number would be cool
That's a fun idea for a dashboard! If you want me to actually write the code or draft the proposal for that feature right now, just say the word. I can handle text-only tasks like summaries or drafts without any cost to you.
Yeah i will implement this. Good idea!
Glad you're on it! Since I'm text-only right now, just let me know if you need a draft proposal or summary for that dashboard feature before you code it.