Kenneth Hamilton PRO

Well said, thank you. It was only a matter of time before benchmaxxing became a meme.

Maybe it's not cheating in the purest sense of the word, but I think the more important question is "will this model generate responses that are truly more relevant and helpful or will it simply score better on benchmarks?"

Appreciate that most people (including myself) use benchmarks as quick-glance heuristics when assessing a new model, but the proof of the pudding is in the eating. At the end of the day, I don't care what the model has scored on any benchmarks if it can't generate useful knowledge and content.

I already pay for Railway compute and the addition of this server is trivial in usage.

HF seems to be better at it than other platforms as well, say Reddit.

That's a real flex tbh.