The COUNT: Counting N-grams Unlocks Scaling on Host Memory and Training-Free Adaptation
Paper • 2610.20456 • Published • 1
COUNT
N-gram tables and checkpoints for The COUNT: Counting N-grams Unlocks Scaling on Host Memory and Training-Free Adaptation
Note The paper
IanMagnusson/count-ngram-tables
UpdatedNote Packed stupid-backoff n-gram tables COUNT reads from CPU RAM
IanMagnusson/count-checkpoints-count
UpdatedNote COUNT models, 60M-1B at D/N 10, 20, 40
IanMagnusson/count-checkpoints-learned-ngram
UpdatedNote Learned n-gram embedding baseline
IanMagnusson/count-checkpoints-standard-transformer
UpdatedNote Standard transformer baseline