v0.6.0: stream MoE experts from the SSD (LRU cache, direct I/O) when the model does not fit; expert memory setting

3a7bf50

verified

ryugyosoft commited on about 12 hours ago