ynFeng
/

approximate-speculative-decoding

Transformers

custom_generate

Model card Files Files and versions

xet

Community

approximate-speculative-decoding / custom_generate /requirements.txt

ynFeng

ASD: Approximate Speculative Decoding custom generation method

9c0a4e6 verified 16 days ago

Raw History Blame Contribute Delete

187 Bytes

# The acceptance loop mirrors `GenerationMixin._assisted_decoding` internals,
# so the minor version is pinned. Verified on transformers 5.19.0.
transformers>=5.19.0,<5.20.0
torch>=2.0.0

	# The acceptance loop mirrors `GenerationMixin._assisted_decoding` internals,
	# so the minor version is pinned. Verified on transformers 5.19.0.
	transformers>=5.19.0,<5.20.0
	torch>=2.0.0