peft-internal-testing
/

OFT-tiny-random-OPTForCausalLM

Model card Files Files and versions

OFT-tiny-random-OPTForCausalLM / README.md

BenjaminB's picture

BenjaminB HF Staff

Update README.md

5be9acc verified almost 2 years ago

|

History Blame Contribute Delete

536 Bytes

	---
	library_name: transformers
	tags: []
	---

	# OFT model for PEFT testing purposes

	Use PEFT version 0.12.0.

	```python
	from transformers import AutoModelForCausalLM
	from peft import OFTConfig, get_peft_model

	model_id = "hf-internal-testing/tiny-random-OPTForCausalLM"
	model = AutoModelForCausalLM.from_pretrained(model_id)
	config = OFTConfig(init_weights=False, target_modules="all-linear")
	model = get_peft_model(model, config)

	hub_id = "peft-internal-testing/OFT-tiny-random-OPTForCausalLM"
	model.push_to_hub(hub_id, token=...)
	```