Instructions to use jonl521/modeling_simple with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use jonl521/modeling_simple with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("jonl521/modeling_simple", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Download .venv/lib/python3.14/site-packages/torch/mtia/_utils.py from jonl521/modeling_simple: direct link, hf CLI and curl.
- Browser
- Download file 1.6 kB
-
https://huggingface.co/jonl521/modeling_simple/resolve/main/.venv/lib/python3.14/site-packages/torch/mtia/_utils.py
- Command line
-
hf download hf://jonl521/modeling_simple/.venv/lib/python3.14/site-packages/torch/mtia/_utils.py
-
curl -L -o _utils.py https://huggingface.co/jonl521/modeling_simple/resolve/main/.venv/lib/python3.14/site-packages/torch/mtia/_utils.py
1.6 kB
| from typing import Any | |
| import torch | |
| # The _get_device_index has been moved to torch.utils._get_device_index | |
| from torch._utils import _get_device_index as _torch_get_device_index | |
| def _get_device_index( | |
| device: Any, optional: bool = False, allow_cpu: bool = False | |
| ) -> int: | |
| r"""Get the device index from :attr:`device`, which can be a torch.device object, a Python integer, or ``None``. | |
| If :attr:`device` is a torch.device object, returns the device index if it | |
| is a MTIA device. Note that for a MTIA device without a specified index, | |
| i.e., ``torch.device('mtia')``, this will return the current default MTIA | |
| device if :attr:`optional` is ``True``. If :attr:`allow_cpu` is ``True``, | |
| CPU devices will be accepted and ``-1`` will be returned in this case. | |
| If :attr:`device` is a Python integer, it is returned as is. | |
| If :attr:`device` is ``None``, this will return the current default MTIA | |
| device if :attr:`optional` is ``True``. | |
| """ | |
| if isinstance(device, int): | |
| return device | |
| if isinstance(device, str): | |
| device = torch.device(device) | |
| if isinstance(device, torch.device): | |
| if allow_cpu: | |
| if device.type not in ["mtia", "cpu"]: | |
| raise ValueError(f"Expected a mtia or cpu device, but got: {device}") | |
| elif device.type != "mtia": | |
| raise ValueError(f"Expected a mtia device, but got: {device}") | |
| if not torch.jit.is_scripting(): | |
| if isinstance(device, torch.mtia.device): | |
| return device.idx | |
| return _torch_get_device_index(device, optional, allow_cpu) | |