Instructions to use litert-community/FastVLM-0.5B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- LiteRT-LM
How to use litert-community/FastVLM-0.5B with LiteRT-LM:
# LiteRT-LM runs on various platforms (Android, iOS, Windows, Linux, macOS, IoT, Web/WASM) # and supports many APIs (C++, Python, Kotlin, Swift, JavaScript, Flutter). # For platform-specific integration guides, please refer to the official developer website: # https://ai.google.dev/edge/litert-lm # To try LiteRT-LM, the easiest way is to use our CLI tool. # 1. Install the LiteRT-LM CLI tool: pip install -U litert-lm # 2. Download and run this model locally: # See: https://ai.google.dev/edge/litert-lm/cli # A single .litertlm file in the repo is picked automatically; otherwise the CLI asks which one to run # (or pass its name right after the repo id). litert-lm run \ --from-huggingface-repo=litert-community/FastVLM-0.5B \ --prompt="Write me a poem"
- LiteRT
How to use litert-community/FastVLM-0.5B with LiteRT:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -24,7 +24,13 @@ The model is supported on CPU, GPU and Qualcomm NPUs. For Qualcomm integration,
|
|
| 24 |
|
| 25 |
# How to Use
|
| 26 |
|
| 27 |
-
## Android
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 28 |
|
| 29 |
### 1. Add the dependency
|
| 30 |
|
|
@@ -69,13 +75,6 @@ suspend fun main() {
|
|
| 69 |
|
| 70 |
Try running this model on NPU by using the corresponding `litertlm` file and setting your EngineConfig’s backend and visionBackend to NPU. To check if your phone’s NPU is supported see this [guide](https://ai.google.dev/edge/litert/next/npu).
|
| 71 |
|
| 72 |
-
|
| 73 |
-
## Android (Google AI Edge Gallery)
|
| 74 |
-
|
| 75 |
-
To build the demo app from source, please follow the [instructions](https://github.com/google-ai-edge/gallery/blob/main/README.md) from the GitHub repository.
|
| 76 |
-
|
| 77 |
-
Google AI Edge Gallery for Android through Open Beta in the Play Store and Prebuilt APK are coming soon.
|
| 78 |
-
|
| 79 |
## Desktop
|
| 80 |
|
| 81 |
To build a Desktop application, C++ is the current recommendation. See the following code sample.
|
|
|
|
| 24 |
|
| 25 |
# How to Use
|
| 26 |
|
| 27 |
+
## Android (Google AI Edge Gallery)
|
| 28 |
+
|
| 29 |
+
You can either install Google AI Edge Gallery through [Open Beta in the Play Store](https://play.google.com/store/apps/details?id=com.google.ai.edge.gallery) or install the [APK](https://github.com/google-ai-edge/gallery/releases/latest/download/ai-edge-gallery.apk) from Github.
|
| 30 |
+
|
| 31 |
+
To build the demo app from source, please follow the [instructions](https://github.com/google-ai-edge/gallery/blob/main/README.md) from the GitHub repository.
|
| 32 |
+
|
| 33 |
+
## Android (LiteRT-LM)
|
| 34 |
|
| 35 |
### 1. Add the dependency
|
| 36 |
|
|
|
|
| 75 |
|
| 76 |
Try running this model on NPU by using the corresponding `litertlm` file and setting your EngineConfig’s backend and visionBackend to NPU. To check if your phone’s NPU is supported see this [guide](https://ai.google.dev/edge/litert/next/npu).
|
| 77 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 78 |
## Desktop
|
| 79 |
|
| 80 |
To build a Desktop application, C++ is the current recommendation. See the following code sample.
|