Instructions to use litert-community/Laya-Multilingual-LiteRT with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- LiteRT
How to use litert-community/Laya-Multilingual-LiteRT with LiteRT:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Laya
How to use litert-community/Laya-Multilingual-LiteRT with Laya:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
File size: 1,749 Bytes
32f1b84 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 | #!/usr/bin/env bash
# Copies the Qualcomm NPU runtime for JIT compilation into app/src/main/jniLibs/arm64-v8a.
#
# The libraries are not in git. Collect them into one directory first:
# libLiteRtDispatch_Qualcomm.so litert_npu_runtime_libraries.zip (LiteRT GitHub Release)
# libLiteRtCompilerPlugin_Qualcomm.so litert_npu_runtime_libraries_jit.zip (separate release asset)
# libQnnHtp.so libQnnSystem.so libQnnHtpPrepare.so libQnnIr.so libQnnSaver.so
# libQnnHtpV<NN>Stub.so libQnnHtpV<NN>CalculatorStub.so QAIRT lib/aarch64-android/
# libQnnHtpV<NN>Skel.so QAIRT lib/hexagon-v<NN>/unsigned/
# <NN> follows the SoC: SM8550 v73, SM8650 v75, SM8750 v79, SM8850 v81. The root README section
# "Running on the NPU" lists the same files.
#
# usage: scripts/fetch_npu_libs.sh <directory-with-the-libraries> [hexagon-version, default v81]
set -euo pipefail
SOURCE=${1:?usage: scripts/fetch_npu_libs.sh <directory-with-the-libraries> [v81]}
HEXAGON=${2:-v81}
MODULE_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")/.." && pwd)"
TARGET="$MODULE_DIR/app/src/main/jniLibs/arm64-v8a"
UPPER=$(printf '%s' "$HEXAGON" | tr 'v' 'V')
FILES=(
libLiteRtDispatch_Qualcomm.so
libLiteRtCompilerPlugin_Qualcomm.so
libQnnHtp.so
libQnnSystem.so
libQnnHtpPrepare.so
libQnnIr.so
libQnnSaver.so
"libQnnHtp${UPPER}Stub.so"
"libQnnHtp${UPPER}CalculatorStub.so"
"libQnnHtp${UPPER}Skel.so"
)
missing=0
for name in "${FILES[@]}"; do
if [ ! -f "$SOURCE/$name" ]; then
echo "missing: $SOURCE/$name" >&2
missing=1
fi
done
[ "$missing" -eq 0 ] || exit 2
mkdir -p "$TARGET"
for name in "${FILES[@]}"; do
cp "$SOURCE/$name" "$TARGET/$name"
done
echo "Copied ${#FILES[@]} libraries for Hexagon $HEXAGON into $TARGET"
|