Orqanta-AI / scripts /edge /README.md
buggandhi's picture
Initial release: Orqanta AI 121M edge foundation model weights, datasets and tools
43a90a1 verified
|
Raw History Blame Contribute Delete
1.45 kB
# Edge Conversion Scripts
This directory contains optional utility scripts to convert the **Orqanta AI / Psycho** model to formats like TFLite or ONNX if required.
> **Note**: Orqanta AI already features precompiled native C/C++ engine binaries in `bin/android-arm64/orqanta` and `bin/linux-x86_64/orqanta` that run natively on Android (Car / Smartwatch) and Linux laptops with **<80MB RAM and sub-50ms CPU latency**, without needing TFLite or ONNX!
## Scripts
| Script | Target Platform | Description |
|--------|----------------|-------------|
| `convert_to_tflite.py` | Android‑based car (or any Android device) | Optional exporter bridge to TensorFlow Lite (`.tflite`). |
| `convert_to_onnx.py` | Linux laptop (or any Linux system) | Optional exporter bridge to ONNX (`.onnx`). |
## Requirements
- **Python 3.9+**
- For TFLite conversion: `pip install tensorflow`
- For ONNX conversion: `pip install torch onnx`
## Direct Native Edge Execution (Recommended)
Instead of converting, use the zero-overhead native engine directly:
```bash
# On Linux Laptops (x86_64):
./bin/linux-x86_64/orqanta --model models/orqanta.cact --tools examples/linux_laptop/laptop_tools.json --prompt "Check battery"
# On Android Automotive / Smartwatch (ARM64):
adb push bin/android-arm64/orqanta /data/local/tmp/
adb push models/orqanta.cact /data/local/tmp/
adb shell "/data/local/tmp/orqanta --model /data/local/tmp/orqanta.cact --prompt 'Hello'"
```