Intro 👇👇

👏👋This is a lite library with pure C++ for AI model inference, aiming to deploy on mobile devices easily. This can be built to be migrated into Unity and used by C#.🎉🎉

NN Inference (Developing) 👇👇

Strongly depending on module: onnxruntime.

Click to Check Demo

1. 2D detection Model
   1. RTMDet-series
   2. YOLO-series
2. Face Landmark Model
   1. Face Detector
   2. Face Landmarker
3. Human Segmentation Model
   1. Selfie (Close to camera)
4. Human Pose Model
   1. RTMPOSE

Supported ONNXRuntime Execution Providers:

	Linux	Android (exclude x86)	MacOS	IOS	Windows	WebAssembly
CPU	✅	✅	✅	✅	✅	✅
GPU	-	-	✅(CoreML)	✅(CoreML)	-	-
XNNPACK	✅	✅	-	-	✅	-
NNAPI	-	✅	-	-	-	-

Other Supported Modules:

Post-processing

1. Non-maximum Suppression
2. Face-Geometry

	Linux	Android	MacOS	IOS	Windows
Non-maximum Suppression	✅	✅	✅	✅	✅
Face-Geometry	✅	✅	✅	✅	✅

Supported 3rd parties:

	Linux	Android	MacOS	IOS	Windows	WebAssembly
OpenCV - Mobile	✅	✅	✅	✅	✅	✅
ONNXRuntime	✅	✅ excluding x86	✅	✅	✅	✅
nlohmann json (header only)	✅	✅	✅	✅	✅	✅
Eigen (header only)	✅	✅	✅	✅	✅	✅
OpenMP	✅	✅	✅	✅	✅	✅

Build

Linux Host:
./build_linux.sh install
# python3 build.py --android --linux

MACOS Host:
./build_osx.sh
./build_ios.sh
# python3 build.py --macos --ios (--noinstall)

Windows Host (with vs2022):
# python3 build.py --windows (--noinstall)

NOTES

Refer to Notion for detail documentation

Some model export guide:

Refer to docs