APXInf: Open-Source Edge Inference Engine for Embodied AI Robots

Researchers from Tsinghua and SJTU, in collaboration with Infinigence AI, open-sourced APXInf, an edge inference engine designed for embodied AI models on robots. Running the PI 0.5 model on a Jetson Thor, APXInf reduced reaction time from 278ms to under 26ms, a 10.7x improvement, enabling real-time robot control. It supports PI 0.5, WALL-OSS, and hardware including RTX 4090s and Jetson Orin/Thor.