XNews

APXInf: Open-Source On-Device Inference Engine for Embodied AI

APXInf: Open-Source On-Device Inference Engine for Embodied AI

APXInf, an open-source on-device inference engine for embodied AI, was released by InfiniteYou, Tsinghua University, and Shanghai Jiao Tong University. It reduces reaction time for the PI 0.5 model on Jetson Thor from 278ms to under 26ms, a 10.7x speedup, enabling real-time robot control. The engine is designed for long-running stability and supports PI 0.5 and WALL-OSS models on RTX 4090 and Jetson Orin/Thor.

Source posts