XNews

APXInf: open-source embodied inference engine reduces latency 10.7x

APXInf: open-source embodied inference engine reduces latency 10.7x

GitHub_Daily announced APXInf, an open-source embodied end-side inference engine from 无问芯穹, Tsinghua, and SJTU. On Jetson Thor with PI 0.5, reaction time dropped from 278ms to under 26ms (10.7x faster). Supports PI 0.5 and WALL-OSS models on RTX 4090 and Jetson Orin/Thor.

Source posts