WNAM REPORT: Chinese startup Spirit AI has said that its Spirit v1.5 embodied intelligence foundation model now ranks first according to the RoboChallenge real-world robotics benchmark, surpassing a leading U.S. model.
According to the RoboChallenge leaderboard, Spirit v1.5 has achieved a total score of 66.09 with a task success rate of 50.33 percent, outperforming the pi0.5 model developed by U.S.-based Physical Intelligence.
Spirit AI said it has open-sourced the leading model and related resources.
RoboChallenge, which industry observers often describe as a “global exam” for robots, is a real-machine evaluation platform that tests embodied intelligence models in physical environments. Its benchmarking process includes 30 tasks covering everyday operations such as object placement, target recognition and tool use.
