Progress-Aware Long-Horizon Robot Tasks
We investigate how robots can track task progress, maintain useful context and select subsequent actions during extended manipulation tasks.
Project investigator: Haonan Zhou
Research
A robot that relies on a wireless link must decide what to share, where to compute and how to act when information arrives late or incomplete. Our 4 themes and 6 ongoing projects approach this from the link, the model and the body.
The system view
People set goals. Network-side intelligence coordinates across robots and shares task context. Each robot keeps its own perception, decision and control loop on board, so time-critical control does not wait for the network.
Between them sits the wireless link. Its bandwidth, delay and reliability decide what can be shared and how quickly — which is why we study communication, intelligence and physical action as one problem rather than three.
A representative system concept, not a deployment diagram. Joint-level control stays on the robot; the wireless link carries task-relevant information.
System concept: people set goals; network-side intelligence coordinates; task-relevant information crosses a wireless link subject to bandwidth, delay and reliability; each robot runs its own perception, decision and control loop; humanoid and quadruped platforms act in the physical world and return observations and task feedback.
Human goals & shared tasks
People set goals and work alongside robots
Goals & instructions
Progress & outcomes
Network side · edge & cloud
Network-side intelligence
Coordination, planning and shared task context
Wireless information exchange
Task-relevant information
Observations & evidence
On each robot
On-robot intelligence
Local control loop — runs on board, without a network round trip
Actions
Physical observations & task feedback
Physical world
Humanoid & quadruped platforms
Acting on objects, spaces and people
Concept
The research loop that links our themes. Communication constraints appear where information is exchanged between the robot and the network.
Concept loop: observe, exchange information under bandwidth, delay and reliability constraints, build task context, select an action, execute it physically, verify the result, and observe again.
We explore how embodied agents connect language, perception, task progress and physical action over extended tasks.
We investigate how robots can track task progress, maintain useful context and select subsequent actions during extended manipulation tasks.
Project investigator: Haonan Zhou
We develop research prototypes that connect object perception, language instructions, grasp planning and feedback control for tabletop manipulation.
Project investigator: Haonan Zhou
We investigate coordination between network-side intelligence, on-robot models and heterogeneous robotic agents.
We study how network-side models and on-robot intelligence can coordinate sensing, planning and execution across multiple robots, while accounting for communication and computation constraints.
Project investigator: Haonan Zhou
We investigate interfaces that connect human instructions with robot behaviours, supporting interactive demonstrations across mobile and humanoid platforms.
Project investigator: Haonan Zhou
We study how robots can exchange task-relevant information under bandwidth, latency and reliability constraints.
How much information does a robot need to act? We investigate compact representations and communication strategies that preserve task-relevant information across constrained and unreliable links.
Project investigator: Haonan Zhou
We investigate movement, manipulation and interaction while accounting for whole-body dynamics and physical constraints.
We explore how whole-body dynamics and geometric constraints can inform upper-body motion, with the aim of improving stability during humanoid manipulation.
Project investigator: Haonan Zhou
We investigate interfaces that connect human instructions with robot behaviours, supporting interactive demonstrations across mobile and humanoid platforms.
Project investigator: Haonan Zhou