Ego-centric Predictive Model

Two-stage egocentric video prediction conditioned on hand trajectories.

An exploratory direction in egocentric future prediction:

  1. Predict future hand trajectories from past observations and recent motion.
  2. Condition future-video generation on those trajectories.

This research direction connects multimodal understanding with predictive models for embodied planning. It is separate from the current submissions listed on the publications page.