Ongoing projects
Social-Transmotion
We translate the idea of a prompt from Natural Language Processing (NLP) to the task of human trajectory prediction, where a prompt can be a sequence of x-y coordinates on the ground, bounding boxes or body poses.
Human Pose Forecasting
First, we develop an open-source library for human pose forecasting. Next, we model the uncertainty in the task, and then propose a denoising diffusion model to handle noisy inputs.
Multi-Transmotion
We propose a pre-trained transformer-based model that can predict multimodal multitask human motion under different frame settings. We also create a unified human motion data framework by merging seven datasets with standardized settings.
Vehicle Trajectory Prediction
Predicting how the future will unroll is essential for a self-driving car system. We propose generalizable prediction models for this regard. The predictions are then employed in the planning pillar or for risk assessment.
Robust Trajectory Prediction
How robust are the trajectory prediction models? We study this question from different perspectives on vehicle and pedestrian trajectory prediction models.
Social-NCE
Learning socially-aware motion representations is at the core of recent advances in multi-agent problems, such as human motion forecasting and robot navigation in crowds. In this work, we introduce a contrastive learning approach built with negative data augment to promote robust motion representations.
TrajNet++: Socially-Aware Human Trajectory Forecasting
We present an in-depth analysis of existing deep learning based methods for modelling social interactions in crowds. To objectively compare the performance of these interaction-based forecasting models, we develop a large scale interaction-centric benchmark TrajNet++, a significant yet missing component in the field of human trajectory forecasting.
Pedestrian Stop and Go
Predicting whether pedestrians will stop walking (Stop) or start to walk (Go) in the near future, for better trajectory prediction around road traffic.
Pedestrian Bounding Box Prediction
A libary for predicting 2D and 3D bounding boxes of humans in autonomous driving scenarios