Alexandre Alahi
EPFL ENAC IIC VITA
GC C1 383 (Bâtiment GC)
Station 18
CH-1015 Lausanne
Web site: Web site: https://vita.epfl.ch/
DO@ENAC
CH A1 375 (Bâtiment CH)
Station 6
CH-1015 Lausanne
Web site: Web site: https://www.epfl.ch/schools/enac/about/diversity-office/
Fields of expertise
Transportation and Mobility
Socially-aware Artificial Intelligence
Computer Vision
Machine Learning
Deep Learning
Human-Robot Interaction
Ambient Intelligence
Socially-aware Artificial Intelligence
Computer Vision
Machine Learning
Deep Learning
Human-Robot Interaction
Ambient Intelligence
Biography
Alexandre Alahi is currently an Assistant Professor at EPFL. He spent five years at Stanford University as a Post-doc and Research Scientist after obtaining his Ph.D. from EPFL. His research enables machines to perceive the world and make decisions in the context of transportation problems and smart environments. He has worked on the theoretical challenges and practical applications of socially-aware Artificial Intelligence, i.e., systems equipped with perception and social intelligence. He was awarded the Swiss NSF early and advanced researcher grants for his work on predicting human social behavior. He won the CVPR Open Source Award (2012) for his work on Retina-inspired image descriptors, and the ICDSC Challenge Prize (2009) for his sparsity-driven algorithm that has tracked more than 100 million pedestrians to date. His research has been covered internationally by BBC, abc, PBS, Euronews, Wall street journal, and other national news outlets around the world. Alexandre has also co-founded multiple startups such as Visiosafe, and won several startup competitions. He was elected as one of the Top 20 Swiss Venture leaders in 2010.Publications
Infoscience publications
A Shared Representation for Photorealistic Driving Simulators
IEEE Transactions on Intelligent Transportation Systems. 2021-12-03. DOI : 10.1109/TITS.2021.3131303.OpenPifPaf: Composite Fields for Semantic Keypoint Detection and Spatio-Temporal Association
Ieee Transactions On Intelligent Transportation Systems. 2021-11-15. DOI : 10.1109/TITS.2021.3124981.DriverGym: Democratising Reinforcement Learning for Autonomous Driving
2021-11-12. 35th Conference on Neural Information Processing Systems (NeurIPS 2021), Online, December 6-14, 2021.Keypoint Communities
2021-10-11. IEEE International Conference on Computer Vision (ICCV 2021), [Virtual], October 10-17, 2021.Safety-aware Motion Prediction with Unseen Vehicles for Autonomous Driving
2021-10-11. IEEE International Conference on Computer Vision (ICCV 2021), [Virtual], October 10-17, 2021.Social NCE: Contrastive Learning of Socially-aware Motion Representations
2021-10-11. IEEE International Conference on Computer Vision (ICCV), Virtual, October 10-17, 2021.Pedestrian intention prediction: A convolutional bottom-up multi-task approach
Transportation Research Part C: Emerging Technologies. 2021-07-15. DOI : 10.1016/j.trc.2021.103259.Guest Editorial: Introduction to the Special Issue on Long-Term Human Motion Prediction
Ieee Robotics And Automation Letters. 2021-07-01. DOI : 10.1109/LRA.2021.3077964.Human Trajectory Forecasting in Crowds: A Deep Learning Perspective
IEEE Transactions on Intelligent Transportation Systems. 2021-04-19. DOI : 10.1109/TITS.2021.3069362.Perceiving Humans: from Monocular 3D Localization to Social Distancing
IEEE Transactions on Intelligent Transportation Systems. 2021-03-25. DOI : 10.1109/TITS.2021.3069376.MonStereo: When Monocular and Stereo Meet at the Tail of 3D Human Localization
2021-03-22. International Conference on Robotics and Automation (ICRA), Xi'an, China, June 1-6, 2021.Injecting Knowledge in Data-driven Vehicle Trajectory Predictors
Transportation Research Part C: Emerging Technologies. 2021-03-08. DOI : 10.1016/j.trc.2021.103010.Learning Decoupled Representations for Human Pose Forecasting
2021. 2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCV 2021), Virtual, October 11-17, 2021. p. 2294-2303. DOI : 10.1109/ICCVW54120.2021.00259.Efficient Depth-based Deep Learning Methods for Multi-Party Pose Estimation
Lausanne, EPFL, 2021. DOI : 10.5075/epfl-thesis-8429.Gradient-based Methods for Deep Model Interpretability
Lausanne, EPFL, 2021. DOI : 10.5075/epfl-thesis-8606.Damage Assessment of Stone Masonry Piers Using Imaged Surface Cracks
Lausanne, EPFL, 2021. DOI : 10.5075/epfl-thesis-9252.Dynamic control strategies for managing pedestrian flows
Lausanne, EPFL, 2021. DOI : 10.5075/epfl-thesis-8200.Architecture Exploration and Optimization of Heterogeneous Many-Core Compute and Memory Architectures with Architectural Extensions
Lausanne, EPFL, 2021. DOI : 10.5075/epfl-thesis-7949.Detecting 32 Pedestrian Attributes for Autonomous Vehicles
IEEE Transactions on Intelligent Transportation Systems (T-ITS). 2021. DOI : 10.1109/TITS.2021.3107587.Interpretable Social Anchors for Human Trajectory Forecasting in Crowds
2021. Conference on Computer Vision and Pattern Recognition (CVPR), 2021, Nashville, USA (Virtual), Jun 19–25, 2021.Deep visual Re-identification with confidence
Transportation Research Part C: Emerging Technologies. 2021. DOI : 10.1016/j.trc.2021.103067.Adaptive hot water production based on Supervised Learning
Sustainable Cities and Society. 2021. DOI : 10.1016/j.scs.2020.102625.Detecting 32 Pedestrian Attributes for Autonomous Vehicles
2020-12-04DeepSVG: A Hierarchical Generative Network for Vector Graphics Animation
2020-09-29. NeurIPS 2020 34th Conference on Neural Information Processing Systems, Vancouver, Canada, December 6-12, 2020.Precise Hand Finger Width Estimation via RGB-D Data
2020-08-31Uncertainty-aware Model Inversion Networks
2020-07-14Human Trajectory Forecasting in Crowds: A Deep Learning Perspective
2020-07-07Joint Human Pose Estimation and Stereo 3D Localization
2020-06-01. International Conference on Robotics and Automation (ICRA), Paris, France. Virtual conference., May 31th, June 4th 2020. p. 2324-2330.Collaborative Sampling in Generative Adversarial Networks
2020-02-11. Thirty-Fourth AAAI Conference on Artificial Intelligence (AAAI-20), New York, New York, USA, February 7-12, 2020. p. 4948-4956. DOI : 10.1609/aaai.v34i04.5933.A Reinforcement Learning Approach to Train Routing and Scheduling
2020-01-23Gait in real world: validated algorithms for gait periods and speed estimation using a single wearable sensor
Lausanne, EPFL, 2020. DOI : 10.5075/epfl-thesis-8099.Automatic detection of hand hygiene using computer vision technology
Journal of the American Medical Informatics Association. 2020. DOI : 10.1093/jamia/ocaa115.Pedestrian Intention Prediction: A Multi-task Perspective
2020. 9th Symposium of the European Association for Research in Transportation (hEART 2021), Lyon, France, 7-9 April 2021.Next Steps for Image Synthesis using Semantic Segmentation
2020. 20th Swiss Transport Research Conference (STRC 2020), [Online event], 13-14 May 2020.The electric autonomous dial-a-ride problem
Lausanne, EPFL, 2020. DOI : 10.5075/epfl-thesis-7431.Mutual Understanding in Educational Human-Robot Collaborations
Lausanne, EPFL, 2020. DOI : 10.5075/epfl-thesis-10144.Bilinear Multimodal Discriminator for Adversarial Domain Adaptation with Privileged Information
2020. 9th Symposium of the European Association for Research in Transportation (HEART 2020), Lyon, France, February 3-4, 2020.An Institutional Approach to Normative Distributed Robotics for Mixed Societies of Humans and Robots
Lausanne, EPFL, 2020. DOI : 10.5075/epfl-thesis-10147.Motion planning for CAVs in mixed traffic, a study on roundabouts
Lausanne, EPFL, 2020. DOI : 10.5075/epfl-thesis-7331.Trustworthy Face Recognition: Improving Generalization of Deep Face Presentation Attack Detection
Lausanne, EPFL, 2020. DOI : 10.5075/epfl-thesis-7635.Learning stereo reconstruction with deep neural networks
Lausanne, EPFL, 2020. DOI : 10.5075/epfl-thesis-7086.Enhancing discrete choice models with representation learning
Transportation Research Part B: Methodological. 2020. DOI : 10.1016/j.trb.2020.08.006.Learning online combinatorial stochastic policies with deep reinforcement
2019-09-04. European Association for Research in Transportation (hEART), Budapest, September 4-6, 2019.Automatic Differentiation in Social Force Models
2019-09-04. European Association for Research in Transportation (hEART), Budapest, 4-6 september 2019.Adversarial Loss for Human Trajectory Prediction
2019-09-04. European Association for Research in Transportation (hEART 2019), Budapest, 4-6 september 2019.Convolutional Relational Machine for Group Activity Recognition
2019-06-16. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, Jun 16-20, 2019. p. 7884-7893. DOI : 10.1109/CVPR.2019.00808.MonoLoco: Monocular 3D Pedestrian Localization and Uncertainty Estimation
2019-06-07. International Conference on Computer Vision (ICCV), Seoul, Korea, October 27- November 2, 2019 .PifPaf: Composite Fields for Human Pose Estimation
2019-06-01. IEEE conference on computer vision and pattern recognition (CVPR), Long Beach, CA, Jun 16-20, 2019. p. 11969-11978. DOI : 10.1109/CVPR.2019.01225.Next Steps for Social Force with Big Data
2019-05-16. Swiss Transport Research Conference (STRC).Feed-forwards meet recurrent networks in vehicle trajectory prediction
2019-05-15. Swiss Transport Research Conference (STRC).A computer vision system for deep learning-based detection of patient mobilization activities in the ICU
npj Digital Medicine. 2019-03-01. DOI : 10.1038/s41746-019-0087-z.Using A Priori Knowledge to Improve Scene Understanding
2019-01-01. 32nd IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, Jun 16-20, 2019. p. 487-489. DOI : 10.1109/CVPRW.2019.00067.Graph-based image representation learning
Lausanne, EPFL, 2019. DOI : 10.5075/epfl-thesis-9267.Pedestrian Image Generation for Self-driving Cars
2019. Swiss Transport Research Conference (STRC).Deep Visual Re-Identification with Confidence
2019. arXiv.Training Algorithms for Multiple Object Tracking
Lausanne, EPFL, 2019. DOI : 10.5075/epfl-thesis-9203.Crowd-Robot Interaction: Crowd-aware Robot Navigation with Attention-based Deep Reinforcement Learning
2019. International Conference on Robotics and Automation (ICRA), Montreal, Canada, May 20-24, 2019. p. 6015-6022. DOI : 10.1109/ICRA.2019.8794134.Enhancing Discrete Choice Models with Neural Networks
2018-09-05. hEART 2018 – 7th Symposium of the European Association for Research in Transportation conference, Athens, September 5-7, 2018.Learning nuisances to track pedestrians in autonomous vehicles
2018-09-05. Heart 2018 - 7th Symposium of the European Association for Research in Transportation conference, Athens, September 5-7, 2018.Linear Artificial Forces for Human Dynamics in Complex Contexts
2018-06-15. WIRN, Vietri, 13-15 june 2018.Learning nuisances to track pedestrians in autonomous vehicles
2018-05-16. 18th Swiss Transport Research Conference, Monte Verità, Ascona, May 16 – 18, 2018.Congestion and departure time choice equilibrium in urban road networks
Lausanne, EPFL, 2018. DOI : 10.5075/epfl-thesis-8862.Micro-mechanical finite element modeling for in-plane behavior of historical masonry
Lausanne, EPFL, 2018. DOI : 10.5075/epfl-thesis-8792.CAR-Net: Clairvoyant Attentive Recurrent Network
2018. European Conference on Computer Vision (ECCV), Munich, 8-14 September 2018.Variational Methods for Human Modeling
Lausanne, EPFL, 2018. DOI : 10.5075/epfl-thesis-8680.Long-term path prediction in urban scenarios using circular distributions
Image and Vision Computing. 2018. DOI : 10.1016/j.imavis.2017.11.006.Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networks
2018. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt lake city, June 18-22. DOI : 10.1109/CVPR.2018.00240.Dealing with Correlations in Discrete Choice Models
Lausanne, EPFL, 2018. DOI : 10.5075/epfl-thesis-8170.Vision-Based Prediction of ICU Mobility Care Activities using Recurrent Neural Networks
NIPS workshop on Machine Learning for Health, 2017-12-08.Viewpoint Invariant Convolutional Networks for Identifying Risky Hand Hygiene Scenarios
Workshop at NIPS on Machine Learning for Health.Unsupervised Camera Localization in Crowded Spaces
2017. IEEE International Conference on Robotics and Automation (ICRA), Singapore, May 29 - June 3, 2017. p. 2666-2673. DOI : 10.1109/ICRA.2017.7989311.Learning to Predict Human Behavior in Crowded Scenes
Group and Crowd Behavior for Computer Vision; Elsevier, 2017. p. 183-207.Tracking millions of humans
Group and Crowd Behavior for Computer Vision; Elsevier, 2017. p. 115-135.Jointly Learning Energy Expenditures and Activities using Egocentric Multimodal Signals
2017. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Hawaii, USA, July 21-26, 2017. p. 6817-6826. DOI : 10.1109/CVPR.2017.721.Social Scene Understanding: End-to-End Multi-Person Action Localization and Collective Activity Recognition
2017. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Hawaii, USA, July 21-26, 2017. p. 3425-3434. DOI : 10.1109/Cvpr.2017.365.Unsupervised Learning of Long-Term Motion Dynamics for Videos
2017. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Hawaii, USA, July 21-26, 2017. p. 7101-7110. DOI : 10.1109/CVPR.2017.751.Towards Vision-Based Smart Hospitals: A System for Tracking and Monitoring Hand Hygiene Compliance
2017. Machine Learning for Healthcare (MLHC), Northeastern University, Massachusetts, August 18- 19, 2017.Characterizing and Improving Stability in Neural Style Transfer
2017. International Conference on Computer Vision (ICCV), Venice, Italy, October 22-29, 2017.Tracking The Untrackable: Learning To Track Multiple Cues with Long-Term Dependencies
2017. International Conference on Computer Vision (ICCV), Venice, Italy, October 22-29, 2017.Vision-Based Hand Hygiene Monitoring in Hospitals
American Medical Informatics Association (AMIA) Symposium, 2016.Social LSTM: Human Trajectory Prediction in Crowded Spaces
2016. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, 27-30 June 2016. p. 961-971. DOI : 10.1109/CVPR.2016.110.Recurrent Attention Models for Depth-Based Person Identification
2016. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, 27-30 June, 2016. p. 1229-1238. DOI : 10.1109/CVPR.2016.138.Point-based Path Prediction from Polar Histograms
2016. p. 1961-1967.Learning Social Etiquette: Human Trajectory Understanding In Crowded Scenes
2016. p. 549-565. DOI : 10.1007/978-3-319-46484-8_33.Towards Viewpoint Invariant 3D Human Pose Estimation
2016. European Conference on Computer Vision (ECCV), 160-177. p. 160-177. DOI : 10.1007/978-3-319-46448-0_10.Knowledge Transfer for Scene-specific Motion Prediction
2016. European Conference on Computer Vision (ECCV). p. 697-713. DOI : 10.1007/978-3-319-46448-0_42.Perceptual Losses for Real-Time Style Transfer and Super-Resolution
2016. European Conference on Computer Vision (ECCV). p. 694-711. DOI : 10.1007/978-3-319-46475-6_43.Learning to Track: Online Multi-object Tracking by Decision Making
2015. IEEE International Conference on Computer Vision (ICCV), Santiago, Chile, 7-13 December 2015. p. 4705-4713. DOI : 10.1109/ICCV.2015.534.RGB-W: When Vision Meets Wireless
2015. IEEE International Conference on Computer Vision (ICCV), Santiago, Chile, 7-13 December 2015. p. 3289-3297. DOI : 10.1109/ICCV.2015.376.Biologically Inspired Keypoints
Biologically Inspired Computer Vision: Fundamentals and Applications; Wiley, 2015. p. 347-374.Socially-Aware Large-Scale Crowd Forecasting
2014. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, OH, USA, 23-28 June 2014. p. 2211-2218. DOI : 10.1109/CVPR.2014.283.System and method for media library navigation and recommendation
WO2014002064 . 2014.Robust Real-time Pedestrians Detection in Urban Environments with a Network of Low Resolution Cameras
Transportation Research Part C: Emerging Technologies. 2014. DOI : 10.1016/j.trc.2013.11.019.From Bits to Images: Inversion of Local Binary Descriptors
IEEE Transactions on Pattern Analysis and Machine Intelligence. 2014. DOI : 10.1109/TPAMI.2013.228.Beyond Bits: Reconstructing Images from Local Binary Descriptors
2012. 21st International Conference on Pattern Recognition (ICPR), Tsukuba Science City, Japan, November 11-15, 2012.Foreground Silhouette Extraction robust to Sudden Changes of background Appearance
2012. IEEE International conference on Image Processing, Orlando, Florida, USA, September 30 - October 3, 2012. DOI : 10.1109/ICIP.2012.6467088.FREAK: Fast Retina Keypoint
2012. IEEE Conference on Computer Vision and Pattern Recognition, Rhode Island, Providence, USA, June 16-21, 2012. p. 510-517. DOI : 10.1109/CVPR.2012.6247715.SCOOP: A Real-Time Sparsity Driven People Localization Algorithm
Journal Of Mathematical Imaging And Vision. 2012. DOI : 10.1007/s10851-012-0405-4.Vision-Based Scene Understanding with Sparsity Promoting Priors
Lausanne, EPFL, 2011. DOI : 10.5075/epfl-thesis-5070.Sparsity Driven People Localization with a Heterogeneous Network of Cameras
Journal of Mathematical Imaging and Vision. 2011. DOI : 10.1007/s10851-010-0258-7.Infoscience
A Shared Representation for Photorealistic Driving Simulators
IEEE Transactions on Intelligent Transportation Systems. 2021-12-03. DOI : 10.1109/TITS.2021.3131303.OpenPifPaf: Composite Fields for Semantic Keypoint Detection and Spatio-Temporal Association
Ieee Transactions On Intelligent Transportation Systems. 2021-11-15. DOI : 10.1109/TITS.2021.3124981.DriverGym: Democratising Reinforcement Learning for Autonomous Driving
2021-11-12. 35th Conference on Neural Information Processing Systems (NeurIPS 2021), Online, December 6-14, 2021.Keypoint Communities
2021-10-11. IEEE International Conference on Computer Vision (ICCV 2021), [Virtual], October 10-17, 2021.Safety-aware Motion Prediction with Unseen Vehicles for Autonomous Driving
2021-10-11. IEEE International Conference on Computer Vision (ICCV 2021), [Virtual], October 10-17, 2021.Social NCE: Contrastive Learning of Socially-aware Motion Representations
2021-10-11. IEEE International Conference on Computer Vision (ICCV), Virtual, October 10-17, 2021.Pedestrian intention prediction: A convolutional bottom-up multi-task approach
Transportation Research Part C: Emerging Technologies. 2021-07-15. DOI : 10.1016/j.trc.2021.103259.Guest Editorial: Introduction to the Special Issue on Long-Term Human Motion Prediction
Ieee Robotics And Automation Letters. 2021-07-01. DOI : 10.1109/LRA.2021.3077964.Human Trajectory Forecasting in Crowds: A Deep Learning Perspective
IEEE Transactions on Intelligent Transportation Systems. 2021-04-19. DOI : 10.1109/TITS.2021.3069362.Perceiving Humans: from Monocular 3D Localization to Social Distancing
IEEE Transactions on Intelligent Transportation Systems. 2021-03-25. DOI : 10.1109/TITS.2021.3069376.MonStereo: When Monocular and Stereo Meet at the Tail of 3D Human Localization
2021-03-22. International Conference on Robotics and Automation (ICRA), Xi'an, China, June 1-6, 2021.Injecting Knowledge in Data-driven Vehicle Trajectory Predictors
Transportation Research Part C: Emerging Technologies. 2021-03-08. DOI : 10.1016/j.trc.2021.103010.Learning Decoupled Representations for Human Pose Forecasting
2021. 2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCV 2021), Virtual, October 11-17, 2021. p. 2294-2303. DOI : 10.1109/ICCVW54120.2021.00259.Efficient Depth-based Deep Learning Methods for Multi-Party Pose Estimation
Lausanne, EPFL, 2021. DOI : 10.5075/epfl-thesis-8429.Gradient-based Methods for Deep Model Interpretability
Lausanne, EPFL, 2021. DOI : 10.5075/epfl-thesis-8606.Damage Assessment of Stone Masonry Piers Using Imaged Surface Cracks
Lausanne, EPFL, 2021. DOI : 10.5075/epfl-thesis-9252.Dynamic control strategies for managing pedestrian flows
Lausanne, EPFL, 2021. DOI : 10.5075/epfl-thesis-8200.Architecture Exploration and Optimization of Heterogeneous Many-Core Compute and Memory Architectures with Architectural Extensions
Lausanne, EPFL, 2021. DOI : 10.5075/epfl-thesis-7949.Detecting 32 Pedestrian Attributes for Autonomous Vehicles
IEEE Transactions on Intelligent Transportation Systems (T-ITS). 2021. DOI : 10.1109/TITS.2021.3107587.Interpretable Social Anchors for Human Trajectory Forecasting in Crowds
2021. Conference on Computer Vision and Pattern Recognition (CVPR), 2021, Nashville, USA (Virtual), Jun 19–25, 2021.Deep visual Re-identification with confidence
Transportation Research Part C: Emerging Technologies. 2021. DOI : 10.1016/j.trc.2021.103067.Adaptive hot water production based on Supervised Learning
Sustainable Cities and Society. 2021. DOI : 10.1016/j.scs.2020.102625.Detecting 32 Pedestrian Attributes for Autonomous Vehicles
2020-12-04DeepSVG: A Hierarchical Generative Network for Vector Graphics Animation
2020-09-29. NeurIPS 2020 34th Conference on Neural Information Processing Systems, Vancouver, Canada, December 6-12, 2020.Precise Hand Finger Width Estimation via RGB-D Data
2020-08-31Uncertainty-aware Model Inversion Networks
2020-07-14Human Trajectory Forecasting in Crowds: A Deep Learning Perspective
2020-07-07Joint Human Pose Estimation and Stereo 3D Localization
2020-06-01. International Conference on Robotics and Automation (ICRA), Paris, France. Virtual conference., May 31th, June 4th 2020. p. 2324-2330.Collaborative Sampling in Generative Adversarial Networks
2020-02-11. Thirty-Fourth AAAI Conference on Artificial Intelligence (AAAI-20), New York, New York, USA, February 7-12, 2020. p. 4948-4956. DOI : 10.1609/aaai.v34i04.5933.A Reinforcement Learning Approach to Train Routing and Scheduling
2020-01-23Gait in real world: validated algorithms for gait periods and speed estimation using a single wearable sensor
Lausanne, EPFL, 2020. DOI : 10.5075/epfl-thesis-8099.Automatic detection of hand hygiene using computer vision technology
Journal of the American Medical Informatics Association. 2020. DOI : 10.1093/jamia/ocaa115.Pedestrian Intention Prediction: A Multi-task Perspective
2020. 9th Symposium of the European Association for Research in Transportation (hEART 2021), Lyon, France, 7-9 April 2021.Next Steps for Image Synthesis using Semantic Segmentation
2020. 20th Swiss Transport Research Conference (STRC 2020), [Online event], 13-14 May 2020.The electric autonomous dial-a-ride problem
Lausanne, EPFL, 2020. DOI : 10.5075/epfl-thesis-7431.Mutual Understanding in Educational Human-Robot Collaborations
Lausanne, EPFL, 2020. DOI : 10.5075/epfl-thesis-10144.Bilinear Multimodal Discriminator for Adversarial Domain Adaptation with Privileged Information
2020. 9th Symposium of the European Association for Research in Transportation (HEART 2020), Lyon, France, February 3-4, 2020.An Institutional Approach to Normative Distributed Robotics for Mixed Societies of Humans and Robots
Lausanne, EPFL, 2020. DOI : 10.5075/epfl-thesis-10147.Motion planning for CAVs in mixed traffic, a study on roundabouts
Lausanne, EPFL, 2020. DOI : 10.5075/epfl-thesis-7331.Trustworthy Face Recognition: Improving Generalization of Deep Face Presentation Attack Detection
Lausanne, EPFL, 2020. DOI : 10.5075/epfl-thesis-7635.Learning stereo reconstruction with deep neural networks
Lausanne, EPFL, 2020. DOI : 10.5075/epfl-thesis-7086.Enhancing discrete choice models with representation learning
Transportation Research Part B: Methodological. 2020. DOI : 10.1016/j.trb.2020.08.006.Learning online combinatorial stochastic policies with deep reinforcement
2019-09-04. European Association for Research in Transportation (hEART), Budapest, September 4-6, 2019.Automatic Differentiation in Social Force Models
2019-09-04. European Association for Research in Transportation (hEART), Budapest, 4-6 september 2019.Adversarial Loss for Human Trajectory Prediction
2019-09-04. European Association for Research in Transportation (hEART 2019), Budapest, 4-6 september 2019.Convolutional Relational Machine for Group Activity Recognition
2019-06-16. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, Jun 16-20, 2019. p. 7884-7893. DOI : 10.1109/CVPR.2019.00808.MonoLoco: Monocular 3D Pedestrian Localization and Uncertainty Estimation
2019-06-07. International Conference on Computer Vision (ICCV), Seoul, Korea, October 27- November 2, 2019 .PifPaf: Composite Fields for Human Pose Estimation
2019-06-01. IEEE conference on computer vision and pattern recognition (CVPR), Long Beach, CA, Jun 16-20, 2019. p. 11969-11978. DOI : 10.1109/CVPR.2019.01225.Next Steps for Social Force with Big Data
2019-05-16. Swiss Transport Research Conference (STRC).Feed-forwards meet recurrent networks in vehicle trajectory prediction
2019-05-15. Swiss Transport Research Conference (STRC).A computer vision system for deep learning-based detection of patient mobilization activities in the ICU
npj Digital Medicine. 2019-03-01. DOI : 10.1038/s41746-019-0087-z.Using A Priori Knowledge to Improve Scene Understanding
2019-01-01. 32nd IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, Jun 16-20, 2019. p. 487-489. DOI : 10.1109/CVPRW.2019.00067.Graph-based image representation learning
Lausanne, EPFL, 2019. DOI : 10.5075/epfl-thesis-9267.Pedestrian Image Generation for Self-driving Cars
2019. Swiss Transport Research Conference (STRC).Deep Visual Re-Identification with Confidence
2019. arXiv.Training Algorithms for Multiple Object Tracking
Lausanne, EPFL, 2019. DOI : 10.5075/epfl-thesis-9203.Crowd-Robot Interaction: Crowd-aware Robot Navigation with Attention-based Deep Reinforcement Learning
2019. International Conference on Robotics and Automation (ICRA), Montreal, Canada, May 20-24, 2019. p. 6015-6022. DOI : 10.1109/ICRA.2019.8794134.Enhancing Discrete Choice Models with Neural Networks
2018-09-05. hEART 2018 – 7th Symposium of the European Association for Research in Transportation conference, Athens, September 5-7, 2018.Learning nuisances to track pedestrians in autonomous vehicles
2018-09-05. Heart 2018 - 7th Symposium of the European Association for Research in Transportation conference, Athens, September 5-7, 2018.Linear Artificial Forces for Human Dynamics in Complex Contexts
2018-06-15. WIRN, Vietri, 13-15 june 2018.Learning nuisances to track pedestrians in autonomous vehicles
2018-05-16. 18th Swiss Transport Research Conference, Monte Verità, Ascona, May 16 – 18, 2018.Congestion and departure time choice equilibrium in urban road networks
Lausanne, EPFL, 2018. DOI : 10.5075/epfl-thesis-8862.Micro-mechanical finite element modeling for in-plane behavior of historical masonry
Lausanne, EPFL, 2018. DOI : 10.5075/epfl-thesis-8792.CAR-Net: Clairvoyant Attentive Recurrent Network
2018. European Conference on Computer Vision (ECCV), Munich, 8-14 September 2018.Variational Methods for Human Modeling
Lausanne, EPFL, 2018. DOI : 10.5075/epfl-thesis-8680.Long-term path prediction in urban scenarios using circular distributions
Image and Vision Computing. 2018. DOI : 10.1016/j.imavis.2017.11.006.Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networks
2018. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt lake city, June 18-22. DOI : 10.1109/CVPR.2018.00240.Dealing with Correlations in Discrete Choice Models
Lausanne, EPFL, 2018. DOI : 10.5075/epfl-thesis-8170.Vision-Based Prediction of ICU Mobility Care Activities using Recurrent Neural Networks
NIPS workshop on Machine Learning for Health, 2017-12-08.Viewpoint Invariant Convolutional Networks for Identifying Risky Hand Hygiene Scenarios
Workshop at NIPS on Machine Learning for Health.Unsupervised Camera Localization in Crowded Spaces
2017. IEEE International Conference on Robotics and Automation (ICRA), Singapore, May 29 - June 3, 2017. p. 2666-2673. DOI : 10.1109/ICRA.2017.7989311.Learning to Predict Human Behavior in Crowded Scenes
Group and Crowd Behavior for Computer Vision; Elsevier, 2017. p. 183-207.Tracking millions of humans
Group and Crowd Behavior for Computer Vision; Elsevier, 2017. p. 115-135.Jointly Learning Energy Expenditures and Activities using Egocentric Multimodal Signals
2017. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Hawaii, USA, July 21-26, 2017. p. 6817-6826. DOI : 10.1109/CVPR.2017.721.Social Scene Understanding: End-to-End Multi-Person Action Localization and Collective Activity Recognition
2017. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Hawaii, USA, July 21-26, 2017. p. 3425-3434. DOI : 10.1109/Cvpr.2017.365.Unsupervised Learning of Long-Term Motion Dynamics for Videos
2017. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Hawaii, USA, July 21-26, 2017. p. 7101-7110. DOI : 10.1109/CVPR.2017.751.Towards Vision-Based Smart Hospitals: A System for Tracking and Monitoring Hand Hygiene Compliance
2017. Machine Learning for Healthcare (MLHC), Northeastern University, Massachusetts, August 18- 19, 2017.Characterizing and Improving Stability in Neural Style Transfer
2017. International Conference on Computer Vision (ICCV), Venice, Italy, October 22-29, 2017.Tracking The Untrackable: Learning To Track Multiple Cues with Long-Term Dependencies
2017. International Conference on Computer Vision (ICCV), Venice, Italy, October 22-29, 2017.Vision-Based Hand Hygiene Monitoring in Hospitals
American Medical Informatics Association (AMIA) Symposium, 2016.Social LSTM: Human Trajectory Prediction in Crowded Spaces
2016. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, 27-30 June 2016. p. 961-971. DOI : 10.1109/CVPR.2016.110.Recurrent Attention Models for Depth-Based Person Identification
2016. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, 27-30 June, 2016. p. 1229-1238. DOI : 10.1109/CVPR.2016.138.Point-based Path Prediction from Polar Histograms
2016. p. 1961-1967.Learning Social Etiquette: Human Trajectory Understanding In Crowded Scenes
2016. p. 549-565. DOI : 10.1007/978-3-319-46484-8_33.Towards Viewpoint Invariant 3D Human Pose Estimation
2016. European Conference on Computer Vision (ECCV), 160-177. p. 160-177. DOI : 10.1007/978-3-319-46448-0_10.Knowledge Transfer for Scene-specific Motion Prediction
2016. European Conference on Computer Vision (ECCV). p. 697-713. DOI : 10.1007/978-3-319-46448-0_42.Perceptual Losses for Real-Time Style Transfer and Super-Resolution
2016. European Conference on Computer Vision (ECCV). p. 694-711. DOI : 10.1007/978-3-319-46475-6_43.Learning to Track: Online Multi-object Tracking by Decision Making
2015. IEEE International Conference on Computer Vision (ICCV), Santiago, Chile, 7-13 December 2015. p. 4705-4713. DOI : 10.1109/ICCV.2015.534.RGB-W: When Vision Meets Wireless
2015. IEEE International Conference on Computer Vision (ICCV), Santiago, Chile, 7-13 December 2015. p. 3289-3297. DOI : 10.1109/ICCV.2015.376.Biologically Inspired Keypoints
Biologically Inspired Computer Vision: Fundamentals and Applications; Wiley, 2015. p. 347-374.Socially-Aware Large-Scale Crowd Forecasting
2014. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, OH, USA, 23-28 June 2014. p. 2211-2218. DOI : 10.1109/CVPR.2014.283.System and method for media library navigation and recommendation
WO2014002064 . 2014.Robust Real-time Pedestrians Detection in Urban Environments with a Network of Low Resolution Cameras
Transportation Research Part C: Emerging Technologies. 2014. DOI : 10.1016/j.trc.2013.11.019.From Bits to Images: Inversion of Local Binary Descriptors
IEEE Transactions on Pattern Analysis and Machine Intelligence. 2014. DOI : 10.1109/TPAMI.2013.228.Beyond Bits: Reconstructing Images from Local Binary Descriptors
2012. 21st International Conference on Pattern Recognition (ICPR), Tsukuba Science City, Japan, November 11-15, 2012.Foreground Silhouette Extraction robust to Sudden Changes of background Appearance
2012. IEEE International conference on Image Processing, Orlando, Florida, USA, September 30 - October 3, 2012. DOI : 10.1109/ICIP.2012.6467088.FREAK: Fast Retina Keypoint
2012. IEEE Conference on Computer Vision and Pattern Recognition, Rhode Island, Providence, USA, June 16-21, 2012. p. 510-517. DOI : 10.1109/CVPR.2012.6247715.SCOOP: A Real-Time Sparsity Driven People Localization Algorithm
Journal Of Mathematical Imaging And Vision. 2012. DOI : 10.1007/s10851-012-0405-4.Vision-Based Scene Understanding with Sparsity Promoting Priors
Lausanne, EPFL, 2011. DOI : 10.5075/epfl-thesis-5070.Sparsity Driven People Localization with a Heterogeneous Network of Cameras
Journal of Mathematical Imaging and Vision. 2011. DOI : 10.1007/s10851-010-0258-7.Research
Research summary
We work on the theoretical challenges and practical applications of socially-aware systems, i.e., machines that can not only perceive human behavior, but reason with social intelligence in the context of transportation problems and smart spaces.We envision a future where intelligent machines are ubiquitous, where self-driving cars, delivery robots, and self-moving Segways are facts of everyday life. Beyond embodied agents, we will also see our living spaces – our homes, buildings, and cities – become equipped with ambient intelligence which can sense and respond to human behavior. However, to realize this future, intelligent machines need to develop social intelligence and the ability to make safe and consistent decisions in unconstrained crowded social scenes. Self-driving vehicles must learn social etiquette in order to navigate cities like Paris or Naples. Social robots need to comply with social conventions and obey (unwritten) common-sense rules to effectively operate in crowded terminals. For instance, they need to respect personal space, yield right-of-way, and “read” the behavior of others to predict future actions.
Our research is centered around understanding and predicting human social behavior with multi-modal visual data. Our work spans multiple aspects of socially-aware systems: from 1- collecting multi-modal data at scale, 2- Extracting coarse-to-fine grained behaviours in real-time, 3- designing deep learning methods that can learn to predict human social behavior in a fully data-driven way, to 4- integrating the developed methods in real-world systems such as a vehicle or a socially-aware robot that navigates crowded social scenes.
Teaching & PhD
Teaching
Civil Engineering
PhD Programs
Doctoral Program in Civil and Environmental Engineering
Doctoral program in computer and communication sciences
Doctoral program in robotics, control, and intelligent systems
Doctoral Program in Electrical Engineering