Research Intern, Multi-Modal Face Tracking (PhD)

Posted 30 days ago
Main Location
Menlo Park, CA, United States
Open jobs
Facebook's mission is to give people the power to build community and bring the world closer together. Through our family of apps and services, we're building a different kind of company that connects billions of people around the world, gives them ways to share what matters most to them, and helps bring people closer together. Whether we're creating new products or helping a small business expand its reach, people at Facebook are builders at heart. Our global teams are constantly iterating, solving problems, and working together to empower people around the world to build community and connect in meaningful ways. Together, we can help people build stronger communities - we're just getting started.

The Facebook Reality Labs (FRL) Research Team brings together a world-class team of researchers, developers, and engineers to create the future of AR and VR, which together will become as universal and essential as smartphones and personal computers are today.Virtual reality depends on advances in computer vision and machine learning. As a PhD intern at Facebook Reality Labs (FRL), you will get an opportunity to make an impact on one of our most exciting and challenging efforts aimed at enabling cutting edge real-time VR experiences. In this role, you will investigate mutil-modal learning methods to solve problems at the forefront of face tracking and related problems for real-time VR. The ideal candidate is pursuing a PhD in computer vision or machine learning research fields, and is passionate about exploring and applying multi-modality learning methods in the context of face tracking.

  • Investigate, design and implement novel multi-modal learning methods related to VR face tracking. This could include (and not limited to) using audio and video inputs, self-supervision, and other cutting-edge computer vision techniques.
  • Develop tools, scripts and tests to support your project.
  • Collaborate with and support other research scientists and engineers across various disciplines.
  • Document and present your progress and project.


  • Currently has, or is in the process of obtaining, a PhD degree in Computer Science, Electrical Engineering, or Electrical and Computer Engineering in the field of computer vision, machine learning, computer graphics, or robotics.
  • 2+ years experience with building systems based on computer vision and deep learning methods for object detection, keypoint estimation, or segmentation.
  • 3+ years experience in C++ and Python.
  • Has publications in top computer vision conferences (e.g., CVPR, ICCV, ECCV, or, SIGGRAPH) or journals (e.g., IEEE Transactions on Pattern Analysis and Machine Intelligence, International Journal of Computer Vision, Pattern Recognition, or IEEE Transactions on Image Processing).
  • Must obtain work authorization in the country of employment at the time of hire and maintain ongoing work authorization during employment.


  • Experience with face tracking, lip syncing, speech, on-device models, avatars, or self-supervised learning methods.
  • Demonstrated software engineer experience via an internship, work experience, coding competitions, or widely used contributions in open source repositories (e.g. Github).
  • Ability to communicate complex research in a clear, precise, and actionable manner.
  • Intent to return to degree-program after the completion of the internship/co-op.


Facebook is proud to be an Equal Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law.Facebook is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at accommodations-ext@fb.com.
Mission
We're a community of women leveraging our connections into top companies to help underrepresented women get the roles they've always deserved. Simultaneously, we work to build truly inclusive hiring processes and environments where women can thrive and not just survive.
Are you hiring? Join our platform for diversifiying your team
Research Intern, Multi-Modal Face Tracking (PhD)
Facebook, Inc.