Research Scientist Context Awareness, Audio (RL Research)

Meta black iconMeta Quest
Research Scientist Context Awareness, Audio (RL Research)
Meta black iconMeta Quest
Location pin icon
Redmond, WA
Meta/Reality Labs Research (RL Research) brings together a world-class team of researchers and engineers to create the future of augmented and virtual reality, which together will become as universal and essential as smartphones and personal computers are today. And just as personal computers have done over the past 45 years, AR and VR will ultimately change everything about how we work, play, and connect. We are developing all the technologies needed to enable breakthrough AR glasses and VR headsets, including optics and displays, computer vision, audio, graphics, brain-computer interfaces, haptic interaction, eye/hand/face/body tracking, perception science, and true telepresence. Some of those will advance much faster than others, but they all need to happen to enable AR and VR that are so compelling that they become an integral part of our lives. At Reality Labs-Research, we are hiring a Research Scientist for Context Awareness to help us create context-aware devices. We will work on devices that can understand and react to the effects of user intent on acoustic event relevance, and understand and react to the effects of acoustic environment on intent, emotion, needs and desires. You will work on systems that incorporate input from audio event detection, acoustic properties detection, and active talkers detection. They may leverage these to predict user intent or integrate with an intent system, and may achieve any or all of these (and more) through combining signals from non-audio modalities. You are working inter-disciplinary to achieve research outcomes in collaboration with other teams will be important to success in the role. This includes collaboration with audio and acoustics-related domains such as the hearing sciences, room acoustics modeling and detection, and audio signal detection, as well as collaboration with domains as broad as computer vision, virtual assistants, and user intent modeling. In addition to inter-disciplinary collaboration, skills needed will include machine learning as applied to audio processing and signal detection, as well as some understanding of microphone array systems and their capabilities.
Research Scientist Context Awareness, Audio (RL Research) Responsibilities
  • Develop machine-learning based technologies to detect acoustic context from signals such as detected talkers, detected emotions, detected talker effort, noise levels, room acoustics properties, and potentially many others
  • Help build experimental design pipelines and generate reliable, correct large-scale audio and human auditory perception datasets for model training/validation/testing
  • Partner with DSP engineers and software engineers to realize designs as functioning real-time demonstrations
  • Partner with user experience researchers to study the user experience of proposed designs
Minimum Qualifications
  • PhD in audio signal processing, machine learning or equivalent relevant to the role
  • 3+ years of experience in the development of DSP and ML algorithms and validation procedures
  • 3+ years experience with development, implementation, and testing of audio digital signal processing methods
  • 3+ years of experience with one or more machine learning toolkits (e.g., TensorFlow, PyTorch, NumPy, Scikit-Learn, Pandas or equivalent)
  • Experience designing data collection protocols and with data collection quality control
Preferred Qualifications
  • Experience in C/C++ programming.
  • Experience with development and implementation of machine learning or deep learning algorithms applied to auditory perception, auditory modeling, audiology, or hearing correction problems.
  • Experience with building computational models on speech and/or acoustic datasets.
  • Proven track record of independence in achieving significant results and innovation as demonstrated by first-authored publications or industrial experience or equivalent.
  • Strong interpersonal skills to facilitate cross-group and cross-culture collaboration.
Locations
About Meta
Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today—beyond the constraints of screens, the limits of distance, and even the rules of physics.
Meta is committed to providing reasonable support (called accommodations) in our recruiting processes for candidates with disabilities, long term conditions, mental health conditions or sincerely held religious beliefs, or who are neurodivergent or require pregnancy-related support. If you need support, please reach out to accommodations-ext@fb.com.
Related Job Openings
Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics. You may view our Equal Employment Opportunity notice here. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. We may use your information to maintain the safety and security of Meta, its employees, and others as required or permitted by law. You may view Meta's Pay Transparency Policy, Equal Employment Opportunity is the Law notice, and Notice to Applicants for Employment and Employees by clicking on their corresponding links. Additionally, Meta participates in the E-Verify program in certain locations, as required by law.

Meta is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, you may contact us at accommodations-ext@fb.com.