Research Scientist, Human-Centric Modeling

Posted 17 Days Ago
Be an Early Applicant
New York, NY
Expert/Leader
Artificial Intelligence
The Role
As a Research Scientist at Google DeepMind, you will lead efforts in developing novel algorithmic architectures for AI, specifically in improving multimodal affective capabilities in large models, enhancing generation quality, and devising better evaluation methods for AI tasks.
Summary Generated by Built In

At Google DeepMind, we value diversity of experience, knowledge, backgrounds and perspectives and harness these qualities to create extraordinary impact. We are committed to equal employment opportunities regardless of sex, race, religion or belief, ethnic or national origin, disability, age, citizenship, marital, domestic or civil partnership status, sexual orientation, gender identity, pregnancy, or related condition (including breastfeeding) or any other basis as protected by applicable law. If you have a disability or additional need that requires accommodation, please do not hesitate to let us know.

Snapshot

Members of the Human-centric Modeling group contribute broadly across DeepMind efforts including to the Gemini program and applied research for Google products. The Affective Computing subgroup works on socio-emotional understanding and generation tasks in audio-, visual- and audiovisual settings, primarily using large language models. Research includes, but is not limited to, better audio-visual representations for understanding emotional expressions, controllability of expressions in generated imagery/video/speech, conversational naturalness in dialog and TTS, emotion-aware reinforcement learning and agents, and safety mechanisms against harms like emotional manipulation and over-reliance.

About us

Artificial Intelligence could be one of humanity’s most useful inventions. At Google DeepMind, we’re a team of scientists, engineers, machine learning experts and more, working together to advance the state of the art in artificial intelligence. We use our technologies for widespread public benefit and scientific discovery, and collaborate with others on critical challenges, ensuring safety and ethics are the highest priority.

The role

Research Scientists at Google DeepMind lead our efforts in developing novel algorithmic architecture towards the end goal of solving and building Artificial General Intelligence.

In this role, responsibilities will include making key contributions into the latest research developed into the Gemini audio workstream, such as:

Key responsibilities

  • Data: Unlocking new multimodal affective capabilities in large models, both pre-training and post-training, focusing on audiovisual conversational settings.
  • Models: Improving quality of models for understanding and generation. This includes research to improve tokenizers, better techniques for generation quality, distill for on-device, and looking at joint audio and visual representations. 
  • Evals: Better evaluation methods (human, auto raters, automated metrics) to measure quality of open-ended tasks. 

About you

In order to set you up for success as a Research Scientist at Google DeepMind, we look for the following skills and experience:

  • PhD in Computer Science, or Machine Learning related field.
  • Experience working with LLMs.
  • Audio or video understanding and/or generation experience.

In addition, the following would be an advantage: 

  • Proven track record of research and publications in some of the following areas: audio generation, video generation, LLMs
  • Proven experience of TensorFlow or similar ML frameworks (e.g. JAX)
  • Experience applying and productionizing state-of-the-art large audiovisual, language and/or multimodal research
  • Experience collaborating cross-function and with other researchers
  • A real passion for AI!

The US base salary range for this full-time position is between $136,000 - $245,000 + bonus + equity + benefits. Your recruiter can share more about the specific salary range for your targeted location during the hiring process.

 

Top Skills

Computer Science
Llms
The Company
1,218 Employees
On-site Workplace
Year Founded: 2010

What We Do

We’re a team of scientists, engineers, machine learning experts and more, working together to advance the state of the art in artificial intelligence. We use our technologies for widespread public benefit and scientific discovery, and collaborate with others on critical challenges, ensuring safety and ethics are the highest priority.

Our long term aim is to solve intelligence, developing more general and capable problem-solving systems, known as artificial general intelligence (AGI).

Guided by safety and ethics, this invention could help society find answers to some of the world’s most pressing and fundamental scientific challenges.

We have a track record of breakthroughs in fundamental AI research, published in journals like Nature, Science, and more.Our programs have learned to diagnose eye diseases as effectively as the world’s top doctors, to save 30% of the energy used to keep data centres cool, and to predict the complex 3D shapes of proteins - which could one day transform how drugs are invented.

Similar Jobs

Kustomer Logo Kustomer

Software Engineer, Full Stack - Back End (Senior Level)

Artificial Intelligence • Enterprise Web • Machine Learning • Natural Language Processing • Software • Conversational AI • Automation
Remote
2 Locations
175 Employees
130K-175K Annually

Kustomer Logo Kustomer

Data Engineer (Senior/Staff levels)

Artificial Intelligence • Enterprise Web • Machine Learning • Natural Language Processing • Software • Conversational AI • Automation
Remote
2 Locations
175 Employees

Kustomer Logo Kustomer

Software Engineer, Full Stack (Senior Level)

Artificial Intelligence • Enterprise Web • Machine Learning • Natural Language Processing • Software • Conversational AI • Automation
Remote
2 Locations
175 Employees

Bilt Rewards Logo Bilt Rewards

Biltern 2025 - Engineering - Platform

Fintech • Mobile • Real Estate • Financial Services • PropTech
Easy Apply
New York, NY, USA
160 Employees

Similar Companies Hiring

Stepful Thumbnail
Software • Healthtech • Edtech • Artificial Intelligence
New York, New York
60 Employees
HERE Technologies Thumbnail
Software • Logistics • Internet of Things • Information Technology • Computer Vision • Automotive • Artificial Intelligence
Amsterdam, NL
6000 Employees
True Anomaly Thumbnail
Software • Machine Learning • Hardware • Defense • Artificial Intelligence • Aerospace
Colorado Springs, CO
131 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account