Senior Quality Engineer, AI

Posted 16 Days Ago
2 Locations
Remote
Senior level
Software
The Role
As a Senior Quality Engineer at Descript, you'll focus on ensuring high quality and reliability in AI products. Responsibilities include creating test plans, developing evaluation processes for AI models, improving methodologies, and collaborating across teams. You'll lead QA efforts, set benchmarks, and mentor other team members, contributing to the overall refinement of the company's audio and video editing tools powered by AI.
Summary Generated by Built In

Help Us Shape the Future of AI at Descript!

Are you obsessed with quality, detail-oriented to a fault, and fascinated by the world of AI? Perfect—because we’re on the hunt for a QA pro to make sure our groundbreaking AI-powered products are as reliable and polished as they are revolutionary. At Descript, we’re not just changing how content creators work with audio and video—we’re making magic 🌟. And we need someone like you to help make sure that magic happens, every time.

This is your chance to dive into the fast-paced world of AI technology, take quality to the next level, and put your stamp on tools that creators will actually love using.

This role can be remote in the US or based in the SF Bay Area.

What You'll Do

  • Work hand-in-hand with our brilliant AI team to create test plans, run experiments, and identify areas for improvement or inconsistencies in model behavior.
  • Set the gold standard for model quality by creating baselines, benchmarks, and rating systems.
  • Build scalable processes for evaluating AI models—both quantitatively and qualitatively—so we can stay ahead of the game.
  • Keep everything organized with clear test plans, documentation, and bug reports that your future self (and team) will thank you for.
  • Tap into internal and external resources to gather the data we need to refine and perfect our models.
  • Be the go-to expert for working with third-party service providers to ensure they meet our sky-high quality standards.
  • Continuously improve testing tools and methodologies.
  • Share the QA love by mentoring others and collaborating across teams to make sure everything works beautifully together.

What You Bring

  • Bachelor’s degree in Computer Science, Engineering, or equivalent relevant experience.
  • 5+ years QA experience.
  • 2+ years experience leading evaluation of AI models.
  • 2+ years experience as a test lead on a team, product area, or feature.
  • Experience working with AI research teams.
  • Ability to collaborate effectively with cross-functional teams and stakeholders.

Nice to Haves

  • Experience evaluating AI speech or video models.
  • Experience writing SQL queries.
  • Experience using Python for scripting.

The base salary range for this role is $140,000-$181,000. Final offer amounts will carefully consider multiple factors, including prior experience, expertise, and location, and they may vary from the amount above.

About Descript

Descript is building a simple, intuitive, fully-powered editing tool for video and audio — an editing tool built for the age of AI. We are a team of 150 — with a proven CEO and the backing of some of the world's greatest investors (OpenAI, Andreessen Horowitz, Redpoint Ventures, Spark Capital). 

Descript is the special company that's in possession of both product market fit and the raw materials (passionate user community, great product, large market) for growth, but is still early enough that each new employee has a measurable influence on the direction of the company.

Benefits include a generous healthcare package, catered lunches, and flexible vacation time. Our headquarters are located in the Mission District of San Francisco, CA. We're looking to hire people who are local and able to join us at the office when needed. We're flexible, and you're an adult—we don't expect or mandate that you're in the office every day. But we do believe there are valuable and serendipitous moments of discovery and collaboration that come from working together in person. 

Descript is an equal opportunity workplace—we are dedicated to equal employment opportunities regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, or Veteran status. We believe in actively building a team rich in diverse backgrounds, experiences, and opinions to better allow our employees, products, and community to thrive. 

Top Skills

Python
SQL
The Company
HQ: San Francisco, CA
90 Employees
On-site Workplace
Year Founded: 2017

What We Do

Descript builds simple and powerful collaborative tools for new media creators. We strive to eliminate the tedious work that often stands between an idea and its expression, so that creators can focus on developing their craft instead of their usage of tools.

Descript is a next generation digital media platform that offers a new "engine"​ that lets you edit audio by editing text (instead of waveforms).

That means it does transcription (both automated and human-powered, whichever you prefer), but more interestingly, it lets you move the audio around by simply editing the transcript.

If you're new to editing audio, you'll find it far easier - it's basically like using a word processor. If you're experienced, Descript is faster than waveform editing - and more fun.

If you work with voice audio (as opposed to music), Descript is what the future looks like...join us and change the world.

Similar Jobs

The PNC Financial Services Group Logo The PNC Financial Services Group

Software Engineer - PowerShell / Karate, Karate Robot / Selenium / Java

Machine Learning • Payments • Security • Software • Financial Services
Remote
USA
56000 Employees

CrowdStrike Logo CrowdStrike

Sr. SDET II - NG-SIEM (Remote, East Coast)

Cloud • Information Technology • Sales • Security • Cybersecurity
Remote
15 Locations
10000 Employees
155K-255K Annually

CrowdStrike Logo CrowdStrike

Sr. Windows SDET - Sensor, Platform (Remote, CAN)

Cloud • Information Technology • Sales • Security • Cybersecurity
Remote
6 Locations
10000 Employees

CrowdStrike Logo CrowdStrike

SDET IT management (Remote)

Cloud • Information Technology • Sales • Security • Cybersecurity
Remote
CA, USA
10000 Employees
135K-215K Annually

Similar Companies Hiring

Hedra Thumbnail
Software • News + Entertainment • Marketing Tech • Generative AI • Enterprise Web • Digital Media • Consumer Web
San Francisco, CA
14 Employees
HERE Thumbnail
Software • Logistics • Internet of Things • Information Technology • Computer Vision • Automotive • Artificial Intelligence
Amsterdam, NL
6000 Employees
True Anomaly Thumbnail
Software • Machine Learning • Hardware • Defense • Artificial Intelligence • Aerospace
Colorado Springs, CO
131 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account