Senior Quality Engineer, AI

Reposted 7 Days Ago
2 Locations
Remote
Senior level
Software
The Role
As a Senior Quality Engineer at Descript, you'll focus on ensuring high quality and reliability in AI products. Responsibilities include creating test plans, developing evaluation processes for AI models, improving methodologies, and collaborating across teams. You'll lead QA efforts, set benchmarks, and mentor other team members, contributing to the overall refinement of the company's audio and video editing tools powered by AI.
Summary Generated by Built In

Help Us Shape the Future of AI at Descript!

Are you obsessed with quality, detail-oriented to a fault, and fascinated by the world of AI? Perfect—because we’re on the hunt for a QA pro to make sure our groundbreaking AI-powered products are as reliable and polished as they are revolutionary. At Descript, we’re not just changing how content creators work with audio and video—we’re making magic 🌟. And we need someone like you to help make sure that magic happens, every time.

This is your chance to dive into the fast-paced world of AI technology, take quality to the next level, and put your stamp on tools that creators will actually love using.

This role can be remote in the US or based in the SF Bay Area.

What You'll Do

  • Build scalable processes for evaluating AI models—both quantitatively and qualitatively—so we can stay ahead of the game.
  • Work hand-in-hand with our brilliant AI Research team to create test plans, run experiments, and identify areas for improvement or inconsistencies in model behavior.
  • Set the gold standard for model quality by creating baselines, benchmarks, and rating systems.
  • Keep everything organized with clear test plans, documentation, and bug reports that your future self (and team) will thank you for.
  • Tap into internal and external resources to gather the data we need to refine and perfect our models.
  • Be the go-to expert for working with third-party service providers to ensure they meet our sky-high quality standards.
  • Continuously improve testing tools and methodologies.
  • Share the QA love by mentoring others and collaborating across teams to make sure everything works beautifully together.

What You Bring

  • 2+ years experience leading evaluation of AI models.
  • 2+ years experience as a test lead on a team, product area, or feature.
  • 5+ years QA experience.
  • Experience working with AI Research teams.
  • Ability to collaborate effectively with cross-functional teams and stakeholders.
  • Bachelor’s degree in Computer Science, Engineering, or equivalent relevant experience.

Nice to Haves

  • Experience evaluating AI speech or video models.
  • Experience writing SQL queries.
  • Experience using Python for scripting.

The base salary range for this role is $140,000-$181,000. Final offer amounts will carefully consider multiple factors, including prior experience, expertise, and location, and they may vary from the amount above.

About Descript

Descript is building a simple, intuitive, fully-powered editing tool for video and audio — an editing tool built for the age of AI. We are a team of 150 — with a proven CEO and the backing of some of the world's greatest investors (OpenAI, Andreessen Horowitz, Redpoint Ventures, Spark Capital). 

Descript is the special company that's in possession of both product market fit and the raw materials (passionate user community, great product, large market) for growth, but is still early enough that each new employee has a measurable influence on the direction of the company.

Benefits include a generous healthcare package, catered lunches, and flexible vacation time. Our headquarters are located in the Mission District of San Francisco, CA. We're looking to hire people who are local and able to join us at the office when needed. We're flexible, and you're an adult—we don't expect or mandate that you're in the office every day. But we do believe there are valuable and serendipitous moments of discovery and collaboration that come from working together in person. 

Descript is an equal opportunity workplace—we are dedicated to equal employment opportunities regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, or Veteran status. We believe in actively building a team rich in diverse backgrounds, experiences, and opinions to better allow our employees, products, and community to thrive. 

Top Skills

AI
Baselines
Benchmarks
Bug Reports
Experiments
Model Quality
Python
Qa
SQL
Test Plans
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
90 Employees
On-site Workplace
Year Founded: 2017

What We Do

Descript builds simple and powerful collaborative tools for new media creators. We strive to eliminate the tedious work that often stands between an idea and its expression, so that creators can focus on developing their craft instead of their usage of tools.

Descript is a next generation digital media platform that offers a new "engine"​ that lets you edit audio by editing text (instead of waveforms).

That means it does transcription (both automated and human-powered, whichever you prefer), but more interestingly, it lets you move the audio around by simply editing the transcript.

If you're new to editing audio, you'll find it far easier - it's basically like using a word processor. If you're experienced, Descript is faster than waveform editing - and more fun.

If you work with voice audio (as opposed to music), Descript is what the future looks like...join us and change the world.

Similar Jobs

Iodine Software Logo Iodine Software

Software Development Engineer in Test

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Software
Remote
USA
250 Employees
82K-115K Annually

Samsara Logo Samsara

Senior Quality Engineer, Embedded Software

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote
Hybrid
United States
2800 Employees
106K-160K Annually

Square Logo Square

Staff Software Quality Engineer, Operating Systems

eCommerce • Fintech • Hardware • Payments • Software • Financial Services
Remote
8 Locations
12000 Employees
161K-284K Annually

Block Logo Block

Staff Software Quality Engineer, Operating Systems

Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Remote
7 Locations
12000 Employees
161K-284K Annually

Similar Companies Hiring

True Anomaly Thumbnail
Software • Machine Learning • Hardware • Defense • Artificial Intelligence • Aerospace
Colorado Springs, CO
131 Employees
Caliola Engineering Thumbnail
Software • Machine Learning • Hardware • Defense • Data Privacy • App development • Aerospace
Colorado Springs, CO
53 Employees
Red 6 Thumbnail
Virtual Reality • Software • Hardware • Defense • Aerospace
Orlando, Florida
113 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account