Data Ops Leader, Annotations & Datasets

Posted 4 Days Ago
Be an Early Applicant
San Francisco, CA
150K-260K Annually
Senior level
Artificial Intelligence • Enterprise Web • Healthtech • Machine Learning • Natural Language Processing • Telehealth • Generative AI
Powering deeper understanding in healthcare through purpose-built AI.
The Role
As the Data Annotation Leader, you'll manage datasets for AI model training, oversee vendor relationships, ensure compliance, and drive quality metrics for annotation processes.
Summary Generated by Built In

Abridge was founded in 2018 with the mission of powering deeper understanding in healthcare. Our AI-powered platform was purpose-built for medical conversations, improving clinical documentation efficiencies while enabling clinicians to focus on what matters most—their patients.

Our enterprise-grade technology transforms patient-clinician conversations into structured clinical notes in real-time, with deep EMR integrations. Powered by Linked Evidence and our purpose-built, auditable AI, we are the only company that maps AI-generated summaries to ground truth, helping providers quickly trust and verify the output. As pioneers in generative AI for healthcare, we are setting the industry standards for the responsible deployment of AI across health systems.

We are a growing team of practicing MDs, AI scientists, PhDs, creatives, technologists, and engineers working together to empower people and make care make more sense. We have offices located in the SoHo neighborhood of New York, the Mission District in San Francisco, and Lawrenceville in Pittsburgh.

The Role

As the Data Annotation Leader, you’ll play a pivotal role in enabling our AI applied science and product teams. This role is responsible for building the datasets needed to train and evaluate the next generation of models powering Abridge’s products. This role is a unique opportunity to stand up a new function on a team that is reshaping the practice of medicine. You will work cross-functionally, collaborating closely with AI/ML scientists, product leaders, data engineers, and our legal team, developing processes to scale up data annotation efforts at Abridge.

Key responsibilities include (i) sourcing job specifications from stakeholders in scientists and product; (ii) working with our commercial, legal, and security teams to identify and uphold all relevant data security and privacy requirements; (iii) driving strategic decisions about which vendors to work with and when to spin up internal annotation processes; (iv) quarterbacking engagements with vendors, working with finance and company leaders to negotiate strong deals; and (v) overseeing the work to ensure the quality of work product and compliance with our requirements. 

What You'll Do

  • Stay on top of the landscape of vendors, including both capabilities and economics.

  • Drive strategic decisions about which annotation jobs to pursue with which vendor. 

  • Quarterback discussions and negotiations with vendors in partnership with finance and leadership.

  • Ensure that our annotation investments align with Abridge’s research and product priorities, communicating frequently with builder leadership. 

  • Work closely with scientists to produce clear specifications and identify appropriate datasets for each task. 

  • Be the point person in charge of each annotation effort, ensuring that all efforts meet our product needs, comply with our obligations, and are completed swiftly.

  • Define and monitor quality metrics for annotation tasks.

  • Work with our AI science and engineering teams to curate the resulting datasets for model training and evaluation (storage, versioning, access controls, etc.).

What You'll Bring

  • 5+ years in data annotation, data operations, or related roles, with at least 2 years in a leadership position.

  • Experience working with annotation platforms (e.g., Labelbox, Scale AI, Supervisely) 

  • Familiar with the operations of machine learning research teams and the role of annotated data in model training.

  • Experience building and managing internal annotation teams

  • Strong organizational and project management skills.

  • Experience working with cross-functional teams in a fast-paced, startup environment

Bonus Points If...

  • Basic scripting or data manipulation skills (e.g., Python, Excel) are advantageous but not required.

  • Experience in medical or conversational data annotation.

  • Understanding of ETL/ELT processes, data governance, and security best practices.

  • Experience with data management tools and frameworks (e.g., SQL, BigQuery, DBT/Airflow).

  • Experience working with Cloud providers (AWS/GCP/Azure).

  • Experience with healthcare data and knowledge of HIPAA compliance.

Base Salary: $150,000 USD - $260,000+ USD per year + Equity

The salary range provided is based on transparent pay guidelines and is an estimate for candidates residing in the San Francisco and New York City metro areas. The actual base salary will vary depending on the candidate's location, relevant experience, skills, qualifications, and other job-related factors. Additionally, this role may include the opportunity to participate in a company stock option plan as part of the total compensation package.

Must be willing to work from our SF office at least 3x per week

This position requires a commitment to a hybrid work model, with the expectation of coming into the office a minimum of (3) three times per week. Relocation assistance is available for candidates willing to move to San Francisco.

We value people who want to learn new things, and we know that great team members might not perfectly match a job description. If you’re interested in the role but aren’t sure whether or not you’re a good fit, we’d still like to hear from you.

Why work at Abridge?

At Abridge, we’re driven by our mission to bring understanding and follow-through to every medical conversation. Our culture is founded on doing things the “inverse” way in a legacy system—focusing on patients, instead of the system; focusing on outcomes, instead of billing; and focusing on the end-user experience, instead of a hospital administrator's mandate.

Abridgers are engineers, scientists, designers, and health policy experts from a diverse set of backgrounds—an experiment in alchemy that helps us transform an industry dominated by EHRs and enterprise into a consumer-driven experience, one recording at a time. We believe in strong ideas, loosely held, and place a high premium on a growth mindset. We push each other to grow and expose each other to the latest in our respective fields. Whether it’s holding a PhD-level deep dive into understanding fairness and underlying bias in machine learning models, debating the merits of a Scandinavian design philosophy in our UI/UX, or writing responses for Medicare rules to influence U.S. health policy, we prioritize sharing our findings across the team and helping each other be successful.

How we take care of Abridgers:

  • Generous Time Off: 13 paid holidays, flexible PTO for salaried employees, and accrued time off for hourly employees.

  • Comprehensive Health Plans: Medical, Dental, and Vision plans for all full-time employees. Abridge covers 100% of the premium for you and 75% for dependents. If you choose a HSA-eligible plan, Abridge also makes monthly contributions to your HSA. 

  • Paid Parental Leave: 16 weeks paid parental leave for all full-time employees.

  • 401k and Matching: Contribution matching to help invest in your future.

  • Pre-tax Benefits: Access to Flexible Spending Accounts (FSA) and Commuter Benefits.

  • Learning and Development Budget: Yearly contributions for coaching, courses, workshops, conferences, and more.

  • Sabbatical Leave: 30 days of paid Sabbatical Leave after 5 years of employment.

  • Compensation and Equity: Competitive compensation and equity grants for full time employees.

  • ... and much more!

Diversity & Inclusion

Abridge is an equal opportunity employer. Diversity and inclusion is at the core of what we do. We actively welcome applicants from all backgrounds (including but not limited to race, gender, educational background, and sexual orientation).

Staying safe - Protect yourself from recruitment fraud

We are aware of individuals and entities fraudulently representing themselves as Abridge recruiters and/or hiring managers. Abridge will never ask for financial information or payment, or for personal information such as bank account number or social security number during the job application or interview process. Any emails from the Abridge recruiting team will come from an @abridge.com email address. You can learn more about how to protect yourself from these types of fraud by referring to this article. Please exercise caution and cease communications if something feels suspicious about your interactions. 

Top Skills

Airflow
AWS
Azure
BigQuery
Dbt
GCP
Labelbox
Python
Scale Ai
SQL
Supervisely
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, California
239 Employees
Hybrid Workplace
Year Founded: 2018

What We Do

Abridge was founded in 2018 with the mission of powering deeper understanding in healthcare. Our AI-powered platform was purpose-built for medical conversations, improving clinical documentation efficiencies while enabling clinicians to focus on what matters most—their patients.

Our enterprise-grade technology transforms patient-clinician conversations into structured clinical notes in real-time, with deep EMR integrations. Powered by Linked Evidence and our purpose-built, auditable AI, we are the only company that maps AI-generated summaries to ground truth, helping providers quickly trust and verify the output. As pioneers in generative AI for healthcare, we are setting the industry standards for the responsible deployment of AI across health systems.

We are a growing team of practicing MDs, AI scientists, PhDs, creatives, technologists, and engineers working together to empower people and make care make more sense.

Why Work With Us

At Abridge, every role matters, and every voice helps drive real change. With us, you’ll find a purpose-driven, collaborative culture, where we work together to build tools that bring humanity back to healthcare.

Gallery

Gallery

Similar Jobs

Block Logo Block

Senior Machine Learning Modeler, Model Risk Management

Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Remote
Hybrid
7 Locations
12000 Employees
195K-343K Annually

Atlassian Logo Atlassian

Principal Data Engineer

Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Remote
San Francisco, CA, USA
11000 Employees
169K-271K Annually

BlackLine Logo BlackLine

Principal Data Engineer

Cloud • Fintech • Information Technology • Machine Learning • Software • App development • Generative AI
Hybrid
Pleasanton, CA, USA
1810 Employees
251K-314K Annually

The Aerospace Corporation Logo The Aerospace Corporation

2025 Optical Thin Films Research Associate

Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Hybrid
El Segundo, CA, USA
4600 Employees
70K-85K Annually

Similar Companies Hiring

HERE Technologies Thumbnail
Software • Logistics • Internet of Things • Information Technology • Computer Vision • Automotive • Artificial Intelligence
Amsterdam, NL
6000 Employees
True Anomaly Thumbnail
Software • Machine Learning • Hardware • Defense • Artificial Intelligence • Aerospace
Colorado Springs, CO
131 Employees
Caliola Engineering Thumbnail
Software • Machine Learning • Hardware • Defense • Data Privacy • App development • Aerospace
Colorado Springs, CO
53 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account