Product Operations Manager, AI Classification

About the team

The AI Classification department supports the product operations for DoubleVerify’s Brand Safety and Suitability solutions.

We make social media platforms and the open web safer for advertisers, brands, and publishers.

Our team’s collaborations across DoubleVerify deliver both manual & automated solutions for content classifications ranging from copyright infringement, to violence, to inflammatory politics & news. As a globally diverse team of AI Classification Specialists, we continuously improve labeling operations to maintain & enhance our industry-leading position in brand safety and suitability for all publishing channels DoubleVerify supports.

Our work betters the experience of brands, advertisers, and publishers globally, and reduces the ROI of bad actors who seek to monetize harmful or unsuitable content through the advertising ecosystem.

About the job

Your direct reports work on human-in-the-loop AI/ML product operations across a variety of content types including mobile apps, connected TV, online long- and short-form video, and social media platforms. Among these, video content labeling, quality assurance, and training will be the majority of your focus.

Though work is centered around ET time zone hours, you will collaborate with in-house & vendor partners globally in locations such as London, India, Finland, and Israel. The hiring manager for this role is also located in our NYC office.

Technical curiosity, strong written communication (ex: Slack, Google Docs, JIRA), and a genuine passion for growing your direct reports’ careers & skills are must-haves. This role has a player-coach element to it, so strategically vital individual contributor work will be part of your workload.

A typical week includes stakeholder rituals (ex: intaking Product requests for labeled data sets, or leaving feedback on a Data Science strategy paper), direct report 1:1s, sprint-planning, deliverable troubleshooting for the Video team, and occasional client-facing work. You will also interface directly with content policy experts and will lead work that sometimes includes upsetting content (ex: death and injury, violence, CSAM.)

You will manage at least one Business Process Outsourcing relationship, run regular performance reviews, you will directly manage up to 5 people in NYC HQ, measure output quality, and ensure their workforce is up-to-date on recent policy revisions.

Responsibilities

• Guide these teams to deliver manual classifications of various content with the highest quality. Ensure the delivery of training data and daily risk triage processes, as well ad-hoc requests from product managers and clients. 
• Manage cross-functional stakeholder requirements via effective communication, collaboration, and consultation with leaders in the USA, global BPOs, and nearshore operations.
• Scope, define, and manage the intake of new projects for your team. Help educate your partners on the team’s capabilities and deliver manual classification projects on-time.
• Own and optimize the office operations by providing perks, incentives, and career development resources to delight your team members.

Minimum qualifications:

• 2+ years experience as a people manager of 3 or more team members
• 6+ years experience in Product Operations, Product Management, or Program Management in a tech company, ad agency, or in-house advertising function
• Excellent stakeholder alignment, executive-facing presentation, and time-management skills
• Experience analyzing, forecasting, and visualizing operational metrics such as throughput, utilization, and accuracy

Preferred qualifications:

• Familiarity with BigQuery, vendor management, and social media video trends
• Experience working in Trust & Safety, especially content moderation and Machine Learning to sort content into safety-related topics such as crime, violence, and sexuality
• Proficiency in multiple languages
• Experience with global workplace cultures and cross-culturally fluent people-management
  

The successful candidate’s starting salary will be determined based on a number of non-discriminating factors, including qualifications for the role, level, skills, experience, location, and balancing internal equity relative to peers at DV.
The estimated salary range for this role based on the qualifications set forth in the job description is between [$86,000 - $185,000]. This role will also be eligible for bonus/commission (as applicable), equity, and benefits.
The range above is for the expectations as laid out in the job description; however, we are often open to a wide variety of profiles, and recognize that the person we hire may be more or less experienced than this job description as posted.

Not-so-fun fact: Research shows that while men apply to jobs when they meet an average of 60% of job criteria, women and other marginalized groups tend to only apply when they check every box. So if you think you have what it takes but you’re not sure that you check every box, apply anyway!