Critical Harms Intelligence Analyst (Self-Harm & Harmful Regulated Content)

Posted 15 Days Ago
Be an Early Applicant
San Mateo, CA
Hybrid
128K-152K Annually
Junior
Computer Vision • Gaming • Software • Virtual Reality • Web3 • Metaverse
Immersive gaming and creation platform
The Role
As a Critical Harms Intelligence Analyst, you will apply your expertise to manage and instruct a moderation team, identify potential gaps in processes regarding user-generated content, and work cross-functionally to mitigate risks and keep the community safe from harmful content.
Summary Generated by Built In

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. 

At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. 

A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone.

The Safety Operations team is focused (okay, maybe obsessed) with scaling Roblox’s Moderation Operations and redefining our customer experience through our multi-year vision and strategy execution. We’re seeking a passionate subject matter expert in online expressions of self-harm and/or harmful regulated content to join the Critical Harms Intelligence, Investigations, and Operations (CHIIOPS) team. CHIIOPS applies subject-matter expertise to our highest-level risks at-scale, and works with cross-functional partners to identify and mitigate these behaviors. 

As a Critical Harms Intel Analyst (Self-Harm & Harmful Regulated Content), you will: 

  • Apply subject matter expertise about how individuals express such behaviors with online user generated content with the goal to keep them and our broader user community safe.
  • Proactively identify potential gaps in our processes, product, or policies that allow inappropriate expression of these behaviors, and work cross-functionally with partners to identify effective risk mitigation solutions.
  • Manage and instruct a specialized moderation team to help identify such content at scale and inform product and process improvements.

You will become an expert in Roblox's internal and external safety policies, the tools we use to keep our users safe, and be able to make data-driven decisions on how to improve the company's overall escalation ecosystem. 

Please note: This role may review graphic, controversial, and sometimes offensive content in line with Roblox’s handling policies. This role will also require some on-call support.

You will report to the Critical Harms Intelligence, Investigations, and Operations Manager.

You Have

  • 2+ years of experience working directly with expressions of relevant content in a user-generated content environment. 
  • Demonstrated experience identifying the appropriate balance between safety and self-expression, and use qualitative and quantitative data to support decisions.
  • Ability to moderate sensitive content with high quality and precision, and expertly navigate content ambiguity to develop clear and concise specialty enforcement guidance.
  • Ability to apply critical thinking to quickly and independently prioritize urgent risks and make judgment calls.  
  • Excellent troubleshooting, communication, and problem-solving skills
  • Bachelor’s degree or equivalent experience in relevant topics, including social work, psychology, child development. 
  • Experience working with external safety organizations who cover these issues.
  • Data analysis and basic querying skills, such as Basic Python/or SQL knowledge. Experience with JIRA, Airtable, or other similar products is also a plus. 

For roles that are based at our headquarters in San Mateo, CA: The starting base pay for this position is as shown below. The actual base pay is dependent upon a variety of job-related factors such as professional background, training, work experience, location, business needs and market demand. Therefore, in some circumstances, the actual salary could fall outside of this expected range. This pay range is subject to change and may be modified in the future. All full-time employees are also eligible for equity compensation and for benefits.

Annual Salary Range

$127,560$151,930 USD

Roles that are based in our San Mateo, CA Headquarters are in-office Tuesday, Wednesday, and Thursday, with optional in-office on Monday and Friday (unless otherwise noted).

You’ll Love: 

  • Industry-leading compensation package
  • Excellent medical, dental, and vision coverage
  • A rewarding 401k program
  • Flexible vacation policy (varies by exemption status)
  • Roflex - Flexible and supportive work policy 
  • Roblox Admin badge for your avatar
  • At Roblox HQ: 
    • Free catered lunches five times a week and several fully stocked kitchens with unlimited snacks
    • Onsite fitness center and fitness program credit
    • Annual CalTrain Go Pass

Roblox provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. Roblox also provides reasonable accommodations for all candidates during the interview process.

Top Skills

Python
SQL

What the Team is Saying

Claus
Ying
Denise
Andrea
The Company
HQ: San Mateo, CA
2,500 Employees
Hybrid Workplace
Year Founded: 2004

What We Do

Roblox is an immersive gaming and creation platform that offers people millions of ways to be together, inviting its community to explore, create and share endless unique experiences. Our vision is to reimagine the way people come together — in a world that's safe, civil, and optimistic. To achieve this vision, we are building an innovative company that, together with the Roblox community, has the ability to strengthen our social fabric and support economic growth for people around the world.

Why Work With Us

Every day, Roblox employees tackle complex questions and drive incredible innovation. Join us in building the future of human connection and communication.

Gallery

Gallery
Gallery
Gallery
Gallery

Roblox Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

We are requiring employees to be in the office three days a week – with core days being Tuesday, Wednesday, and Thursday. On Mondays and Fridays, employees may choose to work remotely, although the office will still be open.

Typical time on-site: 3 days a week
Company Office Image
HQSan Mateo, CA
IN
Learn more

Similar Jobs

Roblox Logo Roblox

Cafe Engineer

Computer Vision • Gaming • Software • Virtual Reality • Web3 • Metaverse
Hybrid
San Mateo, CA, USA
2500 Employees
115K-143K Annually

Roblox Logo Roblox

Facilities Logistics Lead

Computer Vision • Gaming • Software • Virtual Reality • Web3 • Metaverse
Hybrid
San Mateo, CA, USA
2500 Employees
115K-143K Annually

Roblox Logo Roblox

Senior Manager, Campus Security & Emergency Response, Global Security

Computer Vision • Gaming • Software • Virtual Reality • Web3 • Metaverse
Hybrid
San Mateo, CA, USA
2500 Employees
163K-214K Annually

Roblox Logo Roblox

Senior Netsuite Administrator

Computer Vision • Gaming • Software • Virtual Reality • Web3 • Metaverse
Hybrid
San Mateo, CA, USA
2500 Employees
170K-207K Annually

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account