Senior Data Engineer I

Posted 11 Days Ago
Be an Early Applicant
Boston, MA
Senior level
Real Estate • Software • PropTech
At Compass, our mission is to help everyone find their place in the world.
The Role
As a Senior Data Engineer at Compass, you'd design and develop scalable data pipelines, manage large datasets, and optimize data systems for business insights and AI/ML applications. You will collaborate with various teams to drive data solutions and provide on-call support for operational issues.
Summary Generated by Built In

At Compass, our mission is to help everyone find their place in the world. Founded in 2012, we’re revolutionizing the real estate industry with our end-to-end platform that empowers residential real estate agents to deliver exceptional service to seller and buyer clients.

Data is at the core of Compass. Our organization is responsible for evaluating, accelerating, building, and maintaining a unified, scalable, and cost-effective data ecosystem—including infrastructure, data lakes, data warehouses, and tooling. As a horizontal team, we manage data across various domains such as Agents, Listings, Segments, Finance, and more.

We are seeking a self-driven Senior Data Engineer to lead key initiatives and maximize the value of our data. In this role, you will collaborate with stakeholders across Analytics, Growth, Finance, Product, and Data Science teams to understand business needs and design optimal solutions. The ideal candidate is an experienced data expert who can build and optimize data systems for BI, insights, product development, and AI/ML applications.

We are looking for individuals who excel at solving ambiguous business challenges through data, take ownership of their work, and proactively communicate progress and blockers to leadership. If you thrive in a dynamic environment and are passionate about driving impact through data, we’d love to hear from you!

Responsibilities

  • Design, develop, and operationalize scalable and reliable data pipelines.
  • Build and manage large, complex data sets that align with both functional and non-functional business requirements.
  • Apply expertise in database design, including logical data modeling, physical optimization, and security best practices.
  • Enhance data pipeline integrity by implementing Data Quality checks, ensuring a comprehensive and reliable data service.
  • Collaborate with Analytics and Data Science teams to uncover insights and hidden patterns, driving value-added data solutions.
  • Provide on-call support, troubleshooting and resolving user issues based on severity to ensure smooth data operations.

Qualification

  • 7+ years of experience in designing, engineering, and operationalizing data pipelines for large and complex datasets.
  • 3+ years of hands-on experience working with unstructured data, including JSON.
  • Strong expertise in batch and stream processing methodologies.
  • Extensive proficiency in Advanced SQL for data transformation and analysis.
  • 3+ years of experience in Python/PySpark for data processing and automation.
  • 3+ years of experience in data transformation using Databricks.
  • 3+ years of experience working with AWS cloud infrastructure or any equivalent cloud environment.
  • 2+ years of experience in orchestrating data pipelines using DBX DLT, Airflow, or similar tools.

Compensation: The base pay range for this position is $140k-$170k annually; however, base pay offered may vary depending on job-related knowledge, skills, and experience. Bonuses and restricted stock units may be provided as part of the compensation package, in addition to a full range of benefits. Base pay is based on market location. Minimum wage for the position will always be met

Perks that You Need to Know About:

Participation in our incentive programs (which may include where eligible cash, equity, or commissions). Plus paid vacation, holidays, sick time, parental leave, marriage leave, and recharge leave; medical, tele-health, dental and vision benefits; 401(k) plan; flexible spending accounts (FSAs); commuter program; life and disability insurance; Maven (a support system for new parents); Carrot (fertility benefits); UrbanSitter (caregiver referral network); Employee Assistance Program; and pet insurance.

 

Do your best work, be your authentic self.

At Compass, we believe that everyone deserves to find their place in the world — a place where they feel like they belong, where they can be their authentic selves, where they can thrive.  Our collaborative, energetic culture is grounded in our Compass Entrepreneurship Principles and our commitment to diversity, equity, inclusion, growth and mobility. As an equal opportunity employer, we offer competitive compensation packages, robust benefits and professional growth opportunities aimed at helping to improve our employees' lives and careers.

Notice for California Applicants

Los Angeles County Fair Chance Notice

Top Skills

Pyspark
Python
SQL
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
4,000 Employees
On-site Workplace
Year Founded: 2012

What We Do

A real estate company with a purpose; we are building the first modern real estate platform, pairing the industry’s top talent with technology to make the search and sell experience intelligent and seamless.

Why Work With Us

We are a tech company reinventing the space.

To lead the industry requires the smartest tools built by the brightest minds across engineering, design, and strategy. Through our proprietary platform, Compass is changing how agents and clients navigate the process of finding or selling a home. Join our team today!

Similar Jobs

WHOOP Logo WHOOP

Data Engineer

Fitness • Hardware • Healthtech • Sports • Wearables
Easy Apply
Hybrid
Boston, MA, USA
500 Employees

DraftKings Logo DraftKings

Senior Data Engineer, Snowflake

Digital Media • Gaming • Information Technology • Software • Sports • Esports • Big Data Analytics
Hybrid
Boston, MA, USA
5300 Employees

Magnite Logo Magnite

Senior Data Engineer, Scala

AdTech • Big Data • Digital Media • Software
Hybrid
2 Locations
915 Employees
150K-170K Annually

WHOOP Logo WHOOP

Data Engineering Technical Lead

Fitness • Hardware • Healthtech • Sports • Wearables
Easy Apply
Hybrid
Boston, MA, USA
500 Employees

Similar Companies Hiring

HERE Technologies Thumbnail
Software • Logistics • Internet of Things • Information Technology • Computer Vision • Automotive • Artificial Intelligence
Amsterdam, NL
6000 Employees
True Anomaly Thumbnail
Software • Machine Learning • Hardware • Defense • Artificial Intelligence • Aerospace
Colorado Springs, CO
131 Employees
Red 6 Thumbnail
Virtual Reality • Software • Hardware • Defense • Aerospace
Orlando, Florida
113 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account