Data Platform Engineer

DISQO’s mission is to build the world’s most trusted ad measurement platform that fuels brand growth. The world’s largest brands, agencies, and media companies trust DISQO for expert insight and AI-driven intelligence about their advertising performance across all platforms. We capture people’s sentiments and journeys,  connecting them with the brands they value and the media they consume. With this identity-based approach, brands gain more accurate and authentic insight so they can create more meaningful interactions.

When you join DISQO Nation, you join a community that values trust, transparency and innovation. We invest in our employees and apply a bottom-up management approach, rooted in the concept of servant leadership. We approach each day eager to learn, grow, and make a lasting impact. Best of all, we have fun while doing it!

The team: This is a great opportunity to join an exciting & highly motivated team and upgrade your skills while creating real impact. We use a modern tech stack and cloud infrastructure. We are not only looking for work experience, but rather the willingness to step up to challenges and the ability to learn quickly.

We believe the best software is written and managed by small teams that know how to make the impossible possible. We use agile software development techniques and modern tools to focus our efforts on solving our business goals. We deliver early and often. We obsess over our code, architecture and infrastructure and we believe that these practices lead to higher quality products.

What you will do:

• Leverage your data engineering and infrastructure skills to impact our business by taking ownership of key projects requiring environment build and data pipelines
• Collaborate with product managers, software engineers and data engineers to design, implement, and deliver successful data solutions.
• Identify, design and implement internal process improvements including re-designing Data/Observability infrastructure for greater scalability, optimizing data delivery, and automating manual processes.
• Design, build and optimize performant databases, data models, integrations and ETL pipelines in RDBMS and NoSQL environments
• Play a critical role in designing and evolving our data infrastructure on AWS, orchestrating Spark-based pipelines in Kubernetes (EKS), and enabling our data engineering and analytics teams to deliver insights with confidence and speed.
• Proven expertise in Spark and managing Spark workloads on Kubernetes (EKS).
• Use your Big Data skills to help optimize poor performing SQLs for the business
• Maintain detailed documentation of your work and changes to support data quality and governance.
• Participate in an on-call rotation to provide operational support for critical data platform services and data pipeline jobs.
• Ensure high operational efficiency and quality of your solutions to meet SLAs and support commitment to the customers
• Be an engaged participant and advocate of agile/scrum practices to ensure health and process improvements for your team
• Define best practices around making our systems and services measurable and work with our various teams to get those best practices applied
• Collaborate with other Engineering teams to ensure our Jobs are emitting the right metrics
• Collect, aggregate and visualize the collected metrics to provide actionable insight

What you bring to the role:

• At least 5+ years of experience in Data Platform owning and enabling capabilities within an enterprise data ecosystem including best Data Management practices.
• At least 3+ years of experience as SRE, DevOps or equivalent engineering roles
• At least 3+ years of production experience with AWS
• Strong hands on experience managing infrastructure and configuration of Data Platforms in the Cloud - Data Lake, Data Warehouse, Data Mart, Graph Database, Time Series Database, Object Store, etc.
• Strong experience and deep knowledge in the Hadoop ecosystem including performance tuning and operational efficiency.
• Strong experience in Spark with Python or Scala
• Strong hands-on experience in Infrastructure-as-Code and Configuration management tools and technologies: Terraform, Helm, Strimzi, AWS CloudFormation, Packer, Chef, Puppet, Ansible, etc.
• Strong experience in CI/CD tools like Jenkins
• Hands-on experience with observability systems like New Relic, Prometheus/Grafana
• Deep knowledge in various ETL/ELT tools and concepts, data modeling, SQL, query performance optimization
• Experience with building real-time processing applications using Spark Stream and Kinesis/Kafka
• Experience with workflow management tools (Airflow, Oozie, Azkaban, Luigi, etc.)
• Comfortable working in Linux environment
• Ability to thrive in an agile, entrepreneurial start-up environment

#LI-MV1 #LI-Hybrid

At DISQO, we pride ourselves on having a positive, performance-oriented workplace that includes a flexible hybrid approach, competitive medical benefits, and an amazing vacation policy. Read more about our culture on Glassdoor.

You can learn more about what’s happening at DISQO by visiting the DISQO Developer Blog or the DISQO Company Blog.

Perks & Benefits:

·100% covered Medical/Dental/Vision for employee, competitive dependent coverage

·Equity

·401K

·Generous PTO policy

·Flexible workplace policy

·Team offsites, social events & happy hours

·Life Insurance

·Health FSA

·Commuter FSA (for hybrid employees)

·Catered lunch and fully stocked kitchen

·Paid Maternity/Paternity leave

·Disability Insurance

·Travel Assistance Program

·24/7 Counseling Services offered to Employees

·Access to personal and professional growth tools - Calm App & LinkedIn Learning

Note: The benefits noted above are for full time US based employees only.

DISQO is an equal opportunity employer. Discovery, innovation, and growth are possible when we open ourselves to new possibilities, perspectives, and approaches. That’s why, at DISQO, we welcome, support, and empower individuals from diverse backgrounds. Exceptional teams are rooted in extraordinary people, each with a unique story and a compelling set of skills. DISQO does not discriminate against employees based on race, color, religion, sex, national origin, gender identity or expression, age, disability, pregnancy (including childbirth, breastfeeding, or related medical condition), genetic information, protected military or veteran status, sexual orientation, or any other characteristic protected by applicable federal, state or local laws.

*Recruiting firms that submit resumes to DISQO without first entering into a written contract will not be entitled to any compensation on candidates referred by that firm.