Sr. Data Engineer

Reposted 24 Days Ago
2 Locations
Remote
Senior level
Information Technology • Software • Consulting
The Role
The Senior Data Engineer designs scalable data pipelines, collaborates with teams to address business needs, and ensures data infrastructure reliability.
Summary Generated by Built In

Join a pioneering financial services company that is redefining homeownership through innovative, data-driven solutions. As a Senior Data Engineer, you will be instrumental in designing and building scalable data pipelines, transforming complex datasets, and ensuring the reliability of the data infrastructure. Working closely with data scientists and analysts, you will provide critical insights that shape strategic decisions. If you are passionate about data engineering and thrive in a fast-paced, collaborative environment, this role offers you the opportunity to contribute to cutting-edge projects and help shape the future of data architecture




Requirements

  • 5+ years of Python development experience.
  • Experience with AWS, including services like DynamoDB, S3, EMR, Glue, Athena, and Redshift.
  • Knowledge of distributed computing engines, such as Apache Spark.
  • Proficiency in both relational and non-relational databases, along with data modeling expertise.
  • Experience setting up code pipelines using CloudFormation or Terraform.
  • Familiarity with ETL pipeline development in OLAP and Data Warehouse environments.
  • Hands-on experience with orchestration tools like Airflow.
  • Understanding of serverless architectures and scalable application design principles.
  • Proficiency with version control systems, particularly Git.
  • Experience with Node.js, DevOps, and CI/CD practices is a plus.
  • Background in cloud technologies (AWS or Azure) and fintech or banking is desirable.

Responsibilities

  • Design and implement scalable data pipelines in a horizontally scaled environment.
  • Collaborate with cross-functional teams to understand business needs and define transactional scenarios across multiple microservices.
  • Write high-quality, maintainable code that meets established standards and best practices.
  • Build strong relationships with clients by understanding their business model and delivering solutions that align with their goals.
  • Influence and communicate effectively at all levels, including management and engineering teams.
  • Utilize distributed computing systems to transform and manage large datasets efficiently.
  • Work with cloud-based technologies such as AWS to support the company’s data infrastructure.
  • Contribute to continuous integration/continuous delivery (CI/CD) pipelines and DevOps practices.
  • Collaborate with data scientists to ensure the availability and accessibility of critical insights for decision-making.

Top Skills

Airflow
Spark
Athena
AWS
Ci/Cd
CloudFormation
DevOps
DynamoDB
Emr
ETL
Git
Glue
Node.js
Olap
Python
Redshift
S3
Terraform
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
San Francisco, California
21 Employees
On-site Workplace
Year Founded: 2021

What We Do

NTD Software is a Mexican company located in Guadalajara, Jalisco, known as "the silicon valley of Mexico." We help both startups and big companies by finding the right people to join their team and creating digital solutions using the latest or well-established programming languages and tools. Our expertise is in building software from the ground up and expanding our clients' existing teams, allowing us to work with businesses globally

Similar Jobs

Atlassian Logo Atlassian

Senior Data Engineer

Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Remote
San Francisco, CA, USA
11000 Employees
136K-218K Annually

AVM Consulting Logo AVM Consulting

Sr. Data Engineer with AWS experience

Information Technology • Software • Consulting
Remote
Los Angeles, CA, USA
100 Employees
100K-220K Annually

Atlassian Logo Atlassian

Sr. Data Engineer

Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Remote
Mountain View, CA, USA
11000 Employees
136K-218K Annually

Atlassian Logo Atlassian

Senior Data Engineer

Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Remote
San Francisco, CA, USA
11000 Employees
136K-218K Annually

Similar Companies Hiring

True Anomaly Thumbnail
Software • Machine Learning • Hardware • Defense • Artificial Intelligence • Aerospace
Colorado Springs, CO
131 Employees
Caliola Engineering Thumbnail
Software • Machine Learning • Hardware • Defense • Data Privacy • App development • Aerospace
Colorado Springs, CO
53 Employees
Red 6 Thumbnail
Virtual Reality • Software • Hardware • Defense • Aerospace
Orlando, Florida
113 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account