Software Engineer, Data Platform

Posted 21 Days Ago
2 Locations
Mid level
Information Technology • Internet of Things
The Role
Build and maintain data pipelines and infrastructure for the Middesk platform, ensuring high-quality data and scalability. Collaborate with teams to support new product features.
Summary Generated by Built In

About Middesk:

Middesk makes it easier for businesses to work together. Since 2018, we’ve been transforming business identity verification, replacing slow, manual processes with seamless access to complete, up-to-date data. Our platform helps companies across industries confidently verify business identities, onboard customers faster, and reduce risk at every stage of the customer lifecycle.

Middesk came out of Y Combinator, is backed by Sequoia Capital and Accel Partners, and was recently named to Forbes Fintech 50 List and cited as an industry leader in business verification by digital identity strategy firm, Liminal.

About Middesk Engineering:

"Velocity" is the rate at which we effect realized value for our customers, not the rate at which we ship code. We believe that great products result when technical excellence and craft is combined with deep understanding of our customers and the problems we can help them solve. We’re a humble, self-motivated team that seeks to ship early and ship often; we pride ourselves with being willing to roll up our sleeves to solve even the messiest problems our customers present to us.  Middesk Engineering is customer-first engineering.

 The Role:

Middesk is, at its core, a data company. We live and die by the quality of our data asset and the engine that powers it. We’re on a mission to build a comprehensive and complete business dataset for every business in the world. As part of the Foundation team at Middesk, you’ll collaborate with Data Science, Infrastructure and Data Engineering to build and maintain our own proprietary Entity Resolution system used to power the Middesk business identity platform, scaling our system to resolve millions of business identities across hundreds of data sources and thousands of distinct data sets. You’ll often work with and support product engineers looking to launch new products and features.

The ideal candidate is ready to learn relentlessly, eager to learn a wide-breadth of technologies and software stacks,  build and scale our data infrastructure and data pipelines and connect them into our core business verification products. 

We follow a hybrid work model, and for this role, there is an expectation of 2 days per week in our SF or NYC office. Candidates should be based within a commutable distance, as we believe in the value of in-person collaboration and building strong team connections while also supporting flexibility where possible.

What You'll Do:  

  • Build the batch and streaming data pipelines critical to Middesk’s data infrastructure using Airflow, BigQuery, Dataflow, Dataproc and VertexAI.

  • Build reliable, scalable, maintainable, and cost-efficient systems across the stack.

  • Build, scale and extend existing web scraping platforms and capabilities used for real-time data acquisition.

  • Build, update and maintain our interface layer between our application and data platform stack to improve performance and as we continue to scale our platform and datasets. 

What We’re Looking For:

  • 3+ years of experience working in a data engineering or backend engineering role

  • Strong programming skills in at least one backend language and web application framework

  • Knowledge of SQL and experience with RDMS like postgresql, mySQL, etc.

Nice to Haves:

  • Fluency with Ruby, Python or Go

  • Experience building and designing collections stored on ElasticSearch 

  • Experience working with Airflow or other orchestration platforms 

  • Experience working on data pipelines and data streaming with tools like Spark or Kafka

  • Experience building machine learning systems

  • Experience with Terraform, Datadog, or Kubernetes

  • Experience with scraper technologies, including agentic AI

Top Skills

Airflow
BigQuery
Datadog
Dataflow
Dataproc
Elasticsearch
Go
Kafka
Kubernetes
MySQL
Postgres
Python
Ruby
Spark
SQL
Terraform
Vertexai
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
New York, New York
94 Employees
On-site Workplace
Year Founded: 2019

What We Do

Middesk's mission is to enable every business to access the products and services they need to grow and thrive. We believe that if we can make it easy for a business to access financial products, hire new employees, and transact with other businesses, that we increase the odds of success for that business to contribute to its community and the broader economy.

Our Identity product provides accurate, complete information that financial services companies need to make efficient onboarding decisions. Our Agent product makes it easy for employers to file with the state and federal agencies needed to establish their business across the country. Our customers include Affirm, Brex, Plaid, Mercury, Divvy, Rippling, Gusto, and others.

Based in San Francisco, CA, Middesk is backed by Sequoia Capital, Accel Partners, and Y Combinator

Similar Jobs

Celonis Logo Celonis

Data Platform Software Engineer

Big Data • Information Technology • Productivity • Software • Analytics • Business Intelligence • Consulting
Hybrid
New York, NY, USA
3000 Employees
166K-204K Annually

Notion Logo Notion

Software Engineer, Data Platform

Artificial Intelligence • Productivity • Software
Hybrid
2 Locations
800 Employees

Squarespace Logo Squarespace

Senior Software Engineer, Data Platform

Consumer Web • eCommerce • Marketing Tech • Payments • Software • Design • SEO
Hybrid
New York, NY, USA
1723 Employees

Current Logo Current

Senior Software Engineer, Data/ML Platform

Fintech • Mobile • Payments • Software • Financial Services • Cryptocurrency
Easy Apply
Hybrid
New York, NY, USA
200 Employees

Similar Companies Hiring

Jobba Trade Technologies, Inc. Thumbnail
Software • Professional Services • Productivity • Information Technology • Enterprise Web • Consulting • Cloud
Chicago, IL
45 Employees
InCommodities Thumbnail
Renewable Energy • Machine Learning • Information Technology • Energy • Automation • Analytics
Austin, TX
234 Employees
HERE Technologies Thumbnail
Software • Logistics • Internet of Things • Information Technology • Computer Vision • Automotive • Artificial Intelligence
Amsterdam, NL
6000 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account