Senior Engineer, Data Platforms

Posted 6 Days Ago
Hiring Remotely in USA
Remote
Senior level
Big Data • Healthtech • Software • Analytics
A health data platform built to improve lives.
The Role
As a Senior Engineer, you will enhance Arcadia's data platform by building cloud-event microservices and Apache Spark applications. Your responsibilities include designing scalable big data systems, collaborating with various teams, and mentoring junior engineers to improve software solutions and address critical production issues.
Summary Generated by Built In

Arcadia is dedicated to happier, healthier days for all. We transform diverse data into a unified fabric for health. Our platform delivers actionable insights for our customers to advance care and research, drive strategic growth, and achieve financial success. For more information, visit arcadia.io.


Why This Role Is Important to Arcadia


Arcadia’s business is anchored by its scalable data processing infrastructure and pluggable analytics and data enrichment platform. We collect and store health care data at petabyte scale and have built the tools to enable rapid development and deployment of novel analytics capabilities and content, bringing together a legacy of Arcadia data and modern computation engines. To make this vision a reality, Arcadia has simplified the technologies and databases used to integrate with these computation engines and provides a state-of-the-art development ecosystem for its engineers.

In this role, you will help take this platform to the next level by building out cloudevent microservices and Apache Spark applications that more efficiently move, transform, enrich, or analyze Arcadia’s key data assets. You will help Arcadia provide actionable insights to our health care partners and thereby improve the care for millions of patients. 


What Success Looks Like

In 3 months

- Demonstrated understanding of Arcadia’s healthcare data and high-level system architecture

- Actively contributing to the development of CloudEvent Microservices and/or Spark applications 

- Creating and troubleshooting data platform service and application deployment and orchestration

- Strong grasp of Arcadia’s SDLC and engineering processes

- Positive contributor to technical and architectural discussions

- Fundamental understanding of Semantic/Linked Data and FHIR


In 6 months

- Deep familiarity with Arcadia’s data enrichment and analytics systems

- Comfortable with Arcadia’s unified Kubernetes ecosystem for Spark and CloudEvent Microservices

- Proficient in Arcadia’s CI/CD pipelines, including GitHub Actions, ArgoCD, and Helm

- Fully proficient in developing CloudEvent Microservices and Spark applications

- Collaborating with Architects to design solutions to new development projects


In 12 months 

- Highly proficient in core components of the Arcadia data platform and approach to deploying and managing production applications

- Acting as tech lead on new development projects, including end-to-end ownership of software development and delivery

- Identifying areas for technical improvement and innovation 

What You'll Be Doing

  • Working alongside a talented engineering team to design and implement horizontally scalable big data systems processing over a billion records nightly
  • Utilizing cloud-native technologies like Kubernetes, Kafka, Spark, Hudi, Cassandra (Scylla), CloudEvent Microservices, and Nifi - Advancing Arcadia’s flagship product on the AWS cloud platform
  • Leading full-stack design and development of key software components for Arcadia’s platform
  • Architecting and building cloud-event microservices and Spark applications for real-time and batch processing
  • Collaborating with engineers, QA analysts, product specialists, and subject matter experts to deliver quality solutions
  • Debugging and responding to critical production issues impacting customer workflows
  • Mentoring junior engineers and contributing to their growth and development
  • Reviewing code, contributing to architectural decisions, and champion best practices
  • Documenting architectural designs and development tasks to support the engineering lifecycle
  • Driving the adoption of emerging development tools to maintain efficient local development environments
  • Leveraging CI/CD tools like Gradle, GitHub Actions, and ArgoCD to streamline deployment

What You'll Bring

  • Passionate about solving complex, large-scale distributed systems problems and possesses a deep understanding of distributed computing, parallel processing, and big data tech
  • 5+ years of experience in distributed systems and cloud-native technologies
  • Proficiency with Java, Spark, and Kubernetes
  • Extensive experience with cloud platforms (AWS, GCP, or Azure)
  • Familiarity with Data Lake and Lakehouse architecture
  • Strong knowledge of Agile software development processes and CI/CD pipelines
  • Experience mentoring junior engineers and influencing architectural decisions

Would Love For You To Have

  • Experience working with Open Table Formats (Hudi, Iceberg, Delta)
  • Familiarity with healthcare data and standards (FHIR, HL7, etc.)
  • Experience working in a security- and compliance-heavy industry (healthcare, finance, etc.)

What You'll Get

  • The opportunity to be a part of the team that is building the modern data platform for healthcare, using exciting, cutting-edge technologies to enable meaningful change in a massively complex industry
  • Be a part of a mission driven company that is transforming the healthcare industry by changing the way patients receive care
  • A flexible, remote friendly company with personality and heart
  • Employee driven programs and initiatives for personal and professional development
  • Be a member of the Arcadian and Barkadian Community 

About Arcadia

Arcadia.io helps innovative providers and payers across the country transform healthcare to reduce cost while improving patient health. We do this by aggregating large amounts of disparate data, applying algorithms to identify opportunities to provide better patient care, and making those opportunities actionable by physicians at the point of care in near-real time. We are passionate about helping our customers drive meaningful outcomes. We are growing fast and have emerged as a market leader in the highly competitive population health management software market and have been recognized by industry analysts KLAS, IDC, Forrester, and Chilmark for our leadership. For a better sense of our brand and products, please explore our website.


Protect Yourself

If you have concerns about the authenticity of a job offer or recruitment-related communication claiming to be from Arcadia, we encourage you to verify by contacting us directly at (781) 202-3600 and select option 3. For more information, visit our website.


This position is responsible for following all Security policies and procedures in order to protect all PHI under Arcadia's custodianship as well as Arcadia Intellectual Properties. For any security-specific roles, the responsibilities would be further defined by the hiring manager.

Top Skills

Spark
Kafka
Kubernetes

What the Team is Saying

Kelsey
Jacob
Sarah
Gary
Julie
Geo
Mike
The Company
HQ: Boston, MA
370 Employees
Hybrid Workplace
Year Founded: 2002

What We Do

Arcadia is dedicated to happier, healthier days for all. We transform diverse data into a unified fabric for health. Our platform delivers actionable insights for our customers to advance care and research, drive strategic growth, and achieve financial success. For more information, visit arcadia.io.

Why Work With Us

Solving extremely technical challenges in healthcare that will directly impact patient outcomes globally. We have a deep commitment to a shared mission based on improving the healthcare ecosystem.

... and we have a lot of fun doing it!

Gallery

Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery

Arcadia Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

Remote first company with an office in Boston, MA. Employees have flexibility to come onsite, as desired.

Typical time on-site: Not Specified
HQBoston, MA
Our new corporate headquarters is located in the Seaport, a short walk from South Station. Easily accessible by public transit (MBTA, commuter rail, South Station Bus Terminal) and a short 30 minute Uber from Logan airport. A close walk to nearby coffee shops, restaurants, bars, and sights.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account