Senior MLOps Engineer

Company Overview:

Cohere Health is a fast-growing clinical intelligence company that’s improving lives at scale by promoting the best patient-specific care options, using cutting-edge AI combined with deep clinical expertise. In only four years our solutions have been adopted by health plans covering over 15 million lives, while our revenues and company size have quadrupled.  That growth combined with capital raises totaling $106M positions us extremely well for continued success. Our awards include: 2023 and 2024 BuiltIn Best Place to Work; Top 5 LinkedIn™ Startup; TripleTree iAward; multiple KLAS Research Points of Light awards, along with recognition on Fierce Healthcare's Fierce 15 and CB Insights' Digital Health 150 lists.

Opportunity Overview:

Last but not least: People who succeed here are empathetic teammates who are candid, kind, caring, and embody our core values and principles. We believe that diverse, inclusive teams make the most impactful work. Cohere is deeply invested in ensuring that we have a supportive, growth-oriented environment that works for everyone.

What you will do:

You will be leading the deployment, management, and optimization of advanced ML models, including LLMs. You will collaborate with cross-functional teams to architect scalable solutions, improve our core technologies, and drive the strategic direction of our ML infrastructure. This role requires a blend of technical expertise and leadership skills to elevate our ML operations to the next level.

What you will do:

• Strategic Leadership
  • Define and implement the overall MLOps strategy to support the deployment and scaling of ML models. 
  • Lead the architectural design of ML infrastructure, ensuring scalability, reliability, and efficiency. 
  • Collaborate with leadership to align ML initiatives with business objectives.
• LLM Deployment and Management
  • Oversee the deployment, scaling, and optimization of LLMs.
  • Develop strategies to reduce latency and manage costs effectively.
  • Stay updated on the latest advancements in LLMs and integrate relevant technologies
• Core Technology Enhancement
  • Lead the development and improvement of core technology components and system architecture.
  • Work with engineering teams to ensure seamless integration of ML solutions into products and services.
  • Evaluate and implement new tools and technologies to enhance the ML infrastructure.
• Automation and Efficiency
  • Architect and build automated ML pipelines, including data preprocessing, model training, and deployment.
  • Implement robust CI/CD pipelines for ML models to facilitate continuous integration and delivery.
  • Optimize workflows to increase efficiency and reduce time-to-market for ML solutions.
• Monitoring and Optimization
  • Establish monitoring systems to track model performance, data drift, and system health.
  • Proactively identify and resolve issues to maintain high availability and reliability of ML services.
  • Perform regular audits and optimizations to enhance system performance.
• Mentorship and Collaboration
  • Mentor and guide junior ML engineers in MLOps best practices.
  • Foster a culture of innovation, collaboration, and continuous improvement within the team.
  • Engage with cross-functional teams to drive cohesive and integrated solutions.
• Security and Compliance
  • Ensure all ML systems comply with security standards and regulatory requirements.
  • Implement data governance policies and practices to protect sensitive information.

Your background & requirements:

• Master's or Ph.D. (preferred) in Computer Science, Engineering, or a related field.
• 5+ years of experience in MLOps, ML Engineering, or related roles.
• Proven track record of deploying and managing large-scale machine learning models, especially LLMs.
• Deep expertise in programming languages such as Python.
• Extensive experience with ML frameworks like TensorFlow or PyTorch.
• Experience with cloud platforms (AWS preferred, GCP, or Azure) and containerization technologies (Docker, Kubernetes).
• Strong understanding of CI/CD pipelines, automation tools, and infrastructure as code.
• Familiarity with big data technologies (Spark, Hadoop) and distributed computing.
• Experience with monitoring and logging tools (e.g. MLFlow, Tensorboard, ELK Stack).
• Exceptional problem-solving skills and the ability to navigate complex technical challenges.

Nice to have:

• Strong understanding of transformer models and advanced NLP techniques.
• Working knowledge of infrastructure as code tools (e.g. Terraform).
• Proven leadership skills with experience in mentoring and team development.
• Excellent communication skills with the ability to convey complex concepts to non-technical stakeholders.
• Experience in the healthcare sector.

We can’t wait to learn more about you and meet you at Cohere Health!

Equal Opportunity Statement: 

Cohere Health is an Equal Opportunity Employer. We are committed to fostering an environment of mutual respect where equal employment opportunities are available to all.  To us, it’s personal.

The salary range for this position is $150,000 to $170,000 annually; as part of a total benefits package which includes health insurance, 401k and bonus. In accordance with state applicable laws, Cohere is required to provide a reasonable estimate of the compensation range for this role. Individual pay decisions are ultimately based on a number of factors, including but not limited to qualifications for the role, experience level, skillset, and internal alignment.

#LI-Remote

#BI-Remote