Distributed Software Engineer

Posted 6 Days Ago
Be an Early Applicant
2 Locations
Senior level
Artificial Intelligence
The Role
As a Distributed Software Engineer, you will automate configuration, develop orchestration systems, and ensure robust monitoring for large-scale AI Supercomputers in a cluster environment. This role involves working with various software and tools to minimize downtime and enhance resource management in both on-premise and cloud deployments.
Summary Generated by Built In

Cerebras Systems has pioneered a groundbreaking chip and system that revolutionizes deep learning applications. Our system empowers ML researchers to achieve unprecedented speeds in training and inference workloads, propelling AI innovation to new horizons. 

Condor Galaxy 1 (CG-1), a supercomputer set to revolutionize the world of artificial intelligence. With an astounding processing power of 4 ExaFLOPs, 54 million cores, and a cutting-edge 64-node architecture, the CG-1 is the first milestone of a larger project that will redefine the possibilities of AI. 

The successful completion and deployment of the CG-1, the first of nine powerful supercomputers, is a significant achievement for Cerebras. As we enter phase 2 of the project with CG2, we are taking a bold step towards creating a network of interconnected supercomputers that will collectively deliver a mind-boggling 36 ExaFLOPs of AI compute power upon completion.  

The Role

Cerebras Systems is a pioneer in large-scale AI Supercomputers. These multi-exaflop supercomputers are deployed in some of the biggest datacenters. These supercomputers are built using our Wafer-Scale Cluster technology - a cluster of several Wafer Scale Engine (WSE) chips. The Cluster engineering team is responsible for delivering software that are all-things related to cluster.

Responsibilities 

  • Automate bare-metal configuration of networking, OS, and application software in large clusters of Cerebras WSE, servers, and switches
  • Additional push button workflows for cluster upgrades, downgrades, and security patching with key metrics to minimize downtime on clusters
  • An orchestration and scheduler system for resource allocation, job submission & placements for a multi-user environment on a cluster
  • Seamless support for both on-premise and cloud mode deployment and operations
  • A robust system for monitoring, detecting and handling failures for a variety of resources on the clusters (including High Availability of clusters)
  • Broad cluster and job monitoring and visualization capabilities, along with alerting systems
  • User facing tools to monitor the status of jobs and collect metrics
  • Administrator facing tools to manage and operate large clusters

Skills and Qualifications 

  • Strong track record of software architecture, system design and development for over 6 years or more
  • Strong track record of development in distributed cluster environment.
  • Strong understanding of Kubernetes (K8s) software ecosystem, Prometheus and Grafana
  • Strong development skills in GoLang, Python, bash
  • Strong debugging skills with distributed systems
  • Strong skill to develop tests for the new features and regress old features

Why Join Cerebras

People who are serious about software make their own hardware. At Cerebras we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. With dozens of model releases and rapid growth, we’ve reached an inflection  point in our business. Members of our team tell us there are five main reasons they joined Cerebras:

  1. Build a breakthrough AI platform beyond the constraints of the GPU
  2. Publish and open source their cutting-edge AI research
  3. Work on one of the fastest AI supercomputers in the world
  4. Enjoy job stability with startup vitality
  5. Our simple, non-corporate work culture that respects individual beliefs

Read our blog: Five Reasons to Join Cerebras in 2024.

Apply today and become part of the forefront of groundbreaking advancements in AI.

Cerebras Systems is committed to creating an equal and diverse environment and is proud to be an equal opportunity employer. We celebrate different backgrounds, perspectives, and skills. We believe inclusive teams build better products and companies. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them.

This website or its third-party tools process personal data. For more details, click here to review our CCPA disclosure notice.

Top Skills

Go
Python
The Company
HQ: Sunnyvale, CA
402 Employees
On-site Workplace
Year Founded: 2016

What We Do

Cerebras Systems is a team of pioneering computer architects, computer scientists, deep learning researchers, functional business experts and engineers of all types. We have come together to build a new class of computer to accelerate artificial intelligence work by three orders of magnitude beyond the current state of the art.

The CS-2 is the fastest AI computer in existence. It contains a collection of industry firsts, including the Cerebras Wafer Scale Engine (WSE-2). The WSE-2 is the largest chip ever built. It contains 2.6 trillion transistors and covers more than 46,225 square millimeters of silicon. The largest graphics processor on the market has 54 billion transistors and covers 815 square millimeters. In artificial intelligence work, large chips process information more quickly producing answers in less time. As a result, neural networks that in the past took months to train, can now train in minutes on the Cerebras CS-2 powered by the WSE-2.

Join us: https://cerebras.net/careers/

Similar Jobs

Hybrid
Toronto, ON, CAN
832 Employees

Cash App Logo Cash App

Staff Software Engineer, Cash App Web Infrastructure

Blockchain • Fintech • Mobile • Payments • Software • Financial Services
Remote
Hybrid
Kitchener, ON, CAN
3500 Employees
196K-304K Annually

Square Logo Square

Senior Software Engineer, Bank Accounts

eCommerce • Fintech • Hardware • Payments • Software • Financial Services
Remote
Hybrid
Toronto, ON, CAN
12000 Employees
162K-251K Annually

Block Logo Block

Senior Software Engineer, Bank Accounts

Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Remote
Hybrid
Toronto, ON, CAN
12000 Employees
162K-251K Annually

Similar Companies Hiring

RunPod Thumbnail
Software • Infrastructure as a Service (IaaS) • Cloud • Artificial Intelligence
Charlotte, North Carolina
53 Employees
HERE Thumbnail
Software • Logistics • Internet of Things • Information Technology • Computer Vision • Automotive • Artificial Intelligence
Amsterdam, NL
6000 Employees
True Anomaly Thumbnail
Software • Machine Learning • Hardware • Defense • Artificial Intelligence • Aerospace
Colorado Springs, CO
131 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account