Lead Data Engineer

Posted 6 Days Ago
Be an Early Applicant
Bengaluru, Karnataka
Senior level
Artificial Intelligence • Big Data • Cloud • Software
The Role
As a Lead Data Engineer at Avathon, you'll architect scalable ETL and MLOps pipelines while mentoring a talented team. You will work with large datasets from renewable energy sources, focusing on optimizing data management systems to deliver insights across various asset types.
Summary Generated by Built In

Who are we and why this opportunity?

Avathon, Inc. delivers world-class AI solutions that allow a business to solve their most critical problems, empowering them to run a more sustainable, safer, and profitable business. Our award-winning AI solutions predict future outcomes, optimize processes, and prevent cyberattacks. We partner with the world’s industry leaders to analyze, optimize, and learn from data. We augment human intelligence, drive profitable growth, and achieve operational excellence.

Drive change and create a footprint. Learn more at: Avathon

Position Summary:

Avathon’s Renewable Suite is the world's leading AI enabled SaaS platform that provides asset performance management and prescriptive analytics software to ever growing renewable energy power plants by combining the power of machine learning, big data, and deep domain expertise. Our platform works across multiple asset types such as wind, solar, storage and DC coupled assets to offer insights to our customers across their fleets. As a Lead Data Engineer you will be working closely with team members across domains with deep technical skills and passion for clean energy.

Join us in:

  • Bringing large volumes of data from wind, solar, storage sites to cloud
  • Architecting scalable data ETL and MLOps pipelines and workflows 
  • Work on engineering projects to design, construct, install, test and maintain highly scalable data management systems
  • Lead a team of talented Data Engineers and mentor the team as part of people responsibility

You’ll have:

  • Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field. 
  • Experience with Python
  • 7+ years of experience building and optimizing ‘big data’ data pipelines, architectures 
    and data sets. 
  • Experience building ETL pipelines from large disconnected datasets. 
  • Experience with big data tools: Hadoop, Spark, Kafka, etc. 
  • Experience with relational databases such as Postgres
  • Experience with Elasticsearch a plus

It would be great if you had: 

  • Experience in renewable energy or IoT time series data
  • Experience in workflow orchestration technologies like Airflow or Prefect
  • Experience with AWS cloud services: EC2, EMR, S3, RDS, Redshift or experience with GCP

Avathon is an equal opportunity employer, dedicated to diversity, equality, and inclusion, and provides equal employment opportunities to all employees and applicants for employment.

Avathon prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws.

Avathon is committed to providing reasonable accommodations throughout the recruiting process. If you need a reasonable accommodation, please contact us to discuss how we can assist you.

Top Skills

Python
The Company
Austin, , Texas
305 Employees
On-site Workplace
Year Founded: 2013

What We Do

Avathon, a leader in Industrial AI, extends the life of critical infrastructure while advancing the journey toward full autonomy. Avathon’s Industrial AI platform empowers commercial and government customers with scalable, secure, and value-driven solutions that enhance efficiency and resilience across heavy industry.

Similar Jobs

Magna International Logo Magna International

Lead Data Engineer

Automotive • Hardware • Robotics • Software • Transportation • Manufacturing
Hybrid
Bangalore, Bengaluru, Karnataka, IND
171000 Employees

Zeta Global Logo Zeta Global

Lead Software Engineer – Big Data

AdTech • Artificial Intelligence • Marketing Tech • Software • Analytics
Easy Apply
Bangalore, Bengaluru, Karnataka, IND
2194 Employees

Avathon Logo Avathon

Lead Data Engineer

Artificial Intelligence • Big Data • Cloud • Software
Bengaluru, Karnataka, IND
305 Employees

Razorpay Logo Razorpay

Lead Data Engineer

eCommerce • Fintech • Payments • Software • Financial Services
Bangalore, Bengaluru, Karnataka, IND
3200 Employees

Similar Companies Hiring

Hedra Thumbnail
Software • News + Entertainment • Marketing Tech • Generative AI • Enterprise Web • Digital Media • Consumer Web
San Francisco, CA
14 Employees
HERE Thumbnail
Software • Logistics • Internet of Things • Information Technology • Computer Vision • Automotive • Artificial Intelligence
Amsterdam, NL
6000 Employees
True Anomaly Thumbnail
Software • Machine Learning • Hardware • Defense • Artificial Intelligence • Aerospace
Colorado Springs, CO
131 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account