Senior Data Engineer(SSE)

Posted 4 Days Ago
Be an Early Applicant
Hyderabad, Telangana
Senior level
eCommerce • Logistics
The Role
The Senior Data Engineer will design, develop, and maintain data infrastructure for streaming, processing, and storage. Responsibilities include building maintenance tools, contributing to architectural decisions, collaborating on scalable solutions, and enforcing data retention policies. They will enhance team capabilities through knowledge sharing and best practices.
Summary Generated by Built In

Ninja Van is a late-stage logtech startup that is disrupting a massive industry with innovation and cutting edge technology. Launched 2014 in Singapore, we have grown rapidly to become one of Southeast Asia's largest and fastest-growing express logistics companies. Since our inception, we’ve delivered to 100 million different customers across the region with added predictability, flexibility and convenience. Join us in our mission to connect shippers and shoppers across Southeast Asia to a world of new possibilities. 


More about us: 

- We process 250 million API requests and 3TB of data every day.

- We deliver more than 2 million parcels every day.

- 100% network coverage with 2600+ hubs and stations in 6 SEA markets (Singapore, Malaysia, Indonesia, Thailand, Vietnam and Philippines), reaching 500 million consumers.

- 2 Million active shippers in all e-commerce segments, from the largest marketplaces to the individual social commerce sellers.

- Raised more than US$500 million over five rounds.


We are looking for world-class talent to join our crack team of engineers, product managers and designers. We want people who are passionate about creating software that makes a difference to the world. We like people who are brimming with ideas and who take initiative rather than wait to be told what to do. We prize team-first mentality, personal responsibility and tenacity to solve hard problems and meet deadlines. As part of a small and lean team, you will have a very direct impact on the success of the company.

Roles & Responsibilities

  • Design, develop, and maintain Ninja Van's infrastructure for data streaming, processing, and storage.
  • Build tools to ensure effective maintenance and monitoring of the data infrastructure.
  • Contribute to key architectural decisions for data pipelines and lead the implementation of major initiatives.
  • Collaborate with stakeholders to deliver scalable and high-performance solutions for data requirements, including extraction, transformation, and loading (ETL) from diverse data sources.
  • Enhance the team's data capabilities by sharing knowledge, enforcing best practices, and promoting data-driven decision-making.
  • Develop and enforce Ninja Van's data retention policies and backup strategies, ensuring data is stored redundantly and securely.

Requirements

  • Strictly looking 5+ years of experience in a similar role, with a proven track record of building scalable and high-performance data infrastructure using Python, PySpark, Spark, and Airflow.
  • Solid computer science fundamentals, excellent problem-solving skills, and a strong understanding of distributed computing principles.
  • Expert-level SQL knowledge and extensive experience working with both relational and NoSQL databases.
  • Advanced knowledge of Apache Kafka, along with demonstrated proficiency in Hadoop v2, HDFS, and MapReduce.
  • Hands-on experience with stream-processing systems (e.g., Storm, Spark Streaming), big data querying tools (e.g., Pig, Hive, Spark), and data serialization frameworks (e.g., Protobuf, Thrift, Avro).
  • [Good to have] Familiarity with infrastructure-as-code technologies like Terraform, Terragrunt, Ansible, or Helm. Don’t worry if you don’t have this experience—what matters is your interest in learning!
  • [Good to have] Experience with Change Data Capture (CDC) technologies such as Maxwell or Debezium.
  • Bachelor’s or Master’s degree in Computer Science or a related field from a top university.

Tech Stack

Backend: Play (Java 8+), Golang, Node.js, Python, FastAPI

Frontend: AngularJS, ReactJS

Mobile: Android, Flutter, React Native

Cache: Hazelcast, Redis

Data storage: MySQL, TiDB, Elasticsearch, Delta Lake

Infrastructure monitoring: Prometheus, Grafana

Orchestrator: Kubernetes

Containerization: Docker, Containerd

Cloud Provider: GCP, AWS

Data pipelines: Apache Kafka, Spark Streaming, Maxwell/Debezium, PySpark, TiCDC

Workflow manager: Apache Airflow

Query engines: Apache Spark, Trino


Submit a job application

By applying to the job, you acknowledge that you have read, understood and agreed to our Privacy Policy Notice (the “Notice”) and consent to the collection, use and/or disclosure of your personal data by Ninja Logistics Pte Ltd (the “Company”) for the purposes set out in the Notice. In the event that your job application or personal data was received from any third party pursuant to the purposes set out in the Notice, you warrant that such third party has been duly authorised by you to disclose your personal data to us for the purposes set out in the the Notice. 

Top Skills

Airflow
Apache Kafka
Hadoop
MySQL
Pyspark
Python
Spark
SQL
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
4,902 Employees
On-site Workplace
Year Founded: 2014

What We Do

Ninja Van Group is a tech-enabled logistics organisation, backed by marquee investors including GeoPost, Alibaba Group, and B Capital Group. Launched in 2014 as an e-commerce express logistics company, it reached 100% network coverage by 2018 with over 2,000 stations and hubs across Southeast Asia. Today, around two million parcels course through its network daily. A decade of operations fortified Ninja Van Group’s e-commerce express network, enabling concurrent diversification across the realms of e-commerce and express logistics. To maximise its scale in e-commerce, Ninja Van Group offers a comprehensive suite of solutions – from digital to full-funnel marketing – to help shippers sell better. As a springboard for expansion beyond e-commerce, Ninja Van Group's e-commerce express network lays the groundwork for venturing into other express verticals, including business-to-business inventory restocking and cold chain.

Similar Jobs

MassMutual India Logo MassMutual India

Data Engineer - Lead

Big Data • Fintech • Information Technology • Insurance • Financial Services
Hyderabad, Telangana, IND

TransUnion Logo TransUnion

Sr Analyst - Data Engineer

Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
Hybrid
Hyderabad, Telangana, IND
13000 Employees

Zeta Global Logo Zeta Global

CDP ETL & Database Engineer

AdTech • Artificial Intelligence • Marketing Tech • Software • Analytics
Easy Apply
Hybrid
Hyderabad, Telangana, IND
2194 Employees

Accenture Logo Accenture

Data Platform Engineer

Information Technology
Hyderabad, Telangana, IND
456553 Employees

Similar Companies Hiring

Cencora Thumbnail
Pharmaceutical • Logistics • Healthtech
Conshohocken, PA
46000 Employees
Air Space Intelligence Thumbnail
Transportation • Software • Machine Learning • Logistics • Artificial Intelligence • Aerospace
Boston , Massachusetts
109 Employees
HERE Technologies Thumbnail
Software • Logistics • Internet of Things • Information Technology • Computer Vision • Automotive • Artificial Intelligence
Amsterdam, NL
6000 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account