The Role
The Senior Data Engineer will design and maintain data pipelines for machine learning and GenAI applications. Responsibilities include data ingestion and transformation, ensuring data quality, optimizing infrastructure, and collaborating with ML engineers and data scientists for integration.
Summary Generated by Built In
Octopus by RTG is on a mission of connecting top notch ogranizations around the globe with top notch talents. We are currently looking for a Senior Data Engineer.
Responsibilities:
- Design, develop, and maintain robust data pipelines to support machine learning workflows and GenAI applications.
- Implement data ingestion, transformation, and storage solutions for structured and unstructured data.
- Ensure data quality, integrity, and consistency across the entire pipeline.
- Optimize data infrastructure for scalability, performance, and cost-efficiency.
- Implement real-time data processing workflows
- Collaborate with ML engineers and data scientists to ensure seamless integration of data pipelines with models and applications.
- Proficiency in programming languages for data processing (e.g., Python, Scala, Java).
- Strong experience with big data technologies (e.g., Hadoop, Spark) and ETL tools.
- Familiarity with data storage systems (e.g., SQL databases, NoSQL databases, data lakes).
- Strong Experience with vector databases and embedding stores
- Experience with cloud platforms and data services (e.g., AWS Redshift, Google BigQuery, Azure Data Factory).
- Knowledge of data modeling, warehousing, and real-time processing frameworks (e.g., Kafka, Flink).
- Strong problem-solving skills and ability to work in cross-functional teams.
Top Skills
Java
Python
Scala
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Resume Uploaded Successfully
The Company
What We Do
Robusta Technology Group (RTG) | Empowering the tech landscape with innovative digital solutions, expertise, and collaboration. Join us to unlock your business' growth potential.
#TechForGrowth #DigitalTransformation
