The Role
The Data Engineer designs and maintains data pipelines, ensuring data flow, integrity, and performance while collaborating with teams for actionable insights.
Summary Generated by Built In
- Design, implement, and maintain data pipelines to ensure seamless flow of data from various sources to storage systems.
- Work with large, complex datasets to ensure high performance, availability, and scalability of data systems.
- Collaborate with data scientists, analysts, and other engineering teams to deliver insights and business value from structured and unstructured data.
- Implement ETL (Extract, Transform, Load) processes to ensure accurate and efficient data processing.
- Develop and optimize data infrastructure and architecture for efficient storage and retrieval.
- Troubleshoot and resolve data issues, ensuring data integrity and accuracy.
- Ensure compliance with data governance, security policies, and industry best practices.
- Monitor and report on system performance, ensuring minimal downtime and maximum operational efficiency.
- Continuously evaluate and improve data processes, infrastructure, and tools.
- Proven experience (3+ years) as a Data Engineer or similar role in data management, processing, and analytics.
- Experience with data modeling, ETL frameworks, and big data tools like Apache Hadoop, Spark, Kafka, etc.
- Proficiency in programming languages such as Python, Java, Scala, or SQL.
- Hands-on experience with relational databases (e.g., MySQL, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra).
- Familiarity with cloud platforms like AWS, Azure, or Google Cloud for data storage and processing.
- Experience with data warehousing solutions and BI tools such as Snowflake, Redshift, or BigQuery.
- Solid understanding of data pipeline automation, version control, and continuous integration/continuous deployment (CI/CD) best practices.
- Strong analytical and problem-solving skills with attention to detail.
- Ability to work in a fast-paced and collaborative environment.
- Excellent communication skills, both verbal and written, to interact with technical and non-technical teams.
- Ability to handle multiple tasks and deadlines effectively.
- Willingness to learn new technologies and continuously improve technical skills.
- Experience with data visualization and reporting tools is a plus (e.g., Tableau, Power BI).
- Knowledge of machine learning or data science concepts is a bonus.
Top Skills
Apache Hadoop
AWS
Azure
BigQuery
Cassandra
GCP
Java
Kafka
MongoDB
MySQL
Postgres
Power BI
Python
Redshift
Scala
Snowflake
Spark
SQL
Tableau
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
We integrate global leaders in web development with passionate Asian talent to get a unique blend of Quality and Affordability.
We are headquartered in California and work consistent eastern and pacific standard hours.
We like ad hoc pairing as necessary, TDD, and working with other agencies to make things happen.
We contribute to open source projects and genuinely enjoy coding. We are also committed to teaching, and spreading knowledge!
