We are looking for a talented Lead - Data Engineering with big data processing experience to join our Agile development team in building products to support Merkle’s people based marketing vision using the latest data and cloud technologies. You will work with a team of passionate, experienced, nimble, and goal-oriented engineers that are solving complex problems and critical data analysis and reporting features. You will embrace change, and rapidly build, test, and scale solutions that drive incremental business value for our customers and partners. We’re looking for smart, enthusiastic, driven individuals who are eager to contribute to our world class solutions.
Job Description:
Reports to: Technical architect / Business Manager
Manages: Team of 3 – 7 data engineers / developers / analysts
Key Responsibilities
- Design, implement, and deploy enterprise data solutions using cutting-edge cloud-based technologies
- Follow Agile methodologies to rapidly release iterative product features
- Research and introduce new solutions and technologies to the project and stakeholders, provide technical guidance and suggest improvements in development
- Work independently, without guidance, with broader overview on the project
- Coordinate with other teams as part of a larger data-sharing system
- Employ software development best practices such as automated testing, peer code reviews, continuous integration, and continuous delivery
- Translate business requirements and develop technical specifications
- Communicate clearly and document processes
- Perform quality assurance and testing of your work
- Contribute to a collaborative, positive, stimulating, and enjoyable environment for your development team
Qualifications & Required Skills
- Bachelor’s degree in Computer Science, Engineering, Information Systems or equivalent experience
- Must have minimum 5+ years of work experience with programming languages and object-oriented design (Python preferred)
- Must have strong database fundamentals including SQL, relational and non-relational data models and schema designs, and understanding of database performance implications
- Must have understanding of cloud-based technologies such as AWS, GCP or Azure
- Understanding of “Big Data” ETL methodologies and managing large scale data sets
- Strong understanding of data structures, algorithms, and distributed systems
- Must have experience leveraging automated tests for code validation and test-driven development
- Must have experience building and deploying products using continuous integration principles
- Must have working knowledge of software engineering and development methodologies, techniques, and tools, including Issue Tracking (like JIRA), code repositories (like Git, Bitbucket) and the Software Development Lifecycle
- Experience building workflow orchestration, logging, error handling and automated testing utilizing Python and Pytest framework
Desired Skills:
- Experience with Snowflake data warehouse including scheduled tasks, table streams and JavaScript stored procedures
- Experience with data processing workflow systems (Apache Nifi, Talend or Airflow)
- Experience with creating reports, dashboards and visualizations (Tableau preferred)
Location:
Bengaluru
Brand:
Merkle
Time Type:
Full time
Contract Type:
Permanent
Top Skills
What We Do
We are dentsu. We team together to help brands predict and plan for disruptive future opportunities and create new paths to growth in the sustainable economy. We know people better than anyone else and we use those insights to connect brand, content, commerce and experience, underpinned by modern creativity. We are the network designed for what’s next
 (1).png)
