Data Reliability Engineer

Data Reliability Engineer

São Paulo-SP, Brazil or Porto Alegre-RS, Brazil

Who We Are

In 2021, Poatek was acquired by WillowTree, an award-winning digital product consultancy recognized as one of the fastest growing and best places to work in the United States. Now a TELUS Digital, with offices across the globe, we continue to partner with the world’s leading brands, such as HBO, PepsiCo, Domino’s and more, to design, build, and transform their digital products and strategies. We’re looking to grow our Poatek offices in Brazil with top talent excited to collaborate with team members across the globe to deliver innovative solutions for our clients. 

Qualifications

• 5+ years of hands-on experience in supporting data engineering teams, strongly emphasizing data pipeline enhancement and optimization, and data integration.
• Proficient in cloud computing, preferably Google Cloud Platform (GCP), but AWS and Azure are also valid. 
• Experience with cloud data-related services such as BigQuery, Dataflow, Cloud Composer, Dataproc, Cloud Storage, Pub/Sub, or the correlated services from other providers.
• Solid proficiency with Python in terms of data processing.
• Knowledge of SQL and experience with relational databases.
• Proven experience optimizing data pipelines toward efficiency, reducing operational costs, and reducing the number of issues/failures.
• Solid knowledge of monitoring, troubleshooting, and resolving data pipeline issues.
• Familiarity with version control systems like Git.
• Strong English communication and documentation skills.

Responsibilities:

• Design and implement scalable data pipeline architectures in collaboration with Data Engineers.
• Continuously optimize data pipeline efficiency to reduce operational costs and minimize issues and failures.
• Monitor performance and reliability of data pipelines, enhancing reliability through data quality, analysis, and testing.
• Build and manage automated alerting systems for data pipeline issues.
• Automate repetitive tasks in data processing and management.
• Develop and manage disaster recovery and backup plans.
• In collaboration with other Data Engineering teams, conduct capacity planning for data storage and processing needs.
• Develop and maintain comprehensive documentation for data pipeline systems and processes, and provide knowledge transfer to data-related teams.
• Monitor, troubleshoot and resolve production issues in data processing workflows.
• Maintain infrastructure reliability for data pipelines, enterprise datahub, HPBI, and MDM systems. 
• Conduct post-incident reviews and implement improvements for data pipelines.

Why Poatek?

In addition to being part of an international and innovative consultancy company, you will have:

• Flexible hours and autonomy
• Work with cutting edge technologies
• Partner with global and relevant brands in the market
• Collaborative team and learning ecosystem
• Career development plan & growth
• Internacional travel opportunities (optional)

Some of our benefits: 

• Health and dental plan
• Life insurance
• Monthly voucher for meals, culture, education, health and mobility
• Child care assistance and more!

We will only use the information you provide to process your application and to produce tracking statistics. Since we do not request personal data deemed sensitive, we ask you to abstain from sharing those information with us.

For more information on how we use your information, see our Privacy Policy.