We're seeking a talented and motivated Databricks Engineer to join our growing data engineering team. In this role, you will be responsible for designing, developing, and deploying data pipelines and solutions using Databricks, Python, and AWS services. You will play a key role in building and maintaining our data infrastructure to support our business needs.
Responsibilities:
- Design, develop, and maintain scalable and reliable data pipelines using Databricks.
- Write and deploy Python code for data processing and ETL (Extract, Transform, Load) processes.
- Package and deploy Python code effectively for production environments.
- Utilize AWS foundation technologies such as EC2, S3, and SQS to build robust data solutions.
- Implement and adhere to DevOps processes and utilize relevant tools for continuous integration and continuous deployment (CI/CD).
- Write and execute SQL queries for data analysis and manipulation.
- Collaborate with data scientists and analysts to understand their data requirements and provide necessary data infrastructure.
- Monitor and troubleshoot data pipelines and system performance.
- Stay up-to-date with the latest technologies and best practices in data engineering and cloud computing.
- Experience using Python with Apache Spark within the Databricks environment.
- Experience working with Databricks hosted on AWS
- Minimum of 2 years of hands-on experience working with Databricks.
- Strong proficiency in Python programming language.
- Experience with packaging and deployment of Python code.
- Solid understanding of AWS foundation technologies (EC2, S3, SQS, etc.).
- Experience with DevOps processes and tools.
- Proficiency in SQL language.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration skills.
Top Skills
What We Do
Experts in crafting digital products ⚡️
At Thaloz, the mission is to support at every stage of the digital product journey. With a team of over 100 experts and a global presence in 30 countries, we leverage top-tier Latin American talent to deliver exceptional software development solutions that drive success.
Our Services:
→ Product Lab: Comprehensive product development services to build and scale software solutions. From strategy and design to development, testing, and launch, every aspect is handled with expertise.
→ Talent Hub: Accelerate the team-building process by 50% with carefully vetted LATAM talent. Select the team members, and they will be seamlessly integrated into projects under the client's leadership.
→ Enterprise Pod: Optimize operations with streamlined complex integrations and flawless implementations of digital products for B2B companies, ensuring rapid and smooth deployments.
Ready to assist in turning ideas into reality, get in touch through www.thaloz.com/contact-us
Join our community! 👨💻
Instagram: @thalozteam
YouTube: @thalozteam
Clutch: @thaloz
