Java Tech LeadAbout the Role
We are seeking a highly skilled Java Tech Lead with expertise in Apache Spark and AWS EMR to join our team. This role focuses on enhancing the stability, scalability, and cost-efficiency of UserSession, one of the largest and most critical datasets at Indeed. The ideal candidate will lead efforts to optimize data processing, integrate new datasets, and ensure seamless data availability for key reports.
Key Responsibilities
- Lead the development and optimization of the UserSession data pipeline to improve stability and reduce operational costs.
- Design and implement solutions to integrate new datasets that align with evolving business and analytical needs.
- Ensure high performance and scalability of Apache Spark workloads on AWS EMR.
- Work closely with data engineers, analysts, and business stakeholders to understand requirements and translate them into efficient technical solutions.
- Identify bottlenecks and drive performance improvements in data processing and storage.
- Advocate for best practices in coding, testing, and deployment to ensure high-quality deliverables.
- Mentor junior developers and contribute to team knowledge-sharing initiatives.
Requirements
- Solid experience in Java development, with a strong understanding of multi-threading, concurrency, and performance tuning.
- Proven expertise with Apache Spark, including performance optimization and large-scale data processing.
- Hands-on experience with AWS EMR and a deep understanding of distributed computing.
- Strong knowledge of big data processing architectures and data lake best practices.
- Experience with SQL and NoSQL databases for handling large datasets.
- Familiarity with CI/CD pipelines, version control (Git), and modern deployment strategies.
- Excellent problem-solving skills and a proactive approach to troubleshooting.
- Ability to work in a collaborative environment and communicate technical concepts effectively.
Nice to Have
- Experience with other AWS services (S3, Glue, Redshift, Lambda, etc.).
- Knowledge of Scala or Python for data engineering tasks.
- Exposure to machine learning pipelines or analytics-driven environments.
Top Skills
What We Do
In All Media is a cutting-edge technology and innovation consulting organization, facilitating digital transformation in multiple industries.
We have partnered with top-tier organizations such as NBCUniversal, Sony DADC, Aclara Technologies, and Dun & Bradstreet, among other leading companies worldwide. In All Media harnesses the collaborative synergy of all our international talent pool using Agile methodologies, to deliver excellence efficiently and with the utmost quality.
At In All Media, we believe in diversity and autonomy. Our new model brings together a global managed community, with experts guiding and managing talented engineers; working to bring together the best talent in the world, regardless of where they are. We are not only evolving in terms of technology, but also in terms of In All Media as a re-imagined technology consultancy in step with the Fourth Industrial Revolution.
Our community of 200+ experts and engineers are very motivated by different challenges in their field, and apply continuous learning to stay ahead of the curve in their expertise on new developments and innovative technologies.
Our delivery model is based on Agile, On-site, and Near Shore capabilities to maximize team integration and provide the best value to our clients. We partner holistically with our clients in the co-creation of services and products, and follow streamlined Agile processes throughout.
This makes In All Media a truly global company driven by a community of dedicated, talented individuals self-organizing into multi-disciplinary teams, producing the best possible output for our world-class clients.
We're hiring! Email us your CV: [email protected]
Contact Us: [email protected]
.jpg)
.jpg)
 (1).png)
