About Us:
At Zyte, we eat data for breakfast and you can eat your breakfast anywhere and work for Zyte. Founded in 2010, we are a globally distributed team of over 240 Zytans working from over 28 countries who are on a mission to enable our customers to extract the data they need to continue to innovate and grow their businesses. We believe that all businesses deserve a smooth pathway to data
For more than a decade, Zyte has led the way in building powerful, easy-to-use tools to collect, format, and deliver web data, quickly, dependably, and at scale. And today, the data we extract helps thousands of organizations make smarter business decisions, secure competitive advantage, and drive sustainable growth. Today, over 3,000 companies and 1 million developers rely on our tools and services to get the data they need from the web.
About the Job:
As Lead Cloud Engineer, you will drive the architecture, development, and reliability of our Scrapy Cloud platform. You take the lead in implementing best practices for scalability, performance optimization, and system resilience. This role combines hands-on engineering with strategic leadership, focusing on high-availability infrastructure, automation, and continuous improvement in cloud software development.
About the Team:
The Scrapy Cloud team, within the App team, comprises developers, data engineers, and product managers focused on building a high-performance, scalable platform. We prioritize engineering excellence, reliability, and collaboration, fostering a culture of innovation and continuous improvement.
Roles & Responsibilities:
- Lead the design and development of the Scrapy Cloud product maintaining high quality, performance, scalability and resiliency.
- Encourage team collaboration and open communication, facilitating regular meetings for brainstorming and feedback.
- Coordinate with product management to align team objectives with business goals.
- Drive the architectural decisions and guide technical design discussions within the team.
- Identify performance bottlenecks and implement solutions proactively.
- Mentor team members and support their professional growth through feedback and development plans.
- Stay up-to-date with industry trends and technologies to foster innovation.
- Ensure high delivery standards while maintaining a healthy team culture.
Requirements:
- Proficient in Python and experience with web frameworks such as Django, Flask, or similar.
- Strong background in cloud technologies (e.g., AWS, GCP, Kubernetes) and containerization.
- Thorough understanding of managing and optimizing cloud infrastructure and performance.
- Proven experience with CI/CD pipelines and infrastructure-as-code tools.
- Experience with designing and implementing APIs
- Excellent communication skills in English, both written and verbal.
By joining the Zyte team, you will:
- Become part of a self-motivated, progressive, multi-cultural team.
- Have the freedom & flexibility to work remotely.
- Get the chance to work with cutting-edge open source technologies and tools.
Top Skills
What We Do
At Zyte, we’re all about empowering data-driven organizations to ethically and accurately collect web data to power their business. With over 14 years experience and our early authorship and ongoing maintenance of Scrapy, we’ve shaped the web scraping industry from Day 1.
We help our clients…
- With easy-to-use ways to collect, format and deliver web data, quickly, dependably and at scale,
- Spend more time gleaning insights from highly accurate, business-critical data, and
- Spend less money on the total cost of ownership in web data extraction.
Zyte API abstracts away a historically disparate web data extraction tech stack into a single tool. Zyte API automates most anti-bot and proxy management, so developers can spend more time on strategy.
Zyte API is a full-stack solution that crawls, unblocks and extracts data in minutes with the power of AI. Developers skip the hassle of creating manual parsing code and extract public data at unlimited scale.
Zyte Data is an expert web data extraction team in your pocket. Our white glove service extracts any web data your business needs, regardless of project size and complexity. This includes a dedicated team and round-the-clock support.
Zyte’s legal team is our backbone and is made up of the leading minds in web data extraction compliance. They stay on top of the ever-changing and opaque laws that loom over the industry. They evaluate compliance risks and inform customers about best practices.
Zyte is certified by and a co-founder of the Ethical Web Data Collection Initiative (EWDCI) which recognizes web data providers operating with the highest level of ethical and legal standards.
Come work for us!
We encourage a flexible and diverse work environment, so we embraced the benefits of remote work from our very early beginnings. Our team includes over 200 employees in over 30 countries. All sharing the same drive, to do more with web data.
.png)
