At Zyte, we eat data for breakfast and you can eat your breakfast anywhere and work for Zyte. Founded in 2010, we are a globally distributed team of over 240 Zytans working from over 28 countries who are on a mission to enable our customers to extract the data they need to continue to innovate and grow their businesses. We believe that all businesses deserve a smooth pathway to data
For more than a decade, Zyte has led the way in building powerful, easy-to-use tools to collect, format, and deliver web data, quickly, dependably, and at scale. And today, the data we extract helps thousands of organizations make smarter business decisions, secure competitive advantage, and drive sustainable growth. Today, over 3,000 companies and 1 million developers rely on our tools and services to get the data they need from the web.
Zyte is looking for a Senior Systems Administrator to join the team. This role will be responsible for the successful operations and scaling of the infrastructure and software that powers crawls of over 8 billion pages a month. The successful candidate will also get involved in team coordination tasks.
Our infrastructure stack includes Linux, Python, Docker, Mesos/Marathon, MySQL, HBase, Kafka, Nginx, Elasticsearch, AWS, along with our own technologies, such as Scrapy
Roles & Responsibilities:
- Maintain, operate and develop our proxy infrastructure
- Maintain relationship with our IP providers and be main point of contact
- Write tools and scripts to provide automation and self service solutions
- Design new systems to support production services
- Creatively solve scalability challenges
- Help improve monitoring and identify key performance metrics
- Proactive Research and Development - discovering and implementing new providers, tools, emerging technology, etc.
- Troubleshooting and resolution of server/network and application issues
- Apply critical thinking skills to facilitate constructive discussions that challenge assumptions and ensure thorough exploration of alternative solutions
Requirements:
- 3+ years recent experience working as a Linux administrator/engineer at reasonable scale (dozens of systems)
- 2+ years of recent professional experience designing, developing, and operating Configuration Management solutions such as Ansible (preferred) or similar.
- Experience working with 3rd party providers
- Solid experience in Linux tuning, profiling, and monitoring
- Experience with Grafana, ELK, Prometheus, SQL, GIT
- Solid knowledge of networking & network troubleshooting including TCP/IP, HTTP, TLS, firewalls, VLANs, DNS, LDAP.
- Skills in at least one programming language: Python (preferred), Bash
- Proven experience in applying critical thinking to solve complex problems and improve system performance.
- Previous work experience as a team coordinator or supervisor
Desired Skills:
- Experience deploying and debugging applications running on containers as microservices
- Working knowledge of load-balancing technologies
- Highly organized, able to multitask, able to work individually, as well as within a team, and across teams
- Excellent written and spoken English skills
- Proven experience working remotely and collaborating in a cross-functional team environment
- Familiarity with software engineering practices, including n-tier architecture, configuration management, development methodologies (e.g. agile, waterfall, spiral, prototyping), etc
By joining the Zyte team, you will:
Become part of a self-motivated, progressive, multi-cultural team.
Have the freedom & flexibility to work remotely.
Get the chance to work with cutting-edge open source technologies and tools.
Top Skills
What We Do
At Zyte, we’re all about empowering data-driven organizations to ethically and accurately collect web data to power their business. With over 14 years experience and our early authorship and ongoing maintenance of Scrapy, we’ve shaped the web scraping industry from Day 1.
We help our clients…
- With easy-to-use ways to collect, format and deliver web data, quickly, dependably and at scale,
- Spend more time gleaning insights from highly accurate, business-critical data, and
- Spend less money on the total cost of ownership in web data extraction.
Zyte API abstracts away a historically disparate web data extraction tech stack into a single tool. Zyte API automates most anti-bot and proxy management, so developers can spend more time on strategy.
Zyte API is a full-stack solution that crawls, unblocks and extracts data in minutes with the power of AI. Developers skip the hassle of creating manual parsing code and extract public data at unlimited scale.
Zyte Data is an expert web data extraction team in your pocket. Our white glove service extracts any web data your business needs, regardless of project size and complexity. This includes a dedicated team and round-the-clock support.
Zyte’s legal team is our backbone and is made up of the leading minds in web data extraction compliance. They stay on top of the ever-changing and opaque laws that loom over the industry. They evaluate compliance risks and inform customers about best practices.
Zyte is certified by and a co-founder of the Ethical Web Data Collection Initiative (EWDCI) which recognizes web data providers operating with the highest level of ethical and legal standards.
Come work for us!
We encourage a flexible and diverse work environment, so we embraced the benefits of remote work from our very early beginnings. Our team includes over 200 employees in over 30 countries. All sharing the same drive, to do more with web data.