Principal Data Engineer

Posted 19 Hours Ago
Hiring Remotely in Austin, TX
Remote
Expert/Leader
Big Data • Information Technology • Security • Software
SpyCloud is on a mission to keep companies and consumers safe from account takeover and online fraud
The Role
The Principal Data Engineer will modernize data pipelines, cost-optimization strategies for large data processing, and design streaming architectures using AWS technologies. Responsibilities include leading architectural direction, documentation, mentorship of junior engineers, and collaborating with product management for data initiatives.
Summary Generated by Built In

SpyCloud is on a mission to make the internet a safer place by disrupting the criminal underground. SpyCloud’s solutions thwart cyberattacks and protect more than 4 billion accounts worldwide. Cybersecurity is an exciting, evolving space, and being at the forefront of the fight to disrupt cybercrime makes SpyCloud a special place to work. If you’re driven to align your career with a fantastic mission, look no further!

As a Principal Data Engineer at SpyCloud, you will lead our efforts to modernize data pipelines, optimize costs, and design robust streaming architectures using AWS technologies. You will play a critical role in steering our architectural direction and enhancing our data ingestion and processing capabilities.

What You'll Do:

  • Data Pipeline Modernization: Redesign existing data pipelines to improve efficiency, scalability, and maintainability. Implement state-of-the-art technologies to handle large-scale data operations.
  • Cost Optimization: Regularly analyze and optimize the costs associated with the daily ingestion and processing of large data sets. Employ innovative solutions to reduce expenses without compromising performance.
  • Streaming Architecture: Design and implement streaming data solutions using AWS services (e.g., MSKk, Lambda, S3, DynamoDB). Ensure systems can handle real-time data processing with minimal latency.
  • Leadership in Architecture Review Board: Lead the Architecture Review Board, making strategic decisions about architectural practices and standards. Facilitate discussions and drive consensus among stakeholders.
  • Documentation: Develop and maintain comprehensive documentation for reference architectures and architectural decision records.
  • Mentorship: Mentor junior engineers, providing guidance and support in their professional development. Encourage best practices in data architecture and engineering.
  • Technology Integration: Evaluate and adopt new technologies and tools to enhance the data architecture and support new data initiatives.
  • Data Strategy Development: Lead the creation and execution of a strategic data plan that aligns with the company’s goals, focusing on data collection, storage, and utilization.
  • Collaboration: Work closely with Product Management to align architectural strategies with the product roadmap, ensuring seamless execution and delivery.

Requirements:

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
  • 15+ years of experience in data architecture, especially in a cloud environment.
  • Proven experience with AWS cloud services and streaming architectures.
  • Strong experience in designing and optimizing data pipelines.
  • Excellent leadership skills and experience leading technical teams and projects.
  • Demonstrable experience in cost optimization and financial management of IT resources.
  • Strong communication skills and ability to articulate complex technical ideas to non-technical stakeholders.
  • Proficiency in programming languages such as Python, Java with hands-on experience in building Kafka based streaming data pipelines
  • Strong understanding of machine learning principles and model lifecycle management.
  • Working knowledge on building and managing MLOps pipelines

We are not currently sponsoring Visas for candidates.

Benefits + Perks:

At SpyCloud, we are committed to working alongside individuals who are equally passionate about preventing cybercrime, regardless of their department or role. Guided by our core values in all business decisions, we prioritize unity in our mission and ensure all SpyCloud employees have the support and benefits they need to stay focused on our goals. In addition to our engaging workspace in South Austin, flexible and remote-friendly work options, and competitive salary package, we offer our employees a comprehensive benefits package that includes:

  • 401(k)
  • Health, Vision, and Dental Insurance
  • Generous PTO Plan
  • In-office meals provided

About SpyCloud:

SpyCloud is on a mission to disrupt the cycle of cybercrime. As the leader in Cybercrime Analytics, our solutions thwart cyberattacks that originate from the use of stolen data, including account takeover, ransomware, and online fraud. More than 550 customers and partners trust SpyCloud to protect users' identities, prevent targeted attacks, and unmask adversaries attempting to harm businesses and their customers.

To learn more and see insights on your company’s exposed data, visit SpyCloud.

Our Mission:

Our mission is to make the internet a safer place by disrupting the criminal underground. Together with our customers and partners, we aim to end criminals’ ability to profit from stolen information.

Who We Are:

SpyCloud is a place for innovative, collaborative, and problem-solvers to thrive. Individually, we’re amazing, but together, we’re unstoppable. We celebrate diversity and various perspectives and aim to create an inclusive and supportive environment for all. We are proud to be an Equal Employment Opportunity and Affirmative Action employer of choice. All aspects of employment decisions will be based on merit, performance, and business needs. We do not discriminate on the basis of any status protected under federal, state, or local law. All qualified applicants will receive consideration for employment without regard to race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics. Women, minorities, individuals with disabilities, and protected veterans are encouraged to apply. SpyCloud complies with applicable state and local laws governing nondiscrimination in employment. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training.

SpyCloud expressly prohibits any form of workplace harassment. Improper interference with the ability of SpyCloud's employees to perform their job duties may result in discipline up to and including discharge. SpyCloud shares the right to work and participates in the E-Verify program in all locations.

If you need assistance or accommodation due to a disability, you may contact us.

Our Culture:

Our culture is something really special. We’re all driven to disrupt the cybercriminal economy as we keep customer accounts safe from compromise. We support a truly worthy and serious mission, but we have fun doing it together. If you are driven, inventive, and collaborative, you’ll fit right in.

SpyCloud’s Recruitment Policy:

We will never ask an applicant for sensitive or personal financial information during the recruitment process. We advise all applicants seeking employment with SpyCloud to review available information on recruitment fraud. Anyone who suspects that they have been contacted by someone falsely representing SpyCloud should email [email protected].

Compensation Transparency Policy: 

At SpyCloud, we believe in transparency and fairness in compensation. We strive to ensure that all employees are fairly compensated for their contributions, and we openly discuss our compensation philosophy and structure. We are committed to providing competitive salaries and benefits packages to attract and retain top talent, and we encourage open dialogue and feedback regarding compensation matters.

SpyCloud is not sponsoring visas at this time.

Learn more and apply: SpyCloud Careers

Top Skills

Java
Python
The Company
HQ: Austin, TX
96 Employees
Hybrid Workplace
Year Founded: 2016

What We Do

SpyCloud is the leader in account takeover (ATO) prevention, protecting billions of consumer and employee accounts either directly or through product integrations. Our award-winning solutions proactively defeat fraud attempts and disrupt the criminals' ability to profit from stolen information.

Why Work With Us

SpyCloud is on a serious and worthy mission: to disrupt the cybercriminal economy as we keep customer accounts safe from compromise. Our diverse team is made up of smart, proactive, collaborative people with different backgrounds and experiences. We bring our strengths together to support and inspire one another to do our best work.

Similar Jobs

CrowdStrike Logo CrowdStrike

Principal Software Engineer, Data Platform (Remote)

Cloud • Information Technology • Sales • Security • Cybersecurity
Remote
6 Locations
10000 Employees
185K-345K Annually

Movable Ink Logo Movable Ink

Principal Data Engineer - Data Platform & Ingress

Artificial Intelligence • Marketing Tech • Software
Easy Apply
Remote
United States
590 Employees

Multi Media, LLC Logo Multi Media, LLC

Lead Data Platform Engineer

Consumer Web • Digital Media • Information Technology • News + Entertainment • Social Media
Remote
United States
270 Employees
180K-215K Annually

Arcadia Logo Arcadia

Senior Data Engineer

Big Data • Healthtech • Software • Analytics
Remote
USA
370 Employees

Similar Companies Hiring

InCommodities Thumbnail
Renewable Energy • Machine Learning • Information Technology • Energy • Automation • Analytics
Austin, TX
234 Employees
RunPod Thumbnail
Software • Infrastructure as a Service (IaaS) • Cloud • Artificial Intelligence
Charlotte, North Carolina
53 Employees
Hedra Thumbnail
Software • News + Entertainment • Marketing Tech • Generative AI • Enterprise Web • Digital Media • Consumer Web
San Francisco, CA
14 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account