Lead Data Engineer

Hypergiant, an Accelint company that empowers forward-thinking organizations with AI-driven solutions to stay ahead. Our geographic presence spans the U.S. and allied partners, with facilities in key Defense Technology hubs from Southern California to Washington, D.C. We provide large enterprises – across industries like the Defense Department, energy, healthcare and aviation – with bespoke technology solutions, cutting-edge advice, and deployment expertise needed to harness the value out of Artificial Intelligence and Machine Learning. At our core, we are military experts, researchers and technologists who want to accelerate intelligence to deliver strategic insights that turn future challenges into today’s opportunities. 

We are looking for a Lead Data Engineer to work alongside and across our balanced agile delivery teams on highly complex DoD projects, specifically the development of a data service for command and control (C2) software. Hypergiant with its partners is building an innovative cloud-based command and control system that seamlessly integrates existing capabilities and provides automation that improves efficiency and effectiveness of mission planning and execution. A perfect candidate is able to write high-quality code, integrate with partner capability providers, ensure code and product quality, provide technical leadership, and foster innovative thinking. This position will work alongside our development team and other capability providers on highly complex DoD projects.

Roles & Responsibilities

• Develop and continuously improve a data service that underpins cloud-based applications
• Support data and database modeling efforts
• Contribute to the development and maintenance of reusable component libraries and shared codebase
• Participate in the entire software development lifecycle, including requirement gathering, design, development, testing, and deployment, using an agile, iterative process
• Collaborate with developers, designers, testers, project managers, product owners, and project sponsors to integrate the data service to end user applications
• Communicate tasking estimation and progress regularly to a development lead and product owner through appropriate tools
• Ensure seamless integration between database and messaging systems and the frontend / UI they support
• Ensure data quality, reliability, and performance through code reviews and effective testing strategies
• Write high-quality code, applying best practices, coding standards, and design patterns
• Team with other developers, fostering a culture of continuous learning and professional growth

Minimum Qualifications

• 10+ years of professional software development or data engineering experience (10+ with a STEM B.S. or 8+ with a relevant Master's degree)
• Strong proficiency in Python and familiarity with Java and Bash scripting
• Hands-on experience implementing database technologies, messaging systems, and stream computing software (e.g., PostgreSQL, PostGIS, MongoDB, DuckDB, KsqlDB, RabbitMQ)
• Experience with data fabric development using publish-subscribe models (e.g., Apache NiFi, Apache Pulsar, Apache Kafka and Kafka-based data service architecture)
• Proficiency with containerization technologies (e.g., Docker, Docker-Compose, RKE2, Kubernetes, and Microk8s)
• Experience with version control systems (e.g., Git), CI/CD tools (e.g., Jenkins), and collaborative development workflows
• Strong knowledge of data modeling and database optimization techniques
• Familiarity with data serialization languages (e.g., JSON, GeoJSON, YAML, XML)
• Excellent problem-solving and analytical skills that have been applied to high visibility, important data engineering projects
• Strong communication skills and ability to lead the work of other engineers in a collaborative environment
• Demonstrated experience in coordinating team activities, setting priorities, and managing tasks to ensure balanced workloads and effective team performance
• Experience managing and mentoring development teams in an Agile environment
• Ability to make effective architecture decisions and document them clearly
• Must be a US Citizen and eligible to obtain and maintain a US Security Clearance

Preferred Qualifications

• Cloud platforms (e.g., AWS, Azure, GCP) and deployment strategies experience (Ansible, Terraform, WebGL)
• Geospatial information system (GIS) experience (e.g., Geoserver)
• Data science and AI/ML applications experience
• Experience managing robust build & test tools and implementing workflow automations / scripts
• Penchant for learning new technologies, balanced with strong pragmatic thinking
• Design-minded attention to detail in data service implementation
• Leadership of a fully remote team
• Portfolio of past projects with code samples
• Ability to travel as needed
• Active Security Clearance

Clearance Information: This position requires the eligibility to obtain a security clearance. Non-US citizens may not be eligible to obtain a security clearance. The Defense Industrial Security Clearance Office (DISCO), an agency of the Department of Defense, handles and adjudicates the security clearance process. More information about Security Clearances can be found on the US Department of State government website here: https://www.state.gov/security-clearances 

Hypergiant Galactic is an equal opportunity employer. We welcome and encourage diversity in the workplace. We offer a generous benefits package, including company contributions to medical benefits. We offer unlimited PTO. In addition, we offer a fun, flexible work environment, company-sponsored activities, and commit to providing each employee with job satisfaction by addressing core needs. Learn more at hypergiant.com.