The Role
As a QA Engineer, you will test installation and upgrade processes across different environments, ensure CI/CD integration with automated tests, and validate product integrations with ML-Ops and SaaS platforms. Responsibilities include executing performance tests in multiple cloud environments and maintaining test environments that mirror customer setups.
Summary Generated by Built In
QA Engineer
Key Responsibilities:
- Test Installation and Upgrade Processes in Various Environments: Ensure that the product installs correctly and upgrades seamlessly across different customer environments (private clouds, public clouds, and on-prem data centers). Validate the installation and configuration in Kubernetes (K8s) clusters, including Helm charts, manifests, and custom configurations.
- Matrix and Environment Testing: Execute tests across various environments, including different cloud providers (AWS, Azure, GCP) ensuring compatibility, performance, and reliability of customer experience. Set up and maintain test environments mirroring customer configurations, including complex networking, storage, and security settings.
- Support Automation, CI/CD, and Monitoring Pipelines: Ensure that test cases are integrated into the CI/CD pipeline, automating tests for new releases.Create automated testing suites that validate upgrades, scalability, and reliability in production-like environments.
- Integration Testing with ML-Ops and SaaS Platforms: Test the product's integration with ML-Ops platforms, ensuring smooth interaction between components.Validate integration between the on-premise systems and the SaaS backend, ensuring data consistency, synchronization, and functionality.
Key Skills
- Strong Container and Docker Expertise:
- Experience in deploying, managing, and troubleshooting Docker containers,
- Working with Helm based Kubernetes deployments including managing and updating Helm charts.
- Automation & CI/CD Pipeline Expertise:
- Proficiency in setting up, maintaining, and scaling test automation frameworks within CI/CD environments (e.g., Jenkins, CircleCI, GitLab CI).
- Hands-on experience with test automation tools and frameworks like Playwright, k6 , or equivalent tools for API and integration testing.
- Cross-Environment Testing and Troubleshooting:
- Strong troubleshooting and diagnostic skills in complex, multi-component distributed systems, including knowledge of networking, storage, and security configurations.
- Ability to work with logging aggregation and telemetry (e.g., ELK stack, Prometheus) for distributed systems.
- Multiple Cloud Familiarity:
- Proven ability to work across various cloud environments (AWS, Azure, GCP)
- Experience with ML-Ops and Platform Integrations:
- Familiarity with ML-Ops platforms (such as Kubeflow, MLflow, etc.) and experience in testing integrations with AI/ML workflows and pipelines..
Top Skills
Docker
Kubernetes
The Company
What We Do
HiddenLayer, a Gartner recognized AI Application Security company, is a provider of security solutions for artificial intelligence algorithms, models & the data that power them. With a first-of-its-kind, non-invasive software approach to observing & securing AI, HiddenLayer is helping to protect the world’s most valuable technologies. Founded in March of 2022 by experienced security and AI professionals, HiddenLayer is based in Austin, Texas.