Sr. Data Engineer - Azure (Remote)

Company Description

AETOS LLC is a Minority Owned CVE Certified Service Disabled Veteran Owned Small Business (SDVOSB) providing information technology solutions focused on building a business that is customer-centered and performance-oriented. At Aetos, we specialize in developing IT solutions to optimize functionality and efficiencies for government and commercial clients to meet their business needs.

Job Description

In this role, you’ll be responsible for helping to design and develop technical solutions leveraging cloud and automation technologies. The ideal candidate must maintain technical proficiency with Microsoft Azure, scripting languages, and networking skills. Leveraging your experience performing in a client-facing, you will help define and execute our innovation strategy. As a senior data engineer, you will also work with our Business Development team to support solutioning and writing for proposal opportunities. 

It is imperative that the Data Engineer has broad experience within core data engineering areas but is an expert in at least 3 of the following (listed in order of preference): Cloud architecture (Azure preferred); Data warehousing; Data architecture; Data ETL (Extract transform load) techniques; Python programming; Back-end architecture; Web application design. An understanding of unstructured data will be very valuable. Geospatial data and JSON and documents as data sources. Interfacing with machine learning is a plus.

Responsibilities:

• Design, develop, and optimize scalable data pipelines and ETL processes for ingesting, transforming, and storing large datasets from diverse sources.
• Manage and optimize databases on Azure SQL Server, ensuring high performance and availability.
• Collaborate with cross-functional teams, including Data Scientists, Analysts, and Developers, to understand data needs and deliver effective solutions.
• Develop and maintain robust, reusable, and efficient Python scripts to support data transformation and processing tasks.
• Create interactive and insightful data visualizations using Plotly to support business intelligence and decision-making processes.
• Monitor and troubleshoot data pipeline issues to ensure data quality and system reliability.
• Identify performance improvements in back end ETL processes with a focus on efficient and timely updates.
• Enhance performance of data and queries to support interactive queries and filtering
• Ensure compliance with data governance, security, and privacy policies.
• Stay updated with the latest industry trends, tools, and best practices in data engineering
• Contributes to formulation of strategies for project leadership and other functional areas.
• Expert in Azure architecture for both storage and application hosting.
• Develops standard for scalable solutions to data storage and access challenges.
• Assist client delivery teams with design and development of technical solutions for implementation and deployment based on client requirements.
• Responsible for proposal solutioning and technical writing, as well as responsible for authoring technical white papers.

Qualifications

• 5+ years of professional experience in data engineering or a similar role.
• Bachelor’s or master’s degree in computer science, mathematics, statistics, data science, engineering, or a related field.
• Proficiency in designing and managing Azure SQL Server databases.
• Strong understanding of data warehouse design and optimum design for query efficiency.
• Extensive experience building data pipelines and ETL processes using modern tools and frameworks.
• Advanced Python programming skills, with a strong focus on data processing libraries (e.g., pandas, NumPy) and APIs.
• Certifications or demonstrable past performance in Azure environments.
• Familiarity with cloud platforms and services, particularly Microsoft Azure.
• Strong problem-solving skills and the ability to work both independently and collaboratively in a fast-paced environment.
• Excellent communication skills (both written and verbal) with technical and non-technical audiences, specifically briefing senior decision makers.

Preferred:

• Experience with other visualization tools such as Tableau or Power BI.
• Familiarity with containerization and orchestration tools (e.g., Docker, Kubernetes).
• Knowledge of big data frameworks such as Apache Spark or Databricks.
• Understanding of CI/CD pipelines and version control systems like Git. Familiar with geography and GIS Systems
• Experience with GIS Data
• Experience with SQL Server GIS functions

Additional Information

• Applicants must be authorized to work for any employer in the U.S. and reside in the U.S.

All your information will be kept confidential according to EEO guidelines.