Sr. Data Engineer
Level: Senior
Department: Azure
Location: Anywhere in US or Canada (fully remote)
Type: FTE
GENERAL DESCRIPTION & RESPONSIBILITIES
The Sr. Azure Data Engineer will lead the creation of high-value data driven solutions leveraging Cyclotron’s proven implementation methodology and solutions for enterprise projects, as well as contributing to technical pre-sales activities as required. You will be responsible for designing solution architecture, requirement definition, and leading the project delivery team. You will have the opportunity to work with and learn the latest cloud solutions in an exciting work environment. This position will work collaboratively across all Cyclotron’s sales, service delivery and project management organizations in service to Cyclotron’s clients.
The ideal candidate will have extensive Microsoft/Azure data services and Databricks technology experience. Proficiency with the Databricks platform, implementing enterprise Data Lakehouse will be required. Candidates will be expected to contribute to all stages of the data lifecycle including data ingestion, data modeling, data profiling, data quality, data transformation, data movement, and data curation.
Candidate should be familiar with the market challenges in multiple industry verticals and have experience with both traditional and modern across the Microsoft technology stack.
-
Strong collaboration skills, embraces change, works well with ambiguity, shifts easily across roles and groups.
-
Ability and willingness to take the initiative to serve the client needs first.
-
Ability to engage directly with the client stakeholder, managers, and end users.
-
Ability to interface with clients up to the C-suite, down to the line worker.
-
Ability to design and implement Advanced Analytics solutions based on customer needs and knowledge of Microsoft Cloud and related Open-Source (Apache) technologies
-
Ability to triage and self-direct, prioritize and manage time effectively.
-
Ability to collaborate with other members of the Cyclotron team, including Project Managers, Software Engineers, and Business Analysts.
PLACEMENT CRITERIA & REQUIREMENTS
-
Focus on Azure data engineering solutions
-
8+ years data engineering delivery experience
-
3+ years of Databricks engineering development experience
-
2+ years technical team leadership or technical management experience
-
Current Azure and/or Databricks certifications
TECHNICAL SKILLS REQUIRED
General Architecture
-
Designing large-scale data warehouse solutions
-
Being able to interpret business requirements into functional and then technical requirements
-
Design, develop and maintain data pipelines using Databricks and Microsoft Azure services
-
Experience solutioning Azure Cloud based enterprise data architectures.
-
Experience with data pipeline automation
Information Architecture
-
Data Modeling principles for relational and dimensional data structures
-
Data Warehouse design principles
-
Data Lake design principles, Data Virtualization
-
Hybrid enterprise data architecture
Strong knowledge of data warehouse concepts and T-SQL relational/non-relational databases for data access and Advanced Analytics
-
Experience with following languages: Python, SQL, DAX, M
-
Experience with reporting and data visualization tools, specifically PowerBI
-
Practical knowledge of Microsoft SQL Server
-
Experience in multidimensional and / or tabular models (SSAS)
Microsoft Azure Stack
-
RDBMS: Azure SQL / SQL Server 2016+ (SQL, Structure, Stored Procs, Tuning)
-
ETL/ELT, (ADF, SSIS)
-
Data governance – (Purview, Unity Catalogue)
-
Analysis Services [Tabular]
-
Databricks Delta Lake Storage
-
Azure Dev OPS
DESIRED SKILLS
Advanced Analytics Data Technologies
-
Databricks, Delta Lake, Synapse
-
Spark SQL, Pyspark
-
Azure Data Explorer
-
Logic Apps, Key Vault
-
Semi structured data processing
-
Integration Runtime
-
Coding experience: Python, C#, Java for Data analysis purpose
-
One of the following certifications: Microsoft Certified - Data Analyst Associate, MCSA - BI Reporting
-
Knowledge of some of the main components of Azure Analytics: Azure Data Processing Technologies (DataFactory, Databricks), Azure Big Data Technologies, Databricks, Synapse
Information Architecture
-
Data Stewardship, Ownership and Quality Management principles
-
Data Governance, Data Catalog, Enterprise Information Management
NON-TECHNICAL SKILLS
Business Engagement
-
Demonstrated Experience
-
Providing thought leadership and business strategy acumen around advanced analytics and business information lifecycle
-
Leading customers through a value-based decision-making cycle
-
Developing functional, non-functional and technical requirements based on business imperatives
-
Presenting to customer executive teams with authority and purpose
Project and Team Delivery Leadership
-
Demonstrated Experience
-
Directing business analysts and developers in the execution of project tasks
-
Leading consultants in various project work streams
-
Estimating, planning and executing advanced analytics solutions
-
Managing geographically distributed project teams
CYCLOTRON EXPECTATIONS
These are the traits that we hold in the same regard for all employees, also viewed as performance indicators. Each employee should uphold these attributes.
-
Communication and Interpersonal Skills – verbal and written, professional, concise, and effective.
-
Collaboration and Teamwork - share knowledge, build alliances, show respect.
-
Personal Ownership and Responsibility – take initiative, solve problems, be fully present.
-
Customer Focus – Proactive management or Client expectations and needs.
-
Time Management and Productivity – Set Goals, Commit, Record, Communicate
Cyclotron is an equal opportunity employer; we encourage diversity and promote an inclusive environment where everyone feels respected and valued. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, gender expression, age, marital status, religion, national origin, veteran, or disability status. We would love to learn about what you can add to our diverse team.
Top Skills
What We Do
We’re Cyclotron. We want to welcome you to the new world of an action-oriented, modern technology consultancy.
Cyclotron was proudly founded in San Francisco in 2014 with the sole intent of accelerating the success of our clients by solving mission-critical business and technology challenges, through a proven network of industry-specific frameworks. We’re a trusted strategic partner to many innovative organizations in the financial, health and life sciences, public, retail, and technology sectors. Our solutions combined with your investment with us boosts productivity, enhances collaboration, and integrates intelligence across your entire enterprise.