The Lead Cloud Data Engineer in Tax and Accounting innovative and fast-growing Global Audit team is responsible for designing, implementing end to end solutions in Azure Enterprise Data Lake and optimizing data pipelines, ensuring the availability, performance, scalability and security of large-scale data processing systems. This role requires deep understanding of big data technologies, data architecture, infrastructure, CI/CD and data engineering best practices. Experience with Unity Catalog is a bonus. The Lead Cloud Data Engineer will work closely with architects, leads and other stakeholders to support data driven decision making processes.
Experience Required
- Minimum 8+ years of experience with 3+ years as a Lead Data Engineer or related role
- 5+ years of demonstrated experience in developing Big Data solutions that support business analytics and data science teams
- 3-5 years of proficient Data ingestion end-to-end implementation of projects in Azure Enterprise Data Lake, Azure Functions, Databricks, Blob Storage, Cosmos DB, Azure stream analytics, Python, SQL
- Extensive hands-on experience implementing Lake house architecture using Data bricks Data Engineering platform, SQL Analytics, Delta Lake, and Unity Catalog
- Good understanding of spark architecture with Databricks structured streaming, setting up Azure with Databricks, managing clusters in Databricks
- Experienced in DevOps and deployment automations with Azure DevOps - ARM, YAML, Terraform
- Strong knowledge and hands-on experience in SQL, Unix shell scripting
- Ability to research latest trends and propose advanced tooling/solutions for Cloud Data Lake & Data Science platforms
- Experience with business intelligence and analytics tools such as OBIEE, PowerBI or Tableau
- Experience with Unity Catalog preferred
- Collaborate applications teams/Business users to develop new pipelines with Cloud data migration methodologies and processes including tools like Azure Data Factory, Event Hub, etc
- Ensure data security and compliance.
Roles & Responsibilities
- Lead and implement design of data schemas, drive cloud data lake platform design decisions and development standards and maintain data pipelines for data ingestion, processing, and transformation in Azure
- Extract, transform and load from sources system to Azure Data Storage services using a combination of Azure Data factory, Azure Blob Storage, T-SQL, Pyspark and Azure Databricks
- Drive analysis, architecture, design, governance and development of data warehouse, data lake, and business intelligence solutions
- Integrate data from various sources, ensuring data quality, consistency and reliability.
- Define data requirements, gather and mine large scale structured and unstructured data, and validate data using various tools in a cloud environment.
- Manage and optimize Azure Enterprise data Lake for efficient data storge and processing.
- Develop and optimize ETL processes using Databricks and related tools like Apache Spark
- Implementing data validation and cleansing procedures will ensure the quality, integrity, and dependability of the data.
Benefits:
A comprehensive benefits package that begins your first day of employment. Additional Information: Wolters Kluwer offers great benefits and programs to help meet your needs and balance your work and personal life, including Medical, Dental, & Vision Plans, 401(k), FSA/HSA, Commuter Benefits, Tuition Assistance Plan, Vacation and Sick Time, and Paid Parental Leave. Full details of our benefits are available - https://www.mywolterskluwerbenefits.com/index.html
Diversity Matters
Wolters Kluwer strives for an inclusive company culture in which we attract, develop, and retain diverse talent to achieve our strategy. As a global company, having a diverse workforce is of the utmost importance. We've been recognized by employees as a European Diversity Leader in the Financial Times, as one of Forbes America’s Best Employers for Diversity in 2022, 2021 and 2020 and as one of Forbes America’s Best Employers for Women in 2021, 2020, 2019 and 2018. In 2020, we placed third in the Female Board Index, and were recognized by the European Women on Boards Gender Diversity Index. Wolters Kluwer and all of our subsidiaries, divisions and customer/departments is an Equal Opportunity / Affirmative Action employer.
Top Skills
What We Do
Wolters Kluwer (www.wolterskluwer.com) is a global leader in information services and solutions for professionals in the health, tax and accounting, risk and compliance, finance and legal sectors. We help our customers make critical decisions every day by providing expert solutions that combine deep domain knowledge with specialized technology and services.
Founded in 1836 and headquartered in Alphen aan den Rijn, the Netherlands, the company serves customers in over 180 countries, maintains operations in over 40 countries and employs 18,600 people worldwide.
Wolters Kluwer reported 2019 annual revenues of €4.6 billion. Listed on Euronext Amsterdam, Wolters Kluwer shares (WKL) are included in the AEX and Euronext 100 indices. Wolters Kluwer has a sponsored Level 1 American Depositary Receipt program. The ADRs are traded on the over-the-counter market in the U.S. (WTKWY).
