Data Engineer:
We are seeking a highly skilled Data Engineer to join our dynamic Data Warehouse Engineering team. In this pivotal role, you will collaborate closely with cross-functional teams to construct an enterprise data warehouse that supports analytics throughout the organization. Your efforts will play a significant part in influencing the future development of Snowflake products and services within our company. The ideal candidate will possess extensive expertise in Data Modeling and Data Warehousing, coupled with hands-on experience working with the Snowflake platform.
Responsibilities
- Develop robust ETL/ELT pipelines utilizing Snowflake tools such as Snowpipe, Tasks, Streams, and Stored Procedures, ensuring efficient data processing and automation.
- Utilize Python, SQL, and other relevant languages to create scripts for data manipulation and automation, streamlining workflows and enhancing productivity.
- Collaborate closely with Engineering, Product Management, IT, Finance, and other stakeholders to understand data requirements and design scalable, reliable, and efficient solutions for various projects on the Snowflake platform.
- Create and optimize data models for enhanced performance and scalability, continuously improving data processes and workflows.
- Perform performance tuning of Snowflake queries and procedures, while documenting and recommending best practices for efficient Snowflake utilization.
- Implement best practices for data storage and retrieval, ensuring optimized data access and retrieval.
- Take ownership of creating and maintaining comprehensive technical documentation for Snowflake, ensuring compliance with data governance and security policies.
- Implement data sharing and replication capabilities across different cloud regions and for internal and external clients.
- Design, build, and maintain core data models and infrastructure to efficiently manage data and usage across the Snowflake account.
- Establish and manage role-based access controls, Virtual Warehouses, Tasks, Snowpipe, Streams, and other Snowflake elements to support various use cases.
- Monitor Snowflake database usage, proactively identifying and resolving problematic queries in collaboration with the respective teams.
- Stay updated on the latest capabilities of Snowflake, conducting Proof of Concepts (POCs) and implementing relevant features based on business needs.
- Implement Snowflake user/query log analysis, time travel, cloning, history capture, and user email alerts configuration, enhancing monitoring and alerting capabilities, enabling efficient data management and recovery
Qualifications/Skills:
- Bachelor's degree in Computer Science, Information Systems, or a related field.
- Minimum of 8-10 years of hands-on experience in data engineering and data warehousing, with a specialization in big data warehouses, data transformation tools, and SQL.
- 3+ years recent experience on Snowflake database
- Expertise with various ETL technologies and familiar with ETL tools
- Comprehensive knowledge of Data Modeling and Data Warehousing principles and methodologies.
- Strong proficiency and hands-on experience with the AWS platform.
- Expertise in handling file-based data structures and relational database systems.
- Advanced and extensive experience with Python and SQL.
- Ability to analyze functional requirements and translate them into detailed technical specifications.
- Exceptional problem-solving skills and ability to manage multiple tasks in a fast-paced environment.
- Experience in the Finance industry will be highly advantageous.
Top Skills
What We Do
Clearwater Analytics is the leading provider of web-based investment portfolio accounting, reporting, and reconciliation services for institutional investors at thousands of organizations.
Clearwater aggregates, reconciles, and reports on more than $5.5 trillion in assets across thousands of accounts daily. Our clients include corporate treasuries, insurance companies, investment managers, banks, governments, and other institutional investors both in the United States and worldwide.
For more than a decade, we have leveraged web-based software and world-class client service to help clients such as American Family Insurance, Arch Capital, C.V. Starr & Co., Cisco, Facebook, Oracle, Selective Insurance, Sirius Group, Sompo International, Starbucks, WellCare Health Plans, Wilton Re, and many others, streamline their investment and accounting operations. Clearwater also works with hundreds of custodians, investment managers, dealers/brokers, and electronic trading portals who offer Clearwater to their many clients.
With global headquarters in Boise, Idaho, and offices in Edinburgh, London, New Delhi, New York, and Singapore, Clearwater sets the new global standard for investment portfolio reporting.
