Senior Data Engineer

Posted 2 Days Ago
Be an Early Applicant
Warsaw, Warszawa, Mazowieckie
5-7 Years Experience
Fintech • Information Technology • Payments
Join a world leader in payments and technology!
The Role
The Senior Data Engineer will design and implement data integration and analytics solutions on Hadoop, collaborating closely with business partners. Responsibilities include developing ETL code, building analytical applications, and providing insights from data. The role requires experience in Hadoop development and BI tools, as well as the ability to support various testing phases and implement DevOps principles.
Summary Generated by Built In

Company Description

Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.

Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.

Job Description

The Sr. Data Engineer (Hadoop Development) within the Sales Analytics Delivery team will be responsible for designing, developing and implementing Data integration and Analytics solutions on Hadoop and using BI tools, Data mining and/or Machine learning provide insights on the data. This position requires close collaboration with business partners to understand their business goals, understand requirements, design, develop and implement Data Analytics solutions following SDLC and agile methodologies.

Ideal candidate for this position will have a minimum of five years of experience in development and delivery of Analytics projects and three years development experience on Hadoop.

Responsibilities:

  • Participate in technology project delivery activities such as gathering Business requirements, conceptual approach, design, development, test case preparation, unit/integration test execution, support process documentation

  • Develop the source to target mapping documents and ETL code to load data from source to target systems

  • Develop workflows and ETL using Hive scripts, Spark, Airflow, NiFi, Sqoop, Oozie and other utilities on Hadoop

  • Build analytical applications using Hadoop eco system using packaged or open source technologies

  • Partner with IT groups such as CIT, Engineering, Product, Security, and Infrastructure on project delivery activities

  • Provide insights from data and present to IT and non-technical users to improve operations and productivity

  • Unit test data loads and write scripts for data validation

  • Support QA, UAT and performance testing phases of development cycle and implement DevOps principles from development to deployment to production

This is a hybrid position. Hybrid employees can alternate time between both remote and office. Employees in hybrid roles are expected to work from the office 2-3 set days a week (determined by leadership/site), with a general guidepost of being in the office 50% or more of the time based on business needs.

Qualifications

  • Bachelor’s Degree in Computer Science or related discipline
  • Proven experience in Hadoop development and data integration on Hadoop is required, preferably Hive, Spark ,Presto, Airflow, Sqoop, NiFi etc.
  • Two Years of experience in BI/ Analytics Tools – Power BI or Tableau or any BI tools
  • Experience in RDBMS (Oracle and SQLServer) is required and knowledge of emerging technologies (NoSQL/Graph Database(neo4j)/Time Series) nice to have
  • Experience in writing complex SQL and Hive QL queries is required
  • Experience in Python, Shell/ Perl scripting, scheduling and version control, CI/CD technologies is required
  • Experience in real time data ingestion using Kafka/Spark Streaming
  • Experience in Advanced Analytics, Machine learning and data mining is nice to have.
  • Experience in at least one ETL technology is required – Pentaho, Talend, Informatica
  • Strong follow-through, problem identification, analysis and problem solving skills
  • Demonstrated ability to learn new Information technologies and apply quickly
  • Exceptional communication and customer facing skills, able to interact effectively with diverse groups of global stakeholders, both technical and business users
  • Experience in Payment Processing, CRM (Salesforce/Microsoft Dynamics), Genesys Call Center domain are nice to have

Additional Information

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

Top Skills

Hadoop
Hive
Python
Spark
The Company
HQ: San Francisco, CA
26,500 Employees
On-site Workplace
Year Founded: 1958

What We Do

At Visa, we are driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid. As our products and technology have evolved with the world, Visa remains ubiquitous, reaching new customers in new and often invisible ways. We are at the center of this digital revolution with a network that connects people with over 80 million businesses all over the world. And Visa’s network is expanding, accelerating our growth. Our resilient business model, with its strong track record of success, will provide you with amazing opportunities to grow in your career, as well.

We are looking for people like YOU. Come join a people-centric company where you can invest in your career.

For more information, visit visa.com/about, visacorporate.tumblr.com and @VisaNews on Twitter.

Why Work With Us

Our employees are our company. Creating an inclusive and diverse workplace has been our key priority. With our purpose to “uplift everyone, everywhere” as our guide, we’re building an environment where diverse backgrounds and perspectives are celebrated and drive success inside our company and out in our communities.

Gallery

Gallery

Jobs at Similar Companies

MassMutual India Logo MassMutual India

Associate

Big Data • Fintech • Information Technology • Insurance • Financial Services
Hyderabad, Telangana, IND

Silverfort Logo Silverfort

Sales Operations Analyst

Information Technology • Sales • Security • Cybersecurity • Automation
Remote
United States
357 Employees

Jobba Trade Technologies, Inc. Logo Jobba Trade Technologies, Inc.

Customer Success Specialist

Cloud • Information Technology • Productivity • Professional Services • Software
Hybrid
Chicago, IL, USA
45 Employees

Similar Companies Hiring

MassMutual India Thumbnail
Insurance • Information Technology • Fintech • Financial Services • Big Data
Hyderabad, Telangana
Silverfort Thumbnail
Security • Sales • Information Technology • Cybersecurity • Automation
SG
357 Employees
Jobba Trade Technologies, Inc. Thumbnail
Software • Professional Services • Productivity • Information Technology • Cloud
Chicago, IL
45 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account