Staff Data Engineer (Open source committers/contributors)

Posted 3 Days Ago
Be an Early Applicant
Bangalore, Bengaluru, Karnataka
Senior level
Fintech • Information Technology • Payments
Join a world leader in payments and technology!
The Role
As a Staff Data Engineer, you will develop and maintain large-scale distributed systems and data platforms using open-source technologies. You'll collaborate with business units to design scalable solutions and contribute to the open-source community while mentoring junior staff.
Summary Generated by Built In

Company Description

Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.

Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.

Job Description

Visa's Data and AI Platform team is at the forefront of transforming the payment industry by harnessing the power of big data, artificial intelligence, and cutting-edge open-source technologies. Our mission is to build scalable, high-performance data platforms and services that enable Visa’s businesses to innovate and deliver unparalleled value to our customers worldwide.

Our Work

At Visa, we are dedicated to developing robust data platforms that handle massive volumes of data, ensuring real-time processing, analytics, and low-latency responses. Our team leverages a variety of open-source software to create flexible, efficient, and reliable solutions that meet the dynamic needs of our business operations.

  • Big Data Platforms: We design and implement platforms capable of processing and analyzing vast amounts of data generated by millions of transactions daily. These platforms support various use cases, from fraud detection to personalized customer experiences.
  • Open-Source Software: Our development approach heavily relies on open-source technologies, allowing us to build innovative solutions while contributing to the wider tech community. We use and contribute to projects like Apache Hadoop, Apache Druid, Apache Pinot, Apache Spark, Apache Flink, and Apache Kafka, among others.
  • Cutting-Edge Technologies: To achieve our goals, we incorporate state-of-the-art technologies in our stack. This includes leveraging streaming analytics, real-time data processing, and low-latency services to ensure that our platforms are always at the cutting edge of performance and reliability.


Who We Are Looking For

We are seeking seasoned professionals with a deep understanding and expertise in large-scale distributed systems and platform development using open-source software. Ideal candidates will have:

  • Expertise in Distributed Systems: Proven experience in designing, developing, and maintaining large-scale distributed systems.
  • Open-Source Contributions: Active involvement in the open-source community, particularly in streaming, analytical, and low-latency services.
  • Technical Proficiency: Strong proficiency in technologies such as Apache Druid, Apache Pinot, Apache Spark, Apache Flink, Apache Kafka, Temporal, and Yugabyte.
  • Innovative Mindset: A passion for innovation and a drive to stay ahead of the curve by continuously exploring and implementing new technologies.

Join Us

If you are a passionate technologist with a track record of delivering high-quality, scalable solutions and contributing to the open-source community, we invite you to join our team. At Visa, you will have the opportunity to work on groundbreaking projects, collaborate with talented professionals, and make a significant impact on the future of payments.

By joining our Data Platform team, you will play a crucial role in enabling Visa’s businesses to leverage data and AI to drive innovation, enhance security, and deliver exceptional customer experiences.

The candidate must have:

· Actively participate in all phases of software development lifecycle: analysis, technical design, planning, development, testing/CICD, release, post production/escalation support

· Work on a highly scalable, available and resilient multi-tenant Platforms that can host large scale and highly critical applications.

· Develop large scale multi-tenant software components on the Platform in an Agile based methodology to provide self-service capabilities.

· Collaborating with partners from business and technology organizations, develop key deliverables for Data Platform Strategy - Scalability, optimization, operations, availability, roadmap.

· Build partnerships with other technology teams to drive efficiency in their use of platforms and services that PaaS provide

· Expertise in applying the appropriate software engineering patterns to build robust and scalable systems.

· Be a self-starter, work independently and Mentor junior members in the scrum team. Stays current with new and evolving technologies

· Builds strong commitment within the team to support the appropriate team priorities

This is a hybrid position. Hybrid employees can alternate time between both remote and office. Employees in hybrid roles are expected to work from the office 2-3 set days a week (determined by leadership/site), with a general guidepost of being in the office 50% or more of the time based on business needs.

Qualifications

Basic Qualification:
• 5+ years of relevant work experience with a Bachelor’s Degree or at least 2 years of work experience with an Advanced degree (e.g. Masters, MBA, JD, MD) or 0 years of work experience with a PhD, OR 8+ years of relevant work experience.
Preferred Qualifications
• Bachelor's degree in Computer Science, or related technical discipline. With 10+ years of overall software development experience in building PaaS or Application frameworks.
• Excellent verbal and written communication and presentation skills, analytical and problem solving skills
• Proficiency in engineering practices and writing high quality code, with expertise in either one of Java or Python or Go.
• Experience in Technologies like Spark, Druid, Ray and streaming platforms (Kafka, Flink), containers and kubernetes.
• Open source committers in Druid, Pinot and/or Spark.
• Experience in Devops and core infra development using technologies like Kubernetes, Docker, Ansible, Terraform.
• Experience in building REST services and API’s following best practices of service abstractions, Micro-services and Orchestration frameworks.
• Experience building generic services and instrumentation of libraries for wide use across an organization / company.
• Experience in Agile methodology and CICD - tool Integration, automation, configuration management in GIT
• Appreciation of diverse LOBs(Line of business) and their platform needs combined with deep technical expertise are required for the role.

Additional Information

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

Top Skills

Go
Java
Python
The Company
HQ: San Francisco, CA
26,500 Employees
On-site Workplace
Year Founded: 1958

What We Do

At Visa, we are driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid. As our products and technology have evolved with the world, Visa remains ubiquitous, reaching new customers in new and often invisible ways. We are at the center of this digital revolution with a network that connects people with over 80 million businesses all over the world. And Visa’s network is expanding, accelerating our growth. Our resilient business model, with its strong track record of success, will provide you with amazing opportunities to grow in your career, as well.

We are looking for people like YOU. Come join a people-centric company where you can invest in your career.

For more information, visit visa.com/about, visacorporate.tumblr.com and @VisaNews on Twitter.

Why Work With Us

Our employees are our company. Creating an inclusive and diverse workplace has been our key priority. With our purpose to “uplift everyone, everywhere” as our guide, we’re building an environment where diverse backgrounds and perspectives are celebrated and drive success inside our company and out in our communities.

Gallery

Gallery

Similar Jobs

Hybrid
Bengaluru, Karnataka, IND
289097 Employees

Atlassian Logo Atlassian

Data Engineer II

Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Remote
Bengaluru, Karnataka, IND
11000 Employees

Atlassian Logo Atlassian

Principal Data Platform Engineer

Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Remote
Bengaluru, Karnataka, IND
11000 Employees

Target Logo Target

Principal Engineer - Data Engineering

eCommerce • Other • Retail
3 Locations
172344 Employees

Similar Companies Hiring

Jobba Trade Technologies, Inc. Thumbnail
Software • Professional Services • Productivity • Information Technology • Enterprise Web • Consulting • Cloud
Chicago, IL
45 Employees
InCommodities Thumbnail
Renewable Energy • Machine Learning • Information Technology • Energy • Automation • Analytics
Austin, TX
234 Employees
HERE Thumbnail
Software • Logistics • Internet of Things • Information Technology • Computer Vision • Automotive • Artificial Intelligence
Amsterdam, NL
6000 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account