Sr Software Engineer, Big Data

Posted 10 Days Ago
Be an Early Applicant
Pune, Maharashtra
Hybrid
Junior
Big Data • Information Technology • Software • Database • Business Intelligence
The World's Most Advanced Go-To-Market Intelligence To Make The Best Decisions
The Role
As a Senior Software Engineer, you will develop and enhance features, build data pipelines, and collaborate with product development teams in creating effective solutions. Your role includes designing data collection architectures and supporting end users while contributing to a fast-paced engineering team and modern Big Data environment.
Summary Generated by Built In


Job Description

Job Title: Software Engineer
Department: IDP

About Us: Headquartered in beautiful Santa Barbara, HG Insights is the global leader in technology intelligence. HG Insights uses advanced data science methodologies to help the world’s largest technology firms and the fastest growing companies accelerate their sales, marketing, and strategy efforts. We offer a competitive salary, great benefits, and an accomplished diverse remote team. 

What You’ll Do:

You are an experienced Software Engineer, Data/Data Engineer who’s passionate about developing products that are simple, intuitive, and beautiful. You will be making an impact on HG’s core data platform/processing engine using modern Big Data techniques particularly working with enterprise applications for B2B. We are a small engineering focused team who are delivering innovative features in a fast-growing market. We build Big Data systems utilizing cutting edge technologies and solutions that allow our developers to learn and develop while shipping amazing products. 

You will be involved in building data pipelines at a large scale to enable business teams to work with data and analyze metrics that support and drive the business. You will partner with cross functional teams to identify opportunities and continuously develop and improve processes for efficiency.

What You'll Be Responsible For:

● Collaborating with Product Development Teams to build the most effective solutions
● Developing and enhancing features in our databases, backend apps, front end UI, and Data as a Service (DAAS) product
● Building data pipelines to support our data ingesting, cleansing, enriching, and presentation efforts in support of our flagship SaaS applications
● Authoring and scheduling workflows monitored by Airflow
● Responsible for the design and architecture of data collection
● Collaborating with cross-functional teams to design and implement impactful solutions to department and business problems
● Support end users and teammates on code-related questions and issues
● Attend daily stand-up meetings, planning sessions, encourage others, and collaborate at a rapid pace

What You’ll Need:

● BS, MS, or Ph.D. in Computer Science or related technical discipline
● 2+ years of experience in data engineering, or an equivalent combination of education and experience
● Experience using Scala/Java, Spark, Airflow and Hadoop are essential for success in this position
● 2 or more years of designing and programming in a work setting
● Advanced experience in SQL of any flavor (MySQL,Postgres, Snowflake, Sql server etc)
● Proficient in Java or Scala (understand and have real-world experience with design patterns)

● Experience with Amazon Web Services (EC2, S3, RDS, EMR, ELB etc.) or similar cloud platforms
● Experience with web services using REST
● Comfortable working with CI/CD and automation environments such as Docker, Kubernetes, Terraform or similar
● Understand pragmatic agile development practices
● Proven track record of successful project delivery



Top Skills

Java
Scala
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Santa Barbara, CA
200 Employees
Hybrid Workplace
Year Founded: 2010

What We Do

Technology companies are under continuous pressure to maintain aggressive year-over-year growth in an increasingly competitive global landscape. To hit these aggressive growth targets requires more than the best product, distribution, and people. It requires the best data.

For companies selling technology, there is no greater competitive advantage than having detailed, accurate, up-to-date intel on the global technology landscape, from which technologies are companies using, to how much they are spending on those technologies, to which technologies they’re actively researching, and which GSIs are influencing their purchase decisions.

Having this data enables you to make better decisions on which markets to prioritize, which products to build, where to allocate resources, who to partner with, how to design territories, and which accounts to prioritize, all the way down to what message to use.

Why Work With Us

We believe our people are crucial to our success. We work in an inclusive environment where different backgrounds and perspectives are valued and encouraged, regardless of any individual differences. We welcome new ideas and we believe our employees are the catalysts that spark innovation every day and we celebrate our successes along the way!

Gallery

Gallery

Similar Jobs

Nielsen Logo Nielsen

Senior Software Engineer - Big Data

Digital Media • Information Technology • Analytics
Hybrid
Mumbai, Maharashtra, IND
30034 Employees
Mumbai, Maharashtra, IND
774 Employees
Hybrid
Mumbai, Maharashtra, IND
30034 Employees

Similar Companies Hiring

True Anomaly Thumbnail
Software • Machine Learning • Hardware • Defense • Artificial Intelligence • Aerospace
Colorado Springs, CO
131 Employees
Caliola Engineering Thumbnail
Software • Machine Learning • Hardware • Defense • Data Privacy • App development • Aerospace
Colorado Springs, CO
53 Employees
Red 6 Thumbnail
Virtual Reality • Software • Hardware • Defense • Aerospace
Orlando, Florida
113 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account