Job Title: Senior AWS Data Engineer
Get to Know Us:
CG Infinity, Inc. is a software consulting firm that was founded in 1998. We offer solutions that are tailored to the needs of each individual client that we work with instead of offering standard, run-of-the-mill solutions to everyone. We work closely with our clients throughout the entire process and offer solutions for a myriad of challenges.
Our Culture:
Our people-first approach to technology offers best-in-class service and success rates. Here are some of the main services that we offer at CG Infinity: Salesforce Implementations, Customer Experience & CRM, Application Development & Integration, Production Support & QA, and Data Analytics & AI.
Summary of Position:
We are seeking a Senior Data Engineer with hands-on experience in big data processing, data quality, and distributed querying. You will be responsible for designing and building robust, scalable data pipelines using modern tools such as Databricks, Apache Spark, PySpark, Deequ, and Trino. You’ll play a key role in enabling reliable, fast, and clean data delivery to support analytics, reporting, and data science use cases.
Key Responsibilities:
- Design, develop, and optimize large-scale data pipelines using Apache Spark and Databricks.
- Write scalable PySpark code to process structured and semi-structured data.
- Use Trino to query data across various sources in a federated manner.
- Implement data validation and quality checks using Deequ.
- Collaborate with data scientists, analysts, and other engineers to ensure high-quality data delivery.
- Tune Spark jobs for performance and cost efficiency in a cloud environment.
- Contribute to building a modern data platform with a focus on automation, reliability, and scalability.
Qualifications:
- 15+ years of IT experience
- Data Skills needed:
- Databricks
- Apache Spark
- Python (OOP preferred) for PySpark
- Deequ (underlying library for AWS DQDL)
- Trino (Starburst)
What Can We Offer You?
CG Infinity, Inc. offers an exceptionally strong benefits package that compares favorably with those offered by Fortune 500 companies. CG Infinity, Inc. has teamed with a highly regarded ASO, to ensure a great choice for our benefits package.
CG Infinity, Inc. employees have the flexibility to select benefits based on such factors as their personal preference, family situation, and financial objectives, along with our voluntary packages, such as additional Life as well as FSAs.
CG Infinity, Inc. also offers an excellent 401k plan. Upon eligibility, CG Infinity, Inc. contributes an employer match of 100% of the first three percent and 50% of the fourth and fifth percent. All employees enrolled in the 401k retirement plan are 100% vested immediately.
Applicants Must be US Citizens.
Top Skills
What We Do
Our people-first approach to technology offers best-in-class service and success rates. With the world of business and technology growing more complex and confusing every minute, CG Infinity keeps it simple for our clients. Your leaders work with our leaders throughout an engagement. The leaders of our small, blended teams work hand in hand with your team to ensure your objective success.
We partner with companies in a vast array of industries, including the Energy & Utilities and Financial Services industries, to help them thrive in the modern marketplace by leveraging technology to drive their enterprise. From our perfect record in Salesforce implementations, our trusted experience integrating Salesforce with back-end applications, to our creative custom software solutions, CG Infinity is your trusted ally for business technology transitions. With our skilled employees and veteran leadership team, CG Infinity doesn’t complicate life for our clients, we simplify.
