Data Engineer

At Better Debt Solutions, our mission is to nurture a culture of compassion and empowerment. It is rooted in empathy and driven by tailored strategies, transparent practices, and exceeding expectations. By focusing on helping individuals thrive, we unite our team and clients in a shared journey towards a BETTER future.

Job Title: Data Engineer
Location: This position is onsite in Irvine, CA
Employment Type: Full-Time
Pay Range: $130,000-$150,000 per year based on experience, qualifications, and skillset.

Position Overview:
The Data Engineer is instrumental in expanding and optimizing the company’s data architecture, building robust data pipelines, and ensuring efficient data flow across the organization. This role requires a highly skilled data pipeline builder who thrives on optimizing systems and building them from the ground up to support the Data Analytics team, developers, architects, and data owners across various initiatives. The Data Engineer collaborates closely with senior leadership and other teams to meet data needs, support visualization requirements, and ensure a robust, consistent data delivery architecture.

Key Responsibilities:

• Design and maintain scalable data infrastructure and automation pipelines for ETL processes, ensuring quality and reliability
• Develop efficient data models, workflows, and pipelines to move data into data marts within the data warehouse.
• Partner with Account Executives, Data & Analytics teams, IT Ops Engineers, and senior stakeholders to understand business needs and develop innovative data solutions that drive success.
• Support data processing and reporting on a cloud-based platform, leveraging AWS technologies such as Redshift, S3, AWS Glue, and Kinesis.
• Take charge of normalizing and governing data across the organization, ensuring that all data is accurate, consistent, and aligned with best practices.
• Lead efforts to normalize and govern data, implementing standards and protocols to ensure data accuracy.
• Be the go-to problem solver, identifying and resolving critical issues in production with swift troubleshooting to keep things running smoothly.
• Address mission-critical issues in production by providing troubleshooting and resolving system challenges.
• Create and optimize custom queries for Tableau and Looker, making sure teams have the data they need to make informed, data-driven decisions.
• Build and maintain Python-based ETL workflows with tools such as Airflow, streamlining data ingestion, transformation, and exporting to keep everything running at peak efficiency.
• Spearhead the migration from legacy systems to a modern cloud-based data lake, making strategic architectural decisions that ensure future scalability and long-term success.

Qualifications:

The Data Engineer must have the following experiences:

• Bachelor's Degree in Computer Science, Data Science or a related field.
• At least 5 years of progressive technical experience in Data engineering, including work with big data ecosystems and large-scale data migrations.

Skills:

• Advanced proficiency in Python, Java, and SQL (5+ years) for efficient ETL processes and data pipeline development.
• Experience in big data ecosystems and cloud environments, particularly with AWS (Redshift, S3, Glue, Kinesis, Lambda).
• Skilled in schema design, dimensional modeling, and data mart creation.
• Proficient in Airflow for managing ETL workflows.
• Strong skills in Tableau and Looker are a plus.
• Experience with both relational (SQL Server) and non-relational databases (DynamoDB, Elasticsearch).
• Knowledge of Kibana, CloudWatch, and DataDog for monitoring and issue resolution.
• Strong understanding of data quality, cleansing, and governance for reliable ETL processes.
• Proven ability to identify, decompose, and solve complex data challenges.
• Excellent communicator, able to work with technical and non-technical stakeholders alike.
• Demonstrated ability to lead projects in a fast-paced environment, showing initiative and adaptability.
• Familiarity with additional cloud platforms, such as Google Cloud Platform (GCP).
• Database administration experience, including tasks for security, redundancy, and high availability.
• Advanced visualization skills with tools like Tableau, Looker, and Power BI.

Working Conditions:

• Occasional after-hours on-call duties.
• Some local travel may be necessary to support IT operations and projects.
• Ability to lift a minimum of 50 pounds, adhering to occupational safety standards.
• Driving license preferred but not essential.

Benefits:

• Health, dental, and vision insurance.
• PTO and Sick time
• Opportunities for career growth and advancement.
• A supportive and collaborative work environment.

Better Debt Solutions is committed to creating a diverse environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to veteran status, disability, age, race, color, religion, sex, sexual orientation, gender identity or expression, national origin, genetics, marital status, pregnancy, or any other non-merit based factor.

CCPA Notice:

We collect personal information from job applicants for various purposes, including recruiting, compliance with legal obligations, and other business purposes.  For more details, please review our CCPA Notice by visiting this link https://betterdebtsolutions.com/privacy-policy/.