Software Engineering Architect

Posted 2 Days Ago
Be an Early Applicant
San Francisco, CA
224K-373K Annually
Senior level
Cloud
If you’re ready to build your future — and the future of technology — then you’re in the right place.
The Role
As a Software Engineering Architect at Salesforce, you will define and implement quality strategies for SaaS products, focusing on AI technologies and Large Language Models (LLMs). You will evaluate LLM performance, oversee testing and automation processes, establish quality metrics, and collaborate with cross-functional teams to ensure high standards for enterprise applications.
Summary Generated by Built In

To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts.

Job Category

Software Engineering

Job Details

About Salesforce

We’re Salesforce, the Customer Company, inspiring the future of business with AI+ Data +CRM. Leading with our core values, we help companies across every industry blaze new trails and connect with customers in a whole new way. And, we empower you to be a Trailblazer, too — driving your performance and career growth, charting new paths, and improving the state of the world. If you believe in business as the greatest platform for change and in companies doing well and doing good – you’ve come to the right place.

We are seeking an experienced Salesforce Software Quality Architect with a strong background in SaaS platforms and expertise in evaluating Large Language Models (LLMs). This role requires a deep understanding of Salesforce architecture, software quality assurance, and the ability to assess and optimize LLMs for delivering accurate, safe, and high-quality responses.
 

As a Quality Architect, you will play a key role in defining, implementing, and maintaining the quality strategy for Salesforce products, with a focus on integrating cutting-edge AI technologies. You will collaborate with cross-functional teams, including product development, data science, and AI teams, to ensure that Salesforce’s AI-driven solutions meet the highest quality standards for enterprise applications.

Key Responsibilities:

  • Define Quality Strategies: Develop and implement robust quality strategies for Salesforce’s SaaS products, focusing on AI and LLM integrations.

  • Evaluate LLM Performance: Assess and optimize Large Language Models (LLMs) for quality, accuracy, relevance, and safety in various use cases.

  • Testing and Automation: Design test plans and automation frameworks for both traditional software components and LLM-based features, ensuring seamless integration and high performance.

  • Quality Metrics: Establish and track quality metrics, including accuracy, relevance, engagement, and safety of LLM-generated responses.

  • Collaborate on AI Model Improvements: Work closely with data scientists and machine learning engineers to provide feedback on LLM performance and recommend improvements based on quality testing results.

  • SaaS Expertise: Apply your knowledge of Salesforce architecture and SaaS platforms to guarantee high availability, scalability, and user satisfaction in AI-powered applications.

  • Human Evaluation: Oversee human evaluation processes for subjective quality dimensions, such as response engagement, user safety, and contextual accuracy.

  • Drive Innovation & Adoption - Bring structure to the engineering decision-making process by communicating and evaluating solution options, and facilitating agreement among key stakeholders that helps prioritize high-value solutions, driving business impact. Ensures that we are continuously raising our standard of engineering excellence

  • Multiplier - Connect the “Art of the Possible” : You provide technical leadership for critical areas that significantly impact customer success. You have depth of expertise in key technologies and you are often consulted on the design and
    delivery of new solutions. You bring new best practices to R&D and actively ensure that they are being used. Continues to deepen and widen their understanding of the application and drives discussion of sometimes complex or controversial issues in open forums such as concept reviews, VAT discussions, and cross team discussions.

  • Cross-Platform Collaboration - You will use your understanding of customers’ needs across industries and multiple technology landscapes (CRM, Modern Data Stack, Analytics & BI, CRM and AI) to develop solutions across Salesforce's
    technology stack. Works in a consultative fashion to improve communication, teamwork and alignment among teams inside and outside of the organization

  • Technical Leadership on Proof of Concepts: To enter this role you should be able to influence the direction R&D as a whole through your technical, process, or product knowledge leadership. You are able to drive initiatives across R&D. Youare a role model within R&D.Industry-expert level in understanding of quality concerns and validation techniques.Innovates beyond industry expectations. Able to drive behaviors and initiatives that both focus on quality and throughput.

  • Mentor and Organization Builder: You are a cornerstone in the infrastructure of technical expertise represented by the organization's senior engineers. You challenge and engage with them to develop their expertise and leadership contributions. You are a key resource for engineers seeking to advance to the next level

Required Skills and Qualifications:

  • Experience in Salesforce: Understanding of Salesforce’s architecture, platform features, and integration with AI/ML components.

  • SaaS Expertise: Extensive experience with SaaS platforms, cloud architecture, and enterprise-level software quality assurance.

  • LLM Expertise: Hands-on experience evaluating Large Language Models (LLMs) for quality response, including familiarity with GPT-like models and AI evaluation frameworks.

  • Quality Assurance Leadership: Experience leading quality assurance initiatives for complex software systems, including test automation and performance testing.

  • AI & Machine Learning Knowledge: Strong understanding of AI/ML principles, particularly in evaluating and optimizing model performance, response consistency, and safety.

  • Testing Tools & Frameworks: Familiarity with tools like Selenium, TestNG, JUnit, and other automation frameworks, plus experience with AI/ML testing platforms.

  • Collaboration & Communication: Excellent communication skills, with the ability to work cross-functionally with product managers, AI/ML engineers, and data scientists.

  • Problem-Solving & Analytical Skills: Strong analytical and problem-solving abilities with a focus on identifying quality gaps and driving improvement.


Preferred Qualifications:

  • Experience in ethical AI practices and evaluating models for fairness, bias, and user safety.

  • Knowledge of tools for model interpretability and explainability (e.g., LIME, SHAP).

  • Strong understanding of public cloud infrastructure - AWS/Azure/GCP;

  • Certification in Salesforce 

  • Can Architect, design, implement, test and deliver test frameworks for highly scalable products

Accommodations

If you require assistance due to a disability applying for open positions please submit a request via this Accommodations Request Form.

Posting Statement

At Salesforce we believe that the business of business is to improve the state of our world. Each of us has a responsibility to drive Equality in our communities and workplaces. We are committed to creating a workforce that reflects society through inclusive programs and initiatives such as equal pay, employee resource groups, inclusive benefits, and more. Learn more about Equality at www.equality.com and explore our company benefits at www.salesforcebenefits.com.

Salesforce is an Equal Employment Opportunity and Affirmative Action Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender perception or identity, national origin, age, marital status, protected veteran status, or disability status. Salesforce does not accept unsolicited headhunter and agency resumes. Salesforce will not pay any third-party agency or company that does not have a signed agreement with Salesforce.

Salesforce welcomes all.

Pursuant to the San Francisco Fair Chance Ordinance and the Los Angeles Fair Chance Initiative for Hiring, Salesforce will consider for employment qualified applicants with arrest and conviction records.

For Washington-based roles, the base salary hiring range for this position is $224,100 to $341,900.

For California-based roles, the base salary hiring range for this position is $244,500 to $372,900.

Compensation offered will be determined by factors such as location, level, job-related knowledge, skills, and experience. Certain roles may be eligible for incentive compensation, equity, benefits. More details about our company benefits can be found at the following link: https://www.salesforcebenefits.com.

Top Skills

Salesforce
The Company
HQ: San Francisco, CA
72,000 Employees
Hybrid Workplace

What We Do

Salesforce is the #1 AI CRM, where Humans with agents drive customer success together. Through Agentforce, our groundbreaking suite of customizable agents and tools, Salesforce brings autonomous AI agents, unified data from any source, and best-in-class Customer 360 apps together on one integrated platform to help companies connect with customers in a whole new way.

Salesforce is democratizing AI agents for businesses of every size and industry so every company can embrace a workforce without limits. Our low code, open, and secure platform helps companies build and customize Salesforce fast so they can safely scale AI-powered work to every customer and employee experience and transform their business.

Salesforce is proud to be the market leader, but we’re even more proud to lead in philanthropy, innovation and culture. Guided by core values of trust, customer success, innovation, equality, and sustainability, Salesforce is more than a business — we’re a platform for change.

Why Work With Us

There’s no typical day in the life of a Salesforce employee. You could be transforming our next AI innovation — or transforming your community. Closing deals — or closing your laptop for a day of Volunteer Time Off. Driving change for our customers — or driving change within one of our high-performing teams.

Gallery

Gallery

Similar Jobs

Santa Clara, CA, USA
9542 Employees
San Francisco, CA, USA
72000 Employees
224K-373K Annually

Capital One Logo Capital One

Lead Software Engineer

Fintech • Machine Learning • Payments • Software • Financial Services
Hybrid
San Francisco, CA, USA
55000 Employees
201K-244K Annually

Capital One Logo Capital One

Lead Software Engineer

Fintech • Machine Learning • Payments • Software • Financial Services
Hybrid
San Jose, CA, USA
55000 Employees
201K-244K Annually

Similar Companies Hiring

Fulcrum GT Thumbnail
Software • Legal Tech • Cloud
Hoffman Estates, Illinois
501 Employees
Eastwall Thumbnail
Software • Information Technology • Consulting • Cloud • Big Data Analytics • Artificial Intelligence • App development
Denver, CO
20 Employees
Jobba Trade Technologies, Inc. Thumbnail
Software • Professional Services • Productivity • Information Technology • Cloud
Chicago, IL
45 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account