Software Engineer (Applied AI)

What's Freeplay?

Freeplay is the platform for software teams to ship great AI products. We give product development teams the power to test, evaluate, monitor & optimize AI in production. Our customers use Freeplay to to build better LLM features, chatbots, and agents. Already we’re helping leading software companies from growing startups to Fortune 100 companies.

Why does the world need Freeplay?

Making simple requests to ChatGPT is easy. But that building production software around LLMs is much more challenging — especially for development teams without prior AI experience. They're motivated to move fast through the learning curve and focus on delivering value to customers.

Freeplay streamlines this process — making it easy for teams to develop & improve production-ready AI features quickly and confidently. Our customers love that we help them save time, avoid costly mistakes, deliver better features for their customers, and empower their entire team (engineers & non-engineers alike) to ship faster together.

Read more about what we’re up to on our blog.

Your Mission

First and foremost, you'll be a core member of our engineering team, working across our entire stack. While you bring deep applied AI expertise, this is fundamentally a full stack engineering role where you'll contribute broadly to our platform's development and use your AI experience to guide and impact what we build.

• Architect AI-first systems: Design and implement robust architectures for AI-powered features, focusing on things like evaluation frameworks, testing harnesses, and monitoring systems that ensure reliable production deployment of LLM-based features.

• Drive AI development practices: Define and implement best practices for prompt engineering, evaluation, and testing methodologies. Stay at the forefront of emerging techniques in AI development, bringing insights from academic research into practical engineering solutions.

• Shape developer experience: Design and build intuitive APIs, workflows, and tools that make complex AI testing and evaluation accessible to developers without AI/ML backgrounds. Draw from your experience with existing AI frameworks and tooling to create delightful developer experiences that help teams ship confidently.

• Build evaluation infrastructure: Create comprehensive testing and evaluation frameworks that enable teams to measure, compare, and optimize their AI features across multiple dimensions including accuracy, reliability, toxicity, and performance.

• Build alongside the founding team: Work hand-in-hand with our founding team to ideate, prototype, and deliver innovative solutions that address user needs and create value for our customers.

• Shape our engineering culture & process: Implement rigorous testing, code reviews, and continuous integration processes to maintain high-quality, production-ready code while minimizing technical debt.

We’d love to hear from you if…

• You have a minimum of 5 years full-time professional experience in software engineering with at least a year of experience building with Generative AI in production.

• You have a strong product sense and ability to leverage your technical expertise to solve customer and business problems.

• You’re a pro-social, strong communicator that enjoys working on a tight-knit collaborative team.

• Working on a team that cares as much about how we work as much as the code we write sounds exciting.

• Our company values resonate with you.

• The way we run our Engineering team resonates with you and helping further shape and define this sounds invigorating.

• Are eager to work on-site*, in-person 3+ days a week at a beautiful office at the base of the Rockies in Boulder, CO

The details

• Competitive salary and equity package

• Benefits including medical, dental, vision

• Top of the line hardware - brand new Macbook, monitor, peripherals

• Four weeks Paid Time Off per year (we actually want you to use it)

• Relocation assistance negotiable*

* We have a preference for candidates available to work at least a couple days per week on-site in Boulder, CO. We are open to considering exceptional remote candidates, though we do ask for a commitment to travel and spend time regularly with our team in person.