Software Engineer, AI

You will work on the systems that make Respan intelligent: automated evaluations, prompt optimization, model routing, and AI-powered analysis of traces and logs. This is deeply technical AI engineering, not just API calls. We are looking for someone who understands LLMs from the inside out and can build reliable, production-grade AI systems that thousands of teams depend on daily.

Responsibilities

Design and build AI-powered features including eval frameworks and prompt optimization
Develop LLM-as-judge pipelines for automated quality assessment
Build and maintain model routing, caching, and fallback systems
Experiment with new model capabilities and translate them into product features
Collaborate with customers to understand AI workflow pain points and build solutions

Minimum qualifications

Strong software engineering skills with Python and TypeScript
Hands-on experience building with LLMs in production (not just prototypes)
Deep understanding of prompt engineering, eval methodologies, and model behavior
Willingness to work in person in Bay Area, CA

Preferred qualifications

Experience with fine-tuning, RAG, or agent frameworks
Background in ML infrastructure or MLOps
Familiarity with observability systems or developer tools
Contributions to open-source AI/ML projects

Apply for this role

Email careers@respan.ai with the following:

Your resume
A cover letter explaining why you're interested and what you'd bring
Links to your LinkedIn, GitHub, or personal website (if applicable)
A project you have built using Respan (Keywords AI)
Your Respan organization ID

Send application

Department

Product

Location

Bay Area, CA

Type

Full-time

Send application Back to all roles