Prompt Engineer

Job Title

Location: Fully Remote

Work Hours: 4 PM to 1:30 AM IST with daylight savings (Till 3 PM CST)

Experience Required: 2+ Years

As a Prompt Engineer, you will design, evaluate, and refine prompts that drive intelligent behavior in AI-enabled features across our platform. You will work closely with data scientists, engineers, and product leaders to develop prompt frameworks and dialogue flows that power agentic orchestration, helping patients navigate complex health journeys. 

Responsibilities

Architect reusable prompt templates for multi-turn conversational flows, including clarification, escalation, human-in-the-loop, and action triggering 

Work with engineers and data scientists to test and optimize RAG-based search prompts 

Create and maintain prompt libraries with robust versioning and testing frameworks 

Collaborate on agentic workflows that help agents act autonomously and intelligently across clinical, scheduling, and care navigation use cases 

Evaluate prompt performance using real-time analytics and partner with the data science team to iterate 

Support safe prompt handling of PHI, bias mitigation, and hallucination reduction 

Develop challenger agents and evaluation agents to confirm agent output and ensure safe and consistent messaging to MyBSWHealth customers 

Minimum Qualifications

• Bachelor's degree in Computer Science, Linguistics, Philosophy, Cognitive Science, or comparable experience in industry or a related field 
• 2+ years working with LLMs (e.g., GPT, Claude, Mistral, etc.) in production settings 
• Experience with prompt engineering, RAG, or agentic AI architectures 
• Familiarity with healthcare – or other regulated industry - workflows, EHR systems, or clinical terminology is a plus 
• Strong understanding of conversational UX and prompt evaluation metrics 
• Experience with Pydantic AI python library and n8n workflow automation software suite preferred