Sr. Generative AI Tester (Airline Domain)

Develop and support AI applications using Python, Generative AI, and Large Language Models (LLMs). Design, execute, and automate comprehensive AI test strategies across the AI application lifecycle. Validate AI models, LLMs, AI agents, and agentic workflows for accuracy, consistency, reliability, and safety. Perform functional, integration, regression, performance, security, and user acceptance testing for AI solutions. Conduct LLM evaluation, prompt testing, hallucination testing, bias and fairness assessments, and guardrail validation. Develop automated frameworks for testing AI agents, chatbots, copilots, and autonomous workflows. Define and track AI quality metrics, benchmarks, and acceptance criteria. Identify, analyze, and resolve defects related to AI outputs, workflows, and model behavior. Collaborate with business stakeholders and development teams to ensure production-ready AI solutions for airline operations.

Desired Candidate Profile

Strong programming expertise in Python. Hands-on experience with LLMs, Generative AI, RAG architectures, Vector Databases, and AI Models.

Keywords