Job description
Role overview
Tec Partners seeks a Quality Engineer with AI expertise to design and implement robust testing frameworks for LLM and agentic AI systems. This role requires advanced automation skills and a deep understanding of AI evaluation pipelines.
Key responsibilities
- Develop Python-based test frameworks for LLM/RAG evaluation
- Design automated testing strategies across unit, integration, and regression environments
- Assess AI system risks and operational failure modes
- Validate technical solutions against governance, audit, and security standards
- Collaborate with engineering teams to optimize evaluation pipelines
Responsibilities
- Create and maintain Python automation frameworks for AI evaluation
- Evaluate LLM and RAG systems using custom testing methodologies
- Implement regression testing for AI operational pipelines
- Assess technical solutions against governance and security requirements
Requirements
- Strong Python development experience for test automation
- Expertise in LLM/RAG evaluation tools and custom pipelines
- Proven track record in unit/integration testing environments
- Understanding of agentic AI systems and failure modes
Benefits
- Competitive salary £39,000-£45,000 per year
- Professional development in AI/ML testing methodologies
Keywords
Pythonautomated testingLLM evaluationRAG systemsagentic AItest frameworksregression testingsecurity compliancegovernanceAI risk assessment