Area(s) of responsibility

Key Responsibilities

• Develop Python-based automation frameworks (Pytest)
• Test LLM outputs (accuracy, hallucination, relevance)
• Validate multi-agent workflows and pipelines
• Build evaluation metrics (F1, precision, recall)
• Perform API and integration testing
• Ensure high test coverage and CI/CD integration

Required Skills

• Strong Python programming
• Automation frameworks (Pytest/unittest)
• Understanding of GenAI/LLMs
• API testing and debugging
• CI/CD and version control