Senior Manager- AI Safety and Evaluation Engineering

Abu Dhabi Commercial Bank is seeking a senior AI safety and evaluation engineering leader in Abu Dhabi. The role develops repeatable methods for assessing generative AI systems and helps embed evaluation, testing and guardrails into AI delivery. It combines technical leadership with risk awareness, with particular attention to reliability, adversarial behaviour, fairness, explainability and responsible use in regulated banking workflows.

Key Responsibilities

• Define consistent evaluation rubrics and scoring methods for the performance, reliability and safety of different generative AI system types.
• Create test cases covering routine behaviour, probabilistic responses, edge cases and adversarial scenarios, then curate suitable test data.
• Design automated evaluators such as model-based judges, smaller specialised models and deterministic checks.
• Determine which development-stage tests and guardrails should be carried into live applications and oversee implementation by use case.
• Partner with AI platform product and engineering teams to integrate evaluation workflows into an LLMOps environment.
• Apply explainability and bias-detection approaches to improve transparency and support risk and regulatory expectations in areas such as lending and fraud.

Requirements and Qualifications

• Bring substantial hands-on experience in AI, machine learning, software engineering, model evaluation or a closely related discipline.
• Understand evaluation approaches for language models, retrieval-augmented systems, agents and AI-enabled data access.
• Be able to lead cross-functional delivery and explain technical risk clearly to product, engineering and governance stakeholders.
• Use sound judgement, keep records accurate and follow relevant policies, confidentiality expectations and internal controls.
• Relevant education, technical training or equivalent practical experience in the field is beneficial; any mandatory credential should be confirmed before applying.

Skills

• Generative AI, LLM Evaluation, AI Safety, Red Teaming and related practical methods relevant to the position.
• Clear written and verbal communication with colleagues, customers and other stakeholders.
• Organisation, careful documentation and the ability to manage priorities and deadlines.
• A collaborative approach to problem-solving, continuous improvement and responsible decision-making.

Employment Details

• Company: Abu Dhabi Commercial Bank
• Location: Abu Dhabi, UAE
• Employment Type: Full Time
• Function: Artificial Intelligence

Application

Applicants can review the role details and submit their application through the online application page.