QA Automation Engineer - GenAI

QA Automation Engineer – GenAI

Location:  Abu Dhabi
Experience: 7+ Years
Company: NorthBay Solutions

About NorthBay Solutions

NorthBay Solutions is a global digital transformation company delivering innovative cloud-native and AI/ML-powered solutions. We solve complex business challenges with a focus on modern technologies and real-world impact. At NorthBay, we promote a culture of excellence, ownership, and continuous learning.

Note: This is a full-time onsite role based in Abu Dhabi, UAE. Only UAE based candidates can apply.

Position Overview

We are hiring a QA Automation Engineer – GenAI with 7+ years of experience.  This role demands a strong foundation in automation testing and a passion for quality across cloud-native, AI/ML, and GenAI platforms.

Key Responsibilities

• Design and execute detailed test strategies, test plans, and test cases

• Conduct functional, integration, performance, and security testing

• Build and maintain automation frameworks using Pytest, Selenium , or similar tools

• Perform thorough API testing using Postman or comparable tools

• Collaborate with DevOps to integrate test automation in CI/CD pipelines

• Validate AI/ML and GenAI solutions by:

  • Testing model accuracy, fairness, and performance

  • Detecting bias and validating robustness

  • Ensuring input/output data quality

• Manage and track defects using tools such as JIRA

• Provide mentorship to junior QA engineers and promote quality best practices

Required Qualifications

• 7+ years of hands-on experience in QA and automation engineering

• Proficiency with automation tools (e.g., Pytest, Selenium)

• Strong skills in API testing

• Knowledge of CI/CD integration

• Solid understanding of software testing methodologies and lifecycle

• Experience with functional and non-functional testing

• Excellent communication and team collaboration skills

Preferred Skills

• Experience testing AI/ML and GenAI systems, including:

  • Model validation and bias detection

  • Feature/data pipeline testing

  • Robustness and performance evaluation

• Familiarity with cloud platforms (AWS, Azure, GCP)