Purpose of Position

We are seeking a QA Engineer with a passion for ensuring the quality and reliability of AI-driven solutions. You will focus on testing our advanced AI system, powered by large language models (LLMs), ensuring it meets high standards of performance, accuracy, and user experience. You will collaborate closely with developers, data scientists, and product managers in a fast-paced, innovative environment

Key Tasks & Responsibilities

Creating test plan, test cases and documenting them.
Develop and execute comprehensive test plans for AI and LLM-based applications.
Design automated test scripts and frameworks to validate AI functionality, including model outputs, API integrations, and performance metrics.
Conduct functional, regression, performance, and security testing of the AI solution.
Identify, document, and track defects to resolution, ensuring continuous improvement in product quality.
Collaborate with cross-functional teams to establish best practices for testing AI systems.
Implement testing strategies for bias, fairness, and explainability in AI outputs.
Provide feedback on system design to enhance testability and usability.
Participate in the whole project lifecycle - from requirements gathering to releasing the product to the customers, operation and maintenance.
Identify potential problems/bugs in an early stage of development using static analysis tools, code quality metrics, code reviews and peer programming.
Ownership of bugs raised and help developers solve root cause.
Carry risk assessments and do risk-based testing.

Skills & Expertise

Required:

3+ years of experience in software quality assurance, desirable 1+ years focused on AI/ML systems.
Testing: Detailed understanding of the software testing pyramid.
Experience in QA for AI/ML Systems: Strong background in testing machine learning or AI-based products, with a focus on understanding LLMs.
Programming Proficiency: Expertise in Python or JavaScript for writing automated tests.
Knowledge of Testing Tools: Hands-on experience with tools like Selenium, Postman, or Pytest.
API Testing: Solid experience in testing RESTful APIs and working with JSON.
Performance Testing: Ability to test and analyze system performance under varying conditions.
Data Validation: Understanding of data quality, consistency, and preprocessing in AI pipelines.
Attention to Detail: Ability to detect subtle anomalies in AI output.
Problem-Solving: A proactive approach to identifying and resolving issues.
Security: Comfortable about applying information security, able to design and implement solutions with mitigation against security threats
Work style: They can work mostly autonomously, guided by project requirements.

Nice to have:

Experience with LLMs: Familiarity with tools like OpenAI GPT, Hugging Face, or similar frameworks.
DevOps Knowledge: Experience in CI/CD pipelines and containerization (Docker/Kubernetes).
Cloud Platforms: Working knowledge of cloud environments like AWS, Azure, or GCP.
Bias Testing: Skills in testing AI models for fairness, ethics, and bias.
Visualization Tools: Familiarity with tools like Jupyter Notebooks for AI testing.

Our Offer

Flexi-Week and Work-Life Balance: We prioritise your mental health and wellbeing, offering you a flexible four-day Flexi-Week at full pay and with no reduction to your annual holiday allowance. We also offer a variety of different paid special leaves.
Remote Working Allowance: You will receive a monthly allowance to cover part of your running costs. In addition, we will support you in setting up your remote workspace appropriately.
Flexi-Office: We offer an international culture and flexibility through our Flexi-Office and hybrid/remote work possibilities to work across Awin regions
Meal Vouchers: You will be supported with a certain net sum to spend it on a variety of lunches.
Health & Wellbeing: The insurance covers several types of health, vision and / or dental treatments for you and for up to one additional family member.
Remote Working Furniture Package: After 3 months of employment, you will be eligible for a furniture package, which should enable you to set up a proper workplace at your remote working location
Appreciation: Thank and reward colleagues by sending them a voucher through our peer-to-peer program.

Established in 2000, Awin is proud of our dynamic, social and inclusive culture.

Like all businesses, we’ve had to adapt and nurture our culture in a virtual environment. Our virtual ‘Life @ Awin’ hub brings our colleagues from across the globe together for various social activities.

Diversity & Inclusion are paramount to us, and we proudly pursue and hire diverse team members. We champion uniqueness and authenticity; this is who we are at our core. Our network of affiliate partnerships are diverse and transparent, as are the employees powering our vision to build the world’s leading open partner ecosystem. We welcome all backgrounds, identities, and experiences. If you need support at any point in the application or interview process, please let us know.

Apply now to begin the next stage of your career at a progressive company that supports both your professional and personal development.

#LI-RS1

Apply for this Job

* Required

First Name *

Last Name *

Email *

Phone *

Resume/CV *

Dropbox Google Drive

(File types: pdf, doc, docx, txt, rtf)

What are your annual, gross salary expectations? (Please include currency) *

What is your current notice period / availability to start in a new role? *

Not everyone has an automatic right to work in each of the locations that Awin hire. It therefore may be necessary for us to confidentially request further information regarding your eligibility in conjunction with local right to work considerations for this vacancy. To ensure we can identify any necessary immigration formalities, please select the option that fits your application best: *

In an effort to demonstrate that Awin has defined and put in place best-practice information security processes and is looking to protect our stakeholder's sensitive data, we are complying with the ISO 27001 standard. To properly assess your application against these standard, we are kindly asking you to confirm that your application documents are providing a truthful account of your employment history. *

About your personal data *

You have the right to access your personal data, to request the correction, deletion, and restriction of use of your personal data and to receive a machine-readable copy of your personal data and have it transferred to other IT systems. You can find further information about the processing of your personal data in the Data Job Applicants Privacy Policy.

With the submission of your application you confirm the following: *

I hereby declare that I have given all information truthfully. I am aware that false information may lead to dismissal even after official employment.

Enter the verification code sent to to confirm you are not a robot, then submit your application.

Security Code *

This application was flagged as potential bot traffic. To resubmit your application, turn off any VPNs, clear the browser's cache and cookies, or try another browser. If you still can't submit it, contact our support team through the help center.