Role Overview

Relyance AI is seeking a Quality Assurance (QA) and Data Labeling Specialist to help us execute our one-stop privacy platform at the highest level. In this role, you will partner with machine learning (ML) engineers, legal experts, and external vendors to enforce the highest quality in customer-facing predictions of ML models and curate and deliver high-quality labeled data to train these models. By developing and improving QA and labeling workflows, you will play a central role in fostering the culture of high quality and operational efficiency necessary to drive 5-star customer experiences. To succeed in this role, you will have a strong attention to detail and an analytical mindset.


  • Perform QA of customer-facing content in the Relyance AI application (predictions of machine learning models in particular), find patterns in errors and report on your findings
  • Collaborate with external vendors, machine learning engineers, and legal experts to curate, QA, and deliver high-quality labeled data
  • Develop and improve QA and data labeling workflows to drive operational efficiency
  • Establish and improve metrics collection and reporting

You are a good fit if you have:

  • A Bachelor’s degree
  • Strong attention to detail
  • Strong project management skills
  • Basic knowledge of Python or other programming languages
  • An analytical mindset and an ability to find patterns
  • Excellent written and verbal communication skills
  • A strong sense of ownership, urgency, and drive
  • An ability to handle ambiguity and changing priorities
  • Experience in a QA role (preferred)
  • Experience working as a paralegal (preferred)
  • Experience labeling ML data sets (preferred)
  • Experience writing or editing content for a web product (preferred)

Apply for this Job

* Required