QA Analyst

About Appen Appen is a leader in AI enablement for critical tasks such as model improvement, supervision, and evaluation. To do this we leverage our global crowd of over one million skilled contractors, speaking over 180 languages and dialects, representing 130 countries. In addition, we utilize the industry's most advanced AI-assisted data annotation platform to collect and label various types of data like images, text, speech, audio, and video.Our data is crucial for building and continuously improving the world's most innovative artificial intelligence systems and Appen is already trusted by the world's largest technology companies. Now with the explosion of interest in generative AI, Appen is helping leaders in automotive, financial services, retail, healthcare, and governments the confidence to deploy world-class AI products.At Appen, we are purpose driven. Our fundamental role in AI is to ensure all models are helpful, honest, and harmless, so we firmly believe in unlocking the power of AI to build a better world. We have a learn-it-all culture that values perspective, growth, and innovation. We are customer-obsessed, action-oriented, and celebrate winning together.At Appen, we are committed to creating an inclusive and diverse workplace. We are an equal opportunity employer that does not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status. Job Overview : As a member of the LLM Quality Assurance (QA) team, your main role is to check how well our AI model (LLM) performs by comparing its decisions with human labels. When there are differences, you’ll analyze them to find out why they happened and help improve the model. Your work helps make sure our AI moderation system is as accurate and fair as possible. You’ll do this by identifying common issues, spotting patterns, and supporting model improvements through Root Cause Analysis (RCA).

Key Responsibilities :

• Video and Image Comparison : Review and compare new and old videos or images to spot similarities and differences, including visual and sound details.
• Annotation : Clearly label video / image content with important details like timestamps, objects shown, and key changes or similarities.
• Data Quality Assurance : Make sure all annotations are accurate and consistent by following set guidelines and standards.
• Documentation : Keep clear records of your work, including any issues or findings from the comparison process.
• Continuous Improvement : Suggest ways to improve tools and processes based on your experience and insights from the tasks. Provide on-the-floor support, answer associate queries, and clarify quality-related concerns in real time.
• Publish and distribute daily QA performance reports to relevant stakeholders.

Qualifications :

Join us in shaping the future of AI where your attention to detail and analytical skills directly impact smarter, safer, and more reliable technology.Appen is the global leader in data for the AI Lifecycle with more than 25 years’ experience in data sourcing, annotation, and model evaluation. Through our expertise, platform, and global crowd, we enable organizations to launch the world’s most innovative artificial intelligence products with speed and at scale. Appen maintains the industry’s most advanced AI-assisted data annotation platform and boasts a global crowd of more than 1 million contributors worldwide, speaking more than 235 languages. Our products and services make Appen a trusted partner to leaders in technology, automotive, finance, retail, healthcare, and government. Appen has customers and offices globally. We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.