Nov. 4, 2026

Graphic Designer - AI Media Evaluator

Outlier AI Reno, Nevada Up to $15 an hour
Apply Sign up to apply

Outlier, an innovative AI training platform by Scale AI, is on the lookout for meticulous individuals to join our team as Graphic Designers focused on AI Media Evaluation. In this role, you will work on exciting projects that involve generating training data and evaluating the performance of AI models.

About the Opportunity:

As a key contributor, you will have the chance to:

Engage in live, conversational interactions with AI voice models, scoring each exchange based on clarity and usefulness.Compare AI-generated images and videos to determine which aligns better with the provided prompts.Carefully scrutinize outputs, identifying issues like distorted features, unnatural movements, and inaccuracies in audio-visual synchronization.Provide detailed written feedback on your evaluations, helping to refine and advance AI systems.Responsibilities:

Conduct scenario-based conversations in English with AI voice models and evaluate their naturalness and utility.Judge pairs of AI-generated media (images/videos) for adherence to prompts and overall quality.Inspect outputs in detail while documenting any anomalies or areas for improvement.Rate outputs according to specified criteria and clearly articulate your observations.Common Tasks Include:

Image evaluations: Assess AI-generated images based on prompt adherence and quality.Video evaluations: Rank AI-produced videos according to their relevance to text prompts.Video caption labeling: Create precise captions for video clips depicting actions.Audio and voice evaluations: Assess the naturalness and accuracy of AI-generated speech.Ideal Qualifications:

Fluency in English with strong written communication skills.Excellent attention to detail and the ability to analyze media closely.Comfortable with dynamic thinking and problem-solving in realistic scenarios.Experience crafting concise, evidence-based reviews or explanations.Nice to Have:

A Bachelor's degree or higher.Compensation:

Earn up to USD $15 per hour, with potential additional incentives of 7.5% on average, and top performers can increase their earnings substantially. Payment is processed weekly, ensuring you receive compensation for your valuable contributions promptly.

Why Join Outlier?

Work flexibly from anywhere with no minimum hour requirements.Benefit from free access to leading LLMs, valued at $200/month.Join a vibrant community of over 900K Outlier Experts, with $600M paid to contributors.Collaborate with fellow experts to push the limits of AI innovation.How to Apply:

Create an account on Outlier.Upload your resume.Provide a valid ID.Start earning by completing tasks!Currently accepting applicants from Australia, Canada, Ireland, New Zealand, the United Kingdom, and the United States. Please note that this is a freelance, 1099 contract opportunity. You must be authorized to work in your country of residence, and specific conditions may apply for international students.

Create a free account to apply.

Create My Free Account

TheCreativeLoft is a better way to find jobs. Find out more:

You're just 60 seconds away from your new Creativeloft account.

Get jobs like this by email

New Graphic Design jobs in Reno, sent to your inbox.

Email Me New Jobs
Graphic Designer - AI Media Evaluator Apply

Looking For Similar Jobs?