Graphic Designer - AI Media Evaluation

Outlier is an innovative AI training platform brought to you by Scale AI. At Outlier, we embed your expertise into a range of projects, from crafting training data to assessing AI model performance.

About the Opportunity:

We are on the lookout for meticulous English speakers who are eager to review AI-generated media content. Engage in live conversations with AI voice models and assess each interaction, compare AI-generated images and videos to determine which adheres better to the prompts, and provide detailed written explanations of any discrepancies you notice—all from the comfort of your home and on your own schedule.

Your insights will play an essential role in refining the capabilities of advanced AI systems, turning cutting-edge research into practical AI applications.

Responsibilities:

Conduct live, scenario-based conversations in English with AI voice models, then rate how natural, useful, and clear each sounded.Assess pairs of AI-generated images and videos to decide which one aligns better with the prompt.Carefully examine output, utilizing zooming and replaying to identify issues such as distorted anatomy, flickering or unnatural motion, textual errors, and audio mismatches with the video.Rate each output on criteria including adherence to the prompt, quality, and realism. Provide detailed written feedback highlighting specific observations.

Common Tasks:

Image Evaluations: Compare two AI-generated images based on the same text prompt and select the superior one, evaluating adherence to instructions, visual quality, and acknowledgment of AI artifacts.Video Evaluations: Assess AI-generated videos against a text prompt or compare edited videos to their original clips.Video Caption Labeling: Edit first-person videos capturing hands-on tasks of people or robots. Break down each clip into discrete actions and craft precise captions, refining an AI-generated draft.Audio and Voice Evaluations: Evaluate AI-generated speech based on naturalness, pronunciation, and fidelity to a target voice. Some tasks will require you to record your voice to explain your choices.

Ideal Qualifications:

Fluent in English with sharp written communication skills, capable of natural conversational speech.Exceptional attention to detail and patience to analyze closely, with readiness to replay or zoom in on specifics.Comfortable thinking on your feet and conversing through realistic scenarios in an engaging manner.Experience in composing concise, evidence-backed reviews or explanations.Able to make clear judgments, even when presented with flaws on both sides.Bonus: Currently pursuing or holding a Bachelor’s degree or higher.

What You'll Need to Sign Up:

A valid ID and mobile phone number from your home country.A current resume that highlights your skills and expertise.A LinkedIn profile detailing your educational background and professional experience.

Payment:

Project Work: Earn up to USD $15 per hour.Additional Incentives: Participants typically earn an extra 7.5% through Missions, Outlier's surge pricing feature. Top performers see an average increase of 11% in their earnings.Payment Schedule: Payments are processed weekly on Tuesdays, reflecting tasks completed in the previous week (from Tuesday to Monday at midnight UTC), via PayPal, AirTM, or ACH transfer.Rates may vary based on your experience, location, skill assessment, and project requirements. For instance, advanced degrees like PhDs could attract higher pay. Initial onboarding or additional hours may result in lower rates, and specific projects may offer extra incentive payments.

Why Join Outlier:

Enjoy the freedom to work flexibly from anywhere, anytime, with no minimum hour requirement. Tailor your schedule to fit your needs, whether you want to commit to five hours a week or more.Gain complimentary access to top-tier LLMs valued at over $200/month.Join a community of over 900K Outlier Experts across 52 countries, with more than $600M disbursed to contributors.Collaborate with fellow experts to enhance pre-release models and drive innovation.

How to Apply:

Create an account on the Outlier platform.Upload your resume.Submit your valid ID.Start earning by engaging with assigned tasks.

Currently Accepting Applicants From: Australia, Canada, Ireland, New Zealand, United Kingdom, and United States.

Please Note: This is a 1099 contract role on the Outlier.ai platform. As a freelancer/independent contractor, you will not be considered an employee. Please ensure that you have the authorization to work in your country of residence. If you're an international student, you may still apply if on a suitable visa. Consult with your tax or immigration advisor for guidance specific to your situation.