May 21, 2026

Graphic Design Expert

HumanSignal Austin, Texas

At HumanSignal, we’re building the platform that powers the creation, curation, and evaluation of that data. We started before foundation models were mainstream, and we’re doubling down now that AI is eating the world. About The Project You’ll evaluate and rate graphic design elements on standardized quality scales to train AI models that assess design effectiveness—contributing to cutting‑edge technology that advances how AI understands and evaluates visual content quality. What You’ll Do Review and rate graphic design elements using our Label Studio Enterprise platform across multiple quality dimensions: Typography quality (readability, hierarchy, font pairing appropriateness) Visual hierarchy effectiveness (clarity, balance, focal point strength) Design element execution (icon quality, illustration polish, image selection) Color palette effectiveness (harmony, contrast, accessibility) Layout and composition quality (grid usage, spacing, alignment) Overall design effectiveness and professional polish Apply consistent 1‑5 rating scales across hundreds of design examples Provide clear, objective assessments based on established design principles Follow detailed rating guidelines and rubrics to maintain consistency Process high volumes of design samples with sustained attention to detail Participate in weekly calibration sessions to align rating standards Meet quality benchmarks for rating consistency and inter‑rater reliability Basic Qualifications Required Experience Formal training in graphic design, visual arts, or related field (degree, certificate, or bootcamp completion) OR 2‑3 years of professional graphic design experience Strong proficiency in design principles (composition, color theory, typography, visual hierarchy) Ability to objectively critique and evaluate design work against industry standards Understanding of what constitutes effective vs. ineffective design choices Experience reviewing or providing design feedback Exceptional attention to detail and ability to maintain focus during repetitive tasks Skills & Attributes Comfort with highly repetitive work—ability to maintain quality and engagement while rating similar content for extended periods Strong visual discrimination and consistent aesthetic judgment Reliability and consistency in applying rating standards Self‑motivated with ability to work independently on repetitive tasks Excellent focus and concentration for sustained periods Strong communication skills for flagging edge cases or unclear examples Comfortable with feedback and recalibration Minimum 10 hours per week availability for at least 3 months Nice‑to‑Haves Preferred Background Portfolio demonstrating diverse design work and critical eye Experience as a design reviewer, art director, or in quality assurance roles Understanding of accessibility standards (WCAG, inclusive design principles) Knowledge of design across multiple contexts (branding, editorial, digital, UX/UI) Experience teaching or mentoring design concepts Technical Experience Experience with Figma, Sketch, or other modern design tools Prior data annotation, content moderation, or quality evaluation experience Exposure to machine learning or computer vision concepts Familiarity with design systems and component libraries Work Style High tolerance for repetitive evaluation tasks—finds rhythm and satisfaction in systematic work Ability to maintain consistent standards across thousands of ratings Strong pattern recognition—quickly identifying quality patterns across examples Disciplined, methodical approach with minimal variation in judgment Problem‑solving mindset for handling ambiguous or borderline cases Interest in AI/ML applications in design and creative fields Previous remote work experience with self‑directed tasks What Makes Someone Successful in This Role You thrive on consistency and repetition — you find satisfaction in systematic work and can maintain quality standards while evaluating similar content repeatedly without losing focus or accuracy. You have a calibrated design eye — you can quickly assess design quality against objective criteria and apply the same standards consistently across hundreds or thousands of examples.

Create an account to see the full posting, access our search engine, and more.

TheCreativeLoft is a better way to find jobs. Find out more:

You're just 60 seconds away from your new Creativeloft account.

Looking For Similar Jobs?