We are sharing a specialised part-time consulting opportunity for experienced social services professionals with strong real-world judgment, practical execution ability, and the ability to design high-quality prompts, task executions, and evaluation rubrics for AI research workflows.
This role supports an exciting frontier AI research initiative focused on helping AI systems better understand and complete nuanced real-world tasks through high-quality human-designed prompts, realistic task execution, and structured evaluation standards.
Selected professionals will claim tasks across a wide range of real-world activities, write clear and realistic prompts, execute tasks while recording their screen, develop detailed evaluation rubrics, and help improve overall model quality. This opportunity is especially well-suited to professionals who can translate real-life human workflows into structured AI training and evaluation tasks with clarity, realism, and strong practical judgment.
Key Responsibilities
Professionals in this role may contribute to:
Real-World Task Design
Claim tasks across a wide range of real-world archetypes and activities people commonly ask AI to help with
Write clear, realistic prompts grounded in practical human workflows
Help ensure that prompts reflect nuanced, real-life activities rather than abstract or purely factual tasks
Task Execution & Documentation
Execute assigned tasks while recording screen activity
Translate real-world workflows into structured execution examples for AI research
Help create realistic demonstrations of how people interact with AI systems in everyday contexts
Evaluation Rubric Development
Write detailed evaluation rubrics to assess AI performance on each task
Apply professional judgment to define what high-quality execution looks like
Help improve model quality through careful, structured evaluation design and task realism
Ideal Profile
Strong candidates may have:
Professional experience in social services or closely related real-world support environments
Strong practical judgment and the ability to reflect how people actually interact with AI systems
Clear written communication skills
Ability to work independently and turn around tasks quickly
Comfort creating structured prompts, executions, and evaluation criteria
Preferred Qualifications
Experience designing or evaluating real-world service workflows
Strong consistency in producing realistic, detailed, and well-structured written work
Comfort working across a broad range of everyday task types and human-centered scenarios
Ability to translate lived professional experience into useful AI training and evaluation artifacts
Why This Opportunity
Contribute specialised real-world expertise to a first-of-its-kind AI research initiative
Help improve how AI systems understand and complete nuanced everyday tasks
Work on high-impact human-centered evaluation tasks with strong practical relevance
Flexible remote work with competitive hourly compensation
Contract Details
Independent contractor role
Fully remote with flexible scheduling
Hourly compensation of $50–$200 per hour
Minimum commitment of 15 hours per week
Tasks should typically be completed within 24 hours
Ongoing research project with long-term potential
A desktop or laptop computer is required, and Chromebooks are not supported
Projects may be extended, shortened, or concluded early depending on project needs and performance
Weekly payments via Stripe or Wise
Work will not involve access to confidential or proprietary information from any employer, client, or institution
Please note: We are unable to support H1-B or STEM OPT candidates at this time
Start date: Immediate
About The Platform
This opportunity is available through a leading AI-driven work platform that connects domain experts with frontier AI research projects.
Experts contribute to improving advanced AI systems by providing specialised expertise across real-world workflows, structured evaluation, model training support, and domain-specific content validation.
By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy: https://www.24-mag.com/privacy-policy
Show more
Show less