Note: The job is a remote job and is open to candidates in USA. Prolific is a leading company in the AI space focused on building a vast pool of quality human data. They are seeking Concierges to train and evaluate AI models, where successful candidates will be invited to participate as Domain Experts and help enhance the performance of AI systems.
Responsibilities
- Reviewing AI-generated responses to scenarios a Concierge would face and rating them for accuracy, appropriateness, safety, and reasoning quality
- Comparing multiple model answers and selecting/justifying the best response
- Writing improved exemplars, rationales, or structured feedback to help models learn where they fall short
Skills
- Verified status as a Concierge (e.g., by providing a professional profile that shows both educational and professional experience)
- Recent clinical experience and comfort evaluating clinical reasoning and decision-making
- Willingness to complete a short skills/eligibility screener to join our Domain Expert pool
- Strong attention to detail and the ability to focus on complex tasks for up to one hour
- A reliable, fast internet connection and access to a computer
- Willingness to self-declare earnings (participants are self-employed)
- A PayPal account to receive payments from our clients
Benefits
- Flexible hours
- Ability to work from home
Company Overview
Building the most advanced global infrastructure for People Science. It was founded in 2014, and is headquartered in Oxford, Oxfordshire, GBR, with a workforce of 51-200 employees. Its website is https://www.prolific.com/.Company H1B Sponsorship
Prolific has a track record of offering H1B sponsorships, with 12 in 2025, 7 in 2024, 16 in 2023, 39 in 2022, 16 in 2021, 8 in 2020. Please note that this does not guarantee sponsorship for this specific role.