Note: The job is a remote job and is open to candidates in USA. Meridial Marketplace, by Invisible is seeking independent Finance and Insurance Specialists for an AI benchmark evaluation project. The role involves designing evaluation frameworks and generating structured training data to ensure the accuracy of AI models in the finance and insurance sectors.
Responsibilities
- Task & Prompt Creation: Generating realistic, high-quality prompts that compel the AI model to produce complex, professional-grade deliverables specific to the finance and insurance sectors
- Rubric Development: Writing clear, well-structured evaluation rubrics with criteria that are highly specific, non-ambiguous, and easy to score
- Benchmark Evaluation Data Generation: Producing clean, reliable training data that directly aids in the evaluation and refinement of AI models handling industry-specific tasks
- Quality Assurance & Fact-Checking: Ensuring all generated tasks and scoring criteria reflect strict, real-world industry standards and regulatory realities
Skills
- Demonstrable professional expertise within the Finance and Insurance sectors, with a deep understanding of industry standards, terminology, and high-level deliverables
- Strong writing and prompt generation skills, with the ability to design highly realistic, complex task scenarios for AI evaluation
- Proficiency in rubric generation, specifically the ability to create objective, non-ambiguous scoring criteria that leave no room for subjective interpretation
- A meticulous, detail-oriented approach to generating clean, reliable data for system benchmarking
Benefits
- As a contractor you’ll supply a secure computer and high‑speed internet; company‑sponsored benefits such as health insurance and PTO do not apply.
Company Overview
We are the AI training and scaling partner for the leading foundation model providers, enterprises, and governments, bridging the gap between AI potential and production. It was founded in 2015, and is headquartered in , with a workforce of 201-500 employees. Its website is https://www.meridial.ai/.