Meridial Marketplace, by Invisible · Posted 2026-04-29
A project dedicated to assessing and benchmarking advanced agentic audio models against leading systems. The program’s mission is to evaluate and optimize model performance for real-world customer support use cases.Responsibilities Create and execute role-play–based evaluation scenarios that simulate realistic customer service interactions across multiple domains, including:Flight bookings and travel supportFinancial servicesTelecommunications and technical supportContribute to the development of diverse and representative datasets used to assess conversational audio agents.Evaluate model performance across a standardized set of qualitative and quantitative metrics.Ensure evaluations reflect real customer expectations for clarity, efficiency, and natural conversational flow.Evaluation MetricsModel performance is assessed using a combination of conversational, technical, and audio-specific criteria, including but not limited to: Task completion accuracy and efficiencyConversational naturalness (tone, flow, and coherence)Audio comprehension and response qualityInstruction adherence and contextual understandingBasic computer programming literacy, including:Understanding of JSON structuresFamiliarity with functions and methodsAbility to reason about structured data and simple logicTechnical communication clarity when handling support-style problem-solvingTechnical & Equipment RequirementsStrong verbal communication skills in a simulated customer support contextEnglish proficiency including fluency across all language skills: reading, listening, writing, and speaking.Access to a high-quality microphone to ensure clean, reliable audio input during evaluationsComfort working with structured prompts, evaluation rubrics, and technical guidelinesDevice capable of running audio recording software and opening large technical documentationWe offer a pay range of $11-to- $30.65 per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location. Final offer amounts may vary from the pay range listed above. As a contractor you’ll supply a secure computer and high‑speed internet; company‑sponsored benefits such as health insurance and PTO do not apply.Employment type: ContractWorkplace type: RemoteSeniority level: Mid‑Senior Level