GenAI Delivery Manager

About this Role

About Turing: Turing is one of the world’s fastest-growing AI companies accelerating the advancement and deployment of powerful AI systems. Turing helps customers in two ways: Working with the world’s leading AI labs to advance frontier model capabilities in thinking, reasoning, coding, agentic behavior, multimodality, multilinguality, STEM and frontier knowledge; and leveraging that work to build real-world AI systems that solve mission-critical priorities for companies. Role Overview: We are building a highly accurate, evaluation-grade dataset of transcribed, multi-channel audio recordings to assess multilingual, multi-speaker AI systems. This project involves evaluating high-quality and realistic conversations representing diverse dynamics, contexts, and demographics. What does day-to-day look like: Review and evaluate AI-generated transcriptions and diarization outputs to ensure exceptionally high accuracy and adherence to strict low error-rate (WER) targets. Validate whether transcripts correctly capture spontaneous, unnormalized speech while preserving natural conversational dynamics such as overlaps, interruptions, false starts, and disfluencies. Assess the precision of turn-level and word-level timestamps, as well as speaker identification, paying special attention to complex, overlapping dialogue. Comfortably read and validate underlying JSON-formatted outputs to ensure accurate metadata tagging, diarization alignment, and timestamp logic. Identify transcription, diarization, segmentation, and alignment errors and determine whether AI output quality meets acceptance thresholds. Requirements: Fluent/Native proficiency in Italian. Exceptional ear for audio fidelity and the ability to detect subtle background noises, channel bleed, or clipping. Meticulous attention to detail for verifying word-level timestamps, diarization accuracy, and strict, unnormalized verbatim transcription rules. Ability to evaluate AI-generated transcription quality and identify recognition, segmentation, and speaker attribution errors. Preferred Qualifications: Linguists / Phonetics Experts: Deep understanding of natural, unnormalized speech patterns. Expertise in evaluating conversational dynamics and identifying transcription and diarization inconsistencies in spontaneous speech. Language Teachers: Exceptional, native-level mastery of the target language. Ability to evaluate transcript fidelity and ensure speech content is preserved without normalization or grammar correction. Professional Transcriptionists / Speech Data QA Specialists: Strong ear for audio fidelity, rigorous timestamp validation skills, experience reviewing ASR outputs, and ability to assess transcription quality against strict accuracy targets. Experience validating turn-level and word-level timestamps is highly preferred. Perks of Freelancing With Turing: Work in a fully remote environment. Opportunity to work on cutting-edge AI projects with leading LLM companies. Potential for contract extension based on performance and project needs. Offer Details: This is a flexible agreement, not a full-time or part-time employment position. Evaluation Process Shortlisting based on qualifications and relevant professional experience. Shortlisted candidates will undergo a delivery review, after which they will be ready to start!

Related Roles