Research Quality Specialist

About Turing

Turing is one of the world’s fastest-growing AI companies accelerating the advancement and deployment of powerful AI systems.Turing helps customers in two ways: Working with the world’s leading AI labs to advance frontier model capabilities in thinking, reasoning, coding, agentic behavior, multimodality, multilinguality, STEM and frontier knowledge; and leveraging that work to build real-world AI systems that solve mission-critical priorities for companies. Role Overview: We are actively seeking talented developers proficient Java Engineer. The engineer will be working  together on the definition, design, and delivery of new features with cross-functional teams. The company is developing the next generation of dialog agents, which will have a wide range of uses in areas including education, entertainment, and general question-answering. This is an exciting opportunity for candidates who are keen to learn in a fast-paced setting. What does day-to-day look like: • Design, develop, and maintain efficient, high-quality code to train and optimize AI models. •

Conduct evaluations (Evals)

to benchmark model performance and analyze results for continuous improvement. • Evaluate and rank AI model responses to user queries across diverse domains, ensuring alignment with predefined criteria. • Develop comprehensive explanations and rationales for evaluations, showcasing excellent reasoning and technical expertise. • Lead efforts in

Supervised Fine-Tuning (SFT)

, including creating and maintaining high-quality, task-specific datasets. • Collaborate with researchers and annotators to execute

Reinforcement Learning with Human Feedback (RLHF)

and refine reward models. • Design innovative evaluation strategies and processes to improve the model's alignment with user needs and ethical guidelines. • Create and refine optimal responses to improve AI performance, emphasizing clarity, relevance, and technical accuracy. • Conduct thorough peer reviews of code and documentation, providing constructive feedback and identifying areas for improvement. • Collaborate with cross-functional teams to improve model performance and contribute to product enhancements. • Continuously explore and integrate new tools, techniques, and methodologies to enhance AI training processes. Required Skills: • Train LLM models with high-quality, stable, and scalable back-end components using the newest coding best practices in a variety of languages and frameworks. • Participate in code reviews to ensure that the standards for code quality are met • Demonstrate your proficiency with your language of choice, while covering all bases • Provide clear, clean, well-organized, correct, and clearly annotated/classifiable code in the responses • Bachelor’s/Master’s degree in Engineering, Computer Science (or equivalent experience) • Demonstrable experience with developing web apps using modular development and scalable architectures as well as a strong focus on code readability and security/stability (i.e. testing) • Proficiency with Java's syntax and conventions • Nice to have some prior software Quality Assurance and Test Planning experience • Excellent spoken and written English communication skills

Perks of Freelancing With Turing

• Work in a fully remote environment. • Opportunity to work on cutting-edge AI projects with leading LLM companies.

Offer Details

•

Commitments Required

at least 4 hours per day and minimum 20 hours per week with overlap of 4 hours with PST. (We have 3 options of time commitment: 20 hrs/week, 30 hrs/week or 40 hrs/week) •

Engagement  type

Contractor assignment (no medical/paid leave) •

Duration of contract

: 1 month; [expected start date is next week]

Evaluation Process (approximately 75 mins)

• Two rounds of interviews (60 min technical + 15 min cultural &, offer discussion)