Senior Software Engineer – Ruby (LLM Evaluation & Repository Validation)

About Turing

Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L

Role Overview

As a Delivery Leader for our LLM Training business, you will play a pivotal role in leading our efforts to develop high-quality, foundational LLMs. This position requires managing large teams of software engineers and data scientists dedicated to performing various Supervised Fine Tuning (SFT) and Reinforcement Learning from Human Feedback (RLHF) tasks. Your leadership will ensure the delivery of superior SFT and RLHF datasets, achieving optimal outcomes in terms of quality, throughput, and cost.

What does day-to-day look like

: • Lead and manage large teams (20+)  of Python, JavaScript, Java (and other long tail of languages) developers to execute technical tasks effectively. • Collaborate closely with researcher clients, ensuring their satisfaction with the delivered work. • Maintain rigorous review processes to ensure the highest quality of datasets. • Oversee the transition of projects from initiation to stable states, taking full responsibility for delivery • Identify and implement measures to enhance the quality of Python/JavaScript/Java etc. code within the team. • Ensure the team's work is of high quality, addressing any issues related to the clarity of questions, methodology, result communication, or bugs.

Requirements

: • 8+ years of professional software engineering experience, including 3+ years in an engineering management role. • Proven experience in managing large technical teams in a delivery-oriented role with at least one of the following, ideally both: • Python or Java • Javascript • Demonstrated ability to engage in hands-on technical work, identifying and resolving quality issues. • Excellent leadership and people management skills, with a focus on motivating teams and fostering a collaborative work environment. • Strong communication and stakeholder management abilities, capable of effectively collaborating with clients and internal partners.

Why join Us?

Our company is at the cutting edge of AI and Machine Learning, offering unique opportunities to contribute to the advancement of LLMs. You will lead a team of talented individuals, collaborate with top-tier clients, and be part of a dynamic and innovative culture. We are committed to the professional growth, providing a supportive environment where you can thrive and make a significant impact in the AI industry.

Offer Details

•

Commitments Required

: At least 4 hours per day and minimum 20 hours per week with overlap of 4 hours with PST. (We have 3 options of time commitment: 20 hrs/week, 30 hrs/week or 40 hrs/week) •

Employment type

: Contractor assignment (no medical/paid leave) •

Duration of contract

: 10 months •

Location

: India & LATAM countries

Evaluation Process (approximately 120 mins)

• Two rounds of interviews (60 min technical + 60 min leadership)