Senior Software Engineer – Ruby (LLM Evaluation & Repository Validation)

About Turing:

Turing is one of the world’s fastest-growing AI companies accelerating the advancement and deployment of powerful AI systems.

Turing helps customers in two ways: Working with the world’s leading AI labs to advance frontier model capabilities in thinking, reasoning, coding, agentic behavior, multimodality, multilinguality, STEM and frontier knowledge; and leveraging that work to build real-world AI systems that solve mission-critical priorities for companies.

Role Overview:

In this role, you will be working on projects to help fine-tune large language models (like ChatGPT) using your strong analytical and English comprehension skills. The ideal candidate should have the ability to read, summarize, and break down large content into smaller logical blocks, conduct research online, validate claims made in content through online research, and work with the LLM (Large Language Models) to solve puzzles! The projects will also help you learn how to leverage AI to be a better analyst. This is your chance to future-proof your career in an AI-first world!

Your role is critical in helping fine-tune and improve large language models (like gpt), and will make you an expert on how to leverage AI to be a better analyst. This is your chance to future-proof your career in an AI-first world!

What does day-to-day look like:

You would spend time answering a variety of interesting analytical questions and creating scenarios that can train the LLM models to get better. Here are a couple of examples that models might get wrong, and You would articulate the correct answer & explanation to enable the models to learn:

Based on a given distribution of sales by month across locations, could you analyze which location has grown the most? (Hint: what time period should we look at? should we account for sudden variability at the beginning?) In a small town, there are four distinct neighborhoods: Oak, Pine, Maple, and Elm. A postman is assigned to deliver mail and can only deliver to two neighborhoods in one day, with certain rules (e.g. Oak is always visited before Pine). If he delivers to Oak and Elm on the first day, which neighborhoods does the carrier deliver to on the second day? Note: No other prior specialized domain experience is needed.

Requirements:

English Proficiency: Ability to read and write in English with a high degree of comprehension skills. Mathematical Proficiency: Strong skills in algebra, geometry, trigonometry, and calculus at the high school/college level. Problem-Solving Skills: Ability to approach complex problems systematically and creatively. Explanation Skills: Capacity to break down solutions into clear, understandable steps. Time Management: Ability to solve problems efficiently and meet deadlines. Communication: Excellent written and verbal communication skills for explaining mathematical concepts. Adaptability: Flexibility to work with various types of math problems and student needs. Commitment: Ability to work full-time, 40 hours per week. Technical Setup: Desktop/Laptop with reliable internet connection and necessary software for mathematical computations and online collaboration.

Preferred Qualifications:

Bachelor's degree in Mathematics, Engineering, Physics, or a related field. We are open to candidates who have demonstrated exceptional math skills without a formal degree. Experience in tutoring or teaching mathematics at the high school or Engineering Entrance Exam or Engineering College level. Familiarity with standardized test formats and requirements for Engineering Entrance Exam or Engineering College level.  Knowledge of mathematical software and tools is a plus (e.g., LaTeX, Google Colab).

Perks of Freelancing With Turing:

Work in a fully remote environment. Opportunity to work on cutting-edge AI projects with leading LLM companies. Potential for contract extension based on performance and project needs.

Offer Details:

Commitments Required : at least 4 hours per day and minimum 20 hours per week with 4 hours of overlap with PST. (We have 3 options of time commitment: 20 hrs/week, 30 hrs/week or 40 hrs/week) Engagement type : Contractor assignment/freelancer (no medical/paid leave) Duration of contract : 1 month; [expected start date is next week] This role will require some overlap with UTC-8:00 (2-5 hrs/day) America/Los_Angeles

Evaluation Process (approximately 80-90 mins) :

Shortlisted candidates will be sent an automated analytical  challenge  (approximately 30 mins) Once you clear the challenge, you will be redirected to a business writing assessment (English - approximately 30 minutes) followed by a language proficiency assessment (approximately 20 minutes). Once you clear these online assessments, you are ready to go!