About The Company
Turing is a leading technology company dedicated to advancing artificial intelligence and machine learning solutions. Renowned for its innovative approach, Turing specializes in developing cutting-edge AI systems that transform industries and empower businesses worldwide. The company's mission is to accelerate the deployment of powerful AI technologies by fostering a collaborative environment that attracts top talent from around the globe. With a focus on research, development, and practical application, Turing is at the forefront of AI innovation, working on projects that shape the future of software engineering and intelligent automation.
About The Role
We are seeking highly experienced software engineers at the tech lead level to join our dynamic team working on large language model (LLM) evaluation and training datasets. This role offers an exciting opportunity to contribute directly to the development of datasets designed to enhance LLM performance on realistic software engineering tasks. The ideal candidate will possess a deep understanding of high-quality public repositories on GitHub and have a proven track record in software development, environment automation, and issue triaging. Your expertise will be instrumental in evaluating test coverage, assessing code quality, and supporting the creation of verifiable SWE tasks based on synthetic approaches with human-in-the-loop methodologies. This position provides a unique chance to blend advanced software engineering skills with AI research, influencing the future of AI-assisted programming tools.
Qualifications
The ideal candidate will possess a minimum of three years of professional experience in software engineering, with strong proficiency in JavaScript and TypeScript. You should have hands-on experience with version control systems such as Git, containerization tools like Docker, and basic software pipeline setup. Familiarity with navigating and understanding complex codebases, along with the ability to run, modify, and test real-world projects locally, is essential. Experience contributing to or evaluating open-source projects is considered a plus. Additional skills that will enhance your application include prior participation in LLM research or evaluation projects, and experience in building or testing developer tools or automation agents.
Responsibilities
- Analyze and triage GitHub issues across trending open-source libraries to identify challenging tasks for LLMs.
- Set up and configure code repositories, including Dockerization and environment setup, to facilitate testing and evaluation.
- Evaluate unit test coverage and quality to ensure datasets are robust and comprehensive.
- Modify and run codebases locally to assess LLM performance in bug-fixing and code generation scenarios.
- Collaborate closely with research teams to design and select repositories and issues that push the boundaries of current LLM capabilities.
- Lead and mentor junior engineers, fostering a collaborative environment and ensuring project milestones are met.
Benefits
Joining Turing offers a range of benefits tailored to support your professional growth and work-life balance. You will have the opportunity to work remotely from anywhere in the world, providing flexibility and comfort. You will be involved in cutting-edge AI projects that have a meaningful impact on the future of software development and automation. Turing also provides a collaborative, innovative environment where your contributions are valued and recognized. Additionally, you will gain exposure to a global network of talented professionals and have access to resources that support your continuous learning and development in AI and software engineering.
Equal Opportunity
Turing is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate based on race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status. We believe that a diverse team fosters innovation and drives success, and we welcome applicants from all backgrounds to apply and contribute to our mission of advancing AI technology.
IN
