About The Company
Turing is a leading technology company at the forefront of artificial intelligence and software development. Renowned for its innovative approach, Turing specializes in creating cutting-edge AI solutions that revolutionize the way software is developed, tested, and deployed. The company is dedicated to fostering a collaborative environment where talented engineers and researchers work together to push the boundaries of technology. With a global presence and a commitment to excellence, Turing continuously strives to deliver impactful AI systems that meet the evolving needs of industries worldwide.
About The Role
We are seeking experienced software engineers at the tech lead level to join our dynamic team working on advanced datasets for Large Language Model (LLM) evaluation and training. This role involves contributing to a pioneering project focused on building verifiable software engineering tasks based on public repository histories, enhanced with human-in-the-loop methodologies. The ideal candidate will possess a deep understanding of high-quality open-source repositories, particularly on GitHub, and will play a key role in automating development environments, triaging issues, and assessing test coverage and quality. This position offers a unique opportunity to influence the future of AI-assisted software engineering by working closely with researchers and engineers to develop datasets that improve LLM capabilities in real-world scenarios.
Qualifications
The ideal candidate will have a minimum of 3+ years of professional experience in software engineering, with a strong focus on JavaScript and TypeScript. Proficiency in version control systems such as Git, containerization tools like Docker, and experience setting up and managing software pipelines are essential. Candidates should be capable of understanding complex codebases, running and modifying projects locally, and evaluating code quality effectively. Experience with open-source contributions or evaluations is considered a plus, as it demonstrates familiarity with community standards and collaborative development processes. Strong problem-solving skills, attention to detail, and the ability to work independently are vital for success in this role.
Responsibilities
- Analyze and triage issues across trending open-source libraries hosted on GitHub, identifying areas where LLMs may face challenges.
- Set up, configure, and maintain development environments, including Dockerization and environment management, to facilitate efficient testing and evaluation.
- Assess unit test coverage and quality, providing insights and recommendations for improvement.
- Modify and run codebases locally to evaluate LLM performance in bug-fixing and code understanding tasks.
- Collaborate with research teams to design datasets and identify repositories and issues that pose difficulty for LLMs, contributing to dataset diversity and robustness.
- Lead and mentor junior engineers, fostering a collaborative environment and ensuring project milestones are met efficiently.
Benefits
Joining Turing offers numerous benefits, including the flexibility of a fully remote work environment that allows you to work from anywhere. You will have the opportunity to work on cutting-edge AI projects alongside leading LLM companies, gaining invaluable experience in the rapidly evolving field of artificial intelligence. Turing supports professional growth through exposure to innovative technologies and collaborative problem-solving. Additionally, you will be part of a forward-thinking organization that values talent, diversity, and continuous learning, providing a stimulating environment for career advancement and skill development.
Equal Opportunity
Turing is committed to creating an inclusive environment where all employees and applicants are treated with respect and fairness. We are proud to be an equal opportunity employer, welcoming candidates of all backgrounds, identities, and experiences. Our hiring decisions are based solely on merit, skills, and qualifications, ensuring a diverse and dynamic workforce that drives innovation and excellence.