About The Company
Turing is a leading technology company dedicated to advancing artificial intelligence and software engineering through innovative solutions and cutting-edge research. Renowned for its commitment to fostering a dynamic and inclusive work environment, Turing leverages its expertise to develop AI systems that transform industries worldwide. The company prides itself on its collaborative culture, emphasis on continuous learning, and its mission to bridge the gap between human ingenuity and machine intelligence. With a focus on high-impact projects, Turing is at the forefront of AI research, particularly in the development and evaluation of large language models (LLMs), aiming to enhance software development processes and automation.
About The Role
We are seeking experienced software engineers at the tech lead level to join our innovative team working on large language model evaluation and training datasets. This role involves hands-on development work focused on building verifiable software engineering tasks based on public repository histories, utilizing synthetic approaches with human-in-the-loop methodologies. The ideal candidate will have a strong background in analyzing and working with open-source repositories, automating development environments, and assessing code quality and test coverage. This position offers a unique opportunity to contribute directly to AI research by improving the evaluation of LLMs in realistic software engineering scenarios, supporting Turing’s mission to enhance AI capabilities in understanding and generating code.
Qualifications
The ideal candidate will possess a minimum of 3+ years of professional experience in software engineering, with a strong proficiency in JavaScript and TypeScript. They should have a solid understanding of Git, Docker, and basic software pipeline setup, enabling seamless automation and environment configuration. Experience navigating complex codebases, running, modifying, and testing real-world projects locally is essential. Familiarity with open-source contribution and evaluation is a plus. Candidates should demonstrate excellent problem-solving skills, the ability to work independently, and a passion for AI and software development. Prior experience in LLM research or automation tools is beneficial but not mandatory.
Responsibilities
- Analyze and triage GitHub issues across trending open-source libraries to identify challenging tasks for LLMs.
- Set up and configure code repositories, including Dockerization and environment setup, to facilitate testing and evaluation.
- Evaluate unit test coverage and quality, providing insights to improve code robustness.
- Modify and run codebases locally to assess LLM performance in bug-fixing and code generation scenarios.
- Collaborate closely with research teams to design datasets and identify repositories that present meaningful challenges for LLMs.
- Lead and mentor junior engineers, fostering a collaborative team environment and ensuring high-quality deliverables.
- Participate in continuous improvement initiatives to streamline workflows and enhance dataset quality.
Benefits
Joining Turing offers the opportunity to work remotely in a flexible environment, empowering you to balance your professional and personal life effectively. You will be part of a forward-thinking organization engaged in pioneering AI research, providing exposure to cutting-edge projects with leading LLM companies. Turing promotes a culture of innovation, continuous learning, and professional growth, with access to a global network of talented engineers and researchers. Additionally, contractors have the opportunity to collaborate on impactful projects that shape the future of AI-assisted software development, gaining valuable experience and recognition in the industry.
Equal Opportunity
Turing is committed to creating an inclusive environment for all employees and applicants. We are an equal opportunity employer and do not discriminate based on race, religion, gender, sexual orientation, age, disability, or any other protected characteristic. We value diversity and believe that a varied workforce enhances our ability to innovate and serve our global community effectively. All qualified candidates will receive consideration for employment without regard to any legally protected status.
IN
