About The Company
Turing is a leading technology company dedicated to advancing artificial intelligence and machine learning solutions. Renowned for its innovative approach, Turing specializes in developing cutting-edge AI systems that revolutionize the software development landscape. The company fosters a dynamic and collaborative environment, attracting top talent from around the globe to work on impactful projects that shape the future of technology. Committed to excellence and continuous innovation, Turing is at the forefront of AI research and deployment, empowering organizations to leverage AI for competitive advantage.
About The Role
We are seeking experienced software engineers at the tech lead level to join our team for an exciting project focused on Large Language Model (LLM) evaluation and training datasets. This role involves working closely with our research and engineering teams to build verifiable software engineering tasks based on public repository histories. The ideal candidate will have a strong background in software development, particularly in analyzing and navigating complex codebases, automating development environments, and evaluating code quality. Your expertise will directly contribute to creating high-quality datasets that enable LLMs to better understand and solve real-world software engineering problems. This position offers an excellent opportunity to work at the intersection of software engineering and AI research, influencing the future of AI-assisted coding and development tools.
Qualifications
The ideal candidate will possess a minimum of three years of professional experience in software engineering, with proficiency in at least one programming language such as Python. Strong familiarity with version control systems like Git, containerization tools like Docker, and experience setting up and automating software pipelines are essential. Candidates should have the ability to understand and modify complex codebases, run and test projects locally, and evaluate code coverage and quality effectively. Experience contributing to or evaluating open-source projects is considered a plus. Additional skills in automation, scripting, and familiarity with AI or LLM evaluation projects will be advantageous.
Responsibilities
- Analyze and triage issues reported on GitHub across trending open-source libraries to identify challenging tasks for LLMs.
- Set up and configure code repositories, including environment setup, Dockerization, and dependency management.
- Assess unit test coverage, quality, and effectiveness within selected repositories.
- Modify and execute codebases locally to evaluate LLM performance in bug-fixing and code understanding scenarios.
- Collaborate with research teams to design datasets and identify repositories that pose significant challenges for LLMs.
- Lead and mentor junior engineers, fostering a collaborative environment to achieve project goals efficiently.
- Document findings, improve automation processes, and contribute to the continuous enhancement of dataset quality.
Benefits
Joining Turing offers the flexibility of a fully remote work environment, providing the opportunity to collaborate with a global team of experts. You will work on pioneering AI projects that have a meaningful impact on the future of software development. Turing values professional growth and innovation, offering a stimulating environment where your contributions directly influence cutting-edge AI systems. Additionally, you will have access to a network of industry-leading professionals, opportunities for skill development, and the chance to participate in groundbreaking research initiatives. The company also promotes a healthy work-life balance, emphasizing flexibility and autonomy in your work schedule.
Equal Opportunity
Turing is committed to fostering an inclusive and diverse workplace. We are an equal opportunity employer and do not discriminate based on race, gender, sexual orientation, religion, age, disability, or any other protected characteristic. We believe that a diverse team drives innovation and creativity, and we are dedicated to creating an environment where all employees feel valued, respected, and empowered to contribute their best.
IN
