About The Company
Turing is one of the world’s fastest-growing AI companies dedicated to advancing and deploying powerful artificial intelligence systems. With a focus on innovation and excellence, Turing collaborates with leading LLM (Large Language Model) companies to develop cutting-edge solutions that transform the software engineering landscape. The company prides itself on fostering a dynamic and inclusive remote work environment, enabling talented professionals from around the globe to contribute to groundbreaking AI research and development. Turing’s commitment to pushing the boundaries of technology makes it an ideal place for software engineers passionate about AI and software development to grow and make an impact.
About The Role
We are seeking experienced software engineers at the tech lead level to join our innovative project focused on building large language model evaluation and training datasets tailored for realistic software engineering problems. This role involves direct hands-on work in developing and automating software environments, triaging issues from high-quality public GitHub repositories, and assessing test coverage and code quality. The ideal candidate will have a strong background in analyzing open-source projects, understanding complex codebases, and contributing to AI research efforts by evaluating how LLMs interact with real-world code. You will work closely with researchers to identify challenging repositories, design tasks, and improve dataset coverage across various programming languages and difficulty levels. This position offers an excellent opportunity to lead technical initiatives and collaborate with a talented team of engineers and researchers dedicated to advancing AI in software engineering.
Qualifications
- Minimum of 3+ years of professional experience in software engineering.
- Strong proficiency in JavaScript and TypeScript.
- Experience with version control systems, particularly Git.
- Hands-on experience with Docker and setting up software pipelines.
- Ability to understand, navigate, and modify complex codebases.
- Comfortable running and testing real-world projects locally.
- Experience contributing to or evaluating open-source projects is a plus.
- Excellent problem-solving skills and attention to detail.
- Strong communication skills and the ability to collaborate effectively with cross-functional teams.
Responsibilities
- Analyze and triage issues across trending open-source repositories on GitHub.
- Set up and configure development environments, including Dockerization and environment management.
- Evaluate unit test coverage, quality, and effectiveness in real-world projects.
- Modify, run, and test codebases locally to assess the performance of LLMs in bug-fixing and code understanding scenarios.
- Collaborate with research teams to identify repositories and issues that pose challenges for LLMs, aiding in dataset creation and evaluation.
- Design synthetic SWE tasks based on public repository histories, ensuring verifiability and expanding dataset diversity.
- Lead and mentor junior engineers, fostering a collaborative and innovative team environment.
Benefits
Joining Turing as a contractor offers the flexibility of remote work, allowing you to contribute from anywhere in the world. You will have the opportunity to work on cutting-edge AI projects alongside industry-leading LLM companies, gaining valuable experience at the forefront of AI research and software engineering. Turing provides a flexible work schedule with commitments of at least 4 hours per day, 20 hours per week, and options for 30 or 40 hours per week, with a minimum overlap of 4 hours with PST. While this is a contractor role with no medical or paid leave benefits, it offers a unique platform to develop your skills, build your professional network, and be part of innovative AI solutions shaping the future of software development.
Equal Opportunity
Turing is committed to fostering an inclusive environment and is proud to be an equal opportunity employer. We celebrate diversity and are dedicated to creating a workplace where all employees and applicants are treated with respect and fairness, regardless of race, gender, age, religion, sexual orientation, disability, or any other characteristic protected by law. We believe that diverse perspectives drive innovation and excellence, and we welcome applications from talented individuals worldwide who are eager to contribute to our mission of advancing AI technology.