Availability: Consistent availability during weekdays.
Work Focus: AI model training, software engineering task development, code evaluation, reference solution creation, and technical feedback.
We are seeking experienced Software Engineers to contribute to the development, training, and evaluation of next-generation Generative AI models. This role offers an opportunity to leverage strong software engineering expertise to improve the accuracy, reliability, and problem-solving capabilities of advanced AI systems.
The ideal candidate should have extensive hands-on experience in production software development, with strong proficiency in Python and at least one additional programming language such as Java, C++, Go, or Rust. A solid understanding of algorithms, data structures, backend engineering, systems design, and software development best practices is essential.
The role involves creating complex programming challenges, developing reference solutions, evaluating AI-generated code, and providing expert technical feedback to improve AI model performance across real-world software engineering scenarios.
This is a W-2 employment opportunity with the possibility of working as part of the extended workforce of a leading AI research organisation.
Requirements
Key Responsibilities
A. AI Model Training & Technical Expertise
▪Collaborate with AI research and engineering teams to identify technical knowledge gaps and improve AI model performance across software engineering, programming, algorithms, and systems design.
Show the full posting
▪Apply practical software development experience to assess the accuracy, efficiency, and reliability of AI-generated code.
▪Provide expert guidance on programming concepts, backend development, system architecture, and engineering best practices.
Help improve AI models' ability to solve complex software engineering problems through structured training and evaluation.
▪
B. Technical Task Development & Solution Design
▪Design challenging, domain-specific programming tasks covering software engineering, algorithms, data structures, and backend development.
▪Develop accurate, efficient, and well-documented reference solutions for complex coding problems.
▪Create realistic multi-file coding assignments that reflect production-level software development scenarios.
▪Write, review, and debug code across Python and other programming languages, including Java, C++, Go, and Rust.
▪Develop unit tests and validation frameworks to ensure solutions execute correctly and meet defined requirements.
C. Code Review & Technical Evaluation
▪Evaluate AI-generated code for correctness, efficiency, readability, maintainability, and adherence to software engineering standards.
▪Review and debug complex coding solutions, identifying logical errors, performance issues, and architectural weaknesses.
▪Assess code quality, test coverage, error handling, and implementation approaches.
▪Provide clear, detailed, and actionable technical feedback to improve AI-generated programming outputs.
▪Evaluate different approaches to solving engineering problems and assess their practical trade-offs.
D. Evaluation Framework & Benchmark Development
▪Develop structured evaluation rubrics to assess programming accuracy, code quality, design decisions, and test coverage.
▪Establish benchmarks for algorithms, data structures, backend systems, and production software engineering tasks.
▪Create comprehensive test cases to evaluate the reliability and robustness of AI-generated solutions.
▪Collaborate with other software engineering experts to ensure consistency, accuracy, and quality across AI training datasets.
E. Engineering Collaboration
▪Work closely with AI researchers, software engineers, and other subject matter experts.
▪Participate in technical discussions, code reviews, and solution validation exercises.
▪Ensure that technical tasks and reference solutions reflect industry-standard software development practices.
▪Contribute domain expertise to improve the overall quality of AI training and evaluation processes.
Must-Have Skills & Qualifications
▪4+ years of professional experience in Software Engineering or Software Development.
▪Strong production-level proficiency in Python.
▪Hands-on expertise in at least one additional programming language: Java, C++, Go, or Rust.
▪Strong understanding of Data Structures and Algorithms (DSA).
▪Experience in backend development, systems programming, and software architecture.
▪Hands-on experience with Git, version control workflows, code reviews, and collaborative development.
▪Strong understanding of automated testing, unit testing, debugging, and Continuous Integration (CI).
▪Experience developing, reviewing, and maintaining production-grade software applications.
▪Demonstrated professional growth and increasing ownership of software engineering responsibilities.
▪Excellent written communication skills and the ability to explain complex technical concepts clearly.
Good-to-Have Skills
▪Experience designing scalable backend systems and distributed architectures.
▪Knowledge of microservices, APIs, and system design principles.
▪Experience with performance optimisation and debugging complex applications.
▪Familiarity with test automation frameworks and CI/CD pipelines.
▪Exposure to AI/ML development, generative AI, or large language model evaluation.
▪Experience in technical mentoring, documentation, code reviews, or engineering assessments.
▪Previous experience creating coding challenges, technical benchmarks, or reference implementations.
Preferred Candidate Profile
The ideal candidate is a technically strong Software Engineer with substantial production development experience and expertise in Python alongside Java, C++, Go, or Rust.