Onlano
AI / Machine LearningRemote

Senior Software Engineering Consultant (AI Evaluation)

24-MAG - Agency

New York City, New York, ๐Ÿ‡บ๐Ÿ‡ธ United StatesPart-time - Principal (10+ years)0 applicantsCloses Aug 10, 2026

Salary

USD 162,271 - 162,271 / year

Apply for this job

Job description

Job details

  • Location: New York City, New York
  • Work mode: Remote
  • Employment type: Part-time (Not an internship)
  • Salary: USD 162,271 per year

Role overview

24-MAG is seeking a Senior Software Engineering Consultant to join a specialized remote project. In this role, you will apply your deep expertise in production codebases and software architecture to evaluate the reasoning and generation capabilities of advanced AI systems. You will ensure that AI-generated software meets production-quality standards through rigorous review and structured evaluation.

Job details

This is a part-time, Remote position based out of New York City, New York. This is not an internship. The compensation for this role is 162,271 USD.

Responsibilities

  • Evaluate AI-generated code for production readiness and architectural soundness.
  • Perform detailed code reviews on complex software repositories.
  • Analyze how advanced AI systems reason about software engineering problems.
  • Provide structured feedback to improve the quality of AI-generated solutions.
  • Apply senior-level engineering judgment to validate technical implementations.

Requirements

  • Extensive experience working with large-scale production codebases.
  • Proven track record of contributing to or managing open-source repositories.
  • Deep expertise in software architecture and design patterns.
  • Ability to conduct structured and objective evaluations of technical code.
  • Strong communication skills for documenting AI performance gaps.

Benefits

  • Flexible remote work environment
  • Opportunity to shape the future of AI software generation
  • Competitive consulting compensation

Keywords

Software ArchitectureAI EvaluationCode ReviewProduction CodeOpen SourceLLM ReasoningSoftware Engineering