Senior Software Engineer - AI Interaction Evaluator (up to $200/hr)

About the role

We are seeking a senior‑level software engineer to evaluate the quality of interactions with modern AI coding agents such as OpenAI Codex and Claude Code. This contract role focuses on judging how well the model’s responses align with the reasoning and judgment of a strong engineer, rather than writing production code.

Key responsibilities

• Assess AI‑generated coding interactions end‑to‑end for usefulness, high‑level correctness, and alignment with strong engineering judgment.
• Evaluate the quality of explanations, reasoning, and preambles provided by the model.
• Distinguish between different levels of response quality and assign consistent ratings.
• Provide clear, opinionated feedback on what works, what does not, and what feels misleading.
• Help define standards for great interactions with AI‑first development tools such as Cursor.

Required profile

• Staff‑ or principal‑level engineer (or equivalent experience) with a high bar for good engineering.
• Strong background in TypeScript/JavaScript or Python.
• Hands‑on experience using OpenAI Codex, Claude Code, and AI‑first IDEs like Cursor.
• Deep familiarity with modern AI‑assisted development workflows.
• Comfortable making rigorous, subjective judgments and delivering direct feedback.

Required skills

• TypeScript
• JavaScript
• Python
• OpenAI Codex
• Claude Code
• Cursor (AI‑first IDE)

What we offer

• Contract rate up to $200 USD per hour (US/Canada), $150 EUR per hour (EU/Latam), $100 USD per hour (other regions).
• Remote work, 10–20 hours per week.
• Start immediately, engagement through early May with possible extension.