As a Product & UX Design Expert, you will collaborate with leading AI labs to enhance frontier agent evaluations in product design. Your primary responsibility will be to create long-horizon product design tasks that reflect your existing work, each accompanied by a deterministic rubric to assess agent performance against verifiable ground truth. Tasks must yield checkable answers, ensuring clarity and precision in evaluation.

• Develop scenarios focusing on:
• Flow completeness: Design user flows that encompass all necessary states, including empty, loading, error, permissions, and success.
• Design system fidelity: Utilize components and tokens from a defined design system instead of one-off values.
• Spec handoff: Create annotated specifications that include a required-field checklist, accessibility annotations, and measurable copy constraints.
• Engage in challenging tasks that require extended periods of focused work.

• Minimum of 3 years of experience as a product or UX designer in a SaaS or consumer product environment.
• A portfolio showcasing shipped flows rather than concept work.
• Proficiency in one or more of the following areas: advanced Figma (auto-layout, variables, components), design-system development, WCAG and accessibility standards, prototyping, and spec annotation and handoff.
• Ability to read and produce various product design artifacts, including flows, mocks, specs, and design system audits.
• Strong written communication skills, capable of articulating reasoning step by step and encoding it into deterministic rubrics.
• Must be located in the United States or Canada.

This is a remote, hourly position.

Compensation ranges from $85 to $115 per hour, depending on domain expertise and prior experience. High-performing contributors will have opportunities for promotion based on the quality of tasks completed and throughput.