AI Builder (first AI hire)
The bar, stated plainly
No years requirement, no degree requirement. These are the skills the work needs, each with the level it needs — and what that level means in behaviour.
Designs the tool surface deliberately, gates irreversible actions behind approval, and can explain when a workflow beats an agent.
Designs evals that target real failure modes, chooses metrics that resist gaming, and knows the limits of what the eval measures.
Decomposes unreliable tasks into verifiable steps, chooses between prompting, tool use, and retrieval on the merits, and builds a small evaluation set before changing anything.
Structures context deliberately, manages token budgets, and handles rate limits and timeouts.
Handles errors, retries, and rate limits, and manages credentials without leaking them.
This role is matched to the Ship an AI Agent That Won't Embarrass You challenge (90 minutes, rubric public before you start). A verified score on it is the strongest evidence you can attach.
See the challenge & rubricApply with your proofs
Applying shares your proof profile and account email with this employer, for this role only.