ML Inference Engineer – Terminal-Bench Task Designer
Toptal · Remote (Worldwide) · Full-time
Description
Headquarters: Overview We are building a benchmark that tests how well AI agents handle real expert work in a terminal. We are hiring ML inference and serving experts to turn real, paid tasks from their jobs into expert-level Terminal-Bench challenges. Each task includes the environment, a working solution, and an automated check that proves the result is correct. ***THIS IS A TASK BASED COMPENSATION MODEL. PLEASE CHECK THE APPLICATION QUESTIONS FOR MORE DETAILS.*** Responsibilities • Design expert-level Terminal-Bench tasks that turn real, paid ML inference work from your own experience into challenges an AI agent must solve end to end. • Define the files, systems and environments each task runs on, such as model serving with streaming, so the challenge is realistic, reproducible and command-line solvable. • Write a working reference solution for every task and verify it runs end to end, sized for about 60 to 75 minutes of expert effort. • Build automated checks that objectively prove a result is correct, including cases where ML outputs go wrong silently, such as numerical drift or metric bugs. • Package tasks with Docker and Git so they are reproducible, and document the syste…
View full original posting → Source: We Work Remotely
How to apply
- Read the description and requirements and check the location and pay.
- Click “Apply now” on this page. If you do not have a free account yet, create one — it takes about a minute.
- Keep your phone on and your CV or details ready, so the employer can reach you.
- You can also open the original posting (link above) to see how the employer prefers applications.
- Never pay money to get a job. Report any listing that asks you to.
Questions about this job
Where is this ML Inference Engineer – Terminal-Bench Task Designer job located?
It is listed as Remote (Worldwide), so it can be done from home.
Who is hiring?
The employer shown on the listing is Toptal.
What is the salary?
The listing does not state a salary. Ask the employer about pay, overtime and payment dates before accepting.
Is it full-time or part-time?
The listing type is Full-time.
When was this job posted?
It was posted on 4 November 2026. Jobs that stay open too long are closed automatically, so apply soon if you are interested.
How do I apply?
Read the description and requirements, then click Apply now on this page (a free account is needed). You can also open the original posting to see how the employer takes applications.
Do I have to pay to apply?
No. Applying on Get Mazdoor is free, and a genuine employer does not ask for money to apply or for a "registration" or visa fee before an offer. If anyone asks you to pay, do not.
Similar Design & Media jobs
Browse more: Design & Media jobs · All jobs in Pakistan
