Top Tech TransitionBrowse all jobs
Apple

Software Engineer - Evaluation Engineering

Apply on Apple Share on WhatsApp
Interviewing at Apple?

How engineers crack Google & Amazon interviews

Live masterclass with an ex-Google & Amazon Tech Lead · Saturdays, 11 AM IST · ₹9

250+ engineers mentored into better roles · ₹3.5 Cr highest package · students now at Google, Amazon, Meta, Microsoft

Reserve my seat · ₹9

Read 35 Apple interview experiencesApple interview guide

Summary

Join the team redefining what a deeply personal and integrated assistant can be.

As part of the Siri organization, you will help shape one of the world's most widely used AI assistants, powered by our next-generation of Apple Intelligence, with capabilities like personal context understanding and on-screen awareness, built with privacy from the ground up. Your work will have direct, meaningful impact for users across iOS, iPadOS, macOS, watchOS, and visionOS.

This is a rare opportunity to build at the intersection of cutting-edge AI and human-centered design, shipping technology that is centered around users and their needs.

Description

We are looking for a Software Engineer to help build the foundational on-device execution harness and runtime infrastructure for agentic evaluation. As Apple Intelligence evolves, validating agent performance requires reliable, deterministic execution of multi-step agent trajectories directly on heterogeneous user hardware. Our team focuses on building the core harnesses, environment control layers, and trace collection pipelines that enable downstream teams to evaluate agentic reasoning, tool use, on-screen awareness, and personal context actions across the entire Apple ecosystem.

In this role, you will design the low-level execution harnesses and orchestration tooling that drive dynamic agent simulations on target devices. You will solve complex systems engineering challenges around local device state management, process isolation, determinism, and high-fidelity trace generation across varying hardware constraints (iPhones, Macs, iPads, Apple Watch, and Apple Vision Pro).

Minimum Qualifications

Strong programming proficiency in compiled languages (Swift, C++, or Objective-C).

Excellent communication skills and ability to collaborate across teams.

Scripting and automation skills in Python for tooling.

B.S. or M.S. in Computer Science, Machine Learning, or equivalent experience.

Solid computer science and systems fundamentals, including process management, and local runtimes.

Preferred Qualifications

Hands-on experience developing on Apple platforms (iOS, macOS, visionOS) or working directly with low-level OS runtimes and frameworks.

Experience designing or operating environment-staging systems, such as state reset mechanisms, device provisioning, or sandboxed test environments.

Experience building telemetry, trace-capture, or event-logging infrastructure for complex, multi-threaded, or asynchronous systems.

Familiarity with on-device AI/LLM runtime environments, function calling/tool execution mechanics, or agentic system architectures.

You apply directly on Apple's careers site. See similar jobs

₹9 live masterclass · Sat 11 AM ISTHow engineers crack Google & Amazon
Reserve