Skip to content
View YusefSyed's full-sized avatar
💼
Open to startup roles, SF/NYC, Jan 2027
💼
Open to startup roles, SF/NYC, Jan 2027

Highlights

  • Pro

Block or report YusefSyed

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
YusefSyed/README.md

Yusef Syed

Software engineer working on AI agent security and evals. Looking to join a startup team full-time from January 2027 in San Francisco or New York, as a security engineer, evals engineer, AI red team engineer or AI safety research engineer. Also interested in RL environment and agent infrastructure roles. U.S. and Canadian citizen, no sponsorship needed.

Résumé (PDF) · Email · LinkedIn

Merged upstream

15 merged PRs. AI-assisted under my direction; each was merged by that project's maintainers.

  • Microsoft PyRIT (AI red teaming): extended the package-hallucination scenario to Dart, Perl and Raku, with tests.
  • Microsoft Agent Lightning (agent training, reinforcement learning): landed four reliability fixes, e.g. case-insensitive auth-header replacement.
  • W&B RAI Toolkit: landed five evaluation fixes, including keeping a failed prediction's error text from scoring as a pass.
  • Apache Arrow: extended four PyArrow slice APIs to accept Arrow integer scalars, with regression tests.
  • Inspect Scout and Kornia: three more fixes.

Papers

Projects

I build with AI coding agents that I direct and review.

  • ToolEffectBench (Python, Inspect, Docker): an Inspect benchmark scoring prompt injection from a sandbox's database state, not transcripts (188 samples, 17 models, 5,628 scored runs). On one synthetic task, agents' final reports denied at least 13 of 232 recorded forbidden publications.
  • effect-tracer (Rust, Linux ptrace/seccomp, Ed25519): a tracer that signs a process tree's file writes, connects, DNS and execs into a hash chain. 19 of 20 seeded bypasses caught at 1.1-1.9x overhead in seccomp mode (20 of 20 at 5-298x in full mode).
  • Scopehaven open edition (Node.js, Apache-2.0; solo project): a CLI and GitHub Action that tests whether an AI agent touched the wrong account, tenant or refund, decided from the app's own records rather than the agent's report.
  • Agent Eval Mutation Lab (Python): a 624-trial study across two local models on a version-controlled protocol. Five of six validity gates failed, so I withheld improvement claims.

Security research

Filed 15 private security advisories and 2 HackerOne reports (authorization, credential and data-exposure flaws) with 10 open-source projects, each reproduced 3 of 3 with controls first by an automated harness; two triaged, others awaiting triage, as of November 7, 2026.

Also

Providence (Swift): 1st Place, Aramco Americas Challenge (Best Beginner Hack), Hack the North. Evidence and more detail.

First year at the University of Toronto, intended Math + CS.

Pinned Loading

  1. tool-effect-bench tool-effect-bench Public

    Inspect benchmark that scores prompt injection on tool-using LLM agents from a sandbox's database state, not the transcript. 188 samples, 17 models, 5,628 scored runs. AI security evals; code, logs…

    Python

  2. effect-tracer effect-tracer Public

    Records what a Linux process tree, such as an AI agent run, actually did (file writes, connects, DNS, execs) into a hash-chained, Ed25519-signed ledger with a stdlib Python verifier. Rust, ptrace +…

    Rust

  3. scopehaven-oss scopehaven-oss Public

    Security testing for AI agents: checks what an agent actually did in your app, not what it said. Local, deterministic, Apache-2.0.

    JavaScript 1 1

  4. microsoft/agent-lightning microsoft/agent-lightning Public

    The absolute trainer to light up AI agents.

    Python 18.9k 1.7k

  5. microsoft/PyRIT microsoft/PyRIT Public

    Open-source AI red teaming toolkit from Microsoft. Test generative AI systems with automated scans, adaptive multi-turn attacks, and a web UI.

    Python 4.8k 1k

  6. agent-eval-mutation-lab agent-eval-mutation-lab Public

    Reproducible experiments that check what tool-using agents actually did, including partial failures and unknown outcomes.

    Python