Model Policy Manager, Emerging AI Misuse
OpenAI · San Francisco
Est. total comp~$161K–$283KFrom the posting
About the Team
The Model Policy team within OpenAI’s Safety Systems organization defines how increasingly capable AI models should behave in real-world settings. We turn research on emerging risks into model behavior policies, evaluations, and safeguards.
About the Role
As AI systems become more capable, the same advances that expand their legitimate uses can also lower barriers to harm. Emerging misuse risks range from AI assistance with conventional weapons development and the misuse of AI-enabled robotics to fraud, impersonation, and other forms of abuse that people can carry out at scale using AI agents. You’ll build threat models for how people could misuse AI in digital and physical settings, assess what access to AI changes in practice, and use that evidence to define how models should respond.
This role is based in San Francisco. We offer relocation support and work from the office three days a week, with optional work from home on Thursdays and Fridays.
In this role, you will:
- Build and update threat models as capabilities evolve. Assess what people could plausibly do, what expertise and resources they would need, and how AI changes those barriers.
- Define when models should help, limit assistance, or refuse in situations where the same capability has legitimate and harmful uses.
- Turn expert safety judgment into instructions, training examples, and evaluations that teach models when to help, when to limit assistance, and when to refuse. …
Job inventory
We could not pull clear requirements from the posting text we have. Check the full posting for the details.
Sign in to see how you match against your Personnel File.
More at OpenAI
- Engineering Manager, Robotics Embedded Systems
- Manufacturing Quality Engineer, Data Center Modular Builds
- Software Security Architect, Operating Systems | Consumer Devices
- Systems Test Engineer, End-to-End Validation | Consumer Devices
- Software Security Architect, Operating Systems | Consumer Devices
All OpenAI roles on our board →
New to the field? Use the roadmap or read the break-in guides.