OpenAI Developers launched Appshots, a desktop shortcut that hands ChatGPT Work and Codex the live context of the app in front of you so they can understand what you are looking at and act on it. Official examples include summarizing a Slack thread, filling a form, adding a feature from an open API reference, extracting themes from X replies, turning notes into a deck, trimming a video in iMovie, converting a recipe into a grocery list, and planning the rest of a trip from an itinerary. The feature targets human-in-the-loop coding and knowledge-work sessions on the desktop, cutting screenshot-and-paste loops by grounding the agent in the current UI rather than a stale description. For developers, the practical value is letting Codex continue from the IDE, browser, or docs surface already on screen instead of re-explaining layout, errors, or selected text.

Key Takeaways

  • βœ“Appshots injects the foreground app's on-screen context into Codex and ChatGPT Work.
  • βœ“A desktop shortcut replaces screenshot-and-paste loops for UI-grounded agent tasks.
  • βœ“Useful when an agent must continue coding or actions from the live IDE or browser view.
ADSponsored