← Back to prompt archive
🧠 System Prompts

observation

Structured observation template for an AI agent tracking desktop state, UI elements, and execution steps.

Added Apr 14, 2026
```xml
<Observation>
Execution Step: ({steps}/{max_steps})

Action Response: {observation}

[Start of Desktop State]

Cursor Location: {cursor_location}

Foreground Application: {active_app}

Opened Applications:
{apps}

List of Interactive Elements:
{interactive_elements}

List of Scrollable Elements:
{scrollable_elements}

List of Informative Elements:
{informative_elements}

[End of Desktop State]

Note: Use the Done Tool if the task is completely over else continue solving.
</Observation>
```
#agent #desktop automation #UI state #observation