E2B Desktop Skill

Control a headless Linux desktop (Ubuntu + XFCE) via the e2b-desktop Python SDK. All scripts live in scripts/ and wrap the SDK in bash for easy agent use.

Prerequisites

pip install e2b-desktop
export E2B_API_KEY=e2b_***

State Management

• start_sandbox.sh saves the sandbox ID to ~/.e2b_state
• All other scripts auto-load it from there
• Override anytime with export E2B_SANDBOX_ID=\x3Cid>
• Sandboxes survive script exit — reconnect with Sandbox.connect(sandbox_id)

Scripts

Computer-Use Agent Loop Pattern

SCRIPTS="skills/e2b-desktop/scripts"

# 1. Start sandbox
source \x3C($SCRIPTS/start_sandbox.sh --resolution 1280x800 --stream)
echo "Sandbox: $SANDBOX_ID"
echo "View at: $STREAM_URL"

# 2. Agent loop
while true; do
  # Capture screen
  $SCRIPTS/screenshot.sh /tmp/screen.png

  # Send to LLM, parse action... (your code)
  ACTION=$(llm_decide /tmp/screen.png)

  case "$ACTION" in
    click:*)   IFS=: read -r _ x y \x3C\x3C\x3C "$ACTION"; $SCRIPTS/click.sh $x $y ;;
    type:*)    $SCRIPTS/type_text.sh "${ACTION#type:}" ;;
    key:*)     $SCRIPTS/press_key.sh ${ACTION#key:} ;;
    done)      break ;;
  esac
done

# 3. Clean up
$SCRIPTS/kill_sandbox.sh

Key Notes

• scroll.sh AMOUNT: positive = scroll up, negative = scroll down (matches desktop.scroll(amount) API)
• press_key.sh ctrl c: multiple args become a key combo via desktop.press(["ctrl", "c"])
• run_command.sh exits with the sandbox command's exit code
• All mouse coordinate scripts accept integer pixel coordinates matching sandbox resolution
• VNC stream: only one active stream at a time; stop before switching windows