Skip to content

Implement complete Android annotation system for remote desktop#7349

Open
maximus595 wants to merge 2 commits intoYlianst:masterfrom
maximus595:feature/android-annotations-backend
Open

Implement complete Android annotation system for remote desktop#7349
maximus595 wants to merge 2 commits intoYlianst:masterfrom
maximus595:feature/android-annotations-backend

Conversation

@maximus595
Copy link
Copy Markdown

@maximus595 maximus595 commented Oct 16, 2025

Overview

Implements real-time annotation system allowing browser users to draw on Android device screens during remote desktop sessions.

Related PR

Both PRs are required for complete functionality.

Backend changes:

  • meshagent.js: Add annotationAck handler for Android agent responses
  • meshuser.js: Route annotation events to browser sessions
  • default*.handlebars: Add annotationAck event handling for UI

Frontend annotation UI:

  • annotation-ui.js: Complete annotation overlay system with drawing tools
  • agent-desktop-0.0.2.js: Integrate annotation controls with desktop viewer
  • annotation-style.css: Styling for annotation menus and controls
  • style.css: Additional UI integration styles

UI assets:

  • Add complete icon set for annotation tools (pen, shapes, eraser, etc.)
  • Tool icons for rectangle, circle, arrow, color picker, TTL timer
  • State icons for active/inactive annotation modes

Features:

  • Real-time freehand drawing with pen tool
  • Shape tools: rectangles, circles, arrows with preview
  • Eraser tool for removing annotations
  • Color picker with preset and custom colors
  • TTL (time-to-live) options for temporary annotations
  • Mobile-responsive annotation menu
  • Permission handling and capability detection
  • Event-driven comm

Testing

  1. Connect to Android device via remote desktop in browser
  2. Click annotation button in browser interface
  3. Grant overlay permission on Android when prompted
  4. Draw annotations - they appear in real-time on Android screen
  5. Test shapes, colors, eraser, and TTL features

between Android and browser

This enables remote desktop annotation support for Android agents, allowing browser users to draw on Android screens in real-time.

Sample browser vid - Mirrored on android side

2025-10-10_17-12-04.mp4

Note

This PR may have merge conflicts due to recent upstream changes.
Happy to rebase if needed during review.

maximus595 and others added 2 commits October 16, 2025 02:08
Backend changes:
- meshagent.js: Add annotationAck handler for Android agent responses
- meshuser.js: Route annotation events to browser sessions
- default*.handlebars: Add annotationAck event handling for UI

Frontend annotation UI:
- annotation-ui.js: Complete annotation overlay system with drawing tools
- agent-desktop-0.0.2.js: Integrate annotation controls with desktop viewer
- annotation-style.css: Styling for annotation menus and controls
- style.css: Additional UI integration styles

UI assets:
- Add complete icon set for annotation tools (pen, shapes, eraser, etc.)
- Tool icons for rectangle, circle, arrow, color picker, TTL timer
- State icons for active/inactive annotation modes

Features:
- Real-time freehand drawing with pen tool
- Shape tools: rectangles, circles, arrows with preview
- Eraser tool for removing annotations
- Color picker with preset and custom colors
- TTL (time-to-live) options for temporary annotations
- Mobile-responsive annotation menu
- Permission handling and capability detection
- Event-driven communication between Android and browser

This enables remote desktop annotation support for Android agents,
allowing browser users to draw on Android screens in real-time.
- Integrate annotation handlers with latest handlebars changes
- Maintain both upstream updates and annotation functionality
@maximus595
Copy link
Copy Markdown
Author

Resolved previous merge conflict simple one-liner conflict

@si458
Copy link
Copy Markdown
Collaborator

si458 commented Oct 16, 2025

this is brilliant!
im not going to merge it straight away, as i want to discuss it at our monthly meeting next thursday
i just want peoples opinions and views on it!
maybe you could attend the meeting?

@maximus595
Copy link
Copy Markdown
Author

Yes I should be able to attend of course. Would be good to get feed back or need to change something.

@Melo-Professional
Copy link
Copy Markdown
Contributor

This is OUTSTANDIND and need to go live!

@github-actions
Copy link
Copy Markdown

github-actions bot commented Feb 5, 2026

This pull request has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

@github-actions github-actions bot added the Stale label Feb 5, 2026
@si458
Copy link
Copy Markdown
Collaborator

si458 commented Feb 5, 2026

not stale bad bot haha

@github-actions github-actions bot removed the Stale label Feb 6, 2026
@github-actions
Copy link
Copy Markdown

github-actions bot commented Apr 7, 2026

This pull request has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

@github-actions github-actions bot added the Stale label Apr 7, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants