Skip to main content

Managing Coordinate Cache

The Coordinate Cache Editor provides advanced tools for managing cached element coordinates that speed up automation execution. This guide covers all features for viewing, editing, and maintaining coordinate cache entries.

Overview​

Coordinate caching stores the positions of UI elements to avoid repeated vision detection during flow execution. Cached coordinates improve performance but need maintenance when UI layouts change.

Accessing the Cache Editor​

  1. Navigate to any flow in your flows list
  2. Click the flow name to open flow details
  3. Look for the "Coordinate Cache" section or button
  4. Click "Edit Cache" or "View Cache" to open the editor

Device Filtering​

Filter cache entries by device to focus on specific devices:

  • All Devices - Shows entries from all connected devices
  • Specific Device - Filter to show only entries for selected device
  • Device Display - Shows device name and model for easy identification

Gesture-Based Coordinate Capture​

Starting Gesture Stream​

  1. Click "Start Gesture Stream" button
  2. Select target device (auto-detected or manual selection)
  3. Perform gestures on device:
    • Tap - Captures tap coordinates
    • Long Press - Captures long press coordinates
    • Swipe - Captures swipe start/end coordinates

Real-time Coordinate Updates​

  • Live Updates - Coordinates update in real-time as you interact
  • Screen Size Detection - Automatically detects device screen dimensions
  • Normalized Coordinates - Converts absolute coordinates to relative (0-1) values
  • Sequence Capture - Supports capturing multiple coordinates in sequence

Stopping Gesture Stream​

  • Click "Stop Gesture Stream" to end capture session
  • Automatic Cleanup - Stream stops when dialog closes
  • Device Switching - Stream automatically stops when switching device filters

Manual Cache Entry Management​

Adding New Entries​

  1. Click "Add Entry" to open the add form

  2. Select Device from connected devices dropdown

  3. Choose Target Elements:

    • Select from Flow - Choose from elements used in current flow
    • Add Custom - Manually enter element names
    • Multi-select - Add multiple elements at once

  4. Set Screen Size (optional but recommended):

    • Width - Device screen width in pixels
    • Height - Device screen height in pixels

  5. Coordinate Input Methods:

    • Manual Entry - Type X,Y coordinates directly
    • Gesture Capture - Use gesture stream to populate coordinates
    • Normalized Input - Enter relative coordinates (0-1 range)

Coordinate Formats​

Absolute Coordinates​

  • X, Y - Pixel positions on screen
  • Example: X: 540, Y: 1200

Normalized Coordinates​

  • Relative positioning from 0.0 to 1.0
  • Screen-size independent - works across different devices
  • Automatic conversion between absolute and normalized

Bulk Entry Addition​

  • Multiple Elements - Add coordinates for several elements at once
  • Sequence Input - Captures coordinates in order for sequential actions
  • Batch Validation - Ensures all entries have required fields

Editing Existing Entries​

Inline Editing​

  1. Click "Edit" button next to any cache entry

  2. Modify coordinates:

    • Absolute X, Y coordinates
    • Normalized X, Y (0-1 range)
    • Screen dimensions (width/height)

  3. Real-time Updates - See changes reflected immediately

  4. Save or Cancel - Confirm changes or revert

Coordinate Synchronization​

  • Auto-conversion - Changing absolute updates normalized automatically
  • Screen size updates - Adjusting dimensions recalculates coordinates
  • Validation - Prevents invalid coordinate ranges

Cache Maintenance Operations​

Individual Entry Operations​

  • Delete Entry - Permanently remove single cache entry
  • Clear Entry - Reset coordinates to (0,0) to force re-detection
  • Edit Entry - Modify coordinates and metadata

Bulk Operations​

Clear All Entries​

  • Scope Options:
    • Current Flow - Clear all entries for this flow
    • Specific Device - Clear entries for selected device only
  • Confirmation Required - Prevents accidental data loss

Validate All Entries​

  • Mark as Valid - Confirm all entries are current and accurate
  • Post-UI Change - Use after confirming UI layout hasn't changed
  • Performance Impact - Validated entries are preferred during execution

Recompute Coordinates​

  • Screen Size Changes - Recalculate for new device dimensions
  • Batch Processing - Update multiple entries efficiently
  • Progress Tracking - Shows success/failure counts

Cache Statistics and Analytics​

Viewing Statistics​

Click "View Stats" to see comprehensive cache analytics:

  • Total Entries - Overall count of cached coordinates
  • Valid/Invalid Breakdown - Health status of cache entries
  • Average Hit Count - How often entries are used successfully
  • Device Distribution - Which devices have the most cached entries

Performance Metrics​

  • Hit Rate - Percentage of successful cache lookups
  • Usage Patterns - Most frequently accessed elements
  • Device Usage - Cache distribution across devices

Best Practices​

Cache Management​

  1. Regular Validation - Periodically mark entries as valid after UI stability
  2. Clear After UI Changes - Reset cache when app layouts change
  3. Device-Specific Caching - Maintain separate caches per device/resolution
  4. Coordinate Precision - Use normalized coordinates for cross-device compatibility

Performance Optimization​

  1. Gesture Streaming - Use live capture for accurate coordinate collection
  2. Bulk Operations - Perform maintenance tasks in batches
  3. Regular Cleanup - Remove unused cache entries periodically
  4. Screen Size Tracking - Always include screen dimensions for better accuracy

Troubleshooting​

Common Issues​

  • Invalid Coordinates - Clear and recapture after UI changes
  • Screen Size Mismatch - Use "Recompute All" when device resolution changes
  • Missing Elements - Verify element names match flow definitions
  • Gesture Stream Issues - Check device connectivity and permissions

Recovery Procedures​

  1. Coordinate Drift - Use gesture streaming to recapture accurate positions
  2. Batch Failures - Clear all and rebuild cache systematically
  3. Performance Degradation - Validate all entries or clear and rebuild
  4. Cross-Device Issues - Ensure normalized coordinates are used consistently

Advanced Usage​

Custom Automation Integration​

  • API Integration - Use coordinate cache programmatically
  • Bulk Import/Export - Transfer cache data between environments
  • Template Caches - Pre-populate coordinates for common UI patterns

Monitoring and Alerting​

  • Cache Health Metrics - Monitor invalid entry percentages
  • Performance Thresholds - Set alerts for low hit rates
  • Usage Analytics - Track which elements are most/least cached

Previous: Supported Steps