Files
httprunner/uixt
lilong.129 c204542f1f feat: optimize UI-TARS parser with coordinate conversion and action mapping
- Add action mapping for UI-TARS parser to convert action names to option.ActionName
- Implement bounding box to center point coordinate conversion for better accuracy
- Update coordinate normalization to handle coordinates > 1000 properly
- Enhance test cases to verify coordinate scaling and center point conversion
- Improve action argument processing with proper coordinate transformation
- Add comprehensive test coverage for coordinate conversion edge cases

Key improvements:
- Bounding box [x1,y1,x2,y2] now converts to center point [cx,cy] for actions
- Coordinate scaling properly handles different screen resolutions
- Action names are mapped through doubao_1_5_ui_tars_action_mapping
- Enhanced error handling for invalid coordinate formats
2025-06-04 23:16:14 +08:00
..
2025-05-26 16:08:27 +08:00
2025-05-21 16:24:54 +08:00
2025-05-26 14:53:36 +08:00
2025-05-24 23:22:00 +08:00
2025-05-07 20:12:06 +08:00

uixt

From v4.3.0HttpRunner will support mobile UI automation testing:

Some UI recognition algorithms are also introduced for both iOS and Android:

  • OCR: based on OCR API service from volcengine, other API service may be extended

Dependencies

OCR

OCR API is a paid service, you need to pre-purchase and configure the environment variables.

  • VEDEM_IMAGE_URL
  • VEDEM_IMAGE_AK
  • VEDEM_IMAGE_SK

Thanks

This uixt module is initially forked from the following repos and made a lot of changes.