research
∙
08/17/2023
Never-ending Learning of User Interfaces
Machine learning models have been trained to predict semantic informatio...
share
research
∙
01/30/2023
WebUI: A Dataset for Enhancing Visual UI Understanding with Web Semantics
Modeling user interfaces (UIs) from visual information allows systems to...
research
∙
01/20/2023
Screen Correspondence: Mapping Interchangeable Elements between UIs
Understanding user interface (UI) functionality is a useful yet challeng...
research
∙
07/15/2022
Reflow: Automatically Improving Touch Interactions in Mobile Applications through Pixel-based Refinements
Touch is the primary way that users interact with smartphones. However, ...
research
∙
07/09/2022
Extracting Replayable Interactions from Videos of Mobile App Usage
Screen recordings of mobile apps are a popular and readily available way...
research
∙
09/17/2021
Screen Parsing: Towards Reverse Engineering of UI Models from Screenshots
Automated understanding of user interfaces (UIs) from their pixels can i...
research
∙
07/15/2021
MultiBench: Multiscale Benchmarks for Multimodal Representation Learning
Learning multimodal representations involves integrating information fro...
research
∙
05/04/2021
When Can Accessibility Help?: An Exploration of Accessibility Feature Recommendation on Mobile Devices
Numerous accessibility features have been developed and included in cons...
research
∙
01/13/2021
Screen Recognition: Creating Accessibility Metadata for Mobile Applications from Pixels
Many accessibility features available on mobile platforms require applic...
research
∙
01/13/2021
Robustness Gym: Unifying the NLP Evaluation Landscape
Despite impressive performance on standard benchmarks, deep neural netwo...
research
∙
10/12/2020
Making Mobile Augmented Reality Applications Accessible
Augmented Reality (AR) technology creates new immersive experiences in e...
research
∙
07/07/2020
KubeEdge.AI: AI Platform for Edge Devices
The demand for smartness in embedded systems has been mounting up drasti...
research
∙
09/19/2018