Leveraging LLMs for Voice-Based form Filling on the Web: The ConWeb Approach

Web forms are among the most challenging components for individuals using assistive technologies. Improper coding practices can significantly impede screen readers, preventing them from correctly interpreting or even accessing input fields. Conversational interaction presents an opportunity to increase form accessibility. This demonstration presents ConWeb, a conversational platform with which users can interact with web forms using natural language interaction. Our work aims at introducing an alternative and inclusive paradigm to visual web browsing.