This paper presents new interaction mechanisms for voice-based direct manipulation that aim to extend the conversational interaction with LLMs and, more generally, with intent-driven user interfaces. It discusses the need for these extensions and illustrates the proposed approach and prototype, and a preliminary user study.

Enabling Voice-based Direct Manipulation in Intent-oriented Interaction Paradigms

Laura Colazzo;Maristella Matera
2025-01-01

Abstract

This paper presents new interaction mechanisms for voice-based direct manipulation that aim to extend the conversational interaction with LLMs and, more generally, with intent-driven user interfaces. It discusses the need for these extensions and illustrates the proposed approach and prototype, and a preliminary user study.
2025
CHItaly '25: Proceedings of the 16th Biannual Conference of the Italian SIGCHI Chapter
Intent-driven UIs, Voice-based direct manipulation, LLM interfaces, Accessibility
File in questo prodotto:
File Dimensione Formato  
3750069.3755951.pdf

accesso aperto

Dimensione 855.71 kB
Formato Adobe PDF
855.71 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11311/1308459
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 1
  • ???jsp.display-item.citation.isi??? 0
social impact