Investigating Speaker Gaze and Pointing Behaviour in Human-Computer Interaction with the Mint.Tools Collection

Spyros Kousidis; Casey Kennington; David Schlangen

Investigating Speaker Gaze and Pointing Behaviour in Human-Computer Interaction with the Mint.Tools Collection

Spyros Kousidis, Casey Kennington, David Schlangen

Computer Science Department

Bielefeld University

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

9 Scopus citations

Abstract

Can speaker gaze and speaker arm movements be used as a practical information source for naturalistic conversational human-computer interfaces? To investigate this question, we recorded (with eye tracking and motion capture) a corpus of interactions with a (wizarded) system. In this paper, we describe the recording, analysis infrastructure that we built for such studies, and analysis we performed on these data. We find that with some initial calibration, a "minimally invasive", stationary camera-based setting provides data of sufficient quality to support interaction.

Original language	American English
Title of host publication	SIGDIAL 2013 - 14th Annual Meeting of the Special Interest Group on Discourse and Dialogue, Proceedings of the Conference
Place of Publication	Metz, France
Pages	319-323
Number of pages	5
ISBN (Electronic)	9781937284954
State	Published - 2013
Event	14th Annual Meeting of the Special Interest Group on Discourse and Dialogue, SIGDIAL 2013 - Metz, France Duration: 22 Aug 2013 → 24 Aug 2013

Publication series

Name	SIGDIAL 2013 - 14th Annual Meeting of the Special Interest Group on Discourse and Dialogue, Proceedings of the Conference

Conference

Conference	14th Annual Meeting of the Special Interest Group on Discourse and Dialogue, SIGDIAL 2013
Country/Territory	France
City	Metz
Period	22/08/13 → 24/08/13

EGS Disciplines

Computer Sciences

Access to Document

https://aclanthology.org/W13-4048/License: CC BY

Cite this

Kousidis, S., Kennington, C., & Schlangen, D. (2013). Investigating Speaker Gaze and Pointing Behaviour in Human-Computer Interaction with the Mint.Tools Collection. In SIGDIAL 2013 - 14th Annual Meeting of the Special Interest Group on Discourse and Dialogue, Proceedings of the Conference (pp. 319-323). (SIGDIAL 2013 - 14th Annual Meeting of the Special Interest Group on Discourse and Dialogue, Proceedings of the Conference).. https://aclanthology.org/W13-4048/

Kousidis, Spyros ; Kennington, Casey ; Schlangen, David. / Investigating Speaker Gaze and Pointing Behaviour in Human-Computer Interaction with the Mint.Tools Collection. SIGDIAL 2013 - 14th Annual Meeting of the Special Interest Group on Discourse and Dialogue, Proceedings of the Conference. Metz, France, 2013. pp. 319-323 (SIGDIAL 2013 - 14th Annual Meeting of the Special Interest Group on Discourse and Dialogue, Proceedings of the Conference).

@inproceedings{1a2c0a86ec884f14bf8418340e16feb1,

title = "Investigating Speaker Gaze and Pointing Behaviour in Human-Computer Interaction with the Mint.Tools Collection",

abstract = "Can speaker gaze and speaker arm movements be used as a practical information source for naturalistic conversational human-computer interfaces? To investigate this question, we recorded (with eye tracking and motion capture) a corpus of interactions with a (wizarded) system. In this paper, we describe the recording, analysis infrastructure that we built for such studies, and analysis we performed on these data. We find that with some initial calibration, a {"}minimally invasive{"}, stationary camera-based setting provides data of sufficient quality to support interaction.",

author = "Spyros Kousidis and Casey Kennington and David Schlangen",

note = "Publisher Copyright: {\textcopyright} 2013 Association for Computational Linguistics.; 14th Annual Meeting of the Special Interest Group on Discourse and Dialogue, SIGDIAL 2013 ; Conference date: 22-08-2013 Through 24-08-2013",

year = "2013",

language = "American English",

series = "SIGDIAL 2013 - 14th Annual Meeting of the Special Interest Group on Discourse and Dialogue, Proceedings of the Conference",

pages = "319--323",

booktitle = "SIGDIAL 2013 - 14th Annual Meeting of the Special Interest Group on Discourse and Dialogue, Proceedings of the Conference",

}

Kousidis, S, Kennington, C & Schlangen, D 2013, Investigating Speaker Gaze and Pointing Behaviour in Human-Computer Interaction with the Mint.Tools Collection. in SIGDIAL 2013 - 14th Annual Meeting of the Special Interest Group on Discourse and Dialogue, Proceedings of the Conference. SIGDIAL 2013 - 14th Annual Meeting of the Special Interest Group on Discourse and Dialogue, Proceedings of the Conference, Metz, France, pp. 319-323, 14th Annual Meeting of the Special Interest Group on Discourse and Dialogue, SIGDIAL 2013, Metz, France, 22/08/13. <https://aclanthology.org/W13-4048/>

Investigating Speaker Gaze and Pointing Behaviour in Human-Computer Interaction with the Mint.Tools Collection. / Kousidis, Spyros; Kennington, Casey; Schlangen, David.
SIGDIAL 2013 - 14th Annual Meeting of the Special Interest Group on Discourse and Dialogue, Proceedings of the Conference. Metz, France, 2013. p. 319-323 (SIGDIAL 2013 - 14th Annual Meeting of the Special Interest Group on Discourse and Dialogue, Proceedings of the Conference).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Investigating Speaker Gaze and Pointing Behaviour in Human-Computer Interaction with the Mint.Tools Collection

AU - Kousidis, Spyros

AU - Kennington, Casey

AU - Schlangen, David

PY - 2013

Y1 - 2013

N2 - Can speaker gaze and speaker arm movements be used as a practical information source for naturalistic conversational human-computer interfaces? To investigate this question, we recorded (with eye tracking and motion capture) a corpus of interactions with a (wizarded) system. In this paper, we describe the recording, analysis infrastructure that we built for such studies, and analysis we performed on these data. We find that with some initial calibration, a "minimally invasive", stationary camera-based setting provides data of sufficient quality to support interaction.

AB - Can speaker gaze and speaker arm movements be used as a practical information source for naturalistic conversational human-computer interfaces? To investigate this question, we recorded (with eye tracking and motion capture) a corpus of interactions with a (wizarded) system. In this paper, we describe the recording, analysis infrastructure that we built for such studies, and analysis we performed on these data. We find that with some initial calibration, a "minimally invasive", stationary camera-based setting provides data of sufficient quality to support interaction.

UR - https://www.scopus.com/pages/publications/84987859205

M3 - Conference contribution

T3 - SIGDIAL 2013 - 14th Annual Meeting of the Special Interest Group on Discourse and Dialogue, Proceedings of the Conference

SP - 319

EP - 323

BT - SIGDIAL 2013 - 14th Annual Meeting of the Special Interest Group on Discourse and Dialogue, Proceedings of the Conference

CY - Metz, France

T2 - 14th Annual Meeting of the Special Interest Group on Discourse and Dialogue, SIGDIAL 2013

Y2 - 22 August 2013 through 24 August 2013

ER -

Kousidis S, Kennington C, Schlangen D. Investigating Speaker Gaze and Pointing Behaviour in Human-Computer Interaction with the Mint.Tools Collection. In SIGDIAL 2013 - 14th Annual Meeting of the Special Interest Group on Discourse and Dialogue, Proceedings of the Conference. Metz, France. 2013. p. 319-323. (SIGDIAL 2013 - 14th Annual Meeting of the Special Interest Group on Discourse and Dialogue, Proceedings of the Conference).

Investigating Speaker Gaze and Pointing Behaviour in Human-Computer Interaction with the Mint.Tools Collection

Abstract

Publication series

Conference

EGS Disciplines

Access to Document

Other files and links

Fingerprint

Cite this