Special issue on Visual communication cues for remote collaboration
A/Prof Tony Huang, University of Technology Sydney, Australia (Managing editor)
Prof Mark Billinghurst, University of Auckland, New Zealand
Dr. Gun Lee, University of South Australia, Australia
Prof Hideaki Kuzuoka, University of Tokyo, Japan
In many real-world scenarios, people need help from a remote expert to operate on physical objects. For example, when a broken machine needs to be fixed by an expert who is not present on location, when a doctor needs to conduct an operation on a patient with the essential help of a distant surgeon, or when a crime scene investigator needs help from a forensics expert. Particularly, working from home is one of the main themes of 2020, and the increase in remote collaboration could have globally significant socioeconomic impact over the long term.
To support these scenarios, it is essential to construct and provide a shared visual space for common grounding and reference, which has been challenging given its expenses in computation and transferring it over the network. Further, how to construct and convey visual guidance cues within the shared space has also been researched for the past two decades. Despite the effort, it is only recently that the technical breakthrough has been made leading to much attention and rapid progress due to development and enhancement in Computer Graphics, Augmented Reality (AR) and mobile/wearable display technologies. Typically the advanced techniques and methods involves smart construction of 2D/3D workspace scenes sourced from different media such as videos and images, adding Augmented Reality based visual communication cues, such as pointing, sketching, or hand gestures, on top of a video conferencing system where audio communication was available, in order to improve the collaboration experience and task performance.
This special issue targets on novel design principles, technical advancements and evaluation methodologies that are to address issues surrounding constructing shared visual spaces, conveying multimodal communication cues, developing proper interactions and interfaces for remote collaboration. The primary objective of this special issue is therefore to compile a collection of high quality contributions from researchers to reflect the latest state of the art of research in this space. It will foster a focused attention in this new development of the field and to serve as forum for researchers all over the world to exchange and discuss the latest advances.
Papers to be submitted to this special issue must focus on techniques and methodologies surrounding shared visual space and visual communication cues (e.g. re-construction of workspace, combination of several input and/or output communication cues such as gesture, speech, vision, graphics, gaze, haptics, touch, etc.). All submitted papers will be peer-reviewed and papers will be selected based on their quality and relevance to the theme of this special issue. Topics considered for this special issue include, but are not limited to, the following:
Novel 2d/3d construction methods and techniques of video and image scenes
Virtual and augmented reality usage for shared visual space
Extraction and augmentation methods and techniques of visual multimodal communication cues
Design and evaluation of shared visual space and communication cues for remote collaboration
Tools for building augmented reality systems to support remote collaboration
Interaction models for collaboration in AR
AR based human-machine interfaces, frameworks, reference models, architectures, tools and systems
Surveys and reviews of recent development and research relevant to the special issue topics.
Submission open: 20th January, 2021
Submission deadline: 30th June, 2021
Instructions for authors:
Submissions must not have been previously published, with the exception that substantial extensions of conference and workshop papers (at least 30% new content) can be considered.
Prospective authors should follow the instructions given in the Guide for Authors for the journal (https://www.elsevier.com/journals/journal-of-visual-communication-and-image-representation/1047-3203/guide-for-authors), and submit papers directly through the online submission system prior to the submission deadline (https://www.editorialmanager.com/jvci/default.aspx),
please select the article type
“VSI: Visual Communication Cues”
to submit the paper.
Bio of the Guest Editors
Associate Professor Tony Huang
Dr. Huang is Associate Professor at University of Technology Sydney. He was Director of Collaboration and Visual Analytics Research Lab, a senior research scientist and the acting manager of the User Interaction and Collaboration team at CSIRO ICT Centre (now Data61). At CSIRO, he worked on a number of strategic and commercial multi-million dollar projects related to mobile/ wearable/ ubiquitous computing, computer-supported collaboration, computer graphics /vision /visualization /multimedia, and virtual /mixed /augmented reality. He designed multimodal system interfaces and interaction methods, investigated HCI, CSCW and human factors issues, and evaluated usability and user experience of using emerging technologies in industrial domains including mining, education, health and manufacturing.
His research interests lie in HCI and visualization, and more specifically on remote collaboration and visual analysis. He has over 150 publications in these areas including 5 books; one of his books: Recent Trends of Mobile Collaborative Augmented Reality Systems, was among the top 25% most downloaded eBooks of Springer, a major academic publisher. His research has achieved impact both in academia and in industry. He gives keynote/plenary speeches, invited talks and seminars at conferences and universities worldwide.
Prof Mark Billinghurst
Prof. Mark Billinghurst has a wealth of knowledge and expertise in human-computer interface technology, particularly in the area of Augmented Reality (the overlay of three-dimensional images on the real world). In 2002, the former HIT Lab US Research Associate completed his PhD in Electrical Engineering, at the University of Washington, under the supervision of Professor Thomas Furness III and Professor Linda Shapiro. As part of the research for his thesis titled Shared Space: Exploration in Collaborative Augmented Reality, Dr Billinghurst invented the Magic Book – an animated children’s book that comes to life when viewed through the lightweight head-mounted display (HMD).
Not surprisingly, Dr Billinghurst has achieved several accolades in recent years for his contribution to Human Interface Technology research. He was awarded a Discover Magazine Award in 2001, for Entertainment for creating the Magic Book technology. He was selected as one of eight leading New Zealand innovators and entrepreneurs to be showcased at the Carter Holt Harvey New Zealand Innovation Pavilion at the America’s Cup Village from November 2002 until March 2003. In 2004 he was nominated for a prestigious World Technology Network (WTN) World Technology Award in the education category and in 2005 he was appointed to the New Zealand Government’s Growth and Innovation Advisory Board.
Research interests: Dr. Billinghurst’s research focuses primarily on advanced 3D user interfaces such as: Wearable Computing – Spatial and collaborative interfaces for small wearable computers. These interfaces address the idea of what is possible when you merge ubiquitous computing and communications on the body. Shared Space – An interface that demonstrates how augmented reality, the overlaying of virtual objects on the real world, can radically enhance face-face and remote collaboration. Multimodal Input – Combining natural language and artificial intelligence techniques to allow Human-Computer Interaction with an intuitive mix of voice, gesture, speech, gaze and body motion.
Dr. Gun Lee
Dr. Gun Lee is a Senior Lecturer at the Australian Research Centre for Interactive and Virtual Environments (IVE), University of South Australia (UniSA) investigating interaction and visualization methods for sharing virtual experiences in Augmented Reality (AR), Mixed Reality (MR), and immersive 3D environments. Recently, using AR and wearable interfaces to improve remote collaborative experience has been one of his main research themes. Extending this research into sharing richer communication cues and scaling up to a larger group of participants are the next steps he is working on.
Before joining the Empathic Computing Lab at IVE, UniSA he was a Research Scientist at the Human Interface Technology Laboratory New Zealand (HIT Lab NZ, University of Canterbury), leading mobile and wearable AR research projects. Previously, he also worked at the Electronics and Telecommunications Research Institute (ETRI, Korea) as a researcher where he developed Virtual Reality (VR) and AR technology for industrial applications, including immersive 3D visualization systems and virtual training systems.
Dr. Lee received his B.S. degree in Computer Science from Kyungpook National University (Korea), and received his Masters and Ph.D. degrees in Computer Science and Engineering at POSTECH (Korea), investigating immersive authoring method for creating VR and AR contents using 3D user interfaces.
Prof Hideaki Kuzuoka
Prof. Dr. Hideaki Kuzuoka graduated at Graduate School of Engineering, the University of Tokyo (1986) and received the Doctor of Engineering from Graduate School of Engineering, the University of Tokyo (1992). He taught at University of Tsukuba from 1992 to 2019 and directed Groupware Laboratory. He is currently a professor at the Graduate School of Information Science and Technology, the University of Tokyo. His research interest includes Computer Supported Cooperative Work, Social Robotics, Virtual Reality, and Human-Computer Interaction in general. He has been serving as an associate chair of ACM CHI, ACM CSCW, ACM/IEEE HRI, ECSCW, etc., and served as a General Co-Chair of HRI 2013, HAI 2014, and CollabTech 2005-2009. He also served as a steering committee member of CSCW, HRI, and HAI.