Motivation State of the Art My research Interaction Methods in Distributed Collaborative Environments Vit Rushäk Faculty of Informatics, Masaryk University 7. 11. 2011 Motivation State of the Art My research Outline Motivation State of the Art My Contribution Motivation State of the Art My research Collaborative Environments Videoconferening =4> Data-rich Collaboration • Group-to-Group collaboration of globally dispersed teams • Truly shared content = deixis • Wall-sized displays based collaborative systems • Keyboard and mouse interaction is not beneficial Motivation State of the Art My research Large-scale data visualization Medicine Biology Disaster Response (war rooms) Geography Cartography Astronomy Motivation State of the Art My research Research Areas Motivation State of the Art My research Tiled-Display Visualization Middleware Systems • DMX - Distributed Multihead X Project • XDMX - Distributed Multiead X Project. Available at http://dmx.sourceforge.net • Chromium • Humphreys, G., et al. (2002). Chromium: a stream-processing framework for interactive rendering on clusters. ACM Transactions on Graphics, 21(3), 10. • Equalizer • Eilemann, S., et al. (2009). Equalizer: a scalable parallel rendering framework.IEEE Transactions on Visualization and Computer Graphics, 15(3), 436-52. • CGLX - Cross-Platform Cluster Graphic Library • Doerr, K.-U. and Kuester, F. (2010). CGLX: A Scalable, High-performance Visualization Framework for Networked Display Environments. IEEE transactions on visualization and computer graphics, 17(3), 320-332. SAGE - Scalable Adaptive Graphic Environment • Renambot, L., et al. SAGE: the Scalable Adaptive Graphics Environment. In WACE '04, ACM (2004), 8 pp. Motivation State of the Art Interaction Zones My research Jagodic, R. (2011). Collaborative Interaction And Display Space Organization In Large High-Resolution Motivation State of the Art My research Main Issues • Multiple interaction zones Jagodic, R., et al. (2010). Enabling multi-user interaction in large high-resolution distributed environments. Future Generation Computer Systems. Elsevier B.V. • Ponto, K., et al. (2010). CGLXTouch: A multi-user multi-touch approach for ultra-high-resolution collaborative workspaces. Future Generation Computer Systems, 27(6), 649-656. Elsevier B.V. • St0dle, D. (2009). Device-Free Interaction and Cross-Platform Pixel Based Output to Display Walls. Dissertation Thesis. University of Troms0. • Synchronization of events (multi-sensor configuration, strokes across sensors, multi-party cooperation) • Michel, M. and Stanford, V. (2006). Synchronizing multimodal data streams acquired using commodity hardware. VSSN '06, 3. ACM Press. • Nam, S. et al. (2010). Multi-application inter-tile synchronization on ultra-high-resolution display walls. MMSys 10, 10. ACM Press. • Distinguishing users (cursors, devices) • Dietz, P. and Leigh, D. (2001). DiamondTouch. UIST '01 (p. 219). ACM Press. • Schwirten, T., et al. (2010). radarTOUCH. ITS 10 (p. 314). ACM Press. • Runtime gesture recognition • Wobbrock, J. O., et al. (2007). Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes. UIST '07, 159. ACM Press. • Li, Y. (2010). Protractor. CHI '10 (p. 2169). ACM Press. • Kratz, S. and Rohs, M. (2011). Protractor3D. IUI '11 (p. 371). ACM Press. Motivation State of the Art My research Preliminary conditions ' Tiled-display walls and tiled-tabletops • Based on SAGE middleware • Use of commodity HW • Come-and-use - unobtrusivness and zero orchestration • Group-to-Group collaborative environment • Recognition of gestures in distributed environment • Distinguishing users interacting with the system Motivation State of the Art My research Preliminary work (2010/2011) Preliminary outcomes of group-to-group collaborative environment, informal experimental evaluation of coupling strokes in tiled-displays * Towards Collaborative System Based on Tiled Multi-Touch Screens Rusnak, Vft - Rucka, Lukas. In TEI 11 Work-in-Progress Workshop Proceedings. Funchal, Portugal, 2011. od s. 73-78, 6 s. • Shared map over network - supportive application for experimental evaluation of videoconferencing tool GColl Motivation State of the Art My research MUSE Framework Highly-configurable component-based framework Sensor coupling (sensor abstraction) Distinguishing users Association of actions to users Multiple gesture-recognition algorithms Various sensors support (from touch sensors to cameras, even the DancePad) Application i f 1 1 f •> f \ Sin Gesture Runtime Gesture Dummy Parsing Pars Recognizer Recognizer Motivation State of the Art My research Future Work l MUSE Framework completion, Thesis proposal defence (UIST 2012 conference) 2 Framework Evaluation (journal paper) (CHI 2012 conference) 3 Integration of collaborative applications (FGCS journal) 5 Multi-site Group-to-Group collaborative framework (Human Computer Interaction journal) I Dissertation Thesis writing \ Dissertation Thesis submission Motivation State of the Art My research Any question? Motivation State of the Art My research Thank you!