t
PHOTON
ASSISTED PliOTO SHOOTING FOR TI :c BUND
Fedor Tiršel - autumn 2010
Content
• introduction
• WWL and image sonification
• concept PHOTON-GATE-WEBGEN
• what we need
• image tagging
• known problems
• future work
• example of the image exploration
Introduction
GATE
- deploy utilities for easy image annotation
- provide the blind with support for exploring image
- develop system for image generation in means of dialogue
WEBGEN
- simplify the creation of web presentations to the blind
- bridge to the GATE'S Verbal Information Module
4
WWL and image sonification
WHAT-WHERE language
- WHAT is WHERE / WHERE is WHAT
- questions are send to the server asynchronously
image sonification
- seven primary colors, black and white are handled specifically (special sound for each primary color)
- any color is expressed as the mixture of the two closest primary colors
- simultaneous playing of the three discernible sounds
5
Employment at University:
University: Masaryk university Faculty: Faculty of informatics Department: Department of computer science Office: B 201
Office Hours: Monday: 10 a.m. - 12 a.m. University Web Page: Masaryk university
Projects:
Project name: BrowserWebGen
Description: Web page generation using a dialogue
Co-authors: Paul Newman, John Stranger
Dialogue-based exploration |   Sound-based exploration |
flklcr Welcome to Flickr - Photo Sharing
WebGen, 2009. Last Update: 30. 04. 2009
599999999999999999999999999999999999999999999999999999^
Concept PHOTON-GATE-WEBGEN
PHOTON
GATE
WEBGEN
send my location and direction to server get set of near points of interest take photos
add tags, make annotation publish on the web
7
What we need
at least 3Mpix camera
automatic focus
GPS and digital compass
multi-touch screen
accelerometer
voice control and voice over
microphone and speaker
Internet access
current date and time
8
Image tagging
• location and direction
• date and time
• voice memo
• actual weather
• recognized objects, people
9
Known problems
problematic control of touch screen
uncertainty / unavailability of GPS (in cities)
restrictions of EXIF
slow hardware / small battery capacity
limited upload speed
^^^^^^^
4
7 8
V-0
SfflQD
BJSJ5B0EH
6
g|BB B
10
Future work
finishing GATE and WEBGEN, start PHOTON real-time detection of objects and faces micro-navigation in buildings commercial use of whole concept
11
Thank you for attention!
fedor@mail.muni.cz http://lsd.fi.muni.cz/gate Fl - B201
12