Jaanis Garancs


Private multi-verse Perception

Interaktive 'Moleküle' des 'audiovisuellen Raums und der audiovisuellen Zeit'


visual title (pictogramm) [link 01]

visual title (pictogramm)

Technik

Technische Beschreibung

The developed technological solutions facilitates and emphasizes the main formal concept - multi-modal inter-translation of image, sound, space and movement, allowing control of (almost) every pixel, tone, and millisecond.
The use of database for description of scenes, object properties and relationships organises the playground, where the specific behaviors mediate the user's interaction. Objects carry their identity-type, accumulate 'infection' with other 'molecules', interaction history during the session.
Extensive use (and-abuse) of non-standard/multi-layer rendering effects e.g. multiple camera views translated to texture, Z-depth traces, etc.
The technological platform is based on mass-consumer-rate equipment with few specific add-ons. At the time of the production (2002/2003), the utilised computer parameters were 2.6 GHz processor, 1 GB RAM and a graphic card with 128 MB memory.
Self-(co-)developed technical solutions as VRML and C++ :
- overlay of abstract computer graphics on stereoscopic photos and movie files.
- Translation of object geometry, coordinates, movements from VRML to MIDI signals and vice versa (MIDI-to-VRML).
- Scene, Object and Animation Database.
- Touch-screen additional navigation/control interface (also written in VRML/MPEG-4).
The work structure and software components allow to expand (scale-up) the work up to a very large set-up, when the on-site accessible hardware resources allow that (e.g. HDTV resolution projectors, CAVE-like setup, more sound speakers, etc.)
Another direction is to implement it as 'VR-organ' for multimedia/VR 'orchestra' performances.
(more on the project's website: http://plus.x-i.net )

Hardware / Software

Hardware:
3 computers
[ 2 PCs (Windows) for graphics (dual-output nVidia chip graphic cards) and database
and 1 PC or Mac for sound ]
projection:
passive (polarisation glasses) with 2 LCD/DLP projectors or active (shutter glasses) projection - with single CRT projector
Touch-screen monitor
MIDI keyboard
data glove (P5 3D controller)
6DOF space-mouse and/or 1-2 joystick(s)
Software:
BS Contact MPEG-4 (extended VRML browser) for graphics /audio
Reaktor for additional audio processing
MySQL for database access (via custom written ODBC plugin in C++)
Interaction written in VRML script and Java.

Kontext

Hochschule / Fachbereich

Kunsthochschule für Medien, Köln
Medienkunst

URL der Hochschule

» http://www.khm.de [link 02]

Betreuer des Projekts

 David Larcher

Kommentar des Betreuers

I was very happy to be able to act as one of the "Betreuer" for Jaanis Garancs diploma work +=X at KHM in Köln (the others being Prof. Zielinski and Prof. Vogelaar). It represents the current state of his ongoing research in the areas of real-time 3D, VRML, coding, midi triggered audio synthesis and the interface.
The work is difficult to describe since it evolves with each individual presentation and is dependent on aesthetic improvisation and timing which are never quite reproducible. It takes the form of an interface instrument rendering image and sound in real-time and producing 3D spaces both on a flat screen and with the addition of polarizing spectacles. In some sense it can be called an interactive installation since the work is experienced via a joystick, data glove or touch screen interface which link to a database of VRML objects, textures, audio samples and coded behaviours. These create evolving 3D spaces which are rendered on the fly whilst simultaneously triggering and creating audio spaces. Work such as this has already been seen in >=Cave<= and other virtual environments, but in +=X we are invited to take part in the actual creation of the environment. Moving seamlessly between connected visual environments, particle image explosions, lettrist landscapes and disintegrating geometric borderlands. The installation has its roots in current experimentation in VR but it represents an interesting step in new form cinema and gaming relationships since we are immersed in a synthetic aesthetic that becomes its own "raison d'etre" as we learn to navigate its varied geographies. Whether seen single screen in 3D or on multiple screens one is drawn into the experience through the process of continuous transformation.

Seminar / Kurzbeschreibung

Medienkunst

Zuordnung Forschungsbereich

David Larcher, Professor Medienkunst

  • › digital sparks 2003 [link 03]

» http://plus.x-i.net [link 04]

  • › interactive 'audiovisual space/time molecule' [JPEG | 42 KB ] [link 05]
  • › projection [JPEG | 77 KB ] [link 06]
  • › Hi-res screenshot (resize the pop-up window!) [JPEG | 161 KB ] [link 07]
  • › excerpts from installation view [RealMedia] [link 08]
  • › scheme [16 KB ] [link 09]