Das Konzept (Nachtrag)

Im Jänner hab ich mich mit dem Schreiben des Konzeptes befasst. Ich habe während des Prozesses immer wieder Feedback von Herrn Uni. Prof. DI Dr. Alois Sontacchi eingeholt, um die Verschriftlichung möglichst akkurat zu gestalten.

Das Konzept hat folgenden Aufbau:

Name: Auditives Leitsystem für sehbeeinträchtigte Menschen

1. Vorhaben

2. Anfordernisse

3. Aufgabenfeld

4. Methode

5. Referenzarbeiten

6. Quellen

Zeitplan & Methode

Das Konzept am Ende des zwiten Semesters soll die Prototypen aus den Wochen 3-8 (inklusive Erklärung) und eine Aufarbeitung des Feedbacks der Peer Group Review enthalten. Zudem sollen auf

Basis des Feedbacks das weitere Vorgehen für die Finalisierung der Leittöne

dargestellt werden. Die Peer Group soll aus zwei schwer Sehbeeinträchtigte und

einem Hörakustiker bestehen.

Technische Lösung (Nachtrag)

In dieser Woche habe ich mir konkret Gedanken über die technische Lösung des Konzeptes gemacht. Hierbei geht es um die Technik, welche für die Kommunikation der Audiosignale verwendet wird. Dies stellt eine große Herausforderung dar, weshalb auf die Konzeption der Technik im dritten Semester besonders viel Augenmerk gelegt werden muss. Die Auslegung darf nicht zu immersiv werden,  sodass das Leitsystem bewusst umgangen werden kann.

Für eine mögliche Lösung des Problems werde ich im nächsten Semester die Erkenntnisse aus diesem Forschungspapier aufarbeiten.

Mögliche Lösung: Fußmatten als Trigger

Audio Leitsystem für Blinde mit geistiger Behinderung:

https://journals.sagepub.com/doi/pdf/10.2466/pms.1995.80.3.747

Interessante Punkte: Experiment, Matten als Auslöser für den Klang

Interactions to design in a city

A dense city has been and is still the vision of architects as a suggestion to solve a lot of modern problems within city development. I can’t think of a place packet with more interactions than a dense city, my logic dictates that of course should there be interaction designers specifically focused on developing the city.

As I’ve seen in my research so far there are lots of micro districts where notions of the city development of the future takes place. Starting with the small projects will be more manageable, iterative, consequential and considerable towards its people. As with the futuristic city of Telalosa(as mentioned earlier) it can grow a stronger sense of community and shared responsibility within.

Going from a world built around “starchitects” as Frank Lloyd Wright, Le Corbusier, Oscar Niemeyer e.g. I hope we’re going in a more democratic and inclusive way of thinking about city development. Moving away from old ways someone have to design the processes of inclusive design. In a top-down world someone have to advocate the inhabitants of areas of development. More information than ever is at our hands, someone have to shed a light on inequality and also make the information accessible. Reading one of thousand definitions of interaction design, I would argue this someone can be a interaction designer.

interaction design synthesizes and imagines things as they could be. the practice of designing interactive digital products, environments, systems, and services. Beyond the digital aspect, interaction design is also useful when creating physical (non-digital) products, exploring how a user might interact with it.

Definition from Wikipedia

 Marianthi Tatari is a Senior Architect at UNStudio a knowledge-driven architecture and design practice that prides itself on its human-centered approaches. Her approaches to design are holistic and system oriented. One of her approaches for developing city areas is using testzones to spark progression and invite for communication about the projects.

“Cities have the capability of providing something for everybody, only because, and only when, they are created by everybody.”

Jane Jacobs

With all the projects of cities comes interactions. They might be planned or developed organically. How nature changes it’s infrastructure and it’s inhabitants adapt to it. Except this time we’re facilitating and planning the change. My vision for designing future cities after doing this research is a participatory designed society where a flat structure of decisions, information, accessibility takes place. Designed for everybody by everybody because everybody is designing their own interactions to some extent.

Dangers

The “smart city”, where do these ideas come from? is the question raised by Adam Greenfield, in his talk with reSITE, a forum for city development. As smart cities are frequently mentioned in the context of discussing the future of cities I want to highlight some of the negatives associated with it.

One definition of smart cities is that they are, “imbedded networked informatics in every surface, object and relation of the city.” (Meaning everything should be smart). Sounds a bit dystopic doesn’t it?

By this definition smart cities lean towards providing a lifestyle of convenience, consumption and security (for a few). By saying the few, I’m talking about the ones that access the “smartness” of the city they live in. From a lot of cases, e.g. IBM’s smart city, it’s apparent that only top-positioned decision makers can access the data that the population of the city generates. Until now smart cities are largely controlled by large scale actors with their own capitalistic agenda.

Synchronized and analyzed efforts among sectors and agencies as they happen, giving decision makers consolidated information that helps them anticipate problems and manage growth and development

IBM – defining their smart city efforts

The goal of such a city is to optimally regulate and control resources by means of autonomous IT systems

Siemens – about smart cities

A complete picture of building state, usage and operations continually maintained, allowing constant optimization of energy, resources, enviroment, and occupant support and convenience systems.

Living PlanIT

These visions painted by some of the biggest actors behind our smart cities include words like “manage growth”, “optimally regulate and control resources”, “continually maintained, allowing constant optimization”. As Greenfield argues in his reSite talk, these words are purely focused towards the convenience of managing actors completely separated by the people generating the data. Said in an dramatic pictorially manner, “Reflecting lights of our faces to see what engagement we have with what’s around us. But preserving it from the ones that are generating it.”

Referring back to the utopian cities such as Brasilia these smart cities definitions have similarities. As the utopian cities had tendencies of shredding old cities into clean slates to rebuild perfect societies, these smart cities builds a rigid system of managing people of the cities. In the end using politics and strict goals for the cities as means for changing people’s behavior to reach those goals.

“Order is built over time by an infinity of small acts.”

Jane Jacobs

This quote by the famous urbanist and activist Jane Jacobs goes to say that we ought to be careful how we implement change as it’s slowly defining order over time.

A side-effect of such acts are “gentrification”, which means investing in a middle-class district in order to improve it’s quality, often leading to chasing away current inhabitants and replacing them with wealthier people, often in central areas.

The smart city industry is a Trojan horse for technology companies. They come in under the guise of environmentalism and improving the quality of life, but they’re here for money.

Bianca Wylie, The Washington Post

https://www.resite.org/talks/adam-greenfield-on-the-dangers-of-smart-cities?gclid=Cj0KCQiA9OiPBhCOARIsAI0y71AsrFkk7H8OLm9PTZuHQK_yWZlmQ4p8trrfqBwfoTg4mGt_4Es5mh0aAp5-EALw_wcB

https://www.ft.com/content/f866dfc8-a4b3-11e9-974c-ad1c6ab5efd1

https://no.wikipedia.org/wiki/Jane_Jacobs

Dreams cause action

In a lecture on the topic of cities of tomorrow Winy Maas opens by saying, “Dreams will be there to be developed by students. How we paint our cities is how they will look like and be interpreted.” Those are words of the world famous architect which tells how he is visioning the cities of tomorrow, but they are not just words. MVRDV as his architecture company is names have numerous projects around the world backing these words.

In Rotterdam MVRDV constructed a bridge reaching towards the sky. As a symbol of an elevated future which is accessible for everyone. The staircase is a steel and glass construction, but as it was adopted by the inhabitants and by-passers of Rotterdam it became much more. Activating events such as fashion shows, weddings, tourism e.g. the bridge became a activator of people.

The skybridge of Rotterdam is a example of Winy Maas’s vision of changing cities. Sights, areas and infrastructure as activators of people creates sparks and identity of cities. “Courage in the cities can activate a chain of activities in an area.” he says. change by change, spark by spark he wished to transform cities by organic change.

It’s a city out of connections, not blocks and towers

Winy Maas

“Connections will stich the cities together. Don’t think in blocks and buildings, think in connections.” is how Winy Maas goes about doing architecture. He want to develop cities district by district, slowly sparking change. Using cheaper affordable accommodations for the middle class, transforming them into buildings interacting with their audience by e.g. skybridges is a vision they have in MVRDV. The believe that a mix of analog and technological interactions is where we are going.

Seoul, in South Korea, is another area where they prove their concepts in their doing. It previously was a grey city, until the mayor made a huge lawn in front of his house, accessible to everyone later leading to the project “sky garden” which was won by MVRDV in a competition. With small iterative steps they developed a system of buildings with varying plants surrounding and inhabiting them. Cafes, toilets, shops e.g. in a collection of building sized flower pots now creates a green sphere in districts of Seoul. Each “oasis” attracted heaps of locals and tourists further kickstarting the project by mere attention and interactivity. Now Seoul already is and envisions itself as a greener city making ripple effects of democratization.

“Could it be more dense, and more green”

Winy Maas

More dense, more green, that’s where Maas wants cities development to head. With clear similarities to the mindsets of new urbanists and visionaries previous to him. His approach is change in one neighborhood at a time, affecting all it’s connections each time. Dreaming about the future possibilities will create sparks in fellow architects, designers and politicians as well as inhabitants in his opinion. Meaning putting action behind dreams small increments at a time will push us where we want to be in an organically manner.

https://www.mvrdv.nl/projects/208/seoullo-7017-skygarden

User-Centered Perspectives for Automotive AR

| a short summary of a paper on human aspects related to automotive AR application design

A research paper, titled like this blog post, by experts from the Honda Research Institute (USA), the Stanford University (USA) and the Max-Planck-Institut für Informatik (Germany) [1] discusses benefits, challenges, their design approach and open questions regarding Augmented Reality in automotive context with a focus on the users.

Augmented Reality can help drivers in pointig out important and potentially dangerous objects in the driver’s view and increase the driver’s situation awareness. Though if the information is presented incorrectly, the distraction and confusion of the driver can lead to dangerous situations.

The authors of the paper put up a design process with focusing on the appropriate form of solution to a driver’s problem (rather than just describing ideas technically).

To understand the drivers’ problems in the first place, they conducted in-car user interviews with different demographic groups to gather information about driving habits, concerns and the integration of driving into daily life.

After the interviews they ideated prototype solutions and tested concepts in a driving simulator with a HUD. One realization was that at a left turn, drivers needed more help in timing the turn according to oncoming traffic rather than an arrow or graphical aids for the turning path – which even distracted them from the oncoming traffic. The design solutions of the authors therefor focus on giving the driver additional cues to enhance awareness rather than giving only navigation commands. After researching different graphical styles of turning path indication, results showed less distraction with solid red path projection – that is visible in the peripheral vision while focusing on traffic – than simple chevron style lines.

Human visual perception

Regarding human perception, the authors of the paper analized influences of visual depth perception and the field of view. The human eye is built to focus on one distance at a time, so AR displays / Head Up Displays can cause a problem due to their see-through design. The driver’s focus has to remain on the road ahead and not change to the windshield’s distance, blurring out the farther imagery.

The eye’s foveal focus with the highest acuity is only at a ca. 2° center area of the vision field. This determins the so called “Useful Field Of View” (UFOV), the limited area from which information can be gained without head movement. These restrictions imply the use of augmented systems only in the driver’s main field of view, and not throughout the whole windshield. Objects in the peripheries should be therefor signalized either inside of the UFOV or through other methods.

Distraction

The National Highway Traffic Safety Administration (NHTSA) of the USA states three types of driver distraction:

  • visual distraction (eyes off road)
  • cognitive distraction (mind off driving)
  • manual distraction (hands off the wheel)

Each of these types can be aided but also caused by Augmented Reality applications in vehicles.

The authors discussed the human attention system and cognitive dissonance problems further.

  • Attention system
    Regarding the human attention system, the so called “selective visual attention” and the “inattentional blindness” can be problems in driving conditions. Important visual cues can be suppressed when the driver is focusing on secondary tasks or if they are outside of the focus of attention. Warning signs on a HUD can either help by attracting attention, but also distract from other objects that are outside of the augmented field of view. The study states the need of further research on the balance between increasing attantion and avoiding unvanted distraction.
  • Cognitive Dissonance
    Cognitive dissonance, the perception of contradictory information, could occur e.g. with bad overlapping of 2D graphics on the 3D vision of the surroundings, causing confusion or misinterpretation of the visual clues.

Human behaviour

As a third category, the study discusses the effects of AR technology on human behaviour.

Situation awareness – maintaining state and future state information from the surroundings – is detailed by a source in three steps:

  1. Perception of elements in the environment
  2. Comprehension of their meaning
  3. Projection of future system states

Augmented Reality can help drivers not only in perception but also in the further steps. State-of-the-art computers, AI technology and connected car data from surroundings can be especially of help in cases where additional computational power can predict traffic dynamics. [comment of MSK]

One aspect is the behavioural change of drivers after longer use of assitance systems. A study implies that the reduced mental workload could lead to the retention of the drivers’ native skills. Further, the phenomena called “risk compensation” can occur after getting used to the aids. This means a riskier behaviour of the driver than normal, due to higher confidence in the surroundings. These behavioural changes can have dangerous consequences, why the authors suggest the use of driver aids only when needed.

According to one source, the user’s trust in a technology is can be increased with more realistic visual displays, like AR rather than simple map displays. Further, AR can also help to build trust in autonomous cars, communicating the system’s perception, plans and reasons for decision making.

Some open questions were stated at the end of the paper, to be considered further on.
Such were for example how multiple aiding systems can interact at the same time? Or how will the use of AR over longer time effect the drivers’ behaviour and skills when they have to switch back and drive a non-AR vehicle? Will the drivers’ skills deteriorate over and will they become dependent on these aiding systems?

My conclusion

This paper was published in 2013, since when the technology was significantly developed further. Nevertheless the basic principles and human factors are still the same, which have to be considered when designing safety critical automotive applications.

Reliability and understanding the behaviour of autonomous vehicles will be an essential aspect in creating acceptance by the driver / passengers. Augmented Reality can be of much help not only for extra driving assistance systems, but also for the complete user experience at different automation levels.

The mentioned topics of human factors in this paper were only focusing on visual augmentation and assistance. These could be expanded to other modalities like sound and haptic augmentation, and analyse the perception of a combined driver assistance as well.

Source

[1] Ng-Thow-Hing, Victor & Bark, Karlin & Beckwith, Lee & Tran, Cuong & Bhandari, Rishabh & Sridhar, Srinath. (2013). User-centered perspectives for automotive augmented reality. 2013 IEEE International Symposium on Mixed and Augmented Reality – Arts, Media, and Humanities, ISMAR-AMH 2013. 13-22. 10.1109/ISMAR-AMH.2013.6671262.
Retrieved on 30.01.2022. https://www.researchgate.net/publication/261447349_User-centered_perspectives_for_automotive_augmented_reality

Analog/Digital Environments

In this article we will look at other types of installations and projections to see what other settings we can use as designers for immersive experiences.

Projection Mapping

Projection mapping is a 3D video projection technique using physical environments and objects as the surface for a projection, instead of a screen. Light, colors and oftentimes sound is used to outdraw a story with the edges of a building being the only boundaries for the scenery. Architectural elements, such as facades, are filled with life through precise lighting of the projection surface. The structure dissolves and the illusions take over. Houses bend or fall apart, 3D objects move in the direction of the audience.

AV Installations

Worth mentioning are Audio-Video Installations using giant or more smaller screens, showing videos or animations. They are often used in exhibitions and public places and are most times not interactive. But in the lobby of the Terrell Place in Washington DC there is an installation with motion-activated screens responding to the people going by.

Immersive Sensory Rooms

CAVE (Cave Automatic Virtual Environment) is a virtual reality environment consisting of a cube-shaped VR room you can enter. The walls, floors and ceilings are projection screens and with a VR headset, that is synchronized with the projectors, the user can walk around an image to study it from all angles. Sensors within the room track the viewer’s position to align the perspective correctly.

References:

Projection mapping https://www.barco.com/en/solutions/projection-mapping

Videomapping Projection https://www.visualimpression.de/en/3d-visualisierung/videomapping-projection/

Amazing Screen Installation http://www.fubiz.net/en/2016/07/30/amazing-screen-installation/

CAVE (Cave Automatic Virtual Environment) https://whatis.techtarget.com/definition/CAVE-Cave-Automatic-Virtual-Environment

Werbung ist implizit, Wahrnehmung individuell

Man sagt sogar, Werbebotschaften sollen am besten am Piloten vorbei direkt zum Autopiloten gelangen. Eine direkte Aussage sei in den meisten Fällen unwirksam. Daher muss ganz sensibel an das Kernmotiv herangeführt werden.

Es ist nicht unbedingt nötig, für eine implizite Werbung das Produkt großflächig im Vordergrund zu halten. Die Marke wird durch anderes veemittelt. Dafür muss man zuerst verstehen, was für Motive das zu bewerbende Produkt eigentlich hat. Hier sind wieder einmal Zielgruppe und Produktrecherche enorm wichtig. Wie wirkt das Produkt ect. von sich aus und was kommuniziert es?

Bedeutung alleine reicht für den Erfolg von Markenkommunikation nicht aus. Erst durch den Anschluss an relevante Motive lösen wir beim Kunden gewünschtes Verhalten aus.

Das Motiv wird nun in einen visuellen Code gepackt. Für diesen gibt es vier relevante Ebenen: Sprache, Geschichte, Symbolik und Sensorik. Sprache ist der explizite Code. Text oder Apell zum Beispiel. Die Geschichte gibt den Kontext für das abgebildete Geschehen. Symbolik wird von einzelnen Elementen und eben ihren Bedeutungen im Kontext vermittelt. Die Sensorische Wirkung impliziert Emotion – zum Beispiel durch eine bestimmte Farbwahl. Dieses Codesystem kann bei verschiedenen Werbeplakaten beobachtet und auf eigene Beispiele angewendet werden.

Text, ein angespanntes Gesicht eines Mannes, verschiedene symbolische Elemente und eine kühle Farbe erzählen uns etwas. Die Marke oder das Produkt sind nicht das Hauptmotiv.

Bilder sind wirkungsmächtig. Sie erfüllen ihren Zweck – informieren, emotionalisieren ect. Damit ist nicht gemeint, dass sie eine Wahrheit wiedergeben. Der Mensch reagiert aber trotzdem immer sofort auf sie und ist ihnen sozusagen ausgesetzt. Damit ist die Abbildung ein Werkzeug, dessen Bedienung erlernt werden kann und das immer eine Aufgabe hat und nach Benutzung eine Folge hat.


Brink, C. Bildeffekte: Uberlegungen zum Zusammenhang von Fotografie und Emotionen. In: Geschichte und Gesellschaft, 37. Jahrg., H. 1, Geschichte, Emotionen und visuelle Medien (Januar – März 2011), pp. 104-129.

Held, D. Scheier, C. Wie Werbung Wirkt: Erkenntnisse des Neuromarketings. Haufe Verlag, 2006.

The Emotional Space | #10 | Next Steps

Now that the semester is coming to an end, there is finally a little bit of time to reflect upon what has happened in the last four months. And talking specifically about this project, it has come quite some way. In the past weeks I have finalized my exposé (which you can view and download below), worked more on the vision I have, laid out some basic design context and presented it to various people. I will keep this blog entry rather short and just touch upon some of the next steps.