Augmented Reality und Journalismus

Ask me anything   > über FH Wien Studiengang Journalismus & Medienmanagement |   | > über ONA   

Fachgespräch "Augmented Reality und Journalismus": AR-und Medien-Experten diskutieren am 5. Mai. Eine Veranstaltung des Master-Studiums Journalismus & Neue Medien der FH Wien:

    Fazit: Wozu wir Augmented Reality brauchen

    Unser interdisziplinäres Fachgespräch hat gezeigt, wie relevant die AR-Forschung bereits jetzt für Medien ist. Zwar ist längst nicht alles aus den Laboren und den Startup-Unternehmen schon für Journalisten sinnvoll nutzbar. Aber jetzt ist die Zeit, wertvolle Erfahrungen zu sammeln.

    Für uns Journalisten geht es bei AR um die Möglichkeiten, Nachrichten und Geschichten nah und relevant im Leben unserer Leser zu erzählen: “make information relevant and tangible to a reader or viewer” (karthikaswamy, Online Journalism Blog, Feb 2010)

    Meine Thesen:

    Eine reine Lokalisierung von News ist zwar ein netter Service, aber eigentlich nicht AR. 

    Journalistisch spannend sind die Möglichkeiten multimediale, lokalisierte Reportagen zu erzählen, und zwar nicht linear und interaktiv. Besonders taugt AR für Szenarien und Simulationen.

    Was wir aus Print und Online schon kennen, verstärkt sich mit AR: Der Bedarf an wertigen, wertvollen Produktionen, für die unsere Kunden bereit sind zu bezahlen. Und das sind i.d.R. nicht Liveticker, Newshappen und Texte ohne Recherche. Das sind viel mehr exklusive, perfekt recherchiert Analysen, Hintergründe, spannend erzählte Geschichten, eindrücklich visualisierte Daten. Kurzum: mehr Relevanz, mehr Überraschung, mehr Erkenntnis.

    Dem Reality-Virtuality Continuum der AR-Technik entspricht ein Kontinuum des Journalismus: eine Vielfalt der AR-Anwendungen von einfachen Ergänzungen traditioneller Medien mittels QR-Code oder Video bis hin zur intuitiven Visualisierung komplexer Informationen.

    AR für Medien muss über die klassische AR-Definition hinaus gehen. Ronald Azuma definierte 1997 Augmented Reality so:

    • combines real and virtual
    • is interactive in real time
    • is registered in 3D

    In journalistischer Anwendung müssen wir ergänzen:

    • es ist integriert in Social Web
    • es ist absolut intuitiv zu nutzen
    • es muss nicht 3D sein, aber ergänzt immer sinnvoll die Wahrnehmung der Realität 

    Die Art und Weise so zu erzählen, ist nicht neu - eigentlich. Die ersten Geschichten der Menschheit wurden lokalisiert notiert, nämlich auf Stelen und Statuen, die beispielsweise von Siegen an dieser Stelle erzählten. Die Reflexion der historischen, philosophischen und soziologischen Aspekte gehört genauso dazu wie die Kenntnis der Technik. Daraus entstehen dann neue oder veränderte, jedenfalls passende journalistische Formate für unsere Leser, Zuschauer, Zuhörer, User.

    Ungelöste Probleme sind derzeit z.B.:

    • Workflows sind noch nicht etabliert
    • Produktion von AR-Anwendungen ist aufwändig, speziell bei wirkliche reizvollen AR-Simulationen
    • Es fehlt die Integration in Redaktionssysteme
    • Wir brauchen mehr und mehr wirklich sinnvolle Anwednungsbeispiele

    Zur weiteren Lektüre: AR-Contiuum nach Milgram/Kishino,  Geschichte der AR seit 1968 (TU Graz)

    Ulf Grüner

    — Vor 3 Jahren mit 4 Anmerkungen
    #augmentes reality  #journalism  #storytelling 
    The Outlook for Journalism - Expert panel on AR

    Gerald Heidegger, head editorial department
    Robert Schweinzer, editorial head of product management APA
    Gerhard Reitmayr and Philipp Breuss-Schneeweis
    Heidegger and Schweinzer:
    How will we attach the user? Not sure whether people will geo-reference articles.
    APA is experimenting. The vision being: i am in front of the parliament and can see what is going on in there. Or I am in front of a cinema and can see what is being played– APA has all these data. They  code 70-80 news per day. 

    How does the news come to the user? Will it be a success? How do we need to tell stories so they don’t qualify as spam?

    Web is not a medium but a usage, and we need to add our own poetry. We can link a difficult word, we can condense texts. Non-linear telling is actually  an old cultural tradition.

    Example: in the medieval times – when a well educated person heard a word they could tell a story with it – like Montaigne in Bordeaux – he just knew what other writers had said about the town. How much do we trust gadgets?  We don‘t need to think for ourselves anymore- but this implies a lot of trust in foreign data.

    Question on how to filter these data. How much needs to be done? How can we tell stories in such a way that we know what is happening in a special street – a play in the theatre, or even somebody who got killed nearby. It is about filtering info. What are the possiblities in tv?

    How to tell stories in an easier way? We don’t talk about entertainment much – but there could be great uses there. There should be a place where experiments are possible. Milgram continuum – between news and strories that we can tell. These different formats can be used. What is possible?

    Reitmayr: I think about documentaries, guides from one place to another. I could choose what aspects interest me. AR is filtered storytelling, creates depth. NY Columbia tried to work on the student revolts of 68, and show what happened in front of a certain building. It is like a museum where I go from information to information. But I can choose my position, can choose my levels and aspects.  

    Schweinzer (APA): Classic news is the wrong content for AR. For lots of stories ther is no geo-referencing possible. There is an App in Washington where I can see through a camera whether a certain building has been subsidised by the state. Data journalism is a difficult area. 

    Questions: Workflow? How do I get my input? By using content development – tools like Wikitude. You can  go somewhere, put a virtual fence around you, and your mobile recognises this and starts special content. Tools are about to be created – it really  is a playground for creative people. Reitmayr: it is easy to reference informations. Interesting to add other media than just text. Should be an issue in TV. 

    Heidegger ( But we need fewer people. The multi-tasking jounralist needs to work in at least 3 media. We ask ourselves: How relevant are apps? Hdd tv – do we need it? We need to see first how people want to use it. Medias want to have lots of apps, but how much are they really used? Which parts of apps are really being consumed? People spend time on facebook, but not on online news. It isn’t easy to create news. What can we really use? We need to gather more information about user behaviour. 

    Reitmayr: about usability. We talk about software user interfaces. Not sure how to generate news or how to consume them. I think tools are getting better, and also their usability. In a couple of years the camera will give me 3d pictures directly. 

    1.  work with the community is important. Everybody is reading the comments under the articles. The recommandations of other users is highly important.
    2. Relevance is important, too.
    3. Stickiness – how sticky is the app, how often do poeple come back? Facebook is a good example – people keep coming back. We follow facebook and use it. Also create systems that when a user once likes something to recall that info to him. 

    Journalistic formats: From the public: What is sticky? Angry birds – it is about entertainment. That can be a starting point. Put mobile in front of tv and do the quizz at the same time. Fashion magazine – AR marker, I can see the collection live that has been presented in the magazine. This is where I see AR more than in the proper news environment. Schweinzer – this has been around for a while. But has not become so important, is not being used enough. 

    Reitmayr: Entertainment is definitely important for the use of AR – 3d interaction has become easier. Could be more 3d content in stories.

    From the public:
     Is it really useful for journalism? We have amazing technical possibliities but don’t know how to fill them with journalistic content. What can we expect?

    Reitmayr: Graphics, 3d, navigation with images. News ways of using these. Interaction with these.

    Breuss-Schneeweis: 500 years ago the printing was discovered, then came the first newspapers, then they put pictures in papers, then came radio, tv, color tv – internet, mobile internet. AR is a new innovation that simply adds to it. It is a new possibility to visualise content, to recognise content, to heighten the relevance of information. The smartphone knows a lot about us –it can  source and edit information for the user.

    Schweinzer – we don’t have the right content. What we have is being geo-refernced. It needs to be easy – people don’t want to start app, choose world, then click etc – it needs to be super easy and come on directly. 

    Heidegger:  is what we are talking about just a gadget or really a media app that will be working one day.

    Alexandra Markl

    — Vor 3 Jahren
    The Example of Wikitude - Philipp Breuss-Schneeweis

    Wikitude founder Philipp Breuss-Schneeweis
     Founded Wikitude in 2009 as mobilizy, it is in the process of being  renamed now. International awards. Founded start up in Austria.
    Main product: wikitude world browser (voted best AR browser 2009 und 2010)
    The area is so new that there are not many players so it is still time to change things. Mobile software – lots of innovation. Students with ideas have every chance to get famous overnight. 15 people work there.

    Product: Wikitude world browserHe has created new AR, easy way.
    Smartphone recognises gps, compass – so smartphone recognises where I am and where i go, so it can show infos. New blackberry device – wikitude will be pre-loaded onto it.

     What does online media want? – readers, clicks, sell ads. On print, online, mobile websites and apps stand, also on the new tablets.Now only few journalistic areas use AR. We need to enhance the usefulness for users, and heighten the importance.
    1.       Useful AR
    2.       Where is the new content?
    3.       Why do I click on an app?
    4.       How to add relevance?
    Relevance of context:example:  Buckingham palace – Kate and Williams balcony kiss is shown right next to Charles and Diana’s. Articles should not be forgotten in an archive, but should be read where they happened – AR helps to achieve this.
    Ways of AR:
    1.       Recognition of images: additional info can be linked (marker-based)
     2.       3D content
    3.       To position articles geographically (add Latitude and Longitude). There are so many articles that are not being used, but we can reference them geographically and make them relevant again in the process.
    Question about privacy- will the data that I send be kept? This depends on the devices. There is a folder on every  iphone that always knows where the user is. Apple just wanted to tell the user where he is, and we don’t think that data is used for something else. But obviously if data is used by sbdy else this can create problems.
    Wikitude and data protection: we use free data, not sensitive information. Every source of content needs to be checked on  whether we are allowed to use it.Where does the information come from? Wikitude is an app that has location based data and can show it. These data can come from APA or from our server. Depends what the content developer wants.

     Platforms: with  blackberry we can reach lots of people. Somebody for instance can put in payable content, and then the user could be willing to pay a fee to see it.
    AR – we can take objects in 3d, or archeological monuments, and we can go in there and look at them from inside. Journalists will still write but might also develop 3d content. 

    Alexandra Markl

    — Vor 3 Jahren
    An insight into Augmented Reality - Technics and Usability

    Gerhard Reitmayr, Professor for Augmented Reality, TU Graz, Institute for Computer Graphics and Vision:
     All this data should feel like the real thing; AR links reality and virtuality.AR registers in 3D, it is interactive and happens in real time.Virtual objects should behave like real objects.Example: Show St Stephens cathedral the way it looked like before the restoration. I can add info – from wikipedia etc, the other thing I add is simulation. It is a mix – milgram continuum – between reality and virtuality. AR is not virtual reality – the latter  is a completely computer generated environment, everything is generated by the computer.

    (example: Second life)

    AR is different – we want to stay in the reality and add relevant info. There can be a continuum – I can add people, can have almost everything real and only add few virtual things. Classic use of AR – in medicine there can be visualisation of medical data – how can I look into a person : like an  x-ray.

    Other use: maintenance, building of machines or furniture. Example: Mock-up BMW – I put on special glasses and these explain every step of building a car – although these glasses don’t exist yet! But it is possible to reproduce the graphics. The mechanics see the specific info they need.Sport: virtual info is shown onscreen.

    Where does the data come from?

    There are 4 components.
    -          We need displays
    -          We need to know the world
    – tracking
    -          Models
    – 3d info
    -          User interface

    1.       Head worn – mounted displays – one camera in front of each eye
    2.       Glasses, goggles
    3.       Monocular, monoscopic, stereoscopic
    4.       Optical video see through
    5.       Handheld displays: tablet pc, video see through: convenient, mass market, small field of view Projector based AR – projection on buildings, the building is made to appear differently – create holes in it, let flowers grow on it etc.

    We need the display – mobile phone is ideal – cheap, everybody has one.Data comes from GPS, is put in manually.Tracking: position, registration: GPS coordinates and height, position of the camera

    GPS gives me my position in the room, and other sensors in the machine define the position relative to the earth. The sensors do the work directly. But often GPS is not exact enough for this kind of tracking.

    I’m interested in the change, in the showing of additional info.Example: in a house we can show the wiring and pipelines, where they run behind the walls, like x-rays would.

    Alexandra Markl

    — Vor 3 Jahren

    Live video by Ustream

    Live: Übertragung unseres Fachgespräches am Donnerstag, 5. Mai, 17:30 bis ca 19:30 Uhr. Alternativ Übertragung direkt bei uStream ansehen.

    Für alle, die via Twitter sich beteiligen: #arj ist unser Hashtag. Hier lesen, was gerade zu #arj geschrieben wird.

    — Vor 3 Jahren
    Das Programm für das Fachgespräch am 5. Mai

    Unser erstes interdisziplinäres Fachgespräch bringt Journalisten und Technik-Experten zusammen zum Thema Erweiterte Realität – wie digitale Informationen die analoge Lebenswelt verändern und wie Menschen in Zukunft Medien wahrnehmen.

    Erste spannende Angebote mit AR sind bereits auf Markt, wie die österreichische Navigationssoftware Wikitude. Höchste Zeit also, dass auch wir Journalisten genauer hinsehen: Wir diskutieren, was die Technik kann, was die User wollen und wie Medien profitieren.

    17:30 Uhr Begrüßung Prof. Dr. Reinhard Christl, Studiengangsleiter Journalismus & Medienmanagement

    17:35 Uhr Einführung Journalismus und AR: Ulf Grüner, Bereichsleiter Multimedia Studiengang Journalismus & Medienmanagement, International Committee der Online News Association ONA

    17:45 Uhr Einblick AR – Technik & Usability: Gerhard Reitmayr, Professor for Augmented Reality, TU Graz, Institute for Computer Graphics and Vision: Was kann die Technik? Was braucht der User? Was entsteht gerade in den Laboren?

    18:20 Uhr Das Beispiel Wikitude - Gespräch mit Philipp Breuss-Schneeweis 

    19:00 Uhr: Ausblick Journalismus – mit den AR-Experten diskutieren der Redaktionsleiter von, Gerald Heidegger, und Robert Schweinzer (Leiter Produktmanagement APA-Redaktionen)

    ca 19:30 Uhr Ende

    — Vor 3 Jahren
    "it’s not hard to envision a time in the future when your handheld could offer real-time news from your surroundings, almost as it unfolds. … What augmented reality can do above and beyond everything else is make information relevant and tangible to a reader or viewer."
    — Vor 3 Jahren
    "Augmented reality and journalism are made for each other. Journalism gathers information about the world around us. Thanks to augmented reality, this information can be displayed where it got picked up – which is especially interesting for event reporting.
    But there are many more possibilities"
    — Vor 3 Jahren mit 1 Anmerkung

    FocusOnline erklärt Augmented Reality (DLD, 1/2011).

    — Vor 3 Jahren

    Die Redaktion von MacNews testet die AR-Ausgabe des Magazins der Süddeutschen Zeitung (8/2010).

    — Vor 3 Jahren

    PR-Video des aktuellen Wikitude-AR-Browsers (2011).

    — Vor 3 Jahren

    PR-Video von Metaio (Junaio-Browser) zeigt den Einsatz von AR bei einem Tourismus-Magazin (2010).

    — Vor 3 Jahren

    Eine der ersten journalistischen AR-Anwendungen: “App tracks stimulus dollars” von 2009, von der Sunlight Foundation.

    — Vor 3 Jahren