The world is not flat


David Schleifer TV-Bay Magazine
Read ezine online

The world is all around us. We have a lot of cues that make us aware of how we fit into a 3D space. Many of these cues, senses and reactions are survival instincts. For example, the ability to hear someone walk up behind us, to see movement in our peripheral vision, a sense of how we are oriented when we move our bodies or swivel our head. All of this creates an overwhelming amount of data that we seamlessly interpret as we go around our day getting our morning coffee, driving, walking through crowds, diving into pools, and everything that we as people do in our lives.

As movies and television have evolved, we've learnt a new language, a new way to interpret the world around us based on a window into another world, the screen. What we've now become accustomed to via that 'screen' is jumps in location, perspective time and space. The screen is sometimes supplemented with surround sound, but usually we're just left to our imagination to weave the data we get into human stories.

Close ups, wide shots, panning, zooming, and many other devices are all an established part of the storyteller's toolkit. Then along comes Virtual Reality (VR) and 360, and suddenly we have a tendency to fall over reaching out for things that aren't there. We lose perspective, and even though this world, like ours, is not flat, we are lost!

There are differences between VR and 360-degree images, but what they both share is an immersive environment and the ability to represent, like reality does, what is going on all around you. Despite both VR and 360-degree images being more like reality, we find ourselves struggling to know how to use it.

There are several disconnects for us as viewers. I think a major one is that we do not physically navigate our way through the world in the viewer, we can spin around and look up or down, but we don't have all of the normal cues leading up to this. We didn't walk into a town square or into the theatre, so we immediately look around to get our bearings as if just teleported in. Then we can't really move around in 3D space, we are restricted to rotating to see what is next to us. In VR environments you can navigate through space, but generally not in the normal way like walking over to something you see. So basically, we're a little lost and as a result it takes us time to orient ourselves into what is a static scene with action someplace that we have to find.

Throughput the whole VR/360-degree experience, the director, can't guide you through the story in the same way as a 2D film. They no longer have the fast cuts, the zooming, the pacing they are accustomed to using to move you through the story. As a result, there is a focus on the novelty as opposed to an improvement in how we can tell the story.

There is a lot of experimentation going on today, and a lot of it is on the capture side. How to we grab better immersive images and stitch them together. Primestream is dedicated to managing those files. Images are captured, metadata is then added and managed around those files, and ultimately, the workflow is organised around them. This puts us right in the middle of the efforts to better understand how to tell stories with these new assets, pulling us into discussions around the creative process. As creative tools like Premier evolve to meet the needs of editors using them, we too are evolving how to manage the data and metadata that adds value to those captured images in the process. We're no longer engaged in tracking content segments with time-based markers, but rather content that needs to be marked up in time and space with directional data. Not only when, but also where the interesting content is.

We fully expect the requirements for VR/360 asset management to continue to evolve as people figure out how to use it to perfect their techniques over time, and we know that all the creative tools will need to move quickly to keep up with that innovative re-imagining of how we tell stories. We are not there yet, but you can already see the early signs that we are creating an exciting new creative narrative.


Tags: iss120 | vr | 3d | primestream | David Schleifer
Contributing Author David Schleifer

Read this article in the tv-bay digital magazine
Article Copyright tv-bay limited. All trademarks recognised.
Reproduction of the content strictly prohibited without written consent.

Related Interviews
  • Sennheiser VR at IBC 2016

    Sennheiser VR at IBC 2016

  • Elemental Technologies VR at NAB 2016

    Elemental Technologies VR at NAB 2016

  • Virtual and Augmented Reality support with the Arrow Fx7 from Miller at NAB 2017

    Virtual and Augmented Reality support with the Arrow Fx7 from Miller at NAB 2017

  • Ross Video at BVE 2017

    Ross Video at BVE 2017

  • 3D Storm show the new NDI to HDMI decoder at NAB 2019

    3D Storm show the new NDI to HDMI decoder at NAB 2019

  • 3D Storm presents LiveXpert and NewTek products at IBC 2018

    3D Storm presents LiveXpert and NewTek products at IBC 2018

  • 3D Storm discuss IP and NDI for Live Media Server and Live CG Broadcast at NAB 2018

    3D Storm discuss IP and NDI for Live Media Server and Live CG Broadcast at NAB 2018

  • LiveCG Broadcast and LiveMedia Server from 3D Storm at BVE 2018

    LiveCG Broadcast and LiveMedia Server from 3D Storm at BVE 2018

  • NDI and Newtek Products from 3D Storm at IBC 2017

    NDI and Newtek Products from 3D Storm at IBC 2017

  • LiveMedia Server and Live Xpert from 3D Storm at NAB 2017

    LiveMedia Server and Live Xpert from 3D Storm at NAB 2017

  • 3D Storm with LiveXpert at BVE 2017

    3D Storm with LiveXpert at BVE 2017

  • 3D Storm at IBC 2016

    3D Storm at IBC 2016

  • 3D Storm at BVE 2016

    3D Storm at BVE 2016

  • 3D Storm at IBC 2015

    3D Storm at IBC 2015

  • Brainstorm Multimedia: Aston3D at NAB 2013

    Brainstorm Multimedia: Aston3D at NAB 2013

  • Brainstorm Multimedia at IBC 2015

    Brainstorm Multimedia at IBC 2015

  • BRAINSTORM VIRTUAL SETS at NAB 2015

    BRAINSTORM VIRTUAL SETS at NAB 2015

  • Brainstorm Multimedia at BVE 2015

    Brainstorm Multimedia at BVE 2015

  • Brainstorm on BroadcastShow LIVE at IBC 2013

    Brainstorm on BroadcastShow LIVE at IBC 2013

  • Brainstorm with Aston demonstration at IBC 2013

    Brainstorm with Aston demonstration at IBC 2013

  • Brainstorm at IBC 2013

    Brainstorm at IBC 2013

  • Featured Clip: Geoff Boyle comments on NAB 2012

    Featured Clip: Geoff Boyle comments on NAB 2012

  • Brainstorm at NAB 2012

    Brainstorm at NAB 2012

  • VIZRT at BVE 2012

    VIZRT at BVE 2012

  • Newtek at BVE 2012

    Newtek at BVE 2012

  • Sony at ProVideo2011

    Sony at ProVideo2011

  • Sisvel Technology at IBC2011

    Sisvel Technology at IBC2011

  • Sensio at IBC2011

    Sensio at IBC2011

  • Panasonic at IBC2011

    Panasonic at IBC2011

  • Doremi at IBC2011

    Doremi at IBC2011

  • Matrox at IBC2011

    Matrox at IBC2011

  • Blackmagic at IBC2011

    Blackmagic at IBC2011

  • SGO at IBC2011

    SGO at IBC2011

  • Marshall Electronics at IBC2011

    Marshall Electronics at IBC2011

  • Primestream on BroadcastShow LIVE at IBC 2013

    Primestream on BroadcastShow LIVE at IBC 2013


Related Shows
  • Day 3 of BroadcastShow at IBC

    Day 3 of BroadcastShow at IBC


Articles
Painting Performance Analytics with ChyronHego
KitPlus By now, most people are familiar with the sport of mixed martial arts (MMA) and its leading organization – UFC (Ultimate Fighting Championship). And while the sport and its leading promotion are only 25 years old, a great deal has changed in those 25 years, including the training of UFC athletes.
Tags: iss136 | paint | telestrator | ufc | chyron | chyronhego | KitPlus
Contributing Author KitPlus Click to read or download PDF
Looking for the Silver Lining
Harry Grinling According to the World Meteorological Organisation, there are 10 different types of cloud, each of which can be divided further into sub-types. They range from the cirrus, the thin floaty clouds which generally serve only to make the sky look beautiful to the towering, all-embracing cumulonimbus which can deliver fearful quantities of rain – the biggest cumulonimbus clouds can contain 50 million tonnes of water.
Tags: iss136 | cloud | lto | archive | storage | Harry Grinling
Contributing Author Harry Grinling Click to read or download PDF
Keeping Your Post Prodction on Track with Subclips and Search Bins
Alex Macleod

For my 2nd Kit Plus article I thought I’d try and build on the theme of my first, and that’s one of making sure things are organised at all levels of your post production projects.

Last time I talked about trying as best as you can to stick to the ‘two week rule’, making sure that the names & locations of every asset you import, and every bin & sequence that you create in your project - will make sense to you regardless of how long it is you spend away from it.

Tags: iss136 | mediacity training | subclip | premiere pro | gvs | bve | bve2019 | Alex Macleod
Contributing Author Alex Macleod Click to read or download PDF
The way forward in a changing world
Alan Wheable The broadcast and media industries are evolving in all areas to adapt to the challenges of competition from OTT, changing user viewing habits, technological advances in image resolution, dynamic range and colour rendition as well as embracing new video over IP infrastructures.
Tags: iss136 | omnitek | aims | ip | smpte | 2110 | 4k qc | ultra xr | nmos | ultra tq | Alan Wheable
Contributing Author Alan Wheable Click to read or download PDF
4k and HDR Wireless Camera Transmitters
David Edwards Across the globe, live events represented over 50 percent of the most watched TV programs last year. However, big budget episodic shows are impacting live TV and the way viewers want to see their content. Viewers are demanding the same quality of production for live event broadcasts as they see in pre-recorded TV series and films. Producers of live content are looking to new, immersive and cinematic mobile camera views to better achieve these results. This presents a challenge to live production teams as these new camera views and angles must match the quality of the rest of the production -  the demand for mobility means that the cameras need to be wireless.
Tags: iss136 | wireless | hdr | 4k | transmitter | bandwidth | imt vislink | hcam | David Edwards
Contributing Author David Edwards Click to read or download PDF