Virtual sets come of age


Virtual studios (VS) have experienced a roller coaster ride of popularity through their short life. Initially they were hailed as the future for live broadcasting, seamlessly combining people and computer-generated environments without the need for post-production. But the racks of SGI computers, complex studio set-ups, complex camera tracking systems and 3D computer graphics ‘virtual set’ software that even highly skilled geeks took a while to set up, as well as the need for virtual studio experts, all made the systems too expensive to buy and run for wide deployment by broadcasters. But the idea was a good one, and today, after a lot of work on all aspects of VS technology, there are virtual set systems that can offer solutions to suit applications and budgets ranging from those of big broadcasters through to much smaller outfits such as those in the corporate and educational areas. Now the required technologies are more highly developed so, for example, computers can provide the necessary 3D image sources at a more reasonable price – thanks to the huge advances in both graphics cards and software. These help but are only a part of the solution that has made virtual studios more widely available and useable.
Despite the 3D graphics computer workstation developments, they do still add a significant part of the cost of the complete VS systems. The VS principal involves manipulating computer-generated 3D images – the virtual bit – so that they perfectly track the movements and changes of the studio cameras. Typically in a news bulletin, the cameras are focussed on the newsreader placed in front of a blue screen; the studio vision mixer then keys the reader over the CG background. But, of course the idea is to be able to move the camera and have the background move appropriately at the same time – to look as if both were shot live by the same camera.
The CG images are much bigger than the studio camera pictures to allow the pans, tilts and zooms of the camera to be matched by the background CG without exposing their edges. These camera movements are picked up by sensors on the camera and fed to the 3D CG virtual set workstation that then manipulates its output accordingly. Some VS set-ups also allow for cameras to travel around the studio, involving more sensors, cost and complexity. Of course, shooting with just one camera would make for a rather dull presentation so, typically, three are used, with one CG workstation for each, so providing three separate backgrounds and foregrounds to the vision mixer.
FOR-A recognised where the difficulties and cost was adversely affecting the progress of virtual studios and so did something about it. One problem was in camera sensor set-up. This involved experts to calibrate the camera pan, tilt and zoom sensors’ data so that the CG background can be moved in perfect sympathy with the camera, not too much and not too little! The introduction of FOR-A’s ifCALIB interface calibration software now greatly simplifies this task so it can be done quickly and without specialist experts. With this system the camera itself does not travel around the studio, so further simplifying set up and greatly reducing costs.
Despite the advances of technology, another high cost area is still the computers, as one is required per camera. Logically the virtual studio output usually only shows the result of one camera and one computer at a time, so why have more? Of course, cameras cannot instantly change shots, but computers can! So FOR-A introduced its DSC100/200 interface control boxes that switch the cameras’ sensor data feeds, carried over RS422, to a single CG workstation as the studio mixer cuts between cameras. The workstation is able to immediately produce the appropriate background in the right 3D position for that on-air camera. So this further reduces system costs by using only one CG workstation.
FOR-A is well known for its wide range of vision mixers and so can provide for that element of the virtual studio, but it does not have the expertise needed to produce the 3D CG image software. For that it has partnered with Brainstorm Multimedia who provides 3D virtual set applications including Easyset3D. Clearly Brainstorm realised the need for a user-friendly 3D graphics application and Easyset3D provides an extremely simple GUI that pretty much anyone can easily use. It can include a useful starter pack comprising a large number of different objects that are pre-set in a library. As a result you can build a virtual scene by simply selecting and placing the objects on the walls ceiling and floor of your virtual set. Some say they are up and running after two minutes! So this software has earned a reputation as the beginner's choice for 3D virtual software and a part of a virtual set that anyone can easily use. Of course the use of Easyset3D can extend into more complex operations and set-ups and it plays a vital part in extending virtual studio use not just too big broadcasters, but also to smaller stations, schools and corporate set-ups.
One of the many advantages of virtual studios is that they can create a big-set look from a really small studio. Howden in East Yorkshire is the location of the main operations centre of the Press Association. Renowned for many years as a producer of press reports it is vigorously exploring expansion into new media, while still retaining its core text and still picture service at the heart of the business. As a part of this new strategy it has installed a virtual television studio within 6.5 x 6.5m of its offices.
The requirement was to build a very adaptable studio to cater for clients’ needs and to be future-proof. Set building and replacement would have been impossible in the office area available whereas, with a virtual studio, sets could be changed with a few mouse clicks. The FOR-A digiStorm (a combination of FOR-A and Brainstorm) virtual studio system was selected and initially equipped with two remotely controlled cameras steered from the adjacent control room. The set-up included a FOR-A VPS studio vision mixer. It is an integral part of the virtual studio equipment where the live images of the newsreader, reporter, linkman, etc, are keyed in over the virtual set images.
This virtual studio is a part of a larger move where existing PA journalists from around the UK are being trained to become multi-skilled. They are expanding on their traditional text and still picture-based operations to involve using video cameras and other skills and make them video journalists (VJs) who can shoot and edit video news packages, as well as, in some cases, continuing with their traditional ‘text’ operations.
The transformation of virtual studios from the initial designs has involved considerable further development of most of the technologies involved, as well as some new and innovative ideas. A very obvious example of the progress is the 3D graphics ‘virtual set’ workstations that used to occupy a rack now pack into a standard PC tower unit, and cost a fraction of the original price. FOR-A’s approach to virtual studios with pan, tilt and zoom live camera controls provides the freedom to make attractive productions without the extra hassle and expense of tracking moving cameras. FOR-A has also greatly simplified the set-up process with its ifCALIB interface calibration software allowing existing studio engineers to do the job. Similarly, the use of Brainstorm’ Easyset3D to generate the 3D virtual sets means that regular staff can quickly produce results. Overall, FOR-A’s innovative approach to virtual sets has helped to make them both more affordable and easier to use. As a result their appeal is widened to include broadcasters big and small as well as the corporate market.
VPS-715
VPS-715

Tags: virtual sets | 3d graphics | graphics | cg background | for-a | iss022 | N/A
Contributing Author N/A

Read this article in the tv-bay digital magazine
Article Copyright tv-bay limited. All trademarks recognised.
Reproduction of the content strictly prohibited without written consent.

Related Interviews
  • BRAINSTORM VIRTUAL SETS at NAB 2015

    BRAINSTORM VIRTUAL SETS at NAB 2015

  • Brainstorm Multimedia at IBC 2015

    Brainstorm Multimedia at IBC 2015

  • Brainstorm with Aston demonstration at IBC 2013

    Brainstorm with Aston demonstration at IBC 2013

  • Brainstorm at IBC 2013

    Brainstorm at IBC 2013

  • VIZRT at BVE 2012

    VIZRT at BVE 2012

  • Metacast Weather Graphics from ChyronHego at NAB 2017

    Metacast Weather Graphics from ChyronHego at NAB 2017

  • Stardom product range - Polar Graphics at NAB 2016

    Stardom product range - Polar Graphics at NAB 2016

  • Matrox Graphics at IBC 2012 Part Three

    Matrox Graphics at IBC 2012 Part Three

  • Matrox Graphics at IBC 2012 Part Two

    Matrox Graphics at IBC 2012 Part Two

  • Matrox Graphics at IBC 2012 Part One

    Matrox Graphics at IBC 2012 Part One

  • Paint from ChyronHego at NAB 2018

    Paint from ChyronHego at NAB 2018

  • LiveCG Broadcast and LiveMedia Server from 3D Storm at BVE 2018

    LiveCG Broadcast and LiveMedia Server from 3D Storm at BVE 2018

  • Virtual 1st from ChyronHego at NAB 2017

    Virtual 1st from ChyronHego at NAB 2017

  • 3D Storm at IBC 2015

    3D Storm at IBC 2015

  • ChyronHego Lyric64 at IBC 2015

    ChyronHego Lyric64 at IBC 2015

  • ChyronHego Metacast at IBC 2014

    ChyronHego Metacast at IBC 2014

  • ChyronHego Lyric PRO at IBC 2014

    ChyronHego Lyric PRO at IBC 2014

  • Pixel Power at NAB 2014

    Pixel Power at NAB 2014

  • ChyronHego PowerClips at NAB 2014

    ChyronHego PowerClips at NAB 2014

  • ChyronHego at NAB 2014

    ChyronHego at NAB 2014

  • Ross Video at BVE 2014

    Ross Video at BVE 2014

  • ChyronHego on BroadcastShow LIVE at IBC 2013

    ChyronHego on BroadcastShow LIVE at IBC 2013

  • Brainstorm on BroadcastShow LIVE at IBC 2013

    Brainstorm on BroadcastShow LIVE at IBC 2013

  • Pixel Power at IBC 2013

    Pixel Power at IBC 2013

  • Softron Media at IBC 2013

    Softron Media at IBC 2013

  • Matrox Maevex at IBC 2013

    Matrox Maevex at IBC 2013

  • Matrox Avio at IBC 2013

    Matrox Avio at IBC 2013

  • Brainstorm Multimedia: Aston3D at NAB 2013

    Brainstorm Multimedia: Aston3D at NAB 2013

  • Dalet at NAB 2013

    Dalet at NAB 2013

  • Pixel Power at NAB 2013

    Pixel Power at NAB 2013

  • Pixel Power at NAB 2012

    Pixel Power at NAB 2012

  • Brainstorm at NAB 2012

    Brainstorm at NAB 2012

  • Chyron at NAB 2012

    Chyron at NAB 2012

  • Orad at NAB 2012

    Orad at NAB 2012

  • Chyron at BVE 2012

    Chyron at BVE 2012

  • PlayBox Technology at BVE North 2011

    PlayBox Technology at BVE North 2011

  • Elemental Technologies at IBC2011

    Elemental Technologies at IBC2011

  • Brainstorm at IBC2011

    Brainstorm at IBC2011

  • Avid at IBC2011

    Avid at IBC2011

  • Chyron at IBC2011

    Chyron at IBC2011

  • FOR-A at IBC2011

    FOR-A at IBC2011


Related Shows
  • BVE 2013 Day 1

    BVE 2013 Day 1


Articles
Peli Air 1507 Review
Phil Vinter Originally named after a bird that carries its precious cargo through the skies, it was, perhaps, only a matter of time before Peli released its Air range.
Tags: iss133 | peli | peli air 1507 | trekpak | Phil Vinter
Contributing Author Phil Vinter Click to read or download PDF
OB999 Accelerates Hill Climb Broadcast
Nick Collier Over the last century, The Shelsley Walsh Speed Hill Climb has been attempted by some of the world’s most accomplished racing drivers striving to be the fastest up the 1,000 yard, 1 in 6 gradient track.
Tags: iss133 | ob999 | blackmagic | atem | multicam | videohub | cleanswitch | premiere pro | hyperdeck | Nick Collier
Contributing Author Nick Collier Click to read or download PDF
Ruth Matos Interview - A Career Unfolds
Ruth Matos We first met Ruth when we employed her as a student to help with our live studio at BVE in 2013. We were struck by her determination, passion and ‘I’ll do anything to help’ attitude. We became friends of Facebook and have since seen her career in the industry develop and unfold. We thought it was about time to catch up and share her inspiring story of where she is now, how she got there and the challenges she has faced along the way.
Tags: iss133 | interview | filmming | career | education | Ruth Matos
Contributing Author Ruth Matos Click to read or download PDF
The Pace of Change
Dick Hobbs - new

The youngest human to stand on the moon (so far) was Charles Moss, the lunar module pilot of Apollo 16. Charlie had a wonderful claim: his father witnessed the Wright Brothers’ first flight at Kitty Hawk, and lived to see his son on the moon.

Does anything capture the speed of technological advance better than that? The whole of the history of powered flight in one lifetime.

Tags: iss133 | state of the nation | st2110 | st2110-10 | Dick Hobbs - new
Contributing Author Dick Hobbs - new Click to read or download PDF
Taking on a self employed placement year
Joshua Round The idea of being self-employed or freelancing has always been somewhat terrifying for me. There is a level of uncertainty and responsibility that comes with the freedom of being self-employed, the likes of which makes me wonder why I chose to give it a go for my placement year as part of my university course - (BSc) Television and Broadcasting.
Tags: iss133 | placement year | university | student | education | portsmouth | Joshua Round
Contributing Author Joshua Round Click to read or download PDF