Virtual sets come of age


Virtual studios (VS) have experienced a roller coaster ride of popularity through their short life. Initially they were hailed as the future for live broadcasting, seamlessly combining people and computer-generated environments without the need for post-production. But the racks of SGI computers, complex studio set-ups, complex camera tracking systems and 3D computer graphics ‘virtual set’ software that even highly skilled geeks took a while to set up, as well as the need for virtual studio experts, all made the systems too expensive to buy and run for wide deployment by broadcasters. But the idea was a good one, and today, after a lot of work on all aspects of VS technology, there are virtual set systems that can offer solutions to suit applications and budgets ranging from those of big broadcasters through to much smaller outfits such as those in the corporate and educational areas. Now the required technologies are more highly developed so, for example, computers can provide the necessary 3D image sources at a more reasonable price – thanks to the huge advances in both graphics cards and software. These help but are only a part of the solution that has made virtual studios more widely available and useable.
Despite the 3D graphics computer workstation developments, they do still add a significant part of the cost of the complete VS systems. The VS principal involves manipulating computer-generated 3D images – the virtual bit – so that they perfectly track the movements and changes of the studio cameras. Typically in a news bulletin, the cameras are focussed on the newsreader placed in front of a blue screen; the studio vision mixer then keys the reader over the CG background. But, of course the idea is to be able to move the camera and have the background move appropriately at the same time – to look as if both were shot live by the same camera.
The CG images are much bigger than the studio camera pictures to allow the pans, tilts and zooms of the camera to be matched by the background CG without exposing their edges. These camera movements are picked up by sensors on the camera and fed to the 3D CG virtual set workstation that then manipulates its output accordingly. Some VS set-ups also allow for cameras to travel around the studio, involving more sensors, cost and complexity. Of course, shooting with just one camera would make for a rather dull presentation so, typically, three are used, with one CG workstation for each, so providing three separate backgrounds and foregrounds to the vision mixer.
FOR-A recognised where the difficulties and cost was adversely affecting the progress of virtual studios and so did something about it. One problem was in camera sensor set-up. This involved experts to calibrate the camera pan, tilt and zoom sensors’ data so that the CG background can be moved in perfect sympathy with the camera, not too much and not too little! The introduction of FOR-A’s ifCALIB interface calibration software now greatly simplifies this task so it can be done quickly and without specialist experts. With this system the camera itself does not travel around the studio, so further simplifying set up and greatly reducing costs.
Despite the advances of technology, another high cost area is still the computers, as one is required per camera. Logically the virtual studio output usually only shows the result of one camera and one computer at a time, so why have more? Of course, cameras cannot instantly change shots, but computers can! So FOR-A introduced its DSC100/200 interface control boxes that switch the cameras’ sensor data feeds, carried over RS422, to a single CG workstation as the studio mixer cuts between cameras. The workstation is able to immediately produce the appropriate background in the right 3D position for that on-air camera. So this further reduces system costs by using only one CG workstation.
FOR-A is well known for its wide range of vision mixers and so can provide for that element of the virtual studio, but it does not have the expertise needed to produce the 3D CG image software. For that it has partnered with Brainstorm Multimedia who provides 3D virtual set applications including Easyset3D. Clearly Brainstorm realised the need for a user-friendly 3D graphics application and Easyset3D provides an extremely simple GUI that pretty much anyone can easily use. It can include a useful starter pack comprising a large number of different objects that are pre-set in a library. As a result you can build a virtual scene by simply selecting and placing the objects on the walls ceiling and floor of your virtual set. Some say they are up and running after two minutes! So this software has earned a reputation as the beginner's choice for 3D virtual software and a part of a virtual set that anyone can easily use. Of course the use of Easyset3D can extend into more complex operations and set-ups and it plays a vital part in extending virtual studio use not just too big broadcasters, but also to smaller stations, schools and corporate set-ups.
One of the many advantages of virtual studios is that they can create a big-set look from a really small studio. Howden in East Yorkshire is the location of the main operations centre of the Press Association. Renowned for many years as a producer of press reports it is vigorously exploring expansion into new media, while still retaining its core text and still picture service at the heart of the business. As a part of this new strategy it has installed a virtual television studio within 6.5 x 6.5m of its offices.
The requirement was to build a very adaptable studio to cater for clients’ needs and to be future-proof. Set building and replacement would have been impossible in the office area available whereas, with a virtual studio, sets could be changed with a few mouse clicks. The FOR-A digiStorm (a combination of FOR-A and Brainstorm) virtual studio system was selected and initially equipped with two remotely controlled cameras steered from the adjacent control room. The set-up included a FOR-A VPS studio vision mixer. It is an integral part of the virtual studio equipment where the live images of the newsreader, reporter, linkman, etc, are keyed in over the virtual set images.
This virtual studio is a part of a larger move where existing PA journalists from around the UK are being trained to become multi-skilled. They are expanding on their traditional text and still picture-based operations to involve using video cameras and other skills and make them video journalists (VJs) who can shoot and edit video news packages, as well as, in some cases, continuing with their traditional ‘text’ operations.
The transformation of virtual studios from the initial designs has involved considerable further development of most of the technologies involved, as well as some new and innovative ideas. A very obvious example of the progress is the 3D graphics ‘virtual set’ workstations that used to occupy a rack now pack into a standard PC tower unit, and cost a fraction of the original price. FOR-A’s approach to virtual studios with pan, tilt and zoom live camera controls provides the freedom to make attractive productions without the extra hassle and expense of tracking moving cameras. FOR-A has also greatly simplified the set-up process with its ifCALIB interface calibration software allowing existing studio engineers to do the job. Similarly, the use of Brainstorm’ Easyset3D to generate the 3D virtual sets means that regular staff can quickly produce results. Overall, FOR-A’s innovative approach to virtual sets has helped to make them both more affordable and easier to use. As a result their appeal is widened to include broadcasters big and small as well as the corporate market.
VPS-715
VPS-715

Tags: virtual sets | 3d graphics | graphics | cg background | for-a | iss022 | N/A
Contributing Author N/A

Read this article in the tv-bay digital magazine
Article Copyright tv-bay limited. All trademarks recognised.
Reproduction of the content strictly prohibited without written consent.

Related Interviews
  • BRAINSTORM VIRTUAL SETS at NAB 2015

    BRAINSTORM VIRTUAL SETS at NAB 2015

  • Brainstorm Multimedia at IBC 2015

    Brainstorm Multimedia at IBC 2015

  • Brainstorm with Aston demonstration at IBC 2013

    Brainstorm with Aston demonstration at IBC 2013

  • Brainstorm at IBC 2013

    Brainstorm at IBC 2013

  • VIZRT at BVE 2012

    VIZRT at BVE 2012

  • ChyronHego Prime Broadcast Graphics at NAB 2019

    ChyronHego Prime Broadcast Graphics at NAB 2019

  • Metacast Weather Graphics from ChyronHego at NAB 2017

    Metacast Weather Graphics from ChyronHego at NAB 2017

  • Stardom product range - Polar Graphics at NAB 2016

    Stardom product range - Polar Graphics at NAB 2016

  • Matrox Graphics at IBC 2012 Part Three

    Matrox Graphics at IBC 2012 Part Three

  • Matrox Graphics at IBC 2012 Part Two

    Matrox Graphics at IBC 2012 Part Two

  • Matrox Graphics at IBC 2012 Part One

    Matrox Graphics at IBC 2012 Part One

  • Paint from ChyronHego at NAB 2018

    Paint from ChyronHego at NAB 2018

  • LiveCG Broadcast and LiveMedia Server from 3D Storm at BVE 2018

    LiveCG Broadcast and LiveMedia Server from 3D Storm at BVE 2018

  • Virtual 1st from ChyronHego at NAB 2017

    Virtual 1st from ChyronHego at NAB 2017

  • 3D Storm at IBC 2015

    3D Storm at IBC 2015

  • ChyronHego Lyric64 at IBC 2015

    ChyronHego Lyric64 at IBC 2015

  • ChyronHego Metacast at IBC 2014

    ChyronHego Metacast at IBC 2014

  • ChyronHego Lyric PRO at IBC 2014

    ChyronHego Lyric PRO at IBC 2014

  • Pixel Power at NAB 2014

    Pixel Power at NAB 2014

  • ChyronHego PowerClips at NAB 2014

    ChyronHego PowerClips at NAB 2014

  • ChyronHego at NAB 2014

    ChyronHego at NAB 2014

  • Ross Video at BVE 2014

    Ross Video at BVE 2014

  • ChyronHego on BroadcastShow LIVE at IBC 2013

    ChyronHego on BroadcastShow LIVE at IBC 2013

  • Brainstorm on BroadcastShow LIVE at IBC 2013

    Brainstorm on BroadcastShow LIVE at IBC 2013

  • Pixel Power at IBC 2013

    Pixel Power at IBC 2013

  • Softron Media at IBC 2013

    Softron Media at IBC 2013

  • Matrox Maevex at IBC 2013

    Matrox Maevex at IBC 2013

  • Matrox Avio at IBC 2013

    Matrox Avio at IBC 2013

  • Brainstorm Multimedia: Aston3D at NAB 2013

    Brainstorm Multimedia: Aston3D at NAB 2013

  • Dalet at NAB 2013

    Dalet at NAB 2013

  • Pixel Power at NAB 2013

    Pixel Power at NAB 2013

  • Pixel Power at NAB 2012

    Pixel Power at NAB 2012

  • Brainstorm at NAB 2012

    Brainstorm at NAB 2012

  • Chyron at NAB 2012

    Chyron at NAB 2012

  • Orad at NAB 2012

    Orad at NAB 2012

  • Chyron at BVE 2012

    Chyron at BVE 2012

  • PlayBox Technology at BVE North 2011

    PlayBox Technology at BVE North 2011

  • Elemental Technologies at IBC2011

    Elemental Technologies at IBC2011

  • Brainstorm at IBC2011

    Brainstorm at IBC2011

  • Avid at IBC2011

    Avid at IBC2011

  • Chyron at IBC2011

    Chyron at IBC2011

  • FOR-A at IBC2011

    FOR-A at IBC2011


Related Shows
  • BVE 2013 Day 1

    BVE 2013 Day 1


Articles
Living LIVE at BVE with Ross Video
Jon Pratchett KitPlus’ Jon Pratchett chats to Stuart Russell, Ross Video, in the BVE studio. Covering customer partnerships and loyalty, pain points, growth, industry trends, pace of IP adoption, 12g SDI technologies, UHD / HDR, 8k, AI and we try to get a hint of new products on the horizon...
Tags: iss136 | ross video | 12g sdi | uhd | hdr | ip | bve 2019 | bvexpo | Jon Pratchett
Contributing Author Jon Pratchett Click to read or download PDF
NAB Intelligence
Bruce Devlin - new It's that time of year again. 06:30 on road bikes on the Las Vegas Strip with a merry bunch of folks who believe they look good in lycra. As we pedal West up the hill towards Red Rock there will be stories of the year just gone and questions about what to look for at the show. I, for one, will be attending the Devoncroft event to check up on who is spending what and where. I will then look forward to the topics that might be buzzing around the halls. I predict there will be many displays of Machine Learning hiding under the banner of Artificial Intelligence. Some of these will show better picture quality, others will show personalisation engines, some will be improved search tools and yet more will be synthesising pictures and motions to replace reality with and Artificial reality that's more compelling for the viewer.
Tags: iss136 | nab | class | ai | smpte | st2110 | imf | Bruce Devlin - new
Contributing Author Bruce Devlin - new Click to read or download PDF
Keeping Your Post Prodction on Track with Subclips and Search Bins
Alex Macleod

For my 2nd Kit Plus article I thought I’d try and build on the theme of my first, and that’s one of making sure things are organised at all levels of your post production projects.

Last time I talked about trying as best as you can to stick to the ‘two week rule’, making sure that the names & locations of every asset you import, and every bin & sequence that you create in your project - will make sense to you regardless of how long it is you spend away from it.

Tags: iss136 | mediacity training | subclip | premiere pro | gvs | bve | bve2019 | Alex Macleod
Contributing Author Alex Macleod Click to read or download PDF
BSC Expo 2019 Report
Paul MacKenzie BSC Expo returned to the Battersea Evolution on Friday February 1st and Saturday 2nd. It is a busy and friendly event though this year in need of some temperature control: exhibitors around the entrance area were uncomfortably aware of the wintry conditions outside and the main hall was in need of cooling.
Tags: iss136 | bsc | cinematography | canon | c700 | c200 | cartoni | holdan | blackmagic | peli | panasonic | sennheiser | sony | fs5 | teradek | viten | flowtech | Paul MacKenzie
Contributing Author Paul MacKenzie Click to read or download PDF
Painting Performance Analytics with ChyronHego
KitPlus By now, most people are familiar with the sport of mixed martial arts (MMA) and its leading organization – UFC (Ultimate Fighting Championship). And while the sport and its leading promotion are only 25 years old, a great deal has changed in those 25 years, including the training of UFC athletes.
Tags: iss136 | paint | telestrator | ufc | chyron | chyronhego | KitPlus
Contributing Author KitPlus Click to read or download PDF