Viz Arc User Guide

Version 1.7 | Published November 15, 2022 ©

Project Action Types

images/download/attachments/105104292/arc_pa_tb.jpg

Action Group

images/download/attachments/105104292/arc_pa_group.jpg

Action Group is useful for grouping several actions together, both scene and project, and executing them at the same time.
It’s possible to collapse a group or expand it and insert/edit/remove action children.

Pressing the Edit icon images/download/thumbnails/105104292/arc_edit_ico.jpg next to the group name opens the main tool, where you can edit the group name, box color, time delay in milliseconds, keyboard shortcut and GPI channel.

It’s also possible to execute all action boxes included in an action group on initialize group by pressing the Execute All icon images/download/thumbnails/105104292/arc_xa_ico.jpg at the top-right of the group box.

images/download/thumbnails/105104292/arc_pa_cm.jpg

Remove all actions from the group by selecting Take All Actions Out in the Context Menu (right-click on group action).

Command

images/download/attachments/105104292/arc_pa_comm.jpg

The Command action lets you write custom commands to talk with Viz Engines, for example to manage stage animations or start a specific director, as shown in the example above.

Tracking Hub

TH Command lets you write a custom command to interact with Tracking Hub.

images/download/attachments/105104292/arc_pa_th.jpg

Note: Tracking Hub is a console program for Viz Virtual Studio that collects and stores data from tracking systems (cameras and objects). Viz Engine is provided with this tracking data at a configurable time or delay.

MSE

images/download/thumbnails/105104292/mseaction.png

images/download/attachments/105104292/arc_pa_mse.jpg

MSE lets you retrieve Viz Trio’s saved pages and import them directly into Viz Arc for execution.

images/download/thumbnails/105104292/mseprofiles.png

images/download/thumbnails/105104292/arc_pa_msept.jpg

The profile used for the action is in the lower left corner of the MSE action. It contains a list of the profiles configured on your MSE.

To Import Trio Shows

This section shows you how to import Trio Saved Pages into Viz Arc:

images/download/thumbnails/105104292/arc_pa_trio1.jpg

Press the MSE icon images/download/thumbnails/105104292/arc_mse_ico.jpg to make a window containing a list of Trio shows appear.

images/download/attachments/105104292/arc_pa_trio2.jpg

Select a show. A list of Trio pages is displayed.

You can sort pages by page number, description and template by double-clicking on the header at the top of the list.

images/download/thumbnails/105104292/arc_pa_tref.jpg

Reload MSE pages by clicking Refresh.

images/download/attachments/105104292/arc_pa_trio_mse.jpg

To import, select one or more pages and click Add Selected images/download/thumbnails/105104292/arc_addsel_ico.jpg to add them in the actions area.

To abort an operation, close the window or press the Close images/download/thumbnails/105104292/arc_close_ico.jpg button.

images/download/attachments/105104292/arc_pa_trio_atco.jpg

At the bottom of the MSE window, you can select Take, Continue, or Take Out , which creates a single action box for every operation.

To Work with Page Animations

images/download/attachments/105104292/arc_pa_mse2.jpg

Once the pages are imported, you can work with Page animations:

images/download/thumbnails/105104292/arc_take_ico.jpg

TAKE: start animation.

images/download/thumbnails/105104292/arc_cont_ico.jpg

CONTINUE: continue animation from the previous stop point to the next.

images/download/thumbnails/105104292/arc_to_ico.jpg

TAKE OUT: take out the graphic.

images/download/thumbnails/105104292/arc_ex_ico.jpg

Execute: perform the action selected above.

Shared Memory

Set Shared Memory names and assign a value using Shared Memory. You can add multiple Shared Memory key/value pairs.

Note: The Viz.Communication map on the targeted Viz Engine is affected by this action.

Precision Keyer

images/download/attachments/105104292/precisionkeyer.jpg

Setting up the Precision Keyer is a sequential process where each step creates an interim result. The suggested layout follows the sequence and places the show buttons next to the items which need to be inspected. The show buttons are check boxes and can be overwritten if another checkbox got selected. If no checkbox is active the final composition is shown.

No checkbox

Shows the final and composed output of the Keyer.

Denoise

Shows the output of the de-noising step.

Primary Matte

Shows the key output, white representing foreground and black the background.

Primary Matte Inverse

Shows the inverse of the Matte output, foreground white, background black.

Lightwrap

Shows the detected edges between foreground and background.

Processed Foreground

Shows the processed output.

Highlights

Shows the highlights in the foreground.

Primary Matte

images/download/attachments/105104292/primarymatte.jpg

  • Hue: Rotate the color space to move the color of the Cyclorama to the purest color chosen, green or blue. You can adjust this by looking at the matte and checking that the matte calculated on the Cyclorama approaches black.

  • Saturation: If the video is not highly saturated you may want to adjust this to ease setting of the opacity and transparency point.

  • Opacity: This is the point at which the primary matte value becomes 100% opaque. Equivalent to the black point on gray scale images.

  • Transparency: This is the point at the which the primary matte becomes 100% transparent. Equivalent to the white point in gray scale images.

Matte Denoise

images/download/attachments/105104292/denoise.jpg

  • Radius: The radius of the bi-linear filter used to blur the noisy parts of the image.

  • Sharpen: Pixels whose color differ more than this threshold from the main pixel are not included in the blurring process. This maintains detail, even if a large blur radius is applied.

Processed Foreground

images/download/attachments/105104292/procforeground.jpg

  • RGB: The color of the backing plate used to process the foreground.

Despill

images/download/attachments/105104292/despill.jpg

  • CMY: Cyan, Magenta and Yellow despill gain.

Lightwrap

images/download/attachments/105104292/lightwrap.jpg

  • Edge Blur: If this value is greater than zero, edge detection is performed and edges found are blurred by the amount set in this field. The blurred edges serve as input to brighten up the edges to overcome overshooting when going from a dark color to the Cyclorama. These edges are used for lightwrapping.

  • Blur: The blurred background is used for lightwrapping onto the foreground together with either the spill matte or the edge matte.

  • Edge Gain - Background: Defines how strongly the lightwrap is applied to the background when using the edge matte.

  • Spill Gain - Background: Defines how strongly the lightwrap is applied to the background when using the spill matte.

  • Solid Color RGB: A constant color that is applied as a lightwrap on the foreground.

  • Edge Gain - Solid Color RGB: Defines how strongly the lightwrap is applied to the foreground when using the edge matte.

  • Spill Gain - Solid Color RGB: Defines how strongly the lightwrap is applied to the foreground when using the spill matte.

Shadows

images/download/attachments/105104292/shadows.jpg

  • Enabled: Toggles background shadows.

  • Inner: A threshold under which shadows or dark colors are brought to the background. This feature is disabled if the value is zero.

  • Gain: This can be used to strengthen the effect of bringing dark colors back.

Highlights

images/download/attachments/105104292/highlights.jpg

  • Enabled: Toggles foreground highlights.

  • Inner: Luminescence from which highlights are added to the background.

  • Gain: Highlight gain.

Color Correction

Primary color correction is applied on the already keyed foreground pixels.

images/download/attachments/105104292/colorcorrection.jpg

  • Saturation: Value for the overall saturation.

  • Lift: RGB values for lift.

  • Gamma: RGB values for gamma.

  • Gain: RGB values for gain.

Light wrapping: Light wrapping is a compositing technique designed to blend keyed out green screen footage with a background plate. Light wrapping is used to simulate ambient light that casts light onto your subject in the scene. Although in some circumstances (like mixed lighting) it can be better to use a different layer than your background layer for the light wrap, this all depends on your scene.

Edge Matte: Edge detection is performed on the primary matte, resulting in a grayscale image that in most cases needs to be blurred for a smoother transition.

Screen Color

Select between green and blue screen color.

images/download/attachments/105104292/selectcolor.png

Auto Adjust

For an initial keying setup, point the camera into the green/blue box and hit the Auto Adjust button to get an initial key.

images/download/attachments/105104292/autoadjust.png

Picking

Picking lets you get a good first estimate of your Chroma/Precision Keyer. Press the Picking button to enter picking mode:

images/download/attachments/105104292/pickingrect.png

An attempt is automatically made to fetch a still frame from Viz Engine configured in the current channel selected in the chroma action.

images/download/thumbnails/105104292/selectedchannel.png

You'll now be able to scroll horizontally and vertically within the snapshot and pick an area of green. The picking area can be resized using the mouse wheel.

images/download/attachments/105104292/pickdetail.png

Once an area is picked, the calculated RGB values are displayed above the snapshot. The HUE value is only relevant if the Precision Keyer is selected. The picked values are directly applied to the Engine if Update On-Edit is enabled.

images/download/attachments/105104292/fullpick.png

images/download/attachments/105104292/fitscroll.png

You can use the Fit and Scroll to view the snapshot either scaled into the view or in it's original size for more accurate picking.

images/download/attachments/105104292/fetchframebutton.png

To fetch a new still frame from Viz Engine for picking, press Fetch Frame.

images/download/thumbnails/105104292/remainingbuttons.png

  • The Fetch button retrieves the current keying settings from the Viz Engine. This is useful when creating a new Chroma Action that needs to be initialized with the current settings of Viz Engine.

  • FREEZE freezes the selected video input on the Engine. Don't forget to unfreeze when you are finished adjusting the key.

  • SHOW KEY forces the Viz Engine to output the key channel on the fill output. Deselect this when you are finished adjusting the key.

Adjusting the Keyer

To get to a good keying result, the following steps should be followed in the described order, since the different steps depend on each other.

  • Start by hitting the Auto Adjust key button in the Keyer control. This sets the values of the hue and saturation and ensures that the rest of the keying parameters are set to a value to optimize their influence on previous settings.

  • The obtained result after hitting the Auto Adjust key button is the primary matte which results from the difference between the pixel colors and the primary color. The ideal hue can be found by viewing the matte and rotating the hue until the key strength is at a maximum. The brightness of the key represents the strength of the key. The saturation can be used to increase the key strength in case the signal coming from the camera is not very saturated. To adjust the limits for transparency and opacity the user can switch between the key and inverse key view. Clicking on the same button again disables the view.

  • Denoising can be viewed either on the key signal or on the denoised frame which is used to calculate the key. A large radius has a performance cost. Denoising should eliminate the noise on homogenous areas, while keeping details like hair intact.

  • The processed foreground is the next step. The background should be replaced by solid black. When reducing the gain, the user can check if too much or not enough red or blue is still in the processed foreground. Subtracting the wrong color results in red or blue tint in areas with semi-transparent key.

  • Despilling serves two purposes: It removes the green or blue spill from the people and objects in the studio and generates a matte which can be used for light wrapping with either a solid color or blurred background. The shadows and highlights sections allow to bring back dark and bright colors. This happens after the processed foreground has been applied to the background. This should be done after adjusting the primary key and processed foreground.

  • Lightwrapping helps to blend foreground and background better and should be the last step in the process of keying/compositing.

  • A color correction can be applied to the processed foreground. It has no effect on any of the keying and blending methods.

Precision Keyer Stages

images/download/attachments/105104292/afterautoadjust.png

The final composited output after Auto Adjust has been pressed is shown above.

images/download/attachments/105104292/adjustmatte.png

Output of the matte only, black representing foreground and white background, is shown above.

images/download/attachments/105104292/invertmatte.png

Output of the inverse matte only, black representing background and white the foreground, is shown above; helpful for seeing details such as hair.

images/download/attachments/105104292/showedge.png

Output showing the detected and blurred edge is shown above.

images/download/attachments/105104292/processedforeground.png

Output of the processed foreground that also shows the light wrap around the talent is shown above.

Unreal Command

The Unreal Command action lets you write custom commands to talk to the Unreal Engine, for example to trigger a sequence. Multiple commands can be sent separating them by ; and a newline.

images/download/attachments/105104292/unrealcommand.png


Virtual Studio

images/download/attachments/105104292/image2021-2-24_19-51-18.png

Virtual Studio lets you set up X/Y/Z positions and Y rotations of every scene listed at the left of the panel. When Send Position is unchecked, it only sends the scene index to be selected on the Engine(s) and uses the position and rotation stored in the current scene.

Viz Camera

images/download/attachments/105104292/image2020-8-13_13-6-10.png

In Viz Camera, you can select between every camera in Viz Engine (from 1 – main to 16). The default behavior once a Camera Action is created is to simply switch the active camera.

images/download/attachments/105104292/image2020-8-13_13-7-5.png

If the toggle Editor/Remote is activated you can force a camera to be in Remote or in Editor mode, for example.

images/download/attachments/105104292/image2020-8-13_13-11-46.png

When Editor mode is selected, you can enable all aspects of the camera such as Angle, Position and Direction and force the displayed values.