BGE: DeckLink card support for video capture and streaming.
authorBenoit Bolsee <benoit.bolsee@online.be>
Fri, 10 Jun 2016 08:09:26 +0000 (10:09 +0200)
committerBenoit Bolsee <benoit.bolsee@online.be>
Sat, 11 Jun 2016 20:26:05 +0000 (22:26 +0200)
commiteea89417f4a3e2221e25c9c3ae6a601a61a05c22
tree105930e1631fe5f4a14fa02e1d0cede90cd82071
parentc0bf881ebfa93784946ee3d03ccf15122c1b74c3
BGE: DeckLink card support for video capture and streaming.

   You can capture and stream video in the BGE using the DeckLink video
   cards from Black Magic Design. You need a card and Desktop Video software
   version 10.4 or above to use these features in the BGE.
   Many thanks to Nuno Estanquiero who tested the patch extensively
   on a variety of Decklink products, it wouldn't have been possible without
   his help.
   You can find a brief summary of the decklink features here: https://wiki.blender.org/index.php/Dev:Source/GameEngine/Decklink
   The full API details and samples are in the Python API documentation.

bge.texture.VideoDeckLink(format, capture=0):

   Use this object to capture a video stream. the format argument describes
   the video and pixel formats and the capture argument the card number.
   This object can be used as a source for bge.texture.Texture so that the frame
   is sent to the GPU, or by itself using the new refresh method to get the video
   frame in a buffer.
   The frames are usually not in RGB but in YUV format (8bit or 10bit); they
   require a shader to extract the RGB components in the GPU. Details and sample
   shaders in the documentation.
   3D video capture is supported: the frames are double height with left and right
   eyes in top-bottom order. The 'eye' uniform (see setUniformEyef) can be used to
   sample the 3D frame when the BGE is also in stereo mode. This allows to composite
   a 3D video stream with a 3D scene and render it in stereo.
   In Windows, and if you have a nVidia Quadro GPU, you can benefit of an additional
   performance boost by using 'GPUDirect': a method to send a video frame to the GPU
   without going through the OGL driver. The 'pinned memory' OGL extension is also
   supported (only on high-end AMD GPU) with the same effect.

bge.texture.DeckLink(cardIdx=0, format=""):

   Use this object to send video frame to a DeckLink card. Only the immediate mode
   is supported, the scheduled mode is not implemented.
   This object is similar to bge.texture.Texture: you need to attach a image source
   and call refresh() to compute and send the frame to the card.
   This object is best suited for video keying: a video stream (not captured) flows
   through the card and the frame you send to the card are displayed above it (the
   card does the compositing automatically based on the alpha channel).
   At the time of this commit, 3D video keying is supported in the BGE but not in the
   DeckLink card due to a color space issue.
31 files changed:
CMakeLists.txt
build_files/cmake/macros.cmake
doc/python_api/examples/bge.texture.2.py [new file with mode: 0644]
doc/python_api/rst/bge.texture.rst
intern/CMakeLists.txt
intern/decklink/CMakeLists.txt [new file with mode: 0644]
intern/decklink/DeckLinkAPI.cpp [new file with mode: 0644]
intern/decklink/DeckLinkAPI.h [new file with mode: 0644]
intern/decklink/linux/DeckLinkAPI.h [new file with mode: 0644]
intern/decklink/linux/DeckLinkAPIConfiguration.h [new file with mode: 0644]
intern/decklink/linux/DeckLinkAPIDeckControl.h [new file with mode: 0644]
intern/decklink/linux/DeckLinkAPIDiscovery.h [new file with mode: 0644]
intern/decklink/linux/DeckLinkAPIDispatch.cpp [new file with mode: 0644]
intern/decklink/linux/DeckLinkAPIModes.h [new file with mode: 0644]
intern/decklink/linux/DeckLinkAPITypes.h [new file with mode: 0644]
intern/decklink/linux/DeckLinkAPIVersion.h [new file with mode: 0644]
intern/decklink/linux/LinuxCOM.h [new file with mode: 0644]
intern/decklink/win/DeckLinkAPI_h.h [new file with mode: 0644]
intern/decklink/win/DeckLinkAPI_i.c [new file with mode: 0644]
intern/gpudirect/CMakeLists.txt [new file with mode: 0644]
intern/gpudirect/dvpapi.cpp [new file with mode: 0644]
intern/gpudirect/dvpapi.h [new file with mode: 0644]
source/blenderplayer/CMakeLists.txt
source/gameengine/VideoTexture/CMakeLists.txt
source/gameengine/VideoTexture/Common.h
source/gameengine/VideoTexture/DeckLink.cpp [new file with mode: 0644]
source/gameengine/VideoTexture/DeckLink.h [new file with mode: 0644]
source/gameengine/VideoTexture/Exception.cpp
source/gameengine/VideoTexture/VideoDeckLink.cpp [new file with mode: 0644]
source/gameengine/VideoTexture/VideoDeckLink.h [new file with mode: 0644]
source/gameengine/VideoTexture/blendVideoTex.cpp