Perhaps the most mission-critical product of ISR platforms is the video provided by their Electro-Optical/Infrared (EO/IR) sensors.  The Video Management System (VMS) is a Government-Off-The-Shelf (GOTS) product developed by Scientia LLC as part of RDT&E efforts under the G-BOSS and other ISR programs.  The VMS provides many capabilities related to viewing, archiving, exploiting and broadcasting video streams, including STANAG 4609 and MISP-compliant video streams.

VMS meets the critical low-latency requirement for G-BOSS because the video is used for operator-in-the-loop missions.  MISB Engineering Guideline 0802 states that “… glass-to-glass latency needs to be less than 200 milliseconds.”  The framework enables the VMS Server and Client to simultaneously connect to multicast video feeds.   This capability allows the Server to archive video and send KLV metadata to a database for future queries while the Client can view the same video without requiring streaming from the Server.

The VMS components can be deployed modularly.  The VMS Server can be deployed on a platform to archive video feeds autonomously.  The VMS Client/GUI can be used to view live network video streams.  The VMS Server typically requires low CPU resources, but much disk space, whereas the VMS Client/GUI require much more CPU usage.  Again, all of this depends on feed bandwidth, number of feeds, and required amount of time to store data, but theoretically, the VMS components could be deployed on low-end computer hardware for one or two low bandwidth applications or be scaled to high-end blade servers for several dozen HD video feeds.

Leveraging open standards, the VMS uses MPEG-2 Transport Stream over User Datagram Protocol (UDP) or Real Time Streaming Protocol (RTSP) for Multicast or Unicast.  It is capable of decoding H.264, MPEG-2 and Motion JPEG video; and MPEG-4 Advanced Audio Coding (AAC) and MPEG-2 Level 2 or 3 audio.  We can also decode many of the most common MISB Standards, Engineering Guidelines (EG), and Recommended Practices (RP), including: Standard 0601.X (UAS Datalink Local Metadata Set), RP 0808 (Ancillary Text Metadata Sets), EG 0805 (Cursor on Target (CoT) Conversions for Key-Length-Value (KLV) Metadata), and EG 0104.X (Predator UAV Basic Universal Metadata Set).

The VMS has been demonstrated to meet mission-critical requirements for managing video generated by deployed ISR systems.  It also provides a robust “backbone” on which additional sophisticated technologies can be implemented, including video analytics for functions such as automated anomalous activity detection or integrating sensor models to perform mensuration, feature projection, extraction, registration, uncertainty propagation, and other photogrammetric operations.

Video Playback – The VMS can playback all supported formats including MISP-compliant streams with DVR-like functionality.

Video Management – Video can be configured to record to disk, stream archives to external sources, and save snapshots and video clips to external media.

Metadata View - KLV Metadata defined in MISB Standards, Engineering Guidelines, and Recommended Practices can be viewed from the VMS.