Cognitive Value Creation and Collaborative Knowledge Exchange with

Visual Neural Networking and Packetized Augmented Intelligence

ABSTRACT

The invention enables synchronous multiparty communications, collaboration, consultation and instruction with

multichannel, multiplexed streaming imagery data, including interactive curation, multisensory annotation and

metadata tagging, as well as multi-formatted encapsulation, saving and sharing of collaborated imagery data

streams as packetized augmented intelligence. The invention acquires both live stream and archived medical

modality imagery from network-connected medical devices, cameras, signals and sensors, as well as multi-omic

[phenotypic, genomic, metabolomic] clinical data from biometric maps and movies, hapmaps, heat maps and

data stream visualizations. The invention also acquires both medical and non-medical streaming imagery data

from image data repositories, documents and structured reports, workstations and mobile devices, as well as

from wearable computing, signals and sensors. The invention enables networked teams to interactively

communicate, concurrently collaborate and bi-directionally exchange multichannel multiplexed imagery data

streams, singly or together, in real time or asynchronously, generally by curating, annotating and tagging

imagery information objects. The invention encapsulates and saves collaborated imagery data streams, together

with multisensory annotations and metadata tags, in standard file formats as packetized augmented intelligence.

The invention enables recursive cognitive enrichment of multisensory cognitive vismemes, and saves

packetized imagery information objects, multisensory annotations and metadata tags in native file formats

[PDF, MPEG, JPEG, XML, XMPP, QR, SVG and DAE] as well as in formats compliant with standards for

digital communications in medicine [DICOM]. The invention enables live stream N-way multicasting of

multiparty cognitive instruction and collaborative knowledge exchange with multisensory [visual, auditory,

haptic] annotation of streaming imagery data, as well as secure, encrypted transmission of packetized

augmented intelligence across file sharing data networks for interoperable health information exchange.