Skip to content

June 24, 2016

DARPA’s ‘Virtual Eye’ lets soldiers see around obstacles

by John_A

Intel’s virtual FreeD replay tech used in the NBA and other sports is cool, but it requires a lot of cameras and GPU horsepower. DARPA, the US military’s science fiction arm, thinks the same technology could give soldiers and rescuers better situational awareness. Since there’s no way personnel can lug all those computers and cameras into a battle or disaster, it worked with NVIDIA to create Virtual Eye. The system fuses two images into a live synthetic 3D scene using just a powerful laptop and a pair of cameras.

First responders could send a pair of camera-equipped drones or robots into a burning or unstable building, place them in separate locations, and let the software take over. Running on a laptop with a dual NVIDIA K20 GPUs, it fuses the images into a live virtual scene, using extrapolation to fill in the missing pixels. While the images aren’t as pretty as Intel’s FreeD replays, users get a continuous video feed that they can rotate around in real time, unlike the still images from the replay tech.

The resulting synthetic view would help personnel find someone trapped in a fire by looking around objects, or even through them, as shown above. Soldiers could also peer over and around obstacles to spot enemies or booby traps. They could then create a plan for a rescue or incursion with better information than from, say, a single camera.

The researchers also think that Virtual Eye tech could be used for sports, but not just in replays. By adding support for additional cameras, networks could do 3D broadcasting in real time, letting you control exactly what you’re watching. That would give you something else to do with that pricey VR headset.

Source: NVIDIA

Read more from News

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

Note: HTML is allowed. Your email address will never be published.

Subscribe to comments

%d bloggers like this: