Machines can generate sound effects that fool humans

Can machines come up with plausible sounds effects for video? Recently, MIT’s artificial intelligence (CSAIL) lab created a sort of Turing test that fooled folks into thinking that machine-created letters were written by humans. Using the same principal, the researchers created algorithms that act just like Hollywood “Foley artists,” adding sound to silent video. In a psychological test, it fooled subjects into believing that the computer-generated banging, scratching and rustling was recorded live.

Researchers used a drumstick (chosen for consistency and because it doesn’t obscure the video) to hit various objects, including railings, bushes and metal gratings. The algorithm was fed 978 videos with 46,620 actions, helping it recognize patterns in the audiovisual signal. “Training a model to synthesize plausible impact sounds from silent videos, [is] a task that requires implicit knowledge of material properties and physical interactions,” according to the paper.

The AI uses deep learning to figure out how sounds relate to video, meaning it finds the patterns on its own without intervention from scientists. Then, when it’s shown a new, silent video, “the algorithm looks at the properties of each frame of that video, and matches them to the most similar sounds in the database,” says lead author Andrew Owens. As shown in the video (above), it can simulate the differences between someone tapping rocks, leaves or a couch cushion.

In an online study, subjects were more than twice as likely to pick the AI version over the live one as the “real” sound, particularly for non-solid materials like leaves and dirt. In addition, the algorithm can reveal details about an object from its sound: 67 percent of the time, it could tell whether a material was hard or soft.

The AI isn’t perfect — it can get faked out by a near-hit, and can’t pick up sounds not related to a visual action, like a buzzing computer. However, they believe the work could eventually help robots figure out whether a surface is cement-solid or has some give, like grass. Knowing that, they could predict how to step and avoid a (hilarious) accident. If the team can enlarge its database of sounds, the machines could eventually do a Foley artist’s job — with no need for coconuts.

OSVR improves the display on its new developer headset

The Open Source Virtual Reality (OSVR) project will soon have a new headset for developers. Unlike previous hardware, which offered a so-so experience, the new Hacker Development Kit 2 (HDK 2) is supposed to be a true competitor for the Oculus Rift and HTC Vive. That means a better display — the new version comes with a low persistence OLED panel with a total resolution of 2160×1200, or 441 pixels per inch (PPI). It has a 110-degree field of view and supports VR experiences at up to 90 frames per second — both of which are fast becoming industry standards.

The HDK 2 will start shipping in July for $399. That’s a good deal cheaper than the Rift ($599) and the HTC Vive ($799), although it’s worth noting the HDK 2 doesn’t come with headphones or a controller. Still, the headset could appeal to developers who are leaking for a cheaper way to experiment with VR — or at least, a form that doesn’t require a smartphone. In addition, OSVR will continue to sell its older HDK 1.4 headset for $299.

OSVR’s supporters crave an open, dynamic VR ecosystem similar to what Android has achieved on mobile. The hope is that the HDK 2 will ultimately inspire other companies to build their own hardware, expanding the platform and attracting game developers along the way. To accelerate interest on the software side, it’s announcing a development fund worth $5 million today. The payouts are unusual though — Razer says it will buy game codes “in bulk” from each successful applicant. The number (and therefore the value) will vary depending on the project.

OSVR faces stiff competition on four fronts — the HTC Vive and Oculus Rift are already out, while Sony’s PlayStation VR looms on the horizon. Google is jumping in too with Daydream, an Android-based VR platform that will offer a more premium experience than Cardboard. It’s early days for the VR industry, but already game developers are being pulled in different directions. That makes OSVR a tricky proposition — the project has some support, but to survive and flourish it really needs more momentum.

Stanford looks to the skies to calculate underground water

A team at Stanford has pioneered a new use of satellite imagery that could help its home state avoid future water supply issues. Previous Stanford research had already proved satellite images (specifically Interferometric Synthetic Aperture Radar) of minute changes in ground elevation could provide reliable clues to underground water flow. The problem was, only tiny sections of the images provide useful data, and analyzing them is a laborious, manual process. Hopefully not for long.

A newly developed algorithm not only automates discovery of useful data points, but accurately predicts water flow between them. The new system isn’t specifically designed with California in mind, but with an estimated 30-percent of the state’s water coming from such aquifers, and a recent five-year drought, understanding this potentially valuable, but delicate source of H20 is more important than ever.

It’s no secret that increased temperatures, and low snow fall has made water supply in Stanford’s home state a hot topic. This made the use of groundwater more important than ever. The problem is, pumping too much water — known as overdrafting — is expensive, and can even stop the aquifer from naturally replenishing. What makes this new technique so tantalizing, is that as well as discovering more groundwater, it could help us get much more out of existing sources too.

The new algorithm, developed by Jingyi “Ann” Chen, a Stanford postdoctoral researcher on the team, allows them to automate the analysis of the InSAR data, which is a huge time saver in itself. Perhaps the more significant part, is that Chen was also able to figure out a way to accurately “fill in” data in what would otherwise be blind spots. The team tested the algorithm on satellite images of Colorado’s San Luis Valley between 2007 and 2011 and the predictions closely matched the real life measurements.

While California’s immediate water situation might have taken a step back from the precipice, the Stanford team will continue to incorporate data from other sources to improve and refine the algorithm. The ultimate goal would be to give geologists the tools to be able to accurately estimate the full water “budget” of anywhere that has the available satellite imagery. Knowing what’s flowing underground, and how to get the most yield from it, will have both environmental, and economical benefits, the full implications of which are hard to measure.

Source: Stanford

Microsoft Refreshes iOS ‘Xbox’ App Ahead of E3 Press Conference

Microsoft has overhauled its Xbox app for iOS, bringing new features and a look that’s more in line with its Windows 10 range of mobile apps.

The “Xbox One SmartGlass” app, which is now titled simply “Xbox”, enables an iOS device to function as a remote control to maneuver through the Xbox One’s dashboard. It also displays information on the device when playing music or TV through the console, and can be used to browse the web.

As part of the refresh, the Activity Feed now becomes the main home screen of the app and gains a more personalized feel, with screenshots and game clips appearing in it that have been shared by friends.

Trending content has also been added to the feed, for users to find out what is popular on Xbox Live.

Other social media changes include the ability to add Facebook friends to a user’s Xbox players list, a Contacts friend finder, real name sharing, the addition of Game Hubs, and redesigned user profiles.

Microsoft has also updated the Xbox One navigation and media controls within the app.

Microsoft is expected to unveil a new Xbox One S console, new games, and more today at E3 2016, the annual game conference and show at the Los Angeles Convention Center.

Xbox is a free download for iPhone and iPad available on the App Store. [Direct Link]

Tags: Xbox, E3 2016
Discuss this article in our forums

Bethesda and id Software Announce ‘Quake Champions’ at E3 2016

Bethesda Softworks has revealed it is working on a brand new entry in the Quake franchise called Quake Champions.

A spiritual successor to first-person shooter Doom, Quake appeared 20 years ago and was the first FPS to focus on arena-based multiplayer combat and frenetic team-based game modes.

Tim Willits of iD Software and co-designer of the original Quake, revealed the news of the upcoming title for PC at an E3 press event yesterday, describing a new ability for players to select different classes as “esport” in design. A series of Quake leagues and events are to be built out as the game launches.

While no mention was made of a Mac (or indeed any other) version of the game during the presentation, more information about inevitable ports is likely to be revealed at QuakeCon this August.

Apple has attended QuakeCon in the past, and used the annual event in 2001 to show off its latest Power Mac G4s running Quake 3 Arena.

Quake 4 originally shipped on the Mac in 2006, and is available on the Mac App Store for $19.99, complete with full cross-platform multiplayer support, including Deathmatch, Team Deathmatch, Tourney, Capture the Flag, Arena CTF and DeadZone.

Tags: E3 2016, Quake
Discuss this article in our forums

iPhone Sales Predicted to ‘Remain Feeble’ Until Early Next Year

Japanese website Nikkei is continuing the 2016 doom and gloom sentiment surrounding iPhone sales, reporting that an unnamed source has confirmed that sales figures and shipment numbers for Apple’s smartphone lineup will see the first year-over-year decline since the iPhone debuted in 2007. The website cites “lukewarm demand for a new model” and a lack of innovation as the major reasons behind the predicted sales decline.

Specifically, iPhone shipments in 2016 are estimated to total between 210 and 220 million units, which would be a drop off of as much as 8.6 percent from 2015. The “people familiar with the matter” within Hon Hai Precision Industries noted that one of the company’s executives described a lower iPhone demand for the remainder of this year, lasting “until at least early next year.”

iPhone 7 Plus design mockup in “Deep Blue”

“Hon Hai Precision Industry Chairman Terry Gou has told his staff that the demand for iPhones will remain feeble until at least early next year,” a source said. Hon Hai, better known as Foxconn Technology Group, declined to comment.

Gou told Chinese Premier Li Keqiang in China in late May that the company’s overall orders were falling this year, although Foxconn did receive a sudden rush of orders in April and May. Foxconn makes about 70% of iPhones sold globally.

Whether that means the supplier would begin working on the expected mega-cycle “iPhone 8,” or another mid-cycle upgrade similar to the iPhone SE, early in 2017 is unclear. Nikkei’s sources opine that Apple’s attempt to shake up an upgrade cycle with no notable new hardware features by introducing new colors — seemingly referring to the recently rumored Deep Blue — proves “that the company now has no way of breaking out of the current doldrums.”

Still, the 5.5-inch iPhone 7 Plus could come with a few notable new hardware revisions, namely a dual-lens camera that would allow for 2-3x optical zoom capabilities, clearer and brighter images, and the ability for users to refocus an image after taking a picture. Otherwise, the handsets are expected to remain largely in line with the iPhone 6s design, besides the potential removal of the headphone jack and redesigned set of antennae bands.

Related Roundup: iPhone 7
Discuss this article in our forums

WWDC 2016 Spoiler-Free Video Stream

Apple’s WWDC keynote will be kicking off in a matter of hours, and as is tradition, some MacRumors readers who can’t follow the event live are interested in avoiding all of the announcements and waiting until Apple posts the recorded video of the event so as to experience it without already knowing the outcome.

For those individuals, we’ve posted this news story, which will be updated with a direct link to the presentation once it becomes available from Apple. No other news stories or announcements will be displayed alongside this story.

Apple has become quicker about making event videos available for replay over the past several years, and videos are now frequently available within an hour of an event’s conclusion.

Users waiting for the video to be posted are welcome to gather in the thread associated with this news story, and we ask that those who follow the events refrain from making any posts about Apple’s announcements in this thread.

Related Roundup: WWDC 2016
Discuss this article in our forums

Sony XD9405 4K TV review: The 75-inch UHD wonder

Love movies? Got a big living room? Feeling flush this month? Then Sony thinks it has just the ticket for you in the shape of its new flagship TV, the KD-75XD9405.

For the princely sum of £4,999 the XD9405 gives you a huge 75-inch screen stuffed with a native 4K/UHD pixel count and capable of pumping out enough brightness to handle the new high dynamic range (HDR) picture format now available via selected Amazon and Netflix streams, as well as Ultra HD Blu-ray.

Also onboard are not one but two smart TV systems – Android TV and YouView – as well as Sony’s much-acclaimed Triluminos wide colour spectrum technology and the latest version of the brand’s 4K-optimised “X1” video processing system.

Add all this promising tech to the fact that its predecessor, the 75X9405C, was one of the very best TVs of 2015 and it’s fair to say that the omens for the 75XD9405 are good. Very good indeed.

Sony XD9405 4K TV review: Design

The 75XD9405 even looks attractive, which is no mean feat given how massive its screen is. Its black frame is both strikingly trim considering how many acres of picture it holds and rather stylish thanks to its angular edges and tasteful sliver of gold running through the centre of each outer edge.

Sony

The lack of bodywork around the screen does hide one potentially disappointing secret, though: the lack of the spectacular speaker system that made last year’s Sony 75X9405C the best sounding TV we’ve heard (bar, perhaps, a few ultra-expensive Bang and Olufsen models).

Equally, such giant speaker arrangements made the 2015 and earlier models look ug-er-ly. Our inner AV fan can’t help but rue the passing of the 75X9405C’s speakers, though, but we can’t blame Sony for deciding that the 75XD9405’s slimmed-down design is likely a much easier sell to an often space-restricted UK marketplace.

Sony XD9405 4K TV review: All the mod cons

The 75XD9405 is appropriately well connected for a flagship TV in 2016. Its four HDMIs can, of course, handle 4K video up to 60 frames a second, as well as HDR content. Multimedia duties, meanwhile, are serviced by a trio of USBs as well as Ethernet and integrated Wi-Fi network options.

The network options can either stream content into the TV from other DLNA-enabled devices on your network, or access Sony’s online services. These online services predominantly come via Sony’s integration into the 75XD9405 of Google’s latest Android TV platform – though given Android TV’s ongoing lack of support for the main UK catch-up TV services it’s a relief to also find the 75XD9405 packing the same YouView catch-up TV engine Sony eventually added via software update to its mid-range and high-end 2015 TVs.

However, Android TV still feels like a pretty unhelpful smart system, sadly. Even though the platform runs more quickly and stably on the XD9405 than it did on Sony’s 2015 TVs, the interface still looks cluttered, does precious little to pick out links to your favourite stuff and doesn’t permit enough customisation. The sheer number of apps on offer also strikes me as more of a hindrance than a help in a TV (as opposed to smartphone) operating environment.

Further hindrance to using the 75XD9405 comes from its remote control, which bizarrely uses buttons almost flush with the remote’s main bodywork, making it all but impossible to use in a darkened room, or without tearing your eyes away from the onscreen action.

Sony XD9405 4K TV review: Superb direct LED system

Letting the 75XD9405 loose on our shiny new collection of Ultra HD Blu-ray discs pretty much instantly reveals it to be an outstanding television.

For starters its direct LED lighting system, where the lights sit directly behind the screen rather than around its edges, helps it deliver a fantastically HDR-friendly combination of deep, rich blacks at one of the brightness spectrum and punchy, bold whites at the other.

Arguably the real beauty of HDR, though, lies not in the expanded gulf between its light and dark extremes but in the way it fills that gulf with far more subtle light and shade information than you could ever fit into a standard dynamic range image. It’s here that the 75XD9405 is on outstanding form, rendering even the subtlest shadow detailing and the darkest colours with a precision and delicacy that would have been unthinkable in the pre-HDR age – and which actually precious few HDR-capable TVs can deliver with such authority.

As hoped, meanwhile, the 75XD9405’s Triluminos colour system – which includes high levels of colour management as well as phosphors that deliver a wider-than-normal colour range – proves a perfect match for the wider colour ranges and subtler colour tone shifts and blends associated with all of the currently available HDR sources.

As well as making pictures look more natural, more like the real world, the expanded colour and light performance you can clearly see when watching HDR on the 75XD9405 also helps to emphasise the impact of the native 4K resolution. The impact of having four times as many pixels as an HD TV to play with always increases in direct proportion to the size of your screen anyway, but when it’s partnered with colour and light handling precision on the level you get from the 75XD9405 the 4K effect really becomes something special.

If you’ve never seen HDR in action before, the XD9405 leaves you in no doubt whatsoever of the advantages the format brings to the table. And if you have seen it before, you’ll unlikely have seen it looking as all-round gorgeous as it does here – even though some of Samsung’s HDR TVs are capable of delivering more brightness.

Sony XD9405 4K TV review: Halos and colour shift

Even a TV as excellent as the 75XD9405, though, isn’t completely immune to the sorts of backlighting issues HDR’s extreme demands can cause with LCD TVs. Very bright HDR objects can reveal halos of unwanted light around them when they appear against dark backdrops.

If the very bright object occupies a big enough proportion of a mostly dark image the image’s colour tone becomes noticeably cooler (bluer) until a less extreme image returns. This colour shift issue does only happen very rarely, though, while the haloing is pretty low in intensity for most of the time, and less distracting than on some of the smaller but more defined areas of haloing we’ve seen on other HDR TVs like the Panasonic DX902 series.

Sony

With standard dynamic range content of the sort most of us will still be watching for most of our viewing time, the 75XD9405 is pretty much flawless. Because such content doesn’t run as brightly, the haloing and colour temperature flaws noted with HDR disappear almost entirely if you keep the backlight setting to a reasonably low level, leaving you free to bathe in the screen’s contrast, colour and detail glories without distraction.

Sony XD9405 4K TV review: Sound quality

Joining the 75XD9405’s huge and usually stunning pictures is a middling to good sound performance. Voices sound clear and well rounded, action scenes are detailed and have just enough bass behind them to avoid sounding thin, and you can hit movie-friendly volume levels comfortably without harshness setting in.

However, ditching the array of giant built-in speakers found in last year’s 75X9405C means there is a pretty huge step down in sound quality. But at least not having the same massive speakers on the 75XD9405 means it’s your choice over whether you take up more of your valuable living room space by adding a separate audio system. And the earlier model was a full £1,000 more expensive too, so the XD9405 puts the buying power back in your hands.

Verdict

The 75XD9405 won’t be for everyone because it’s simply too big and too expensive for any sort of mass market consumption. Which makes us wish, actually, that Sony did 65-inch and 55-inch XD9405 models too, rather than sticking to a single king-sized option for the second year in a row. There is the edge-LED illuminated XD9305 model in such sizes, though.

If you do happen to have the space and financial wherewithal to get the 75-inch XD9405 into your life, though, you can snap one up safe in the knowledge that it’s got the features and the performance talents to do the brave new world of 4K and HDR ample justice. And for standard dynamic range images it’s pretty much flawless.