Xiaomi Goes Virtually Edgeless By Using Ultrasound

By | October 26, 2016

NewImage

Regular readers will know I’ve been looking out for this to happen for a while: the use of sound, or rather ultrasound, as a form of interface. Here’s a Reuters piece I did on it a year ago:  From pixels to pixies: the future of touch is sound | Reuters:

Ultrasound – inaudible sound waves normally associated with cancer treatments and monitoring the unborn – may change the way we interact with our mobile devices.

But the proof will be in the pudding, I reckoned:

Perhaps the biggest obstacle to commercialising mid-air interfaces is making a pitch that appeals not just to consumers’ fantasies but to the customer’s bottom line.

Norwegian start-up Elliptic Labs, for example, says the world’s biggest smartphone and appliance manufacturers are interested in its mid-air gesture interface because it requires no special chip and removes the need for a phone’s optical sensor.

Elliptic CEO Laila Danielsen says her ultrasound technology uses existing microphones and speakers, allowing users to take a selfie, say, by waving at the screen.

Gesture interfaces, she concedes, are nothing new. Samsung Electronics had infra-red gesture sensors in its phones, but says “people didn’t use it”.

Danielsen says her technology is better because it’s cheaper and broadens the field in which users can control their devices.

That day has happened. Xiaomi’s new MIX phone, Elliptic Labs says, is the first smartphone to use their Ultrasound Proximity Software:

INNER BEAUTY replaces the phone’s hardware proximity sensor with ultrasound software and allows the speaker to be completely invisible, extending the functional area of the screen all the way to the top edge of the phone.

Until now, all smartphones required an optical infrared hardware proximity sensor to turn off the screen and disable the touch functionality when users held the device up to their ear.

Without the proximity sensor, a user’s ear or cheek could accidentally trigger actions during a call, such as hanging up the call or dialing numbers while the call is ongoing.

However, INNER BEAUTY — built on Elliptic Labs’ BEAUTY ultrasound proximity software — uses patented algorithms not only to remove the proximity sensor, but also to hide the speaker behind the phone’s glass screen.

Besides eliminating the unsightly holes on a phone’s screen, Elliptic Labs’ technology eliminates common issues with hardware proximity sensors, such as their unreliability in certain weather conditions or in response to various skin colors as well as dark hair.

This is a good first step. The point here of course, for the company, is that they can push the display right to the top, which definitely looks nice (the front-facing camera, if you’re wondering, is now at the bottom.) But the use of ultrasound has lots of interesting implications — not least for how we interact with our phones. If gestures work, rather than just say they work, it will make interacting with other devices as interesting, maybe more interesting, than voice.

The Ugliness of Short Term Hacks on the Road to Wireless

By | October 1, 2016

Here’s a Kickstarter project to solve the problem of no audio jack which illustrates just how thorny it is: iLDOCK – charge and listen to iPhone 7 at the same time by ildockgear — Kickstarter

ILDOCK lets you use your wired headphone while charging your iPhone 7. You can also add storage via SD, TF and USB ports with Plus. 

NewImage

The problem, as some have highlighted in the comments, is that Apple rarely grants MFi status to accessories where the lightning cable doesn’t plug directly into an Apple device. In this case, one does but the external one doesn’t. Most manufacturers get around this by making the external one a microusb. I don’t mind that, in fact it helps me, but some folk aren’t crazy about it. 

There are other issues too, of course: if you have lightning headphones and want to charge, this isn’t going to help you. 

I know I’ve written before that the future is wireless, but this project, worthy though it is, merely illustrates how ugly the interim is going to look like. 

(Via Kickstarter)

Yahoo Dyslexia

By | September 23, 2016

Yahoo probably has enough on its plate right now, facing possibly the largest data breach ever –  Yahoo says at least 500 million accounts hacked in 2014 – but I just wanted to point out that it doesn’t inspire confidence when their log in screen contains a glaring typo: 

Screenshot 2016 09 23 05 11 47

(I’m not sure the links below about the ‘account security issue’ are particularly helpful either. Users may not have heard about it, and so don’t know what it’s referring to, and the second link does not enlighten the user in this case about whether they’re ‘potentially affected’ or not.) 

But a typo on a login screen? I had to double check I’d not been diverted to a scam site. Not reassuring. 

I’m An Airline, Fly Me

By | September 13, 2016

This an email from a bona fide airline: 

Dear Sir/Madam,

Please be informed that your transaction with [international carrier] has been confirmed. Due to fraud prevention procedure against Credit Card transaction, we would like to validate your recent transaction with [international carrier] by filling information below :

Passenger(s) name :
Route :
Date of Travel :
Cardholder name :
Address :

Also, we need to confirm and validate your name and last four digit of your card number. Please kindly provide scanned/image of your front side credit card that used to buy the ticket. You may cover the rest information on the card. Please reply in 8 hours after received this email or we will cancel the reservation.

Thank you for your cooperation.

Best Regards,
Verification Data Management

Jack’s Hit: Apple’s Missing Socket

By | September 9, 2016

There’s been a lot of talk about the removal of the iPhone’s audio jack, most of it knee-jerk, albeit sometimes amusing. A sampling:

I’m no fan-boi, but I find most of this coverage small-minded. Yes, I get that there’s a potential inconvenience here:

  • if you don’t have the lightning-jack adapter, then you can’t use your existing earphones. 
  • Yes, Apple is prodding you in the direction of its expensive wireless AirPods. 
  • Yes, wireless tech is not quite as ready as it could be for the pairing to be seamless. 
  • Yes, these things are easy to lose.
  • Yes, using the headphone and charging at the same time is not going to be possible without some adapter. (This is an oversight, I agree.) 
  • yes, Apple makes more money, because it owns the lightning connector and makes maybe $4 off each device that uses it. (Yes, I don’t like this either. But the wireless 

But two years down the track these kinds of arguments will seem as anachronistic as those that lamented the phasing out of the floppy drive, the serial port, the parallel port, the CD/DVD-rom drive, its own Firewire and 30 pin connectors. (The ultimate Apple I/O death chart – The Verge)

Oddly, both the arguments by Apple and its supporters are also somewhat limited in their horizons. Apple argues that it needs more space inside the device to pack more goodies in. That the technology itself is more than 100 years old. That it makes it easier to waterproof the device. That audio via Lightning or wireless is actually as good as, if not a better, experience. Apple has talked about being courageous, which is a tad disingenuous: brave is risking everything on a startup, not when you’ve got $200 billion sitting around.

The real reason why being pro-jack is going to seem a little Luddite in the future is that the future is not just wireless, it’s deviceless. The smart watch tried (and in my view failed) to move the functionality of the smartphone to the wrist. It’s not a natural place for that functionality to be, because you’re still looking at, and tapping on a screen. It’s just smaller, closer to your face and strapped on. Same with Google Glass. Nice idea, but you’re still looking at a screen, and people hate you.

The device should disappear, all of its features — input, output — internalised. Preferably inside the body. But we can’t do that quite yet, hence the earbud. A good earbud should be both controller and receptor. That’s where we’re going. This is what I wrote for Reuters on the subject. Here’s what I said on Reuters TV.

Nothing too revolutionary here. It only seems so because the debate around jack’s hit has been so mundane, so parochial, as if technology should stand still, and technology companies should listen solely to their users. The phrase ‘faster horse’ springs to mind. Apple isn’t even leading the field on this. There are at least three other smartphone companies which have already ditched the audio jack — Oppo did it four years ago.

We’ll look back at the folk who protested the disappearance of the jack as slightly quaint folk who didn’t get it. Everything leads inexorably towards breaking down the barriers between us and the technology we use — until eventually it is inside our skull. Next to it is close enough for now. 

Hence Ben Thompson, who nailed it with this piece Beyond the iPhone, saying that this wireless, deviceless future is one which may not involve much of Apple at all. 

To Apple’s credit they are, with the creation of AirPods, laying the foundation for a world beyond the iPhone. It is a world where, thanks to their being a product — not services — company, Apple is at a disadvantage; however, it is also a world that Apple, thanks to said product expertise, especially when it comes to chips, is uniquely equipped to create. That the company is running towards it is both wise — the sooner they get there, the longer they have to iterate and improve and hold off competitors — and also, yes, courageous. The easy thing would be to fight to keep us in a world where phones are all that matters, even if, in the long run, that would only prolong the end of Apple’s dominance.

In that sense, Apple has never stood in the way of its own destruction. Yes, it has penny pinched — taxing accessory makers, avoiding taxes elsewhere, squeezing suppliers — but it has not shied away from making these bigger decisions. What is interesting is that in this new world to come it may be at a disadvantage.