Soft Robots: Has Their Time Come?

By | October 13, 2019

NewImage

image: University of Toronto

When I first saw a room full of soft robots I was a little freaked out. A bunch of guys standing over what looked like colostomy bags or oversized centipedes as they navigated an obstacle course. It was hard to see the potential in it, but when I took a closer look I realised soft robots were the missing link in the computational evolutionary chain. The biggest problem we have with robots — whether they’re on industrial production lines, in homes, offices, airports — they’re too rigid. They’re parodies, robots that look like robots, instead of assuming the contours, movements, materials of nature, which is where they should be heading. Think adaptable, flexible, dexterous, able to go places rigid robots can’t — and safer. Hence soft robots. (Here’s the piece I wrote more than two years ago for Reuters) 

There’s been huge progress in the limbs, skin, movement and energy sources of soft robots. But there’s still a long way to go. For example, soft robots by definition have soft outer layers, and those layers need to stretch and adapt like the outer layers of the animals they loosely mimic. They also need to be energy-sensitive, since soft robots are (usually) self-contained, untethered things that rely on portable electronics for power — if that. 

Researchers at Carnegie Mellon University have developed such a material that can adapt its shape in response to its environment — shape-morphing, in the words of the researchers. Carmel Majidi, an associate professor of mechanical engineering who directs the Soft Machines Lab at Carnegie Mellon is quoted as saying:  “Just like a human recoils when touching something hot or sharp, the material senses, processes, and responds to its environment without any external hardware. Because it has neural-like electrical pathways, it is one step closer to artificial nervous tissue.” (You can see some videos of the material in action here.) 

The composite, which is made up of liquid crystal elastomers (LCEs, a type of the LCD you see in flat panel displays but linked together like rubber) and liquid metal gallium indium, is also resilient and, to an extent, self healing:

“We observed both electrical self-healing and damage detection capabilities for this composite, but the damage detection went one step further than previous liquid metal composites,” explained Michael Ford, a postdoctoral research associate in the Soft Machines Lab and the lead author of the study. “Since the damage creates new conductive traces that can activate shape-morphing, the composite uniquely responds to damage.”

The researchers believe the material could be used in healthcare, clothing, wearable computing, assistance devices and robots, and space travel.

Another problem with soft robotics relying on soft actuators is that they tend to be bulky. Soft robots need to move and do stuff, and often this is done by pumping air or fluids through chambers. One — the colostomy bag lookalike — moved around in this way, and it was effective but took up a lot of space — a pump or something like it is usually required, which keeps them tethered and unwieldy. Researchers at UC San Diego reckon they have a solution in creating soft actuators that are controlled not by air or fluid but by electricity. (h/t Nanowerk)

If that sounds like a step backward, the point here is less that they’re using electricity, but are using material that is used for artificial muscles in robots, the LCEs I mentioned above. As with the CMU researchers, the UC San Diego team focused on how LCEs change shape, move and contract in response to stimuli such as heat or electricity. They sandwiched three heating wires between two thin films of LCE. The material was then rolled into a tube, pre-stretched and exposed to UV light. Each heating wire can be controlled independently to make the tube bend in six different directions, as well as contracting. 

The researchers built an untethered, walking robot using four actuators as legs. This robot is powered by a small lithium/polymer battery on board. They also built a soft gripper using three actuators as fingers. The thing was slow — each leg takes about 30 seconds to bend and contract, but they’re working on ways of speeding it up. 

Movement of soft robotics is a challenge. There’s lots of biomimicry involved, where researchers seek inspiration from land and sea creatures. Researchers at the University of Toronto have created a miniature robot that can crawl like an inchworm. This uses electrothermal actuators (ETAs), devices made of specialized polymers that can be programmed to physically respond to electrical or thermal change. A robotic inchworm in itself isn’t that novel— I saw one up the road at NUS here in Singapore a couple of years ago  — but the Toronto folk say theirs is different largely because it’s more efficient. And, I’d have to say, more like a real inchworm. They say their approach can be applied to other movements, including the wings of a butterfly. 

Their goal: to see it in clothing. “We’re working to apply this material to garments. These garments would compress or release based on body temperature, which could be therapeutic to athletes,” says Hani Naguib director of the Toronto Institute of Advanced Manufacturing, and the manufacturing robotics lead of U of T’s Robotics Institute. The team is also studying whether smart garments could be beneficial for spinal cord injuries.

There are other announcements — all of them in the past few weeks — that suggest major progress in this field: 

  • A Florida State University research team has developed methods to manipulate polymers in a way that changes their fundamental structure (think caterpillar turning into butterfly);
  • Soft robots could get smarter at solving everyday tasks after a team from MIT and Tsinghua University have developed a “soft finger” with embedded cameras and deep learning methods to allow the robot to better understand and manipulate their position, environment and items in it; 
  • Researchers from Linköping University in Sweden have come up with a way to fabricate soft microrobots from a single design process, hopefully making it easier to use soft robots in minimally invasive surgery or drug delivery. The researchers, intriguingly, say they “are now working on soft robots that function in air.” 

Look, I don’t think these things are going to find their way out of the lab any time soon. But clearly serious headway is being made. And in the end if it’s seen as commercially viable we’ll see big players get involved. So far there are a few players: Breeze Automation of San Francisco (a piece on them here from TechCrunch), and Fusion Fund, which says it’s interested in funding entrepreneurs using soft robots for “task automation beyond the capacities of current robotics technology.” It see soft robotics beyond industrial manufacturing — and I think they’re probably right. Soft robots will thrive in places either humans (and other devices) can’t get to — think search and rescue, like a Thai cave to reach stranded boys, or in interacting with humans safely and in an engaging way (a robot that can hug or catch a falling person, anyone?) and in miniature — hard to reach places inside an engine, inside a blood vessel, or in water. 

Big, or Bigger: Southeast Asia’s Tech Economy in 2025

By | October 11, 2019

Google and Temasek have been taking a crack at estimating and predicting the size of Southeast Asia’s ecommerce economy for the past four years, starting in 2016 (yes, I know that’s three years but they’ve put out four reports, the latest this week, so there.) 

I’ve not had a close look at this report, there’s obviously some good stuff in there, and it’s easy to pick holes in this kind of thing, but it pays to be humble. I’ve done my own chart, below, taken the data from each report about their predictions for 2025, and how they’ve changed over time. The four left columns are more or less the years of the estimate (2016 assessed 2015 for some reason, while the others did the year the report was released in); the right four stacks are the estimates for 2025 in 2016, 2017, 2018 and 2019 respectively. You can see how much their view has changed. 

The first year there was no separate estimate for ride hailing; it clearly wasn’t considered to be a significant sector, or likely to be one. I think a smarter analysis would have seen that one coming. It was 2016 already, and Grab was already the region’s biggest unicorn. Then there’s the huge disparity in estimates between 2017 and 2018, the third- and second-to right columns, and then between last year and this. Overall, between 2016 and 2019 the report upped its project by 50%, from $200 billion to $300 billion. 

Of course, it pays for all those involved to cheerlead the region; no one is going to say things are going to get better, and it’s a good headline to say ‘we goofed up by underestimating how well things are going’. But these are big numbers, and big discrepancies. If nothing else, it’s a good reminder that such estimates need to be taken with a big grain of salt. 

Google Temasek estimate of ecommerce market size in Southeast Asia 2016 2019

A New Form Factor for the Phone?

By | October 9, 2019

EGYzfB5UcAAawPu 1 768x1024

photo @arubin via twitter

The smartphone hasn’t changed much, at least in terms of proportions, since the first iPhone (the iPhone belatedly adopted the 16:9 aspect ratio most other phones had long assumed in 2012 with the iPhone 5). Yes, Samsung made it bigger, an idea considered dumb at the time but one which has largely become the norm. Phones have gotten thinner — anorexic, in the words of one writer — which has produced its own problems (and may hold back 5G). But the essential dimensions of the phone haven’t changed in more than 10 years. 

That is, sort of, changing, with Samsung’s Fold and the Surface Duo hinged Android phone. But that in itself isn’t that radical — both are just two phones stuck together, design-wise, which is something that designers have been playing with for a while. (I wrote about bendable screens back in 2013 and revisited it a year ago).

Step up Andy Rubin, the former Android guy who left Google over allegations of sexual misconduct (retaining a huge severance package). He now works at Essential, which make a nice-looking but essentially conventionally sized phone. 

The phone, pictured above, seems to be about the same length as a conventional phone, but is maybe half the width. At first that doesn’t seem to make any sense, but looking at the way it sits in the hand, it seems to fit more snugly. I’m guessing the idea here is that most of the time we’re operating a phone with one hand while moving — walking, on a bus, hopefully not driving, jogging, abseiling, windsurfing, under-the-desk-in-meetings — so this form factor makes a lot of sense. I assume that’s why the screenshots are of maps. 

And I suppose that lain horizontal it would make for one pretty cool cinematic perspective. Although nowadays everyone seems to be shooting vertically, so who knows? It’s not clear whether this phone is an Essential one according to Sean Hollister at the Verge.

It’s good that we’re seeing experimentation in this space again. This isn’t a massive leap forward, but it does suggest that some minds are showing signs of thinking outside the box. It also shows that we are probably using our phones in ways we didn’t a few years ago. Certainly navigating the average street these days involves having to dodge people glued to videos or games while in motion. 

Smart cities without digging

By | October 8, 2019

Smart cities sound like a great idea — who wouldn’t want your city to be smart, or at least smarter? — but it usually involves lots of digging. What if we could have the sensors that make cities smart, without the holes?

Sensors need to be lain in the ground, or on street furniture, and often cables lain to connect them. This means more holes, which is something residents don’t like. A mayor in the Indian state of Goa threatened to seize the equipment of the local smart city corporation, Imagine Panaji Smart City Development Corporation Ltd, in May after they ignored the city’s ban on digging up its streets. (India is in the throes of developing 100 smart cities and is trying to come up with alternatives to the chaos wrought by digging — the city of Dehradun is proposing a ‘multi utility duct’ (see illustration) to house electricity cables and telephone cables. “This will avoid frequent digging roads for connections and repair of telephone cables.” Not a pretty solution, I have to say.) 

Anyway, for those cities that already have broadband fibre lain in the ground, Verizon has an interesting solution: converting these fibre cables into sensors using a technology called optical fibre sensing. Optical fibre sensing is used for monitoring power cables, tunnels, mines, railways and dams for fires, temperature, strain, rupture  — or even for whether someone violates a perimeter. But they require laying purpose-built cable, usually close to the surface. 

Verizon and NEC said this week they had used software and AI to monitor traffic — including density of vehicles, direction, speed, acceleration and deceleration — on Verizon’s existing communications cables. Purpose-built optical fibre has long been used for sensing but this, the two companies say, is the first time it can do both — carrying high speed data, while also performing sensing. 

The technology needn’t just be used for traffic: the companies say it could also “support public functions such as helping first responders detect and respond to gun shots and enhancing municipalities’ ability to more quickly and efficiently identify earlier deterioration of bridges, tunnels and other infrastructure.” 

“This test marks an important milestone for technology that could provide a huge leap forward for those building smart cities and those tasked to manage them,” the press release quoted Adam Koeppe, Senior Vice President of Technology Planning and Development with Verizon as saying. “Instead of ripping up tarmac to place road and traffic-sensing technology, cities will be able to simply piggyback Verizon’s existing fiber optic network.”

They’re not the only ones trying to make use of existing fibre without more digging. A British company called OptaSense is developing something called Distributed Acoustic Sensing (DAS) that “enables continuous, real-time measurements along the entire length of a new or existing, single mode fibre optic cable. The fibre optic cable is transformed into a sensor by an Interrogator Unit plugged onto the end of a single unused spare core.” The unit injects a pulse of laser light into the cable which then creates a “virtual microphone” every 10 metres along the cable. The sensor would be able to detect different size vehicles, traffic jams etc. (It wasn’t clear from the Verizon press release whether their solution also required the presence of a similiar unit or some other hardware installation.)

5G’s Achilles Heel: Heat

By | October 7, 2019

5G promises a lot. a mobile internet of things, new immersive VR and AR experiences, lower latency, washboard stomachs. But something the industry isn’t addressing is that the devices themselves heat up. A lot. This from Digits to Dollars‘ Jonathan Goldberg: 

5G phones get hot. Really hot. Probably not hot enough to ignite your battery (probably), but enough to generate a definite burning sensation in your pants pockets. At Mobile World Congress in February, we spoke with an engineer from Sony who was demo’ing a phone (behind glass) that was clocking 1 Gbps speeds. Wow, fast. We asked the engineer why it was not going faster and he said “It overheats.” A good solid answer, from a nuts-and-bolts-and-antenna person. We will wager any amount that at next year’s show, no one on the floor will be as open about this problem.

The industry, Goldberg writes, is tackling this issue by er, ignoring it. And indeed the standard response appears to be that “we’ve seen heat problems with every new generation and what we have with 5G is nothing significant, 3G was way worse,” as one commenter said he’d been told at a 5G conference. But that may be underestimating the problem — Goldberg says the “heat budget” is 67% higher than current phones. (Heat budget is the total amount of thermal energy transferred to the chip when the device is in operation.) And he points out that both no-one seems yet to be offering a solutions and “solving the issue in 3G broke a couple vendors.” 

Some background: what we call 5G is actually two stages of technology. What most carriers are currently rolling out is phase 1, or what is called, confusingly, sub 6, an evolution of 4G that bring (quoting Goldberg again in a different post): “modest improvements in data rates as well as some important, but hard to observe, changes in the software the operators use to run their networks.” The big step will be the second phase, mmWave, “will bring much more tangible changes, notably including data rates at or above 1 Gbps.”It’s these mmWave radios that are (indirectly) causing the problem. 

As I understand it, these mmWave operate at very high frequencies — close to microwave — which require high clock speeds in the chips. The heat this creates is concentrated in a small subset of the electronic components within the phone, and there’s no easy way to move that energy around. Goldberg again: 

Of course there are some solutions, but none of them are complete and they all have serious drawbacks. It turns out that the way we cool electronics has not advanced in 40 years. There are really two methods used currently to cool Things down- Fans and Dissipation.

Fans are what you think they are. Anyone who has ever opened up their desktop PC or overclocked their laptop knows what these look like. But fans have two problems: they are big and they have moving parts. Both of those require design decisions that go counter to every mobile design trend in the past 15 years.

Dissipation is just the idea of moving the heat around to hasten air cooling. In a PC, this is typified by those funny looking prong-things that sit on top of CPUs. Those things are too tall to fit inside a 10mm thick phone. So for mobiles, OEMs are looking at using ‘straws’, or copper pipes that span the length of the phone. These take up a lot of space and inserting a large conductive element (copper!) inside a phone wreaks havoc on mobile radios, (i.e. hurting data rates).

We all know the problems of overheating phones, but what is surprising is how little this issue seems to be addressed. Goldberg says that this is a problem on a whole new level to previous generations, and one that is only now being addressed: “The problems with 5G mmWave are larger and will not go away as quickly. Handset makers are just waking up to the existence of this problem.”

The only place to find discussion of this issue appears to be in academia, which itself notes the lack of discussion. In a paper published last year three researchers at the Huazhong University of Science and Technology wrote (PDF):

the heat dissipation of smartphones restricts the maximum receiving rate of smartphones. Although the maximum receiving rate of smartphones is restricted by the computation capability and heat dissipation, detailed studies of basic models used for evaluating the maximum receiving rate of smartphones are surprisingly rare in the available literature.

The researchers ran their own tests and reached some sobering conclusions: 

– anything above 4 Gbps and the temperature of the smartphone reaches above 45 C “within a few seconds.” (5G has promised peak data rates up to 20 Gbps and Qualcomm’s first 5G modem “is designed to achieve up to 5Gbps downlink peak data rate.” So the smartphone has to “decrease the computation capability of the chip to reduce the heat generation, e.g., decrease the working frequency of the chip, to prevent low-temperature burns on the user’s skin. Thus, smartphones cannot sustain the original receiving rate and may even have to shut off wireless communications.” This is obviously not an optimal outcome. This is already happening with the first mmWave 5G rollouts (what AT&T calls 5G+) — which, remember, is not the one that involves mmWave radios: The Wall Street Journal wrote in July that their Galaxy S10’s 5G switched off in the Icelandic summer. Others have reported similar problems.

The researchers recommend that to address this”using new materials or redesigning the components’ structure to improve the heat conduction rate from the chip to other low-temperature components in smartphones. Additionally, mobile edge computing, one of the 5G technologies, can be applied to improve the maximum receiving rate of smartphones by offloading the computation assignments in the chips.” It’s hard to imagine that would be a welcome advance, since as I understand it it would mean transferring a lot of the hard work from the phone to the base station — and who exactly would pay for that? 

The researchers are, in their academic way, somewhat scathing of how the field has failed to address the serious matter of device heat: “In 5G and future 6G cellular networks, most of research is focused on the core networks and BSs. However, many potential impacts triggered by the maximum receiving rate of smartphones have not yet been investigated. How to design reasonable mobile terminals for matching with 5G and future 6G wireless communication systems is still an open issue for industries and academic researchers.” 

That was a year ago. One can only hope the device manufacturers are addressing this. For now, it seems to make sense to take 5G promises with a pinch of salt and a bucket of ice.