Siri and voice first

In a recent episode of his Vector podcast, Rene Ritchie had “voice first” advocate Brian Roemmele. Rene is probably my current favorite Apple blogger and podcaster and Vector is excellent.

As I listened to this episode I found myself nodding along for much of it. Roemmele is very passionate about voice first computing and certainly seems to know what he’s talking about. In regards to Siri, his primary argument seems to be that Apple made a mistake in holding Siri back after purchasing the company. At the time Siri was an app and had many capabilities that it no longer has. Rather than take Siri further and developing it into a full-fledged platform Apple reigned it in and took a more conservative approach. In the past couple of years it has been adding back in, via Siri Kit, what it calls domains.

Apps adopt SiriKit by building an extension that communicates with Siri, even when your app isn’t running. The extension registers with specific domains and intents that it can handle. For example, a messaging app would likely register to support the Messages domain, and the intent to send a message. Siri handles all of the user interaction, including the voice and natural language recognition, and works with your extension to get information and handle user requests.

So, they scaled it back and are rebuilding it. I’m not a developer but my understanding of why they’ve done this is, in part, to allow for a more varied and natural use of language. But as with all things internet and human, people often don’t want to be bothered with the details. They want what they want and they want it yesterday. In contrast to Apple’s handling of Siri we have Amazon which has it’s pedal to the floor.

Roemmele goes on to discuss the rapid emergence of Amazon’s Echo ecosystem and the growth of Alexa. Within the context of this podcast and what I’ve seen of his writing, much of his interest and background seems centered on commerce and payment as they relate to voice. That said, I’m just not that interested in what he calls “voice commerce”. I order from Amazon maybe 6 times a year. Now and in the foreseeable future I get most of what I need from local merchants. That said, even when I do order online I do so visually. I would never order via voice because I have to look at details. Perhaps I would use voice to reorder certain items that need to be replaced such as toilet paper or toothpaste but that’s the extent of it.

What I’m interested in is how voice can be a part of the computing experience. There are those of us that use our computers for work. For the foreseeable future I see myself interacting with my iPad visually because I can’t update a website with my voice. I can’t design a brochure with my voice. I can’t update a spreadsheet with my voice. I can’t even write with my voice because my brain has been trained to write as I read on the screen what it is I’m writing.

But this isn’t the computing Roemmele is discussing. His focus is “voice first devices”, those that don’t even have screens, devices such as the Echo and the upcoming HomePod1. And the tasks he’s suggesting will be done by voice first computing are different. And this is where it get’s a bit murky.

Right now my use of Siri is via the iPhone, iPad, AppleWatch and AirPods. In the near future I’ll have Siri in the HomePod. How do I make the most of voice first computing? What are these tasks that Siri will be able to do for me and why is Roemmele so excited about voice first computing. The obvious stuff would be the sorts of things assistants such as Siri have been touted as being great for: asking about for the weather, adding things to reminders, setting alarms, getting the scores for our favorite sports ball teams and so on. I and many others have written about these sorts of things that Siri has been doing for several years now. But what about the less obvious capabilities?

At one point in the podcast the two discuss using voice for such things as sending text. I often use dictation when I’m walking to dictate a text into my phone when using Messages and I see the benefit of that. But dictation, whether it is dictating to Siri or directly to the Messages app or any other app, at least for me, requires an almost different kind of thinking. It may be that I am alone in this. But it is easier for me to write with my fingers on the keyboard then it is to “write” with my mouth through dictation. It might also be that this is just a matter of retraining my brain. I can see myself dictating basic notes and ideas. But I don’t see myself “writing” via dictation.

At another point Roemmele suggests that apps and devices will eventually disappear as they are replaced by voice. At this point I really have to draw a line. I think this is someone passionate about voice first going off the rails. I think he’s let his excitement cloud his thinking. Holding devices, looking, touching, swiping, typing and reading, these are not going away. He seems to want it both ways though at various points he acknowledges that voice first doesn’t replace apps so much as it is a shift in which voice becomes more important. That I can agree with. I think we’re already there.

Two last points. First, about the tech pundits. Too often people let their own agenda and preference color their predictions and analysis. The lines blur between their hopes and preferences and what is. No one knows the future but too often act as they do. It’s kinda silly.

Second, what seems to be happening with voice computing is simply that a new interface has suddenly become useful and it absolutely seems like magic. For those of us who are science fiction fans it’s a sweet taste of the future in the here and now. But, realistically, its usefulness is currently limited to very fairly trivial daily tasks mentioned above. Useful, convenient and delightful? Yes, absolutely. Two years ago I had to go through all the trouble of putting my finger on a switch, push a button or pull a little chain, now I can simply issue a verbal command. No more trudging through the effort of tapping the weather app icon on my screen, not for me. Think of all the calories I’ll save. I kid, I kid.

But really, as nice an addition as voice is, the vast majority of my time computing will continue to be with a screen. I don’t doubt that voice interactions will become more useful as the underlying foundation improves and I look forward to the improvements. As I’ve written many times, I love Siri and use it every day. I’m just suggesting that in the real world, adoption of the voice interface will be slower and less far reaching than many would like.

  1. Actually, technically, the HomePod technically has a screen but it’s not a screen in the sense that an iPhone has a screen. ↩︎

Panic, Transmit and Keeping My Options Open

I’ve been coding websites for the web since 1999 and doing it for clients since 2002. I started using Coda for Mac when the first version came out and when Transmit and Coda became available for iOS I purchased both. When I transitioned to the iPad as my primary computer in 2016 those two apps became the most important on my iPad. But no more.

A couple weeks ago Panic announced that they would no longer be developing Transmit for iOS. They’d hinted in a blog post a year or two ago that iOS development was shaky for them. They say though that Coda for iOS will continue. But I’m going to start trying alternative workflows. In fact, I’ve already put one in place and will be using it for the foreseeable future. Why do this if Coda still works and has stated support for the future?

I’m not an app developer. I’m also not an insider at Panic. But as a user, I find it frustrating that we are over three full months since the release of iOS 11 and seven months since WWDC and Panic’s apps still do not support drag and drop in iOS 11. Plenty of other apps that I use do. I find myself a bit irritated that Panic occupies this pedestal in the Apple nerd community. It’s true that their apps are visually appealing. Great. I agree. But how’s about we add support for important functionality? I really love Coda and Transmit but I just don’t feel the same about Panic as a company. Sometimes it seems like they’ve got plenty of time and resources for whimsy (see their blog for posts about their sign and fake photo company) and that’s great I guess. I guess as a user that depends on their apps I’d rather they focus on the apps. I’m on the outside looking in and it’s their company to do as they please. But as a user I’ll have an opinion based on the information I have. And though they’ve said Coda for iOS will continue, it’s time to test other options.

I’ve been using FileBrowser for three years just as a way to access local files on my MacMini. I’d not thought much about how it might be used as my FTP client for website management in conjunction with Apple’s new Files app. Thanks to Federico’s recent article on FTP clients I was reminded that FileBrowser is actually a very capable ftp app. So, I set-up a couple of my ftp accounts. With this set-up I can easily access my servers on one side of my split screen via FileBrowser and my “local” iCloud site folders in Files on the other side. I really like the feel of it. The Files app is pretty fantastic and being able to rely on that in this set-up is a big plus. It feels more open which brings me to the next essential element in this process: editing html files.

One of my frustrations with Coda and Transmit was that my “local” files were stuck in a shared Coda/Transmit silo. Nice that they were interchangeable between the two but I could not locate them in DropBox or iCloud. With this new set-up I needed a text editor that could work from iCloud as a local file storage. I’ve got two options that I’m starting with, both have built in ftp as well as iCloud as a file storage option. Textastic is my current favorite. Another is GoCoEdit. Both have built in preview or the option to use Safari as a live preview. So, as of now, I open my coding/preview space and use a split between Textastic and Safari. I haven’t used Textastic enough to have a real opinion about how it feels as an editor when compared to Coda’s editor. But thus far it feels pretty good. My initial impression is that navigation within documents is a bit snappier and jumping between documents using the sidebar is as fast as Coda’s top tabs.

So, essentially, this workflow is relying on four apps in split screen mode in two spaces. One space is for file transfer, the other is for coding/previewing. Command Tab gets me quickly back and forth between them. I often get instructions for changes via email or Messages. Same for files such as pdfs and images. In those cases it is easy enough to open Mail or Messages as a third slide over app that I can refer to as I edit or for drag and drop into Files/FileBrowser.

It’s only been a few days with this new 4 app workflow but in the time I’ve used it I like it a lot. I get drag and drop and synched iCloud files (which also means back-up files thanks to the Mac and Time Machine).

Hey Siri, give me the news

Ah, it’s just a little thing but it’s a little thing I’ve really wanted since learning of a similar feature on Alexa. In fact, I just mentioned it in yesterday’s post. We knew this was coming with HomePod and now it’s here for the iPad and iPhone too. Just ask Siri to give you the news and she’ll respond by playing a very brief NPR news podcast. It’s perfect, exactly what I was hoping for. I’ve already made it a habit in the morning, then around lunch and again in the evening.

Alexa Hype

A couple years ago a good friend got one of the first Alexa’s available. I was super excited for them but I held off because I already had Siri. I figured Apple would eventually introduce their own stationary speaker and I’d be fine til then. But as a big fan of Star Trek and Sci-fi generally, I love the idea of always present voice-based assistants that seem to live in the air around us.

I think he and his wife still use their Echo everyday in the ways I’ve seen mentioned elsewhere: playing music, getting the news, setting timers or alarms, checking the weather, controlling lights, checking the time, and shopping from Amazon. From what I gather that is a pretty typical usage for Echo and Google Home owners. That list also fits very well with how I and many people are using Siri. With the exception of getting a news briefing which is not yet a feature. As a Siri user I do all of those things except shop at Amazon.

The tech media has recently gone crazy over the pervasiveness of Alexa at the 2018 CES and the notable absence of Siri and Apple. Ah yes, Apple missed the boat. Siri is practically dead in the water or at least trying to catch-up. It’s a theme that’s been repeated for the past couple years. And really, it’s just silly.

Take this recent story from The Verge reporting on research from NPR and Edison Research

One in six US adults (or around 39 million people) now own a voice-activated smart speaker, according to research from NPR and Edison Research. The Smart Audio Report claims that uptake of these devices over the last three years is “outpacing the adoption rates of smartphones and tablets.” Users spent time using speakers to find restaurants and businesses, playing games, setting timers and alarms, controlling smart home devices, sending messages, ordering food, and listening to music and books.

Apple iOS devices with Siri are all over the planet rather than just the three or four countries the Echo is available in. Look, I think it’s great that the Echo exists for people that want to use it. But the tech press needs to pull it’s collective head out of Alexa’s ass and find the larger context and a balance in how it discusses digital assistants.

Here’s another bit from the above article and research:

The survey of just under 2,000 individuals found that the time people spend using their smart speaker replaces time spent with other devices including the radio, smart phone, TV, tablet, computer, and publications like magazines. Over half of respondents also said they use smart speakers even more after the first month of owning one. Around 66 percent of users said they use their speaker to entertain friends and family, mostly to play music but also to ask general questions and check the weather.

I can certainly see how a smart speaker is replacing radio as 39% reported in the survey. But to put the rest in context, it seems highly doubtful that people are replacing the other listed sources with a smart speaker. Imagine a scenario where people have their Echo playing music or a news briefing. Are we to believe that they are sitting on a couch staring at a wall while doing so? Doing nothing else? No. The question in the survey: “Is the time you spend using your Smart Speaker replacing any time you used to spend with…?”

So, realistically, the smart speaker replaces other audio devices such as radio but that’s it. People aren’t using it to replace anything else in that list. An Echo, by it’s very nature, can’t replace things which are primarily visual. As fantastic as Alexa is for those that have access to it, for most users it still largely comes down to that handful of uses listed above. In fact, in another recent article on smart speakers, The New York Times throws a bit of cold water on the frenzied excitement: Alexa, We’re Still Trying to Figure Out What to Do With You

The challenge isn’t finding these digitized helpers, it is finding people who use them to do much more than they could with the old clock/radio in the bedroom.

A management consulting firm recently looked at heavy users of virtual assistants, defined as people who use one more than three times a day. The firm, called Activate, found that the majority of these users turned to virtual assistants to play music, get the weather, set a timer or ask questions.

Activate also found that the majority of Alexa users had never used more than the basic apps that come with the device, although Amazon said its data suggested that four out of five registered Alexa customers have used at least one of the more than 30,000 “skills” — third-party apps that tap into Alexa’s voice controls to accomplish tasks — it makes available.

Now, back to all the CES related news of the embedding of Alexa in new devices and/or compatibility. I’ve not followed it too closely but I’m curious about how this will actually play out. First, of course, there’s the question of which of these products actually eventually make it to market. CES announcements are notorious for being just announcements for products that never ship or don’t ship for years into the future. But regardless, assuming many of them do, I’m just not sure how it all plays out.

I’m imagining a house full of devices many of which have microphones and Alexa embedded in them. How will that actually work? Is the idea to have Alexa, as an agent that listens and responds as she currently does in a speaker, but also in all of the devices be they toilets, mirrors, refrigerators… If so, that seems like overkill and unnecessary costs. Why not just the smart speaker hub that then intelligently connects to devices? Why pay extra for a fridge with a microphone if I have another listening device 10 feet away? This begins to seem a bit comical.

Don’t get me wrong, I do see the value of increasing the capabilities of our devices. I live in rural Missouri and have a well house heater 150 feet away from my tiny house. I now have it attached to a smart plug and it’s a great convenience to be able to ask Siri to turn it off and on when the weather is constantly popping above freezing only to drop below freezing 8 hours later. It’s also very nice to be able to control lights and other appliances with my voice, all through a common voice interface.

But back to CES, the tech press and the popular narrative that Alexa has it all and that Siri is missing out, I just don’t see it. A smart assistant, regardless of the device it lives in, exists to allow us to issue a command or request, and have something done for us. I don’t yet have Apple’s HomePod because it’s not available. But as it is now, I have a watch, an iPhone and two iPads which can be activated via “Hey Siri”. I do this in my home many times a day. I also do it when I’m out walking my dogs. Or when I’m driving or visiting friends or family. I can do it from a store or anywhere I have internet. If we’re going to argue about who is missing out, the Echo and Alexa are stuck at home while Siri continues to work anywhere I go.

So, to summarize, yes, stationary speakers are great in that their far-field microphones work very well to perform a currently limited series of tasks which are also possible with the near-field mics found in iPhones, iPads, AirPods and the AppleWatch. The benefit of the stationary devices are accurate responses when spoken to from anywhere in a room. A whole family can address an Echo whereas only individuals can address Siri in their personal devices and have to be near their phone to do so. Or in the case of wearables such as AirPods or AppleWatch, they have to be on person. By contrast, these stationary devices are useless when we are away from the home when we have mobile devices that still work.

My thought is simply this, contrary to the chorus of the bandwagon, all of these devices are useful in various ways and in various contexts. We don’t have to pick a winner. We don’t have to have a loser. Use the ecosystem(s) that works best for you If it’s Apple and Amazon enjoy them both and use the devices in the scenarios where they work best. If it’s Amazon and Google, do the same. Maybe it’s all three. Again, these are all tools, many of which compliment each other. Enough with the narrow, limiting thinking that we have to rush to the pronouncement of a winner.

Personally, I’m already deeply invested in the Apple ecosystem and I’m not a frequent Amazon customer so I’ve never had a Prime membership. I’m on a limited budget so I’ve been content to stick with Siri on my various mobile devices and wait for the HomePod. But if I were a Prime member I would have purchased an Echo because it would have made sense for me. When the HomePod ships I’ll be first in line. I see the value of a great sounding speaker with more accurate microphones that will give me an even better Siri experience. I won’t be able to order Amazon products with the HomePod but I will have a speaker with fantastic audio playback and Siri which is a trade off I’m willing to make.

Brydge Keyboard Update

It’s been almost two months of using the Brydge keyboard. It seems to be holding up very well in that short time. The only defect I’ve discovered is the right most edge of the space bar does not work. My thumb has to be at least a half inch over to activate a press. Not a deal breaker but it is something I’ve had to adjust.

Also, something positive that I’ve discovered. The Brydge hinges rotate all the way to a parallel position with the keyboard. In other words, the iPad rotates all the way to no angle at all, it just sort of opens all the way, level with the keyboard. I initially thought this would be useless. Why would I ever want to do this?

As it turns out, it does indeed come in very handy. When I’m lounging on the futon to read I can put the iPad in this position and let the keyboard, resting in my lap or on a pillow next to me, serve as a stand to elevate the iPad to eye level. I don’t have to look down towards my lap as one does with a standard laptop. Instead, the iPad seemingly floats in front of my face. It’s actually kind of fantastic and a very comfortable position for reading. And interestingly, it balances perfectly. I barely have to hold the iPad or the keyboard. It’s kinda weird actually. I just lightly grasp the pair right above the keyboard and use my thumb to scroll. I can also easily shift my right hand down to the arrow keys to scroll via keyboard while browsing or reading. If I need to do some real typing the motion to fold the two into a normal laptop position is fluid and natural, taking less than a second. No doubt this has been a very nice surprise feature.

One Year with Apple AirPods

It was a year ago that began selling the AirPods and they were sold out instantly. In fact, it was difficult to get them for months as Apple struggled to keep up with demand. Production finally caught in mid-summer up only to fall behind in recent weeks as holiday demand surged. I ordered mine within minutes of them going on sale so was lucky enough to get in on the first shipment. I’ve worn them many times a day every day since they arrived.

It’s been said by many over the past year that the AirPods were their favorite Apple product in recent memory. There’s no doubt, they are a delight to use. For anyone that enjoys music or podcasts on the go, especially those with an iPhone or Apple Watch, these are well worth the cost.

A few highlights:

  • They stay in my ears very well and many report the same thing. Even if the fit is not perfect, because there is no wire tugging, they tend to stay put.
  • The batteries last 3-4 hours and recharge very quickly in the case which lasts for 3-4 days.
  • Siri works fantastically.
  • Phone calls are great. The mic does a great job of cancelling out background noise providing clean audio for the person I’m talking to.
  • With the occasional oddball exception, they pair up quickly with whatever device I’m trying to use. Usually iPhone or AppleWatch, sometimes an iPad.
  • I’m often streaming music from my iPhone to the AppleTV. When I head out for a walk I pop the AirPods in and the music switches to them with no action from me. That’s the kind of magic that makes me smile.
  • They rarely drop the connection and have a pretty fantastic range. I often step outside my tiny house, forgetting the phone inside (sometimes leaving it deliberately) and can take care of little tasks such as refilling bird feeders, watering plants on the deck, etc. A 30 foot range is pretty typical. At about 40 feet they start to drop a bit.
  • I use them a lot with Siri to control audio especially in the winter when my phone is in a pocket, I’m wearing gloves and the watch is under layers of clothing. I often tap through hats and hoods to activate Siri and it works great to change artist, repeat a song, skip forward, etc. Same to answer or initiate a call.
  • I have not lost them. They are in my ears or in the case. The case is on a shelf (they have their spot) or in my pocket. Basically I treat them the same way I treat other little things such as my keys.

HomePod Pricing

It’s always funny when journalists give advice to Apple. Here’s Shira Ovide at Bloomberg who suggest Apple’s HomePod is priced too high:

But if Apple truly wants to become more than a hardware company, it needs to think different — to steal from a Steve Jobs advertising campaign. It needs the quality of its digital music service, mapping app, Siri, future web video products and more to be up to par and not only good enough to help differentiate its hardware from that of rivals. Apple doesn’t necessarily need to sell $50 Siri speakers. But if Apple wants its software and internet offerings to stand on their own, then it needs to borrow from Amazon and Google and make the hardware a means to an end — and rethink gadget prices, too.

The same thing was said about the AirPods. But interestingly Apple has been selling AirPods so quickly that they have barely been able to produce enough of them to keep up with demand. Apple never engages in the race to the bottom as we see is now happening between Amazon and Google as their smart speaker prices fall lower and lower. The market is flooded with dirt-cheap tablets but iPads continue to sell at normal iPad prices. Same goes for the AppleWatch. And the iPhone X. The list goes on.

It always surprises me that journalists and analysts get to keep their jobs regardless of how consistently wrong they are.

Given the number of bluetooth speakers that are available in the $300+ range I consider the HomePod at less than $400 a bargain. Unlike a bluetooth speaker which does nothing but play music piped in from nearby device, a HomePod is a self-contained speaker capable of not only pulling down it’s own music via the internet but will also allow for playing from iPhones, iPads, AppleTVs. Not to mention all the features that come along with Siri and the convenience of voice control.

HomePod and the Siri Ecosystem

homepod-white-shelf

I’ve recently written about my hopes for a more proactive Siri. I’ve written about Siri quite a bit over the past couple years and it’s been mostly positive. Frankly, I think “she” is pretty fantastic and I call upon her many times a day. I remember when a friend first showed me his Echo a couple years back. I instantly wanted a Siri powered speaker by Apple. I’ve been waiting ever since. I will buy the HomePod the day it becomes available. No hesitation and with the same excitement and for the same reasons as I bought the AirPods the minute they were available: music, podcasts, Siri.

But much of the tech press has another take on the voice assistant market. Over the past couple of years it’s become fashionable in the tech media, especially among the Apple nerds that love to pride themselves on their very high standards, to complain about Siri while holding up high Alexa and the Echo1.

Interestingly, Pew has recently come out with an article on the very issue of voice assistants by Americans. Not too surprisingly 46% use voice assistants and of that 42% access via smartphone. 14% access via computer or tablet. Only 8% access via a stand-alone device such as an Echo. My own experience and observation of family mirror this. Practically all of my extended family have and use Siri on a myriad of devices on a daily basis. But in that same group the Echo is only in one household.

There are a few exceptions to the common chorus of the bandwagon and two of my favorites are Daniel Erin Dilger and Neil Cybart. They offer a more mature, big picture analysis. It’s less about whether or not they are personally pleased with how a product suits them but more about the larger context and trends. They seem to do a much better job of taking into account how the potential interactions of the larger public will play out.

I agree with their recent analysis of the HomePod, digital assistants and devices. Their posts were less about Siri and more about the varied form factors of devices through which digital assistants are accessed as well as the larger function of those devices.

First, Daniel Erin Dilger over at AppleInsider recently discussed the intent of Apple’s upcoming HomePod. I agree with his take on it, nicely summarized by the article title, Apple’s HomePod isn’t about Siri, but rather the future of home audio. He does a great job of digging into the difference in the intended function of the devices. Specifically, the role of the devices in the home. This bit comparing the audio quality of HomePod to the Echo made me giggle:

It’s an emotional experience, which is exactly what Apple has been increasingly pursuing as it enhances its products. Amazon Alexa isn’t an emotional experience; it’s an intellectual one. It’s a polite conversation with a librarian who moonlights as a sales agent at an online warehouse and plays songs with the fidelity of a clock radio.”

Over at Above Avalon Neil Cybart recently wrote a post in which he explores, in part, the bias of the media in relation to the perceived success of the platforms and ecosystems. As he has in the past, he does an excellent job of providing some context about where the market is at based on numbers rather than the din emanating from the excited bandwagon.

We are in the midst of a massive mindshare bubble involving stationary smart speakers in the home. While the press talk up the category with near breathless enthusiasm and positivity, there is a growing amount of evidence that stationary smart speakers powered by digital voice assistants do not represent a paradigm shift in computing. Instead, the stationary smart speaker’s future is one of an accessory, and it will be surpassed in prominence by wearables. It’s time to call out the stationary smart speaker market for what it is: a mirage.

On more than one occasion Neil has compared the consistent praise heaped upon the Echo as compared to the criticism put upon the Apple Watch which, in terms of sales, has not only sold more units but at a greater profit. Amazon is practically giving away its Echo devices. Put another way, in terms of the number of form factors offered by each ecosystem, Apple’s is far more diverse and as a result, more useful and it’s also making a profit for the company.

Another of my favorites and the host of the Vector Podcast, Rene Ritchie, has recently covered the topic with guests in two different episodes.

The first, in which Rene interviewed Jan Dawson in episode 18, mirrored the points made Neil Cybart. Jan points out that contrary to the fixation on the Echo, it’s actually Siri that has the largest number of users. The only way that Apple appears to be behind is if we focus only on home speaker hardware such as the Echo, a market Apple has yet to enter but will enter in early 2018. But he correctly points out that Alexa-based hardware, as a share of the voice assistant market, is actually very small. He also makes the point that voice, as a computer UI, is still only one in a larger pool of UIs and that it is often not appropriate for use in many settings.

In the second, Rene interviews Ben Bajarin in episode 35. In this second interview Ben Bajarin disagrees somewhat the the above three takes. He suggests that there is a large and growing market for what he calls ambient computing. He suggests that Google is in the weakest position with search being it’s differentiator. Amazon is in a very good position with it’s differentiator being commerce. He goes on to say that Apple is very much a part of the market and that it’s differentiator is communications and service. He also suggests that while Apple is already in the game he looks for them to do more a lot more.

In the second half of the interview there is a great conversation about Siri’s future. Ben Contends that Siri is already quite good and that the general public is largely satisfied with it. They then delve into machine learning for Siri and the line that Apple is walking in regards to differential privacy as a technique for collecting large-scale social data and how this contrasts with more personalized data as the base for machine learning. It’s a great conversation.

I’m with Ben that I hope Apple can figure out how to better personalize it’s approach. In short, many of us trust Apple with our data and would like Apple to use it for a more fine-tuned machine learning for individuals. Their discussion concludes on the problem of making Siri in the HomePod work in the context of families. How can a communal device be used in both a communal context and an personal one? Or can it?

It will be interesting to see how the Apple’s Siri ecosystem evolves. While Amazon is offering various Echo devices all of which are tied to the home2, Apple offers global distribution in many languages in form factors ranging from wearables to pocketable to carried and soon, a stationary, home device. In the Apple ecosystem I am connected to Siri and thus, a variety of services, all of the time. Or, more precisely, anywhere I have an internet connection which, these days is almost everywhere I am. In other words, Siri is already providing, to a great degree, ambient voice-controlled computing.

This plethora of devices has me covered in a variety of circumstances but I’m curious to see how that works in the home with the HomePod. I’ll have an iPhone and iPad sitting within range all the time. The watch on my wrist and the HomePod somewhere in the room. What will happen when I say “Hey Siri”? I’m just one person in a tiny house. I’m also curious what happens when you have 4 or 5 family members each with devices in a larger house. Currently Siri does a good job of responding only to the device owner and even does a pretty good job of responding with the right device when several “Hey Siri” devices are within range. I assume this will be no different when the HomePod is introduced.

The new year is around the corner and with it the HomePod. I’m looking forward to trying it out. I don’t doubt that Apple is working on making all of it’s Siri devices work well together. I’ve got a spot on my shelf waiting for the new arrival.

  1. I‘ve come to dislike the Apple-oriented echo-chamber because they seem to approach every new thing from a very narrow perspective. To my ears and eyes, it comes off as snobbery. ↩︎
  2. And just a handful of countries ↩︎

A Proactive Siri

First, just a few notes about my Siri usage. I use Siri daily, many times a day calling on “her” from every iOS device I own. I’ve always wanted the pervasive, ever present computer from Star Trek. Siri is one of my favorite iOS features. I tend to activate her via a mix of “Hey Siri” and tapping the AirPods and the keyboard on the iPad. Most of my usage is Homekit-related, adding calendar and to-do items, music control and a good number of informational queries such as conversions, spelling, and factoid searches. But with Siri, and to my knowledge, all other voice assistants, the user makes a request first. It occurred to me that there are two times a day when I would like Siri to initiate a “session”.

Imagine starting your morning with a new, more pro-active Siri. Essentially, I’d like a Siri wake-up greeting. Combine the iOS morning alarm, perhaps couple of chimes followed by Siri offering a few configured options such as weather, calendar review, and the morning news. Eve better, what about “Siri Scenes” integrated with the Home App? Add a light or other devices to the above scene?

Then again, imagine a Siri “Goodnight” scene. Because night time might vary a bit more this might be scheduled and again, start off with a couple of gentle chimes and then Siri would ask if I’m ready for bed. At that point I might say in twenty minutes which would set a reminder. 20 Minutes later again the gentle chimes followed by Siri reading the forecast for tomorrow, events, reminders, turning off lights, etc. Then end with “would you like any music?” Or perhaps I’m the only one in the habit of going to bed to music? So this would be a set automation which would kickoff at my usual bedtime but which could be delayed by anytime I respond with. If I’m working late I might say “give me 30 minutes” or check back at 10.

Wake-up and bed-time are two times a day when we have fairly consistent, repeatable routines and it seems an idea opportunity for Apple to dip into the possibility of offering a new level of Siri engagement. I think it would be a great experience.

The iPad Laptop

I’ve always used the iPad with an external keyboard and with the Pro I’ve been using Apple’s Smart Keyboard. I love the feel and sound of the keys though have been wishing for media keys and the other special function keys such as brightness, volume etc. Oh, and a back light which may not be possible with a fabric covered keyboard. The beauty of the iPad and one of my reasons for switching to it as a primary machine is that it can be a tablet when I want or a laptop when I want.

That said, as much as I’ve enjoyed using the Smart Keyboard I’ve got to admit I’ve been longing for Apple to make a keyboard like the Brydge. Others have written about the Brydge which is often described as very similar to an Apple laptop keyboard. Most recently Jason Snell wrote an excellent piece on Why Apple’s next laptop should run iOS. He’d previously written a review of the Brydge and mentions it again:

The problem with the iPad Pro is that it’s literally not a laptop: You can’t comfortably set it in your lap and get work done. (Yes, you can kind of balance the Smart Keyboard on your lap, but it’s not the same as using a laptop—in terms of stability or adjustability.) This year I’ve been using my iPad Pro with the Brydge keyboard, a Bluetooth keyboard with two clamps that turn the iPad Pro into something that looks an awful lot like a laptop—albeit one with no trackpad.

Seeing his mention of it and the accompanying photo sent me off to have another look. The only reason I’d previously held off were the many reports of hit and miss quality. Lots of folks report getting units that had to be replaced, often more than once. Yikes. By chance I happened to look around Thanksgiving and they were running a Black Friday sale so I finally bought it and have been using it for about a week.

The Brydge arrived in perfect condition. It is, as reported by many, very similar to typing on the keyboard of a current generation MacBook Air or the previous generation of MacBook Pro. Which is to say, it’s excellent. It is very nearly the perfect iPad keyboard. I can slide the iPad into the hinge connectors easily but not too easily. They grip it well so it feels secure. I really only have two complaints.

The top, outer edge of this keyboard is very sharp. It almost feels like a knife blade. Second, the iPad rests deep enough in the hinges that the bottom edge of the screen is just level with the back of the keyboard which means using my fingers to pull-up to activate the dock and multitasking of iOS 11 is very difficult and often results in misses. Very frustrating. If I put the iPad into the hinge brackets but don’t push it all the way down it still sits above the back of the unit and activating the dock is easy. If it just sat 1-2 millimeters higher, access to the dock and multitasking would be much better.

I added a tiny bit of rubber with sticky backing into the bottom of each hinge to lift the iPad up just a wee bit. Not only does it make activating the dock/multitasking much easier it has the additional benefit that when closed the iPad sticks out just that little bit over the keyboard front of the keyboard. By design it is flush with the keyboard and while that looks great aesthetically when closed it makes lifting the iPad up difficult. If the iPad overhangs just a millimeter or two it is easier to lift and open for use.

If the design were tweaked these are issues that could be fixed without too much difficulty and they really should be.

Back to Jason Snell who posted a follow-up article on the idea of an iOS laptop, this time addressing the critiques of his initial article. In the follow-up, The case against building an iOS laptop—and why it might happen anyway, he writes:

I use my iPad with external keyboards all the time. Sometimes it’s clipped into a keyboard case, so it’s shaped exactly like a laptop. Sometimes it’s on a table with a Smart Keyboard attached. Other times, it’s in a stand on a table with a USB keyboard attached via Apple’s USB 3-Lightning adapter…

If I were doing something that didn’t require typing, something that involved intense tapping and swiping on my iPad, the Zombie Arms experience would start to come to the fore. On the iPad, that’s when I would disconnect the keyboard and hold the tablet more naturally. (That’s why I think an iOS laptop would ideally be a convertible laptop, so you could fold back the keyboard entirely when it isn’t needed.)

I’ve been using mine like this too. My only disagreement is that I think the current iPad is the iPad Jason is describing. I don’t think Apple needs to do much aside from build a proper keyboard. Just tweak the current Brydge a bit and give it the usual Apple fit and finish. Perhaps fix the orientation of the Apple logo on the back of the iPad to reflect a primary horizontal orientation. If Apple could create a hinge with the Smart Connector and a magnetic lock-in we would have the tablet/laptop combination.

As is I think the Brydge does this right now though it is bluetooth based whereas an Apple solution would use the Smart Connector. I’ve only had a week with the Brydge but this combination feels nearly perfect. It’s a laptop when I want a laptop, a tablet when I want a tablet. The effort required to switch form factors is simply to lift the iPad from the hinges or to place in back in them.