Control systems: On my command

The control systems market has had a turbulent few years but has survived the emergence of the iPad. Could the rise of AI and voice control shake things up again? Paul Milligan speaks to those involved.

The control systems market has had a difficult time of it in recent years. The iPad caused a seismic shock when Apple introduced it to the world in 2010. To date around 400 million iPads have been sold. On the surface here was something that could replicate a professional touchpanel, for a quarter of the price. This led to years of articles proclaiming the imminent death of the touchpanel. The counter-argument at the time from the likes of Crestron and AMX was that there would always be a market for professional touchpanels and that the iPad would simply drive more interest towards people looking for a more high-end solution (the same argument used now for Microsoft Surface Hub and touchscreens). It’s hard to argue that eight years later this is how things have panned out.  

Control systems manufacturers have seen year-on-year sales continue to grow and the vast majority of meeting rooms, regardless of size, have some form of control installed, either fitted to the wall or as a handheld device within the room.

Crestron Amazon voice control

While the iPad didn’t spell the end of the touchpanel, it did have a sizable impact on how they are designed, how they feel and how they work. And there is another form of technology on the horizon that could have a similar sized impact on control systems – voice control. Again, like the iPad, this is being driven by consumer products such as Amazon Alexa and Google Home. While voice is not an overnight sensation, the fast adoption of these technologies will drive change in this market. “We’ve had voice integration for years, but bringing along the skillset of a company like Amazon has meant we can take it to a completely different level,” says Matthew Buck, regional sales manager, Crestron UK. People are setting up their own control systems, and seeing the benefits of voice control for themselves, and as we have seen with other technology, what will happen next is they start demanding it in their places of work too.

So what type of impact will voice control have on the control space? Will it become the default way to use a control system? “Voice control is having a profound impact, its creating opportunities for an otherwise diluted space,” says Vincent Bova, RTI’s dealer experience manager. “For existing companies, if you aren’t a player in the voice control space, it can create the perception that your technology is outdated.”  The demand is there but is that translating to actual orders? Yes it is says Buck. “In the last 4-6 weeks we have seen a sudden upturn in companies who want to get rid of touchpanels and interfaces in their presentation and meeting rooms and want to move solely over to voice activation.”

crestron touch panel

Everyone we spoke to about voice control agreed it would have a big impact, but there are a number of caveats that need addressing first.  “The main obstacle (to it becoming the default) is that current voice control options are based on commands such as ‘Alexa, turn on the lights’, and do not respond to a more natural way of speaking,” says Keren Lipshitz, director of control and solutions at Kramer.

Lipshitz has already seen some improvement in voice control technology with the addition of ‘routines’, the use of which allows users to pre-define scenarios such as ‘movie time’. This single command activates a series of actions – dimming the lights, setting speaker volume, turning on the TV etc. “While this is progress it still requires the user to be aware of the available pre-defined scenarios and learn the relevant commands. As long as we are in the residential market this isn’t a major issue.  However it gets complicated once we move to a commercial environment, which hosts random users.  Can we really expect anyone who walks into a conference room to know the available commands/scenarios? Of course not.  That’s why we need voice control which enables the use of any kind of syntax as a command. Only then will see voice control widespread across the commercial, and specifically corporate, markets.” 

Jason Lapthorne, applications engineer, AV and control, EMEA, from AMX by Harman is another seeing installers experimenting with voice control, and this is in turn driving more enquiries. But like others we spoke to, Lapthorne is aware some issues need to be addressed. “I think it will be difficult for voice in the education and corporate markets, mainly down to security. Essentially you have an open microphone that is always on, and its connected to the internet. There are huge legal/security matters around voice (that need to be solved) before we see it taking off in the corporate world. It records what you say, then you have data protection and privacy issues around that. Who owns that data? Currently anything you say to an Alexa or Siri is then owned by Amazon or Apple.”

The view on whether voice will become the default to control AV within any given room is probably best summed by RTI’s Bova; “As far as it being the default, we will have to wait and see.  Clearly this is not a fad. However it needs to be more intelligent, with the ability to learn the speech habits of users.”

The move towards using your voice to control AV equipment is part of a larger shift in the last five years, which has seen manufacturers prioritise ease of use over functionality. So is the design of the front end now the crucial aspect of any control system? “Barry Schwartz argues in his book (The Paradox Of Choice – Why More Is Less) that eliminating consumer choices can greatly reduce any anxiety for shoppers.  This is evident with control systems as well,” says Lipshitz.

“The more options we provide the user with will result in over-complicating the user experience.  And there lies the challenge for us manufacturers.  Its up to us to find the delicate (some might say impossible) balance of flexible and all-encompassing system that answers the user requirements but without compromising on ease of use.” But as with voice control things are improving already with regards to front-end design continues Lipshitz. “Lately we’ve seen a shift with various control systems being based on drag and drop builders and this is the first step in that direction.  With a properly designed drag and drop builder, the user doesn’t lose functionality.”

Simplifying the front-end design of control panels is vital because without it the proAV industry will just repeat the problems of video conferencing, which overcomplicated the very simple requirement of seeing and hearing the person on the other end. “We were guilty in the past of copying everything your remote control could do,” says Lapthorne. “We don’t need all those buttons, people use the same 4 or 5 buttons and that’s it, time after time.” To emphasise this change of thinking Lapthorne revealed the new AMX experience centre doesn’t feature any touchpanels on the wall (Crestron has also made the same change to its showrooms). “We now look at the user’s journey - When you walk into a room what happens? What happens when you walk into a room and what happens to that room when you are finished and walk out?” adds Lapthorne. 

One giant step to improving the control experience could be the emergence of AI. How close are we to getting truly smart room control i.e. meeting rooms that react to your presence in the room? AMX has been working with IBM Watson for a few years now and the system has already shown it’s capable of learning and adapting. “It learns phrases, so if you say ‘it’s a bit dark in here’ it will turn the lights on.  There are trigger words, and its much more conversational (than command-based systems),” says Lapthorne. AMX is currently looking at ways to track user’s previous behaviour to improve the next experience.

“RMS already monitors individual users to see how they use each room (preferred volume level etc).  At the moment to change that it would need some programming so we can tailor-make it for their environment, but we could use AI to make that easier in the future.  It’s there at the moment, it just needs some time and some tweaking.” Crestron is also doing something similar (learning your behaviour to better the next outcome etc) with its PinPoint app. This is surely the way forward for control systems, you walk in a room and it knows who you are, what volume, lighting, heat etc setting you like and get sit all ready five minutes before you even enter the room. All you will need to do is simply turn on your device once you are in the room.

Speaking of devices, how has the emergence of BYOD affected the user interface of control systems? “Manufacturers understand that BYOD and control cannot continue to live as separate entities in the commercial environment. We are witnessing a rise in ‘control brains’ (software to control the home and office alike). Companies are now offering the option to secure the ‘brain’, an application that just like any other can run on any device based on iOS, Android and Windows,” says Lipshitz. In many cases the control system user interface is being replaced says Bove; “By intelligent systems that can anticipate BYOD and provide an easy way to integrate devices, replacing the user interface of the control system with personal products. The demand for BYOD integration is now considered a necessity versus a luxury.”

The irony with control becoming intelligent is that it’s now moving from an easy to use device sat on the meeting room desk into something working in the background. It was always designed to be the glue that held everything together says Lapthorne, but is now evolving into something smarter. “What we are seeing now is control is taking a step back, it’s becoming more invisible.  The actual perception is that there is no control in the room, its just happening.  The reality is that everything is happening at the back end.”