Four of the biggest tech companies are using human contractors to listen in on samples of voice requests. This means requests between you and your voice assistant may have another set of ears listening in.
One of the most popular voice assistants, Google Assistant, is included with most Android devices, devices running the Chrome browser, and iOS devices running the Google app. Google also has a dedicated smart speaker for voice assistance, as well as a range of smart TVs with similar functionality.
Its strength comes from off-device processing, meaning that voice requests are sent to Google’s cloud to be transcribed, understood, and sent back for assisting a user. This means that almost any smartphone with an Internet connection can run the assistant as smoothly as the latest Android flagships.
Google has had a somewhat-hushed scandal with human voice contractors in Belgium, where Time Verheyden, a journalist with Belgian broadcaster VRT, was given access to over 1000 voice files containing requests and some random snippets of audio. 150 of these requests were snippets from smartphones that thought they heard the “OK Google” wake word. These included a child and a grandfather speaking and a woman in distress.
The voice assistant included with most Apple devices, Siri, is also not as innocent as Apple claims it is. Most new iPhones, iPads, and Apple Watches are consistently listening, and some “false positives” – when the device mistakes sounds for the wake word – are sent back to contractors. Apple says this done to analyse why the device thought it was requested and what can be done to prevent it in the next version update. Contractors told The Guardian that Siri can be summoned by the sound of a zip being zipped up, and that they have heard potential drug deals, as well as the sound of sexual acts.
Apple has since suspended this project with its contractors, presumably to continue at a later date, and has planned an opt-out feature for users to have their recordings sent to Apple for improving the assistant.
Some contractors came forward to Bloomberg to say that, while most requests were mundane, some were “possibly criminal”, including potential sexual assault. Amazon told CNN Business that an “extremely small number of interactions from a random set of customers” were sent to these listening centres. While this quote may be reassuring at face value, 6.3-million Amazon Echo devices were sold worldwide in Q3 of 2018. This means that an “extremely small” amount of questions taken from an extremely large request base is less non-trivial than it sounds.
Microsoft’s innovations are vast, but come at the cost of privacy. Its voice assistant included with Windows 10 and Xbox, Cortana, is most likely on and listening if users chose the “Express Setup” option when setting up their devices for the first time. This means that Microsoft may have far more false positives than the other voice assistants, because users either don’t know it’s there, or have forgotten about it since setup. Like Google, Amazon and Apple, contractors were given access to random voice requests, some of which were false positives, to improve its voice assistant.
Skype conversations are also sent back to contractors to assess the effectiveness of translations. Some contractors heard very intimate conversations, and some clips even included bank account information, home addresses, and bedroom conversations.
The events mentioned above all happened in 2019, which shows that artificial intelligence, especially natural language processing, is not ready to do all the work for big tech companies. This is why a little more human training is required to teach these systems about what to listen out for and what can be ignored.
However, it comes at a cost to privacy. Often, it is a hidden cost.
Read more about how voice has become the new oil.
New measures as video production comes to a halt
MultiChoice has announced a range of measures to safeguard the incomes of cast, crew, and creatives, as well as the sustainability of production houses.
MutliChoice Group has confirmed that production of video entertainment has come to a complete halt in South Africa, as the industry adheres to the national lockdown.
Many sectors across the African continent are adjusting and finding ways to deal with challenges brought about by the current coronavirus pandemic. Among these, MultiChoice Group is one of the best-known brands across Africa, due to its dominance of the video entertainment sector. As a result, it says, it is acutely aware of the challenges its partners in the industry are facing.
“For many years MultiChoice has been a leader in the sector and are a leading investor in local content production,” it said in a statement on Friday. “The group has deep rooted partnerships and long-standing commitments that have grown the industry for the benefit of many, both in front and behind the camera.”
For this reason, says MultiChoice, it has decided to implement several measures aimed at safeguarding the incomes of cast, crew, and creatives as well as the sustainability of production houses.
“With these measures the group can hopefully steer the industry through this tumultuous time.”
MultiChoice announced the following measures:
- “MultiChoice has set aside R80 million to ensure that current productions are able to pay full salaries of cast, crew, and creatives for the months of March and April, by when hopefully we will have the worst of the disruptions behind us. The need to secure salaries of our creatives goes a long way in creating income stability for them and their families. We believe this to be critical for the industry and in our view simply the right thing to do.
- “Through the MultiChoice Talent Factory we will be launching an online learning portal that will support over 40 000 members of the industry to gain access to courses and online master classes, so they can continue to hone their craft whilst adhering to the public health measures of social distancing and isolation.
- “Furthermore, we have committed to guarantee the incomes of freelancers in our SuperSport Productions, who are currently unable to work due to the suspension of sport and the national lockdown. This extends to guaranteeing the income of freelancers in our broadcast technology environment.”
MultiChoice Group CEO Calvo Mawela said: “Our main concern is to ensure as much as possible that we secure the incomes of creatives, cast and crew over this period. We want to ensure that they and their families are not negatively impacted as work has come to a standstill.”
Nintendo South Africa launches online gameathon
Nintendo’s South African distributor has set up live events for virtual participation during lockdown.
Being stuck inside doesn’t mean not being with the game. Players now have the chance to meet up virtually to play Nintendo Switch Online games like Ring Fit Adventure, Animal Crossing: New Horizons, and Pokémon Sword and Shield.
A daily schedule is available for each game. For example, Ring Fit Adventure has a kids challenge at 9am from Monday to Friday, while adults can join in at 2pm. The challenges are co-ordinated by a dedicated Ring Fit coach.
The challenge instructions will be available via the Discord channel. Join the channel via the invite here.
Players of all skill levels are encouraged to join. Plenty tips and tricks will be shared about the games.