The engine behind Amazon Alexa is one of the machine learning technologies powering a new suite of artificial intelligence tools announced by AWS this week.
At the AWS re:Invent conference in Las Vegas this week, Amazon Web Services announced three Artificial Intelligence (AI) services that make it easy for developers to build apps that can understand natural language, turn text into lifelike speech, have conversations using voice or text, analyze images, and recognise faces, objects, and scenes.
Amazon Lex, Amazon Polly, and Amazon Rekognition are based on the same highly scalable Amazon technology built by the thousands of deep learning and machine learning experts across the company. AWS says that Amazon AI services all provide high-quality, high-accuracy AI capabilities that are scalable and cost-effective. Amazon AI services are fully managed services, so there are no deep learning algorithms to build, no machine learning models to train, and no up-front commitments or infrastructure investments required. This promises to free developers to focus on defining and building a new generation of apps that can see, hear, speak, understand, and interact with the world around them.
Amazon Web Services provided the following information:
Until now, very few developers have been able to build, deploy, and broadly scale apps with AI capabilities because doing so required access to vast amounts of data, and specialized expertise in machine learning and neural networks. Effectively applying AI involves extensive manual effort to develop and tune many different types of machine learning and deep learning algorithms (e.g. automatic speech recognition, natural language understanding, image classification), collect and clean the training data, and train and tune the machine learning models. And this process must be repeated for every object, face, voice, and language feature in an application. Amazon AI services eliminate all of this heavy lifting, making AI broadly accessible to all app developers by offering Amazon’s powerful and proven deep learning algorithms and technologies as fully managed services that any developer can access through an API call or a few clicks in the AWS Management Console. Amazon AI services make the full power of Amazon’s natural language understanding, speech recognition, text-to-speech, and image analysis technologies available at any scale, for any app, on any device, anywhere.
“The combination of better algorithms and broad access to massive amounts of data and cost-effective computing power provided by the cloud is making AI a reality for application developers. AWS is home to some of the most innovative and creative AI applications in use today,” said Raju Gulabani, VP, Databases, Analytics, and AI, AWS. “Thousands of machine learning and deep learning experts across Amazon have been developing AI technologies for years to predict what customers might like to read, to drive efficiencies in our fulfillment centers through robotics and computer vision technologies, and to give customers our AI-powered virtual assistant, Alexa. Now, we are making the technology underlying these innovations available to any developer in the form of three fully managed Amazon AI services that are easy to use, powerful, and cost effective. We are excited to see how customers use Amazon Lex, Amazon Polly, and Amazon Rekognition to build a new generation of apps that have human-like intelligence and can see, hear, speak, and interact with people and their environments.”
Intelligent conversations with Amazon Lex
Amazon Lex is a new service for building conversational interfaces using voice and text that is built on the same automatic speech recognition (ASR) technology and natural language understanding (NLU) that powers Amazon Alexa. Amazon Lex makes it easy to bring sophisticated, natural language capabilities to virtually any app. Developers can build and test bots (conversational apps that perform automated tasks like checking the weather or booking flights) directly from the AWS Management Console by typing in a few sample phrases (e.g., “find a flight,” or “book a flight”) along with instructions for getting the required parameters to complete task (e.g., travel date and destination) and the corresponding clarifying questions to ask the user (e.g., “when do you want to travel?” and “where do you want to go?”). Amazon Lex takes care of the rest, building the language model and asking the follow-up questions needed to complete the task. Because Amazon Lex is integrated with AWS Lambda, developers can configure Amazon Lex to invoke the appropriate backend service (e.g., the flight booking service) through an AWS Lambda function. Developers can also use pre-built enterprise connectors that execute AWS Lambda functions to answer questions like “what are my top 10 accounts in Salesforce.com,” by fetching data from enterprise systems like Salesforce, Microsoft Dynamics, Marketo, Zendesk, QuickBooks and HubSpot.
Bots built using Amazon Lex can be used anywhere: from web applications, to chat and messenger apps like Slack and Facebook Messenger, or through voice in apps on mobile or connected devices. Amazon Lex handles the authentication required by different platforms and simplifies the user interface design by not requiring developers to write custom code for each platform. Moreover, developers do not have to worry about scaling their infrastructure as Amazon Lex scales automatically as traffic to a bot increases, and developers pay only for the calls made to the Amazon Lex API.
Capital One offers a broad spectrum of financial products and services to consumers, small businesses, and commercial clients through a variety of channels. “As a heavy user of AWS, Amazon Lex’s seamless integration with other AWS services like AWS Lambda and Amazon DynamoDB is really appealing,” said Firoze Lafeer, Chief Technology Officer, Capital One Labs, Capital One. “A highly scalable solution, Amazon Lex also offers potential to speed time to market for a new generation of voice and text interactions, such as our recently launched Capital One skill for Alexa.”
OhioHealth is a nationally recognized healthcare organization with a network of 11+ hospitals in 47 counties. “We are excited about utilizing evolving speech recognition and natural language processing technology to enhance the lives of our customers. Amazon Lex represents a great opportunity for us to deliver a new experience to our patients,” said Michael Krouse, Senior Vice President Operational Support and Chief Information Officer, OhioHealth. “Everything we do at OhioHealth is ultimately about providing the right care to our patients at the right time and in the right place. Amazon Lex’s next generation technology and the innovative applications we are developing while using it will help provide an enhanced customer experience. We are just scratching the surface of what is possible.”
HubSpot is a marketing and sales software leader. “HubSpot’s GrowthBot is an all-in-one chatbot which helps marketers and sales people be more productive by providing access to relevant data and services using a conversational interface. With GrowthBot, marketers can get help creating content, researching competitors, and monitoring their analytics. Through Amazon Lex, we’re adding sophisticated natural language processing capabilities that helps GrowthBot provide a more intuitive UI for our users,” said Dharmesh Shah, Chief Technology Officer and Founder, HubSpot. “Amazon Lex lets us take advantage of advanced AI and machine learning without having to code the algorithms ourselves.”
Twilio helps businesses make communications relevant and contextual by making it possible to easily embed real-time communication and authentication capabilities directly into software applications. “Developers and businesses use Twilio to build apps that can communicate with customers in virtually every corner of the world,” said Benjamin Stein, Director of Messaging Products, Twilio. “Amazon Lex will provide developers with an easy-to-use modular architecture and comprehensive APIs to enable building and deploying conversational bots on mobile platforms. We look forward to seeing what our customers build using Twilio and Amazon Lex.”
Intelligent Speech with Amazon Polly
Amazon Polly makes it easy for developers to add natural-sounding speech capabilities to existing applications like newsreaders and e-learning platforms, or create entirely new categories of speech-enabled products – from mobile apps to devices and appliances. Amazon Polly is easy to use; developers can send text to Amazon Polly using the SDK or from within the AWS Management Console and Polly immediately returns an audio stream that can be played directly or stored in a standard audio file format. With 47 lifelike voices and support for 24 languages, developers can choose from both male and female voices with a variety of accents to make applications for users around the globe. And Amazon Polly’s fluid pronunciation of text content means applications deliver high-quality voice output across a wide variety of text formats. Amazon Polly is scalable, returning high-quality speech fast, even when converting large volumes of text to speech. With Amazon Polly, developers pay only for the text they convert, and they can cache generated speech and replay it as many times as they like with no restrictions.
The Washington Post is a Pulitzer Prize-winning media and technology company that publishes more than 1200 stories a day. “We’ve long been interested in providing audio versions of our stories, but have found that existing text-to-speech solutions are not cost-effective for the speech quality they offer,” said Joseph Price, Senior Product Manager, The Washington Post. “With the arrival of Amazon Polly and its high-quality voices, we look forward to offering readers more rich and versatile ways to experience our content.”
GoAnimate is a cloud-based, animated video creation platform, designed to allow business people with no background in animation to quickly and easily create animated videos. “Amazon Polly gives GoAnimate users the ability to immediately give voice to the characters they animate using our platform. This is especially helpful in scenarios where live voiceover is either resource or time prohibitive, such as when developing a video in many languages, or within pre-production to speed the approval process,” said Alvin Hung, CEO and Founder, GoAnimate. “The speech from Amazon Polly is integrated seamlessly with our rich set of pre-animated assets, which reinforces GoAnimate’s ease of use and affords our customers both efficiency and speed to market.”
Intelligent Image Analysis with Amazon Rekognition
Amazon Rekognition enables developers to quickly and easily build applications that analyze images, and recognize faces, objects, and scenes. Amazon Rekognition uses deep learning technologies to automatically identify objects and scenes, such as vehicles, pets, or furniture, and provides a confidence score that lets developers tag images so that application users can search for specific images using key words. Amazon Rekognition can locate faces within images and detect attributes, such as whether or not the face is smiling or the eyes are open. Amazon Rekognition also supports advanced facial analysis functionalities such as face comparison and facial search. Using Rekognition, developers can build an application that measures the likelihood that faces in two images are of the same person, thereby being able to verify a user against a reference photo in near real-time. Similarly, developers can create collections of millions of faces (detected in images) and can search for a face similar to their reference image in the collection. Amazon Rekognition removes the complexity and overhead required to develop and manage expensive image processing pipelines by making comprehensive image classification, detection, and management capabilities available in a simple, cost-effective, and reliable AWS service. There are no upfront costs for Amazon Rekognition, developers pay only for the images they analyze and the facial feature vectors they store.
Redfin is a full-service brokerage that uses modern technology to help people buy and sell houses. “Redfin users love to browse images of properties on our site and mobile apps, and we want to make it easier for our users to sift through hundreds of millions of listing and images,” says Yong Huang, Director of Big Data & Analytics, Redfin. “Amazon Rekognition generates a rich set of tags directly from images of properties. This makes it relatively simple to build a smart search feature that helps customers discover houses based on their specific needs, such as a fireplace, yard, or swimming pool. And since Rekognition accepts Amazon S3 URLs, it is a huge time-saver to detect objects, scenes, and faces without having to move images around.”
SmugMug is a safe and beautiful home for photos that stores billions of beautiful photos for millions of amazing customers every day. “SmugMug customers want to spend their time making more memories, not manually managing their photo collection,” said Don MacAskill, Co-Founder, Chief Executive Officer, and Chief Geek, SmugMug. “Amazon Rekognition will allow us to automatically identify the content in customers’ photos, unlocking a host of features that will allow them and their visitors to have more time to focus on enjoying life and celebrating their photos.”
Deep Learning and AI on AWS
Amazon Polly is available today in US East (N. Virginia), US East (Ohio), US West (Oregon), and EU (Dublin) Regions, and will expand to additional Regions in the coming months. Amazon Rekognition is available in US East (N. Virginia), US West (Oregon), and EU (Dublin) Regions, and will expand to additional Regions in the coming months. Customers can sign up for the Amazon Lex preview starting today.
In addition to these services, AWS recently announced it is investing significantly in MXNet, an open source distributed deep learning framework, initially developed by Carnegie Mellon University and other top universities, by contributing code and improving the developer experience. MXNet will enable machine learning scientists to build scalable deep learning models that can significantly reduce the training time for their applications. For more information on AWS support for MXNet, visit: http://www.allthingsdistributed.com/2016/11/mxnet-default-framework-deep-learning-aws.html.
AWS also makes it easy for developers to run their own deep learning and machine learning workloads to build their own AI platform on top of AWS. Amazon Elastic Compute Cloud (Amazon EC2), with its broad set of instance types and GPUs with large amounts of memory, is ideal for deep learning training. P2 instances, launched in September 2016, were designed for large-scale machine learning and deep learning with up to 8 NVIDIA Tesla K80 Accelerators, each running a pair of NVIDIDA GK210 GPUs that have 12 GiB of memory and 2,496 parallel processing cores. And, customers can make use of AWS’s Deep Learning AMI, which contains six pre-configured and pre-tested deep learning frameworks including all dependencies, Nvidia drivers, and data science tools like Jupyter and Anaconda. In addition, AWS CloudFormation templates are available for training deep neural networks at scale in just a few clicks.
Earth 2050: memory chips for kids, telepathy for adults
An astonishing set of predictions for the next 30 years includes a major challenge to the privacy of our thoughts.
Buy 2050, most kids may be fitted with the latest memory boosting implants, and adults will have replaced mobile devices with direct connectivity through brain implants, powered by thought.
These are some of the more dramatic forecasts in Earth 2050, an award-winning, interactive multimedia project that accumulates predictions about social and technological developments for the upcoming 30 years. The aim is to identify global challenges for humanity and possible ways of solving these challenges. The website was launched in 2017 to mark Kaspersky Lab’s 20th birthday. It comprises a rich variety of predictions and future scenarios, covering a wide range of topics.
Recently a number of new contributions have been added to the site. Among them Lord Martin Rees, the UK’s Astronomer Royal, Professor at Cambridge University and former President of the Royal Society; investor and entrepreneur Steven Hoffman, Peter Tatchell, human rights campaigner, along withDmitry Galov, security researcher and Alexey Malanov, malware analyst at Kaspersky Lab.
The new visions for 2050 consider, among other things:
- The replacement of mobile devices with direct connectivity through brain implants, powered by thought – able to upload skills and knowledge in return – and the impact of this on individual consciousness and privacy of thought.
- The ability to transform all life at the genetic level through gene editing.
- The potential impact of mistakes made by advanced machine-learning systems/AI.
- The demise of current political systems and the rise of ‘citizen governments’, where ordinary people are co-opted to approve legislation.
- The end of the techno-industrial age as the world runs out of fossil fuels, leading to economic and environmental devastation.
- The end of industrial-scale meat production, as most people become vegan and meat is cultured from biopsies taken from living, outdoor reared livestock.
The hypothetical prediction for 2050 from Dmitry Galov, security researcher at Kaspersky Lab is as follows: “By 2050, our knowledge of how the brain works, and our ability to enhance or repair it is so advanced that being able to remember everything and learn new things at an outrageous speed has become commonplace. Most kids are fitted with the latest memory boosting implants to support their learning and this makes education easier than it has ever been.
“Brain damage as a result of head injury is easily repaired; memory loss is no longer a medical condition, and people suffering from mental illnesses, such as depression, are quickly cured. The technologies that underpin this have existed in some form since the late 2010s. Memory implants are in fact a natural progression from the connected deep brain stimulation implants of 2018.
“But every technology has another side – a dark side. In 2050, the medical, social and economic impact of memory boosting implants are significant, but they are also vulnerable to exploitation and cyber-abuse. New threats that have appeared in the last decade include the mass manipulation of groups through implanted or erased memories of political events or conflicts, and even the creation of ‘human botnets’.
“These botnets connect people’s brains into a network of agents controlled and operated by cybercriminals, without the knowledge of the victims themselves. Repurposed cyberthreats from previous decades are targeting the memories of world leaders for cyber-espionage, as well as those of celebrities, ordinary people and businesses with the aim of memory theft, deletion of or ‘locking’ of memories (for example, in return for a ransom).
“This landscape is only possible because, in the late 2010s when the technologies began to evolve, the potential future security vulnerabilities were not considered a priority, and the various players: healthcare, security, policy makers and more, didn’t come together to understand and address future risks.”
For more information and the full suite of inspirational and thought-provoking predictions, visit Earth 2050.
Pizoelectrics: Healthcare’s new gymnasts of gadgetry
Healthcare electronics is rapidly deploying for wellness, electroceuticals, and intrusive medical procedures, among other, powered by new technologies. Much of it is trending to diagnostics and treatment on the move, and removing the need for the patient to perform procedures on time.
Instruments become wearables, including electronic skin patches and implants. The IDTechEx Research report, “Piezoelectric Harvesting and Sensing for Healthcare 2019-2029”, notes that sensors should preferably be self-powered, non-poisonous even on disposal, and many need to be biocompatible and even biodegradable.
We need to detect biology, vibration, force, acceleration, stress and linear movement and do imaging. Devices must reject bacteria and be useful in wearables and Internet of Things nodes. Preferably we must move to one device performing multiple tasks.
So is there a gymnast material category that has that awesome versatility?
Piezoelectrics has a good claim. It measures all those parameters. That even includes biosensors where the piezo senses the swelling of a biomolecule recognizing a target analyte. The most important form of self-powered (one material, two functions) piezo sensing is ultrasound imaging, a market growing at 5.1% yearly.
The IDTechEx Research report looks at what comes next, based on global travel and interviewing by its PhD level analysts in 2018 with continuous updates.
Click here to read how Piezo has been reinvented.