The engine behind Amazon Alexa is one of the machine learning technologies powering a new suite of artificial intelligence tools announced by AWS this week.
At the AWS re:Invent conference in Las Vegas this week, Amazon Web Services announced three Artificial Intelligence (AI) services that make it easy for developers to build apps that can understand natural language, turn text into lifelike speech, have conversations using voice or text, analyze images, and recognise faces, objects, and scenes.
Amazon Lex, Amazon Polly, and Amazon Rekognition are based on the same highly scalable Amazon technology built by the thousands of deep learning and machine learning experts across the company. AWS says that Amazon AI services all provide high-quality, high-accuracy AI capabilities that are scalable and cost-effective. Amazon AI services are fully managed services, so there are no deep learning algorithms to build, no machine learning models to train, and no up-front commitments or infrastructure investments required. This promises to free developers to focus on defining and building a new generation of apps that can see, hear, speak, understand, and interact with the world around them.
Amazon Web Services provided the following information:
Until now, very few developers have been able to build, deploy, and broadly scale apps with AI capabilities because doing so required access to vast amounts of data, and specialized expertise in machine learning and neural networks. Effectively applying AI involves extensive manual effort to develop and tune many different types of machine learning and deep learning algorithms (e.g. automatic speech recognition, natural language understanding, image classification), collect and clean the training data, and train and tune the machine learning models. And this process must be repeated for every object, face, voice, and language feature in an application. Amazon AI services eliminate all of this heavy lifting, making AI broadly accessible to all app developers by offering Amazon’s powerful and proven deep learning algorithms and technologies as fully managed services that any developer can access through an API call or a few clicks in the AWS Management Console. Amazon AI services make the full power of Amazon’s natural language understanding, speech recognition, text-to-speech, and image analysis technologies available at any scale, for any app, on any device, anywhere.
“The combination of better algorithms and broad access to massive amounts of data and cost-effective computing power provided by the cloud is making AI a reality for application developers. AWS is home to some of the most innovative and creative AI applications in use today,” said Raju Gulabani, VP, Databases, Analytics, and AI, AWS. “Thousands of machine learning and deep learning experts across Amazon have been developing AI technologies for years to predict what customers might like to read, to drive efficiencies in our fulfillment centers through robotics and computer vision technologies, and to give customers our AI-powered virtual assistant, Alexa. Now, we are making the technology underlying these innovations available to any developer in the form of three fully managed Amazon AI services that are easy to use, powerful, and cost effective. We are excited to see how customers use Amazon Lex, Amazon Polly, and Amazon Rekognition to build a new generation of apps that have human-like intelligence and can see, hear, speak, and interact with people and their environments.”
Intelligent conversations with Amazon Lex
Amazon Lex is a new service for building conversational interfaces using voice and text that is built on the same automatic speech recognition (ASR) technology and natural language understanding (NLU) that powers Amazon Alexa. Amazon Lex makes it easy to bring sophisticated, natural language capabilities to virtually any app. Developers can build and test bots (conversational apps that perform automated tasks like checking the weather or booking flights) directly from the AWS Management Console by typing in a few sample phrases (e.g., “find a flight,” or “book a flight”) along with instructions for getting the required parameters to complete task (e.g., travel date and destination) and the corresponding clarifying questions to ask the user (e.g., “when do you want to travel?” and “where do you want to go?”). Amazon Lex takes care of the rest, building the language model and asking the follow-up questions needed to complete the task. Because Amazon Lex is integrated with AWS Lambda, developers can configure Amazon Lex to invoke the appropriate backend service (e.g., the flight booking service) through an AWS Lambda function. Developers can also use pre-built enterprise connectors that execute AWS Lambda functions to answer questions like “what are my top 10 accounts in Salesforce.com,” by fetching data from enterprise systems like Salesforce, Microsoft Dynamics, Marketo, Zendesk, QuickBooks and HubSpot.
Bots built using Amazon Lex can be used anywhere: from web applications, to chat and messenger apps like Slack and Facebook Messenger, or through voice in apps on mobile or connected devices. Amazon Lex handles the authentication required by different platforms and simplifies the user interface design by not requiring developers to write custom code for each platform. Moreover, developers do not have to worry about scaling their infrastructure as Amazon Lex scales automatically as traffic to a bot increases, and developers pay only for the calls made to the Amazon Lex API.
Capital One offers a broad spectrum of financial products and services to consumers, small businesses, and commercial clients through a variety of channels. “As a heavy user of AWS, Amazon Lex’s seamless integration with other AWS services like AWS Lambda and Amazon DynamoDB is really appealing,” said Firoze Lafeer, Chief Technology Officer, Capital One Labs, Capital One. “A highly scalable solution, Amazon Lex also offers potential to speed time to market for a new generation of voice and text interactions, such as our recently launched Capital One skill for Alexa.”
OhioHealth is a nationally recognized healthcare organization with a network of 11+ hospitals in 47 counties. “We are excited about utilizing evolving speech recognition and natural language processing technology to enhance the lives of our customers. Amazon Lex represents a great opportunity for us to deliver a new experience to our patients,” said Michael Krouse, Senior Vice President Operational Support and Chief Information Officer, OhioHealth. “Everything we do at OhioHealth is ultimately about providing the right care to our patients at the right time and in the right place. Amazon Lex’s next generation technology and the innovative applications we are developing while using it will help provide an enhanced customer experience. We are just scratching the surface of what is possible.”
HubSpot is a marketing and sales software leader. “HubSpot’s GrowthBot is an all-in-one chatbot which helps marketers and sales people be more productive by providing access to relevant data and services using a conversational interface. With GrowthBot, marketers can get help creating content, researching competitors, and monitoring their analytics. Through Amazon Lex, we’re adding sophisticated natural language processing capabilities that helps GrowthBot provide a more intuitive UI for our users,” said Dharmesh Shah, Chief Technology Officer and Founder, HubSpot. “Amazon Lex lets us take advantage of advanced AI and machine learning without having to code the algorithms ourselves.”
Twilio helps businesses make communications relevant and contextual by making it possible to easily embed real-time communication and authentication capabilities directly into software applications. “Developers and businesses use Twilio to build apps that can communicate with customers in virtually every corner of the world,” said Benjamin Stein, Director of Messaging Products, Twilio. “Amazon Lex will provide developers with an easy-to-use modular architecture and comprehensive APIs to enable building and deploying conversational bots on mobile platforms. We look forward to seeing what our customers build using Twilio and Amazon Lex.”
Intelligent Speech with Amazon Polly
Amazon Polly makes it easy for developers to add natural-sounding speech capabilities to existing applications like newsreaders and e-learning platforms, or create entirely new categories of speech-enabled products – from mobile apps to devices and appliances. Amazon Polly is easy to use; developers can send text to Amazon Polly using the SDK or from within the AWS Management Console and Polly immediately returns an audio stream that can be played directly or stored in a standard audio file format. With 47 lifelike voices and support for 24 languages, developers can choose from both male and female voices with a variety of accents to make applications for users around the globe. And Amazon Polly’s fluid pronunciation of text content means applications deliver high-quality voice output across a wide variety of text formats. Amazon Polly is scalable, returning high-quality speech fast, even when converting large volumes of text to speech. With Amazon Polly, developers pay only for the text they convert, and they can cache generated speech and replay it as many times as they like with no restrictions.
The Washington Post is a Pulitzer Prize-winning media and technology company that publishes more than 1200 stories a day. “We’ve long been interested in providing audio versions of our stories, but have found that existing text-to-speech solutions are not cost-effective for the speech quality they offer,” said Joseph Price, Senior Product Manager, The Washington Post. “With the arrival of Amazon Polly and its high-quality voices, we look forward to offering readers more rich and versatile ways to experience our content.”
GoAnimate is a cloud-based, animated video creation platform, designed to allow business people with no background in animation to quickly and easily create animated videos. “Amazon Polly gives GoAnimate users the ability to immediately give voice to the characters they animate using our platform. This is especially helpful in scenarios where live voiceover is either resource or time prohibitive, such as when developing a video in many languages, or within pre-production to speed the approval process,” said Alvin Hung, CEO and Founder, GoAnimate. “The speech from Amazon Polly is integrated seamlessly with our rich set of pre-animated assets, which reinforces GoAnimate’s ease of use and affords our customers both efficiency and speed to market.”
Intelligent Image Analysis with Amazon Rekognition
Amazon Rekognition enables developers to quickly and easily build applications that analyze images, and recognize faces, objects, and scenes. Amazon Rekognition uses deep learning technologies to automatically identify objects and scenes, such as vehicles, pets, or furniture, and provides a confidence score that lets developers tag images so that application users can search for specific images using key words. Amazon Rekognition can locate faces within images and detect attributes, such as whether or not the face is smiling or the eyes are open. Amazon Rekognition also supports advanced facial analysis functionalities such as face comparison and facial search. Using Rekognition, developers can build an application that measures the likelihood that faces in two images are of the same person, thereby being able to verify a user against a reference photo in near real-time. Similarly, developers can create collections of millions of faces (detected in images) and can search for a face similar to their reference image in the collection. Amazon Rekognition removes the complexity and overhead required to develop and manage expensive image processing pipelines by making comprehensive image classification, detection, and management capabilities available in a simple, cost-effective, and reliable AWS service. There are no upfront costs for Amazon Rekognition, developers pay only for the images they analyze and the facial feature vectors they store.
Redfin is a full-service brokerage that uses modern technology to help people buy and sell houses. “Redfin users love to browse images of properties on our site and mobile apps, and we want to make it easier for our users to sift through hundreds of millions of listing and images,” says Yong Huang, Director of Big Data & Analytics, Redfin. “Amazon Rekognition generates a rich set of tags directly from images of properties. This makes it relatively simple to build a smart search feature that helps customers discover houses based on their specific needs, such as a fireplace, yard, or swimming pool. And since Rekognition accepts Amazon S3 URLs, it is a huge time-saver to detect objects, scenes, and faces without having to move images around.”
SmugMug is a safe and beautiful home for photos that stores billions of beautiful photos for millions of amazing customers every day. “SmugMug customers want to spend their time making more memories, not manually managing their photo collection,” said Don MacAskill, Co-Founder, Chief Executive Officer, and Chief Geek, SmugMug. “Amazon Rekognition will allow us to automatically identify the content in customers’ photos, unlocking a host of features that will allow them and their visitors to have more time to focus on enjoying life and celebrating their photos.”
Deep Learning and AI on AWS
Amazon Polly is available today in US East (N. Virginia), US East (Ohio), US West (Oregon), and EU (Dublin) Regions, and will expand to additional Regions in the coming months. Amazon Rekognition is available in US East (N. Virginia), US West (Oregon), and EU (Dublin) Regions, and will expand to additional Regions in the coming months. Customers can sign up for the Amazon Lex preview starting today.
In addition to these services, AWS recently announced it is investing significantly in MXNet, an open source distributed deep learning framework, initially developed by Carnegie Mellon University and other top universities, by contributing code and improving the developer experience. MXNet will enable machine learning scientists to build scalable deep learning models that can significantly reduce the training time for their applications. For more information on AWS support for MXNet, visit: http://www.allthingsdistributed.com/2016/11/mxnet-default-framework-deep-learning-aws.html.
AWS also makes it easy for developers to run their own deep learning and machine learning workloads to build their own AI platform on top of AWS. Amazon Elastic Compute Cloud (Amazon EC2), with its broad set of instance types and GPUs with large amounts of memory, is ideal for deep learning training. P2 instances, launched in September 2016, were designed for large-scale machine learning and deep learning with up to 8 NVIDIA Tesla K80 Accelerators, each running a pair of NVIDIDA GK210 GPUs that have 12 GiB of memory and 2,496 parallel processing cores. And, customers can make use of AWS’s Deep Learning AMI, which contains six pre-configured and pre-tested deep learning frameworks including all dependencies, Nvidia drivers, and data science tools like Jupyter and Anaconda. In addition, AWS CloudFormation templates are available for training deep neural networks at scale in just a few clicks.
3D printed room-service? Visit the hotel of tomorrow
To mark its 100th birthday, Hilton predicts the trends that will change travel and hospitality in the next 100 years.
Intergalactic getaways, fast-food nutrient pills, 2-3 hour working days and adaptable, personalised rooms that can transport guests everywhere from jungles to mountain ranges. These are some of the predictions for the next 100 years that the Hilton hotel group has put together in celebration of its 100th anniversary.
In a report supported by expert insight from the fields of sustainability, innovation, design, human relations and nutrition, findings reveal the impact of the growing sophistication of technology and climate change on the hotel industry in the future.
Key predictions for the hotel of the future include:
Personalisation is King
- Technology will allow every space, fitting and furnishing to continuously update to respond to an individual’s real-time needs – the Lobby will conjure up anything from a tranquil spa to a buzzy bar, giving every guest the perfect, personal welcome
- From temperature and lighting, to entertainment and beyond, microchips under the skin will enable us to wirelessly control the setting around us based on what we need, whenever we need it
The Human Touch
- In a world filled with Artificial Intelligence, human contact and the personal touch will be more critical and sought after than ever
- Technology will free up time for hotel staff to focus on what matters most: helping guests to connect with one another and building memorable moments
‘Sustainable Everything’ – The Role of Responsibility
- Only businesses that are inherently responsible will survive the next century
- Sustainability will be baked into everything about a hotel’s design – from weather-proofed domes, to buildings made from ocean-dredged plastic
- Hotels will act as the Town Hall of any community, managing local resources and contributing to the areas they serve with community-tended insect farms and vertical hydroponic crop gardens
Menu Surprises and Personalisation
- Our diets will include more plant-based recipes and some surprising sources of protein – Beetle Bolognese, Plankton Pies and Seaweed Green Velvet Cake will be menu staples!
- Decadent 3D-printed dinners and room service will provide unrivalled plate personalisation
- Chefs will be provided with biometric data for each guest, automatically creating meals based on preferences and nutritional requirements
Futuristic Fitness and Digital Detoxes
- Outswim a virtual sea turtle in the pool, or challenge yourself to climb the digital face of Mount Everest, your exercise routine will be as unique as you are. What’s more, exercise energy generated from workouts will be used to power the hotel, providing a zero-impact, circular system. Guests could even earn rewards based on reaching workout targets
- Pick up where you left off with trackable workouts and holographic personal trainers
- Offline will be the new luxury as we seek to find moments of tech-free time
“Since its inception in 1919, Hilton has pioneered the hospitality industry, introducing first-to-market concepts such as air-conditioning and in-room televisions. Last year, Hilton also became the first hospitality company to set science-based targets to reduce its environmental impact,” said Simon Vincent, EVP & President, EMEA, Hilton. “We enter our second century with the same commitment to innovation, harnessing the power of our people and technology to respond to guest demands. Our research paints an exciting future for the hospitality industry, highlighting the growing importance of human interaction in an increasingly tech-centric world.”
Futurologist Gerd Leonhard said: “In 2119 we will still be searching for unique experiences, but they will be more personalised than ever. As technology shapes our lives we will seek out moments of offline connection with others, including hotel team members who will help us truly get what we need from our stays. 100 years from now hotels will have to create opportunities to converse, collaborate and connect, delivering moments that matter, individually, to each and every guest.”
Gadget ed to chair Digital Council
Specialist financial services provider Sasfin Bank has established a Digital Advisory Council to provide the market with industry-leading expertise and insights on trends shaping the use of technology in financial services.
Digitalisation is one of the most powerful forces for change shaping Finance today. This has turned Fintech into one of the most vibrant sectors in both information technology and among start-ups, generating billions of dollars in investment and development globally. The South African fintech space is dynamic, and Sasfin is playing a leading role in the transformation of local financial services and the resulting enhancement of customer experiences.
“We have been investing in fintech development in-house and acquiring or integrating fintech start-ups,” says Sasfin CEO Michael Sassoon. “Over the last year we have built further digital offerings, integrated via APIs into leading businesses and invested in fintechs. We built and launched B\\YOND, an innovative digital business banking platform and SWIP, a digital wealth and investing platform. We have invested in Payabill, an online SME lender and DMA, a digital trading platform. We recently announced our alliance banking relationship, leveraging open banking, with Hello Paisa to offer seamless banking to the unbanked. We feel that there is a huge opportunity to improve the experience of South African businesses and savers through using technology. We have therefore created an independent forum to assess how to even better improve financial services for South Africans by leveraging the digital economy.”
Arthur Goldstuck, founder of high-tech research consultancy World Wide Worx, editor-in-chief of Gadget, and a globally respected technology analyst has accepted Sasfin’s invitation to head up the Sasfin Digital Advisory Council, an independent think tank that will help Sasfin and its clients decipher the fintech present and future.
“The Sasfin Digital Advisory Council is broader than providing only the bank with a source of insight on how digital services are evolving and lessons from across the world,” said CEO Michael Sassoon. “Sasfin has been involved in fintech investing for many years and we are leveraging this experience as well as the experience of independent experts such as Arthur to provide insights and guidance to interested stakeholders in this space.”
The team appointed to the Digital Advisory Council is being selected for the breadth and range of knowledge they would bring to the table, with further appointments to the Council being announced soon. There will also be room for the Council to co-opt specialist expertise as it is required.
Goldstuck, who has been covering the fintech sector as an analyst, commentator and columnist for many years, says he sees the role as a welcome challenge.
“There has been a long-standing need for a clear understanding of the impact being made by fintech today, and the exponential change it will cause tomorrow,” said Goldstuck. “My role will be, partly, to curate the wide spectrum of fintech and digitalisation knowledge and insights that the members will bring to the Digital Advisory Council, and help create scenarios that businesses and policymakers may use to navigate the future – both inside and outside Sasfin.”