Email Login
News | Research | DeepLearning | Seminar | Q&A

Nvidia wants AI to Get Out of the Cloud and Into a Camera, Drone, or Other Gadget Near You

By Tekla S. Perry

Posted 8 Mar 2017 | 20:00 GMT


Teal's smart drone uses the Nvidia Jetson module to identify what its cameras see, attaching labels in real time to, in this demo, peoplePhoto: Tekla PerryTeal's drone uses the Nvidia Jetson module to identify what its cameras see

People are just now getting comfortable with the idea that data from many electronic gadgets they use flies up to the cloud. But going forward, much of that data will stick closer to Earth, processed in hardware that lives at the so-called edge—for example, inside security cameras or drones.

That’s why Nvidia, the processor company whose graphics processing units (GPUs) are powering much of the boom in deep learning, is now focused on the edge. Deepu Talla, vice president and general manager of the company’s Tegra business unit, says bringing AI technology to the edge will make a new class of intelligent machines possible. “These devices will enable intelligent video analytics that keep our cities smarter and safer, new kinds of robots that optimize manufacturing, and new collaboration that makes long-distance work more efficient,” he said in a statement.


Nvidia's Deepu Tallu shows off the company's new Jetson TX2 AI computing platformPhoto: Tekla PerryNvidia’s Deepu Talla with the Jetson TX2

Why the move to the edge? At a press event held Tuesday in San Francisco, Talla gave four main reasons: bandwidth, latency, privacy, and availability. Bandwidth is becoming an issue for cloud processing, he indicated, particularly for video, because cameras in video applications such as public safety are moving to 4K resolution and increasing in numbers. “By 2020, there will be 1 billion cameras in the world doing public safety and streaming data,” he said. “There’s not enough upstream bandwidth available to send all this to the cloud.” So, processing at the edge will be an absolute necessity.


Latency, he said, becomes an issue in robotics and self-driving cars, applications in which decisions have to be made with lightning speed. Privacy, of course, is easier to protect when data isn’t moving around. And availability of the cloud, Talla pointed out, is an issue in many parts of the world where communications are limited.


“We will see AI transferring to the edge,” he said, with future intelligent applications using a combination of edge and cloud processing.


Nvidia, of course, wasn’t painting this glowing picture of edge computing without some self-interest. At the event, the company announced its new edge-processing platform, the Nvidia Jetson TX2. This credit card–size module is a plug-in replacement for the company’s Jetson TX1, designed for embedded computing. Depending on how it is applied, it can either run at twice the speed of its predecessor or use half the power. Detailed specs are here. The developer kit costs $600, $300 for educators; the production version will sell for $400.


Developers, showing off their work at the launch event, were happy to point out how they are using or intend to use internal AI processing at the edge. A few examples:


  • Cisco demonstrated a new collaboration device that will work with its Spark Board system and use AI to recognize people in the room, automatically select a field of view that emphasizes participants instead of empty chairs and adjust in response to people coming and going, and zoom in on people speaking.
  • Artec, a company with impressive 3D scanning technology that I’ve previously covered, showed a new scanner in development that extracts geometry and color information and stitches together a 3D file in real time; its previous scanners needed to be connected to a computer.
  • Teal Drones showed off a $1300 smart drone, shipping in three months, that can understand and react to what its cameras are seeing. Bob Miles, product and project manager, says putting AI on board will distinguish his drone from competitors. “My father, a farmer in Australia, spends about a third of his time counting cattle,” Miles told me. He thinks a smart drone could do that for him. He also imagines some fun apps—like playing hide and seek with your drone—as well as some more serious ones, like distinguishing aggressors from non-aggressors for law enforcement purposes.
  • EnRoute, another drone company, uses AI onboard to navigate and avoid objects. Moving to the Jetson TX2 from the current TX1, said Nvidia’s Barrett Williams, will enable the Zion drone to fly faster and still avoid objects.
  • Live Planet introduced a $10,000 4K 360-degree 3-D camera for live streaming of video; it uses AI to encode the 3D video in real time. “The camera produces a stream of 65 gigabytes,” chief strategy officer Khayyam Wakil said, far too much data to transmit to a cloud server. “We couldn’t do this product before Jetson,” he said.
번호 제목 글쓴이 날짜 조회 수
공지 2019 IVPL 송년회 [1] yjchoi 2019.12.20 348
공지 [한국과총]글로벌 현장연수 참가자 모집 GreatMind 2018.04.04 371
공지 Inform Your Students: Global Student Challenge. Over US$2,000 in Prizes! GreatMind 2017.01.12 4434
공지 nVidia Parallel Computing Software Engineer 채용 GreatMind 2016.11.16 798
69 Reuters Top 75 : Asia’s Most Innovative Universities ...!!!! GreatMind 2017.06.08 86
68 [Notice] Mr. Avishek's paper has been accepted for publication in Personal and Ubiquitous Computing (Springer)....! GreatMind 2017.06.26 110
67 [Notice] MR. Lee's paper has been accepted for publication in Mobile Networks and Applications (ACM/Springer)...!! GreatMind 2017.06.27 77
66 [Notice] Ms. Choi's paper has been accepted in Journal of Multimedia and Information System...!!! GreatMind 2017.06.27 78
65 JCR 2016 Update...!!! GreatMind 2017.06.27 106
64 [Notice] Dr. Tae-Jung Kim's paper has been accepted for publication in Personal and Ubiquitous Computing (Springer)...!!! GreatMind 2017.07.06 78
63 [Notice] Mr. Hong's paper has been accepted in Displays Journal (Elsevier)....!!!! GreatMind 2017.07.13 69
62 AI Creates Fake Obama...! GreatMind 2017.07.14 270
61 Facebook, Microsoft, and IBM Leaders on Challenges for AI and Their AI Partnership..! GreatMind 2017.07.14 108
60 Smart glasses let you turn off the lights in the blink of an eye GreatMind 2017.08.01 343
59 2017년 실리콘밸리 인턴십 운영지원사업 참여학생 선발 공고 GreatMind 2017.09.05 282
58 [Notice] Mr. Young-Woon Lee's paper has been accepted for presentation in IEEE ICCE 2018..!!! GreatMind 2017.09.06 22
57 [Notice] Mr. Lee Jong-Hyeok has been nominated in Marquis Who's Who in the World ...!! GreatMind 2017.09.07 1115
56 [Notice] Mr. Lee Jong-Hyeok of our group, his biography has been listed (accepted) on Who's Who in the World 2018....!!! GreatMind 2017.09.08 348
55 [Notice] Mr. Young-Woon Lee and Ms. Young-Ju Choi's paper has been accepted for publication in Journal of Digital Contents Society..!!!! GreatMind 2017.10.10 56
54 NVIDIA Jetson Developer Contest...!!! GreatMind 2017.10.24 62
53 Carnegie Mellon Solves 12-Year-Old DARPA Grand Challenge Mystery..!!! GreatMind 2017.10.26 1123
52 [Notice] Young-Ju Choi, Ji-Hae Kim's paper has been accepted for publication in Journal of Digital Contents Society..!!!! GreatMind 2017.11.21 71
51 [Notice] 캡스톤디자인팀 똑띠 학부우수 논문상 수상 (DdokDdi has won the Outstanding Paper Award in KMMS Autumn conference)...!!!! file GreatMind 2017.11.29 219
50 JPL's AI-Powered Racing Drone Challenges Pro Human Pilot GreatMind 2017.12.20 751