深度学习：从神经网络到模型部署.pdf

Service & Sharewww.cecport.comService & Share深度学习 从神经⽹络到模型部署Service & Sharewww.cecport.com 中电港是⾏业领先的元器件应⽤创新与现代供应链综合服务平台，依托三⼗余年产业上下游资源积累、技术沉淀、应⽤创新，已发展成为涵盖元器件分销、设计链服务、供应链协同配套和产业数据服务的综合服务提供商。 中电港秉持“为客户服务，与伙伴共享”的经营理念，在履⾏社会责任的同时，努⼒打造元器件供应链⽣态圈，助⼒中国电⼦信息产业发展。营业收入（亿元）20172018201920202021385260172143130Service & Sharewww.cecport.com⼀、市场分析备注：（1）Ampere架构是当前最新⼀代的GPU架构（2）仅代理PCIe接⼝的A100/V100，不包含SXM(For NVLINK) 服务器端：Tesla Series—⾯向云与数据中⼼解决⽅案的GPUService & Sharewww.cecport.com⼀、市场分析⼀、市场分析边缘/设备端：Jetson Series—⾯向⾃主机器与边缘计算的嵌入式模组Service & Sharewww.cecport.comCONTENTS111222333www.cecport.com深度学习介绍1.神经元2.构建⽹络3.激励函数模型部署 1.数据增强 2.模型部署⾃然语⾔处理⼯业检测Service & Sharewww.cecport.com定义⼀组 分类规则1将这些规则编入计算机2向其提供示例，以便程序使⽤规则进⾏分类3传统编程Service & Sharewww.cecport.com机器学习向模型展示示例 以及有关如何 分类的答案1模型进⾏猜测， ⽽我们会告诉它 正确与否2训练过程中， 模型学习如何正确进⾏分类。模型 ⾃主学习规则3Service & Sharewww.cecport.com单⼀神经元神经元是⼀个数学函数，并以⼀定量的数值作为输入.如何构建神经⽹络呢？Service & Sharewww.cecport.com构建神经⽹络扩充到更多的输入^𝑦w2w1^𝑦w4w3Service & Sharewww.cecport.com机器学习扩充到更多的输入能够串联神经元^𝑦w6w5w1w2x1x2w3w4Service & Sharewww.cecport.com神经⽹络扩充到更多的输入能够串联神经元如果所有回归均为线性 回归，输出也将为线性 回归Service & Sharewww.cecport.com激励函数^𝑦w1X2X1X4X3∑w2w3w4F(z)Service & Sharewww.cecport.com激励函数LinearReLUSigmoidService & Sharewww.cecport.com数据准备[0,0,0,21,23,14,6,165,0,1,2,64,34,0,0,…][0,4,0,98,3,4,9,15,21,77,22,90,22,0,1,…][0,0,0,55,33,44,1,115,2,0,2,71,11,0,0,…][0,1,0,11,93,4,71,205,2,7,2,18,18,0,0,…][0,0,0,21,23,14,0,175,3,13,23,4,3,0,0,…][0,4,0,68,3,4,9,19,61,77,22,90,22,0,1,…][0,0,0,51,32,43,12,65,2,0,2,71,11,0,0,…][0,1,0,19,90,4,62,205,2,7,2,18,18,0,0,…]Service & Sharewww.cecport.com数据增强Service & Sharewww.cecport.com数据增强Service & Sharewww.cecport.com数据增强Service & Sharewww.cecport.com模型部署(28, 28,1) 图像输入(3, 3, 1, 2) 内核(28, 28, 2) 堆叠图像(3, 3, 2, 2) 内核(28, 28, 2) 堆叠图像(1568) 展平后的图像 向量… …… …(24) 输出预测(512) 密集(512) 密集Service & Sharewww.cecport.com模型部署训练批量 输入卷积…最⼤池化Service & Sharewww.cecport.com模型部署CATService & Sharewww.cecport.com⾃然语⾔处理字典1.A2.And3.Are4.Bee5.Dog6.Ground7.High8.Is9.On10. The“The dog is on the ground.”[10,5,8,9,10,6]Service & Sharewww.cecport.com⾃然语⾔处理字典1.A2.And3.Are4.Bee5.Dog6.Ground7.High8.Is9.On10. TheTheDogService & Sharewww.cecport.com⾃然语⾔处理更⼤的字典1.A2.And3.Are4.Bee5.Dog6.Ground7.High8.Is9.On10.TheA11.And12.Are13.Bee14.Dog15.Ground16.High17.Is18.On19.TheA20.And21.Are22.Bee23.Dog24.Ground25.High26.Is27.On28.TheA29.And30.Are31.Bee32.Dog33.Ground34.High35.Is36.On37.The1.A2.And3.Are4.Bee5.Dog6.Ground7.High8.Is9.On10.TheA11.And12.Are13.Bee14.Dog15.Ground16.High17.Is18.On19.TheA20.And21.Are22.Bee23.Dog24.Ground25.High26.Is27.On28.TheA29.And30.Are31.Bee32.Dog33.Ground34.High35.Is36.On37.The1.A2.And3.Are4.Bee5.Dog6.Ground7.High8.Is9.On10.TheA11.And12.Are13.Bee14.Dog15.Ground16.High17.Is18.On19.TheA20.And21.Are22.Bee23.Dog24.Ground25.High26.Is27.On28.TheA29.And30.Are31.Bee32.Dog33.Ground34.High35.Is36.On37.The1.A2.And3.Are4.Bee5.Dog6.Ground7.High8.Is9.On10.TheA11.And12.Are13.Bee14.Dog15.Ground16.High17.Is18.On19.TheA20.And21.Are22.Bee23.Dog24.Ground25.High26.Is27.On28.TheA29.And30.Are31.Bee32.Dog33.Ground34.High35.Is36.On37.The驯养野⽣⼤型⼩型⼩猫 (-.75, -.8)美洲驼 (-.9, .1)隼 (.15, -.4)海鹦 (.85, -.65)⻓颈鹿 (.9, .9)Service & Sharewww.cecport.com⼯业检测AI with AOITraditionalService & Sharewww.cecport.com⼯业检测CaptureGet imageAOI Check / CaptureVerify by OPNGOKOKNGStore all imageRepairOKNG10~70%Training data for DLService & Sharewww.cecport.com⼯业检测AOI Check / CaptureVerify by OPNGOKOKNGStore all imageRepairOKNG10~70%Training data for DLAOI 机器采⽤传统的 CV 算法 误报率可能⾼达 70％ 需要频繁且昂贵的⼿动算法调整 容易上当（当具有⾼差异组件时）Service & Sharewww.cecport.comTAO - 迁移学习⼯具包Service & Sharewww.cecport.com⼀、市场分析⼀、市场分析型号A100A30A40A10A16A2技术架构AmpereAmpereAmpereAmpereAmpereAmpere算⼒(FP32)19.5 TFLOPS10.3TF37.4TF31.2TF4x4.5TF4.5TF算⼒(INT8)624 TOPS | 1248 TOPS1330 TOPS | 661 TOPS1299.3TOPS | 598.6TOPS1250 TOPS | 500 TOPS*4x35.9 TOPS | 4x71.8 TOPS¹36 TOPS | 72 TOPS¹MIG⽀持YesYesNoNoNoNoRTX⽀持NoNoYesYesYesYesvGPU⽀持vCSvCSvPC、vAppsvWS、vCSvPC、vAppsvWS、vCSvPC、vAppsvWS、vCSvPC、vAppsvWS、vCS显存(GB)80 GB24 GB48 GB24 GB4*16 GB16GB显存带宽(GB/s)1935 GB/s933 GB/s696 GB/s600GB/s4 *200 GB/s200GB/s最⼤功耗(W)300 W165 W300 W150W250 W40-60WNVIDIA产品线推⼴物料：Tesla Series GPUService & Sharewww.cecport.comWin-WinTHANKS