MindSpore-tsc

mindspore-tsc@mindspore.cn

August 2020

2 participants
2 discussions

MindSpore TSC Monthly Meeting Aug 20, 2020
by Zhipeng Huang 19 Aug '20

19 Aug '20

Dear TSC Members, This is a kind reminder for our monthly meeting tomorrow. Besides the usual items on community progress, we will introduce 2 new SIGs and 2 new WGs :) Respectively: *SIG-MSLITE* for mobile and IoT support *SIG-DPP* for deep probabilistic programming support *WG-MM* for community collaboration on deep learning support in Molecular Modeling *WG-Research* for community collaboration on several research topics For the US-Asia timezone friendly meeting, please join https://zoom.us/j/98865564258 <https://www.google.com/url?q=https://zoom.us/j/98865564258&sa=D&source=cale…> and for EU-Asia timezone friendly meeting, please join https://zoom.us/j/99378539769 <https://www.google.com/url?q=https://zoom.us/j/99378539769&sa=D&source=cale…>. The calendar invitation has been updated as well. -- Zhipeng (Howard) Huang Principle Engineer OpenStack, Kubernetes, CNCF, LF Edge, ONNX, Kubeflow, OpenSDS, Open Service Broker API, OCP, Hyperledger, ETSI, SNIA, DMTF, W3C

1 0

[Release]Plan For 0.7.0-beta
by ljllujiale 12 Aug '20

12 Aug '20

Please find below the release plan for our upcoming release 0.7.0 beta targeting the end of August. We've also documented the release management related info at https://gitee.com/mindspore/mindspore/wikis/August%202020?sort_id=2684223 Please also note that this is not the final release note, which will contain additional information on bug fixes and so forth. Feel free to ask any questions or provide any feedback through the list! Planned Features and Improvements For 0.7.0-beta release MindSpore Major Features and Improvements Ascend 910 Training and Inference Framework New models Mask-RCNN: a simple and flexible deep neural network extended from Faster-RCNN for object instance segmentation on COCO 2017 dataset. TinyBert: a smaller and faster version of BERT using transformer distillation for natural language understanding on GLUE benchmark. SENet: a convoluation neural network using Squeeze-and-Excitation blocks to improve channel interdependencies for image classification on ImageNet 2017 dataset. Inception V3: the third version of Inception convolutional architectures for image classification on ImageNet 2012 dataset. Hub: third-party model hosting, downloading and usage; interface definition specifications; benchmarking process and test of preset model on the device side. Frontend and user interface Embedding operator high-level packaging to support segmented by field for Wide&Deep. Load multi-node checkpoint into single-process to support host-device hybrid inference. Support Concat/Tile/Strideslice distributed operators. Support cumulative gradient and batch training split. Support variable parameter input for Cell object. Parameter mixed calculation optimization for pynative mode. Deep Probabilistic Programming Support statistical distributions classes used to generate stochastic tensors. Support probabilistic inference algorithms. Support BNN layers used to construct BNN. Support interfaces for the transformation between BNN and DNN. Support uncertainty estimation to estimate epistemic uncertainty and aleatoric uncertainty. Executor and performance optimization Minspore graph compilation process performance improved by 20%. Decoupling C++ and Python modules to achieve separate compilation of core modules. Serving module supports restful interface. Data processing, augmentation, and save format Support automatic data augmentation Support GNN distributed cache in single node Batch operator optimization Other Hardware Support GPU platform New model supported: VGG16, ResNet101, InceptionV3, NASNet, Transformer, TinyBert, YoloV3-DarkNet, MNASNet, EffecientNet-B0, ShuffleNet. Support some distributed operators in ResNet50 and Wide&Deep. Support automatic parallel for Wide&Deep. Support function funcsi (such as switch-case). Support distributed training with parameter server. Performance optimization of the distributed training with allreduce. Performance optimization of the mixed precision training. Performance optimization of the pynative mode. Performance optimization of the convolution operator, batch normalization operator. Serving module supports GPU backend. CPU platform Support MobileNetV2 Re-Training: Re-train the network with different class number. MindSpore Lite Major Features and Improvements Converter Support third party model, including TFLite/Caffe/ONNX. Add 96 TFLite op. Add 18 Caffe op. Add support for windows. Add 11 optimized passes, include fusion/const fold. Support aware-training and Post-training quantization. API Add JAVA APIs. Add pre/post data processing APIs. CPU Add 100+ops，support fp32, int8/uint8, FP16 ops Support fast convolution algorithms: Sliding Window, Img2col + Gemm, Strassen, Winograd Support assembly/neon instruction. Support CPU fp16 and sdot on ARM v8.2+. GPU Add 50+ ops for OpenCL. Support image2D/buffer format. Optimize online initialization time. add optimized convolution1X1/3X3/depthwise/convolution_transposed for OpenCL. NPU Support Kirin NPU. Tool & example Add benchmark and TimeProfile tools. Add image classification and object detection Android Demo. GraphEngine Major Features and Improvements Conditional operator memory supports separate allocation of 4G memory space; In the zero-copy scenario, atomic_clean supports cleaning the memory of each part of the output when the network is multi-output; Support profiling of multiple levels of data in inference scenarios; In the online compilation scenarios, GE compilation time optimization. MindArmour Major Features and Improvements Privacy leakage evaluation. Using Membership inference to evaluate the privacy-preserving of AI model. Fuzzing based Adversarial Robustness testing. Coverage-guided test set generation. MindInsight Major Features and Improvements Support GPU operator profiling Web UI supports English Computation graph show full_name in anf_ir.proto as node name Provides a code wizard tool to quickly generate classic network scripts in a friendly and easy way. Thanks Lujiale

1 0