Aims and Scope
With the emergence of big data and efficient computing resources, deep learning has made major breakthroughs in many areas of artificial intelligence. However, in the face of increasingly complex tasks, the scale of data and deep learning models has become increasingly large. For example, the amount of tagged image data used to train an image classifier amounts to millions, or even tens of millions. The emergence of large-scale training data provides a material basis for training large models. Therefore, many large-scale machine learning models have emerged in recent years. However, when the training data is increased, the deep learning model may have tens of billions or even hundreds of billions of parameters without any pruning.
In order to improve the training efficiency of the deep learning model and reduce the training time, distributed technology should be used to perform training tasks. At the same time, multiple working nodes are used to train the neural network model with excellent performance in a distributed and efficient manner. Distributed technology is an accelerator of deep learning technology, which can significantly improve the training efficiency of deep learning and further increase its application range. Peer-to-peer (P2P) networks use a distributed architecture, which means that all the computers or devices that are part of it share the workloads in the network. The characteristics of P2P networks make it possible to perform distributed tasks, therefore it can be used for distributed deep learning.
This special issue focuses on recent advances in architecture, algorithms, optimization, and models of P2P computing for deep learning tasks. Original, unpublished contributions and invited articles, reflecting various aspects of P2P computing for deep learning are encouraged. The topics of interest for the special issue include, but are not limited to:
- P2P networking framework for deep learning
- Fault tolerance in P2P computing systems
- Algorithms, schemes and techniques in P2P computing systems for deep learning
- Parallel computing in P2P computing systems for deep learning
- Optimization and distributed control
- Large-scale data analysis
- Distributed infrastructures, parallelization of deep learning training
- Resource allocation and scheduling of deep learning training
- Data management of deep learning training
- Security and privacy in P2P computing systems
- Surveys of distributed computing for deep learning
Paper submission due: Feb. 01, 2020
First notification: Mar. 15, 2020
Revision: April 01, 2020
Final decision: May 15, 2020
Online Publication date: July 2020
The authors should visit www.springer.com/12083 for information on paper submission. Prospective authors should submit an electronic copy of their complete manuscript through the Editorial Manager system at http://www.editorialmanager.com/PPNA using the article type: “SI: P2P Computing for Deep Learning.” Manuscripts will be peer reviewed according to the standard of Peer-to-Peer Networking and Applications.
Prof. Ying Li, Zhejiang University, China (Lead Guest Editor)
Prof. Li is an associate professor in College of Computer Science and Technology, Zhejiang University, director of the Center for Pension Health Innovation Service Research, Binhai Industry Technology Research Institute of Zhejiang University. In 2000, he received his Ph.D. degree in computer software from Zhejiang University. He worked as a visiting scholar at the University of California, Santa Barbara (UCSB) in 2013. He was selected into the talent project in Zhejiang New Century 151. He has been engaged in research in the fields of service computing, platform software, business process management and other industrial applications. Dr. Li has undertaken more than 10 scientific research projects as the leader, including 6 national-level projects such as the National Major Special Project, the National Science and Technology Support Program, the National 863 Program and the National Natural Science Foundation Project. The research and development of the Qiantang middleware platform software and other achievements won the second prize of the National Science and Technology Progress Award and the first prize of the provincial and ministerial level scientific and technological progress. More than 50 research papers have been published, of which more than 30 papers have been indexed by SCI/EI. More than 60 national invention patents were proposed. He focused on the research on common support technologies in the field of modern service industry and had invented a series of core technologies around complex service systems.
Prof. R.K. Shyamasundar, Indian Institute of Technology, India
Prof. R K Shyamasundar is a Fellow of IEEE, a Fellow of ACM, Distinguished ACM Speaker, a Distingusihed Alumnus of Indian Institute of Science, served as IEEE Distinguished Speaker, is currently JC Bose National Fellow, Distinguished V. Professor at the Department of Computer Science, IIT Bombay where he is the principla investigator of the Information Security Research and Development Centre (ISRDC) from Ministry of Electronics and Information Technology (MeiTY) from the Govt. of India. He was awarded the 2014 SN Mitra award for excellence in research by the Indian National Academy of Engineering. Since 2015, he is holds the distinguished position of Scholar-in-Residence at IIT Jodhpur. He is the founding Dean of the School of Technology and Computer Science at TIFR. He has made outstanding contributions to Real-Time Distributed Computing, Logics of Programs, Network and Computer Security. His research interests include distributed real-time systems, Logics of Programs, Concurrent and Parallel programming Languages, Formal Methods, Cyber Security etc. He has more than 300 publications, 8 books, 8 international patents, 3 Indian patents, and 3 Best Paper Awards. Thirty five students have completed Ph.D. under his guidance, has served on IEEE Esterel Standards and served as consultant to ESPRIT projects. He did post doctoral work under the legendary Turing Laureate Professor Dr. Edsgar W. Dijkstra and was a Distinguished Visiting fellow under the UK Royal Academy of Engineering at the Computing Laboratory of University of Cambridge. He has also served as a Distinguished Visiting Fellow by the UK Royal Academy of Engineering in 2016 at the City University of London. He has served as Faculty/Staff at IBM TJ Research, Eindhoven University, State University of Utrecht, Pennsylvania State University, University of Illinois, University of California at San Diego at Lajolla, University of Cambridge, University of Linkoping, SUNU at Albany, UNM at Albuquerque, IRISA, INRIA, CWI, JAIST Japan, Max Planck Institute, IBM Research India etc. He was Founding Chair of conference series Foundations of Software Technology and Theoretical Computer Science (FSTTCS), founding President of Indian Association of Research in Computing Science (IARCS.), founding Dean of School of Technology and Computer Science and Founder of the Center for Formal Designa and verification of Software as a tri-partite center among BARC, TIFR and IIT Bombay) located at IIT Bombay. He serves/served on the Governing Council of IIIT Allahabad, IIIT Jabalpur, CSIR Centre CMMACS (CSIR-FPI) Bangalore , serves on the Technical Advisory Board of BSE (Bombay Stock Exchange), and Research Advisory Board for Institute of Development and Research in Banking Technology (IDRBT) of RBI at Hyderabad. He is a Fellow of Indian Academy of Sciences, Indian National Science Academy, National Academy of Sciences, National Academy of Engineering, India and a Fellow of the Academy of Sciences of the Developing world (TWAS), Trieste, Italy. He serves on the IEEE Fellow selection committee on Product safety. He has served on IEEE Esterel Standards Committee and serves on the Editorial board of Journal of Parallel and Distributed Computing, corersponding editor for Sadhana- Journal of Engineering Sciences of the Indian Academy of Sciences etc. He is a receipient of Diamond Jubilee medal from IETE and also its’ Fellow.
Prof. Yuyu Yin, Hangzhou Dianzi University, China
Prof.Yuyu Yin received the PhD in Computer Science from Zhejiang University in 2010. He is currently a Professor at the College of Computer in Hangzhou Dianzi University and is engaged as a Supervisor of Master Students with the School of Computer Engineering and Science of Shanghai University, Shanghai, China. His research interests include Service Computing, Cloud Computing, and Business Process Management. He is a IEEE Member, Member of the China Computer Federation (CCF), CCF Service Computing Technical Committee Member. During the past ten years, he has published more than 40 papers in journals and refereed conferences such as Sensors, Entropy, IJSEKE, Mobile Information Systems, ICWS, SEKE. He organized and more than 10 international conferences and workshops, such as FMSC2011-2017, DISA2012\2017-2018. Also He worked as guest editor for Journal of Information Science and Engineering and International Journal of Software Engineering and Knowledge Engineering, and as reviewers for IEEE transaction on Industry Informatics, Journal of Database Management, Future Generation Computer Systems, etc.
Prof. Mohammad S. Obaidat, University of Jordan.
Professor Mohammad S. Obaidat is an internationally known academic/researcher/scientist/scholar. He received his Ph.D. degree in Computer Engineering with a minor in Computer Science from the Electrical and Computer Engineering (ECE) Department, The Ohio State University, Columbus, USA. He has received extensive research funding and published about One Thousand (1000) refereed technical articles-About half of them are journal articles, over 65 books, and over 65 Book Chapters. He is Editor-in-Chief of 3 scholarly journals and an editor of many other international journals. He is the founding Editor-in Chief of Wiley Security and Privacy Journal. Among his previous positions are Advisor to the President of Philadelphia University for Research, Development and Information Technology, President of the Society for Molding and Simulation International, SCS, Senior Vice President of SCS, Dean of the College of Engineering at Prince Sultan University, Chair and tenured Professor at the Department of Computer and Information Science and Director of the MS Graduate Program in Data Analytics at Fordham university, Chair and tenured Professor of the Department of Computer Science and Director of the Graduate Program at Monmouth University. He is now a Full Professor at Nazarbayev University, Astana, Kazakhstan, a Full Professor at King Abdullah II School of Information Technology, University of Jordan, The PR of China Ministry of Education Distinguished Overseas Professor at the University of Science and Technology Beijing, China and an Honorary Distinguished Professor at the Amity University- A Global University.
He has chaired numerous (Over 160) international conferences and has given numerous (Over 150) keynote speeches worldwide. He founded or co-founded four international conferences. He has served as ABET/CSAB evaluator and on IEEE CS Fellow Evaluation Committee. He has served as IEEE CS Distinguished Speaker/Lecturer and an ACM Distinguished Lecturer. Since 2004 has has been serving as an SCS Distinguished Lecturer. He received many best paper awards for his papers including ones from IEEE ICC and IEEE Globecom international conferences. He also received many worldwide awards for his technical contributions including: SCS prestigious McLeod Founder’s Award , Presidential Service Award, SCS Hall of Fame –Lifetime Achievement Award for his technical contribution to modeling and simulation and for his outstanding visionary leadership and dedication to increasing the effectiveness and broadening the applications of modeling and simulation worldwide. He was awarded in 2017 the IEEE CITS Hall of Fame Distinguished and Eminent Award. He received very recently the 2018 IEEE ComSoc Technical Committee on Communications Software- 2018 Technical Achievement Award on original significant technical contribution to cybersecurity, computer networks and wireless networks. He has been awarded with the Amity University Distinguished Honorary Professor Award. He also received the Distinguished Professor Award from University of Science and Technology-Beijing, China, and the SCS Outstanding Service Award. He is a Life Fellow of IEEE and a Fellow of SCS.