Deep Learning Models and Applications: A Review

  • Nadia Siddiqui
  • Aysha Khan
  • Saiful Islam
  • Rashid Ali


This Deep learning is a forthcoming field ofMachine Learning (ML). Deep Learning (DL) consists of several hidden layers identical to artificial neural networks. Its strategies comprises of supervised and unsupervised learning techniques to automatically learn the hierarchical representation of deep architecture. As data is becoming larger, deep learning is benefiting in this scenario to deal with such enormous amount of resources. Deep learning methodology related with non-linear transformation to abstract furthermore features in high level data representation. The recent development of architecture and techniques in deep learning shows wide application in various fields using artificial intelligence. As deep learning is becoming popular, it is of utmost importance that users should be efficiently equipped with how the model works, how it fails, how the performance is improved, etc. This paper focuses on describing the notion of deep learning along with its progression. The paper also presents some of the most popular DL models and various application areas where it can be applied. This survey can help researchers to have a proper understanding of the widely used DL models and their applications.

Keywords: Artificial Intelligence, Deep Learning, Convolutional Neural Networks, Recurrent Neural Networks, Long-Short Term Memory.


[1] W. S. McCulloch and W. Pitts, “A logical calculus of the ideas immanent in nervous activity,” The bulletin of mathematical biophysics, vol. 5, no. 4, 1943.
[2] A. Mosavi, A.R. Varkonyi-Koczy, “Integration of Machine Learning and Optimization for Robot Learning,” in Advances in Intelligent Systems and Computing, vol. 519, pp. 349-355, 2017.

[3] “What I learned from competing against a convnet on ImageNet,”, 2018.

[4] K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in CVPR, 2016.

[5] J. Deng, W. Dong, R. Socher, L. J. Li, K. Li, and L. Fei-Fei,“ImageNet: A large-scale hierarchical image database,” in CVPR, 2009.

[7] B. Heo, K. Yun and J. Y. Choi, "Appearance and motion based deep learning architecture for moving object detection in moving camera," 2017 IEEE International Conference on Image Processing(ICIP), Beijing, pp. 1827-1831, 2017.

[8] A. Mosavi, A. R. Varkonyi-Koczy, “Integration of Machine Learning and Optimization for Robot Learning,” Advances in Intelligent Systemsand Computing, vol. 519, pp. 349-355, 2017.

[9] Y. Bengio, “Learning deep architectures for AI,” Foundations andtrends in Machine Learning, vol. 2, pp. 1-127, 2009.

[10] K. Fukushima, Neocognitron, “A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position,”Biological cybernetics, vol. 36, pp. 193-202, 1980.

[11] B. B. Le Cun, J. S. Denker, D. Henderson, R. E. Howard, W. Hubbard,and L. D. Jackel, “Handwritten digit recognition with a backpropagation network,” NIPS Proceedings, pp. 396-404, 1990.

[12] Alex Krizhevsky, Sutskever I, and Hinton G.E, “Imagenet classification with deep convolutional neural network,” NIPS Proceedings, 2012.

[13] D. H. Hubel and T. N. Wiesel, “Receptive fields and functional architecture of monkey striate cortex,” The Journal of physiology, vol. 195, no. 1, pp. 215-43, 1968.

[14] Ramachandran R, Rajeev DC, Krishnan SG, P Subathra, “Deep learning an overview,” IJAER, vol. 10, no. 10, pp. 25433-25448, 2015.

[15] J. Fan, W. Xu, Y. Wu, and Y. Gong, “Human tracking using convolutional neural networks, Neural Networks,” IEEE Transactions, vol. 21, no. 10, pp. 1610 – 23, 2010.

[16] A. Toshev and C. Szegedy, “Deep -pose: Human pose estimation via deepneural networks,” Computer Vision & Pattern Recognition, 2014.

[17] ]M. Jaderberg, A. Vedaldi, and A. Zisserman, “Deep features for text spotting,” ECCV, 2014.

[18] R. Zhao, W. Ouyang, H. Li, and X. Wang, “Saliency detection by multicontext deep learning,” Computer Vision & Pattern Recognition, 2015.
0 Views | 0 Downloads
How to Cite
Siddiqui, N., Khan, A., Islam, S., & Ali, R. (2019). Deep Learning Models and Applications: A Review. Asian Journal For Convergence In Technology (AJCT). Retrieved from