Skip to main content
SpringerLink
Log in

Deep Learning for Medical Image Processing: Overview, Challenges and the Future

  • Chapter
  • First Online:
Book cover Classification in BioApps

Part of the book series: Lecture Notes in Computational Vision and Biomechanics ((LNCVB,volume 26))

Abstract

The health care sector is totally different from any other industry. It is a high priority sector and consumers expect the highest level of care and services regardless of cost. The health care sector has not achieved society’s expectations, even though the sector consumes a huge percentage of national budgets. Mostly, the interpretations of medical data are analyzed by medical experts. In terms of a medical expert interpreting images, this is quite limited due to its subjectivity and the complexity of the images; extensive variations exist between experts and fatigue sets in due to their heavy workload. Following the success of deep learning in other real-world applications, it is seen as also providing exciting and accurate solutions for medical imaging, and is seen as a key method for future applications in the health care sector. In this chapter, we discuss state-of-the-art deep learning architecture and its optimization when used for medical image segmentation and classification. The chapter closes with a discussion of the challenges of deep learning methods with regard to medical imaging and open research issue.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://github.com/BVLC/caffe/tree/master/models/bvlcalexnet

  2. 2.

    http://deeplearning.net/tutorial/lenet.html

  3. 3.

    https://github.com/ShaoqingRen/fasterrcnn

  4. 4.

    https://github.com/BVLC/caffe/tree/master/models/bvlcgooglenet

  5. 5.

    https://github.com/gcr/torch-residual-networks

  6. 6.

    http://www.robots.ox.ac.uk/vgg/research/verydeep/

References

  1. Gulshan V, Peng L, Coram M, Stumpe MC, Wu D, Narayanaswamy A, Venu-gopalan S, Widner K, Madams T, Cuadros J et al (2016) Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA 316(22):2402–2410

    Article  Google Scholar 

  2. Kathirvel CTR (2016) Classifying diabetic retinopathy using deep learning architecture. Int J Eng Res Tech 5(6)

    Google Scholar 

  3. Pratt H, Coenen F, Broadbent DM, Harding SP, Zheng Y (2016) Convolutional neural networks for diabetic retinopathy. Procedia Comput Sci 90:200–205

    Article  Google Scholar 

  4. Haloi M (2015) Improved microaneurysm detection using deep neural networks. In: arXiv preprint arXiv:1505.04424

  5. Alban M, Gilligan T (2016) Automated detection of diabetic retinopathy using fluorescein angiography photographs. In: Report of standford education

    Google Scholar 

  6. Lim G, Lee ML, Hsu W, Wong TY (2014) Transformed representations for convolutional neural networks in diabetic retinopathy screening. Modern Artif Intell Health Anal 55:21–25

    Google Scholar 

  7. San GLY, Lee ML, Hsu W (2012) Constrained-MSER detection of retinal pathology. In: 2012 21st International Conference on Pattern Recognition (ICPR). IEEE, pp 2059–2062

    Google Scholar 

  8. Razzak MI, Alhaqbani B (2015) Automatic detection of malarial parasite using microscopic blood images. J Med Imaging Health Inform 5(3):591–598

    Article  Google Scholar 

  9. Shirazi SH, Umar AI, Haq NU, Naz S, Razzak MI (2015) Accurate micro-scopic red blood cell image enhancement and segmentation. In: International conference on bioinformatics and biomedical engineering. Springer International Publishing, pp 183–192

    Google Scholar 

  10. Shirazi SH, Umar AI, Naz S, Razzak MI (2016) Efficient leukocyte segmentation and recognition in peripheral blood image. Technol Health Care 24(3):335–347

    Article  Google Scholar 

  11. Sirinukunwattana K, Raza SEA, Tsang YW, Snead DR, Cree IA, Rajpoot NM (2016) Locality sensitive deep learning for detection and classification of nuclei in routine colon cancer histology images. IEEE Trans Med Imaging 35(5):1196–1206

    Article  Google Scholar 

  12. Bayramoglu N, Heikkila J (2016) Transfer learning for cell nuclei classification in histopathology images. In: Computer vision–ECCV 2016 workshops. Springer, pp 532–539

    Google Scholar 

  13. Levi G, Hassner T (2015) Age and gender classification using convolutional neural networks. In: Proceedings of the IEEE Conference on computer vision and pattern recognition workshops, pp 34–42

    Google Scholar 

  14. Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Advances in neural information

    Google Scholar 

  15. Malon C, Miller M, Burger HC, Cosatto E, Graf HP (2008) Identifying histological elements with convolutional neural networks. In: Proceedings of the 5th international conference on soft computing as transdisciplinary science and technology, ACM, pp 450–456

    Google Scholar 

  16. Quinn JA, Nakasi R, Mugagga PK, Byanyima P, Lubega W, Andama A (2016) Deep convolutional neural networks for microscopy-based point of care diagnostics. Pattern Recognition p 112

    Google Scholar 

  17. Peixinho A, Martins S, Vargas J, Falcao A, Gomes J, Suzuki C (2015) Diagnosis of vision and medical image processing V: proceedings of the 5th eccomas thematic conference on computational vision and medical image processing (VipIMAGE 2015, Tenerife, Spain, p 107

    Google Scholar 

  18. Xie W, Noble JA, Zisserman A (2016) Microscopy cell counting and detection with fully convolutional regression networks. Comput Methods Biomech Biomed Eng: Imaging Vis pp 1–10

    Google Scholar 

  19. Qiu Y, Lu X, Yan S, Tan M, Cheng S, Li S, Liu H, Zheng B (2016) Applying deep learning technology to automatically identify metaphase chromosomes using scanning microscopic images: an initial investigation. In: SPIE BiOS, International society for optics and photonics, pp 97,090 K–97,090 K

    Google Scholar 

  20. Dong Y, JZSHPWWLRVBW, Bryan A (2017) Evaluations of deep convolutional neural networks for automatic identification of malaria infected cells. In: IEEE EMBS International Conference on Biomedical & health informatics (BHI), pp 101–104

    Google Scholar 

  21. Saltzman JR, Travis AC (2012) Gi health and disease

    Google Scholar 

  22. Jia X, Meng MQH (2016) A deep convolutional neural network for bleeding detection in wireless capsule endoscopy images. In: 2016 IEEE 38th Annual international conference of the Engineering in medicine and biology society (EMBC), IEEE, pp 639–642

    Google Scholar 

  23. Pei M, Wu X, Guo Y, Fujita H (2017) Small bowel motility assessment based on fully convolutional networks and long short-term memory. Knowl Based Syst 121:163–172

    Article  Google Scholar 

  24. Wimmer G, Vecsei A, Uhl A (2016b) CNN transfer learning for the automated diagnosis of celiac disease. In: 2016 6th International Conference on Image Processing Theory Tools and Applications (IPTA). IEEE, pp 1–6

    Google Scholar 

  25. Wimmer G, Hegenbart S, Vecsei A, Uhl A (2016a) Convolutional neural network architectures for the automated diagnosis of celiac disease. In: International Workshop on Computer-assisted and Robotic Endoscopy. Springer, pp 104–113

    Google Scholar 

  26. Zhu R, Zhang R, Xue D (2015) Lesion detection of endoscopy images based on convolutional neural network features. In: 2015 8th International congress on image and signal processing (CISP). IEEE, pp 372–376

    Google Scholar 

  27. Georgakopoulos SV, Iakovidis DK, Vasilakakis M, Plagianakos VP, Koulaouzidis A (2016) Weakly-supervised convolutional learning for detection of inflammatory gastrointestinal lesions. In: 2016 IEEE international conference on Imaging systems and techniques (IST), IEEE, pp 510–514

    Google Scholar 

  28. Tajbakhsh N, Gurudu SR, Liang J (2015) Automatic polyp detection in colonoscopy videos using an ensemble of convolutional neural networks. In: 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI), IEEE, pp 79–83

    Google Scholar 

  29. Ribeiro GW, Uhl A, Wimmer G., Häfner M (2016b) Exploring deep learning and transfer learning for colonic polyp classification. Comput Math Methods Med p 116

    Google Scholar 

  30. Coates A, HL, Ng AY (2011) An analysis of single-layer networks in unsupervised feature learning. In: Proceedings of the 4th international conference on artificial intelligence, p 215223

    Google Scholar 

  31. Ribeiro AU, Häfner M (2016a) Colonic polyp classification with convolutional neural networks. In: IEEE 29th International symposium on computer-based medical systems (CBMS), p 253258

    Google Scholar 

  32. Wolterink JM, Leiner T, Viergever MA, Išgum I (2015) Automatic coronary calcium scoring in cardiac ct angiography using convolutional neural networks. In: International conference on medical image computing and computer-assisted intervention. Springer, pp 589–596

    Google Scholar 

  33. Wang Z, YKYZ, Yu G, Qu Q (2014) Breast tumor detection in digital mammography based on extreme learning machine. Neurocomputing p 175184

    Google Scholar 

  34. Kooi TNK, van Ginneken B, den Heeten A (2017) Discriminating solitary cysts from soft tissue lesions in mammography using a pretrained deep convolutional neural network. Int J Med Phys Pract

    Google Scholar 

  35. Cui Z, Yang J, Qiao Y (2016) Brain MRI segmentation with patch-based cnn approach. In: Control conference (CCC), 2016 35th Chinese, IEEE, pp 7026–7031

    Google Scholar 

  36. Arevalo J, Gonzlez FA, Ramos-Polln R, Oliveira JL, Lopez MAG (2016) Representation learning for mammography mass lesion classification with convolutional neural networks. Comput Methods Programs Biomed pp 248–257

    Google Scholar 

  37. Huynh MDB, Giger K (2016a) Computer-aided diagnosis of breast ultrasound images using transfer learning from deep convolutional neural networks. Int J Med Phys Pract p 3705

    Google Scholar 

  38. Huynh HLBQ, Giger ML (2016b) Digital mammographic tumor classification using transfer learning from deep convolutional neural networks. J Med Imag

    Google Scholar 

  39. Antropova N, BH, Giger M (2016) Predicting breast cancer malignancy on DCE-MRI data using pre-trained convolutional neural networks. Int J Med Phys Pract p 33493350

    Google Scholar 

  40. Samala RK, LHMAHJW, Chan HP, Cha K (2016) Authors develop a computer-aided detection (CAD) system for masses in digital breast tomosynthesis (DBT) volume using a deep convolutional neural network (DCNN) with transfer learning from mammograms. Int J Med Phys Pract p 66546666

    Google Scholar 

  41. Heath M, DKRM, Bowyer K, Kegelmeyer P (2000) The digital database for screening mammography. In: Proceedings of the 5th international workshop on digital mammography, p 212218

    Google Scholar 

  42. Chan HP, BSEARTWMARRHMDBKLMH, Wei J, Helvie MA (2005) Computer-aided detection system for breast masses on digital tomosynthesis mammograms: preliminary experience 1. Radiology p 10751080

    Google Scholar 

  43. Shin H, MGLLSMZXINJYDM, Roth HR, Summers RM (2016) Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning. IEEE Trans Med Imaging p 12851298

    Google Scholar 

  44. Williamson JR, BSHJPSSGGC, Quatieri TF, Mehta DD (2015) Segment-dependent dynamics in predicting parkinsons disease MIT lincoln laboratory. Lexington, Massachusetts, USA

    Google Scholar 

  45. Kang Y, Na DL, Hahn S (1997) A validity study on the Korean Mini-Mental State Examination (KMMSE) in dementia patients. J Korean Neurol Assoc 15(2):300–308

    Google Scholar 

  46. Fahn S, Elton R (2006) Unified parkinsons disease rating scale. [Online]. Available: http://img.medscape.com/fullsize/701/816/58977 UPDRS.pdf

  47. Association A (2012) Alzheimers disease facts and figures. Alzheimers & De-mentia p 131168

    Google Scholar 

  48. Sarraf S, Anderson J, Tofighi G (2016) Deep AD: Alzheimers disease classification via deep convolutional neural networks using MRI and FMRI. bioRxiv p 132/p 070441

    Google Scholar 

  49. Lessmann N, Isgum I, Setio AA, de Vos BD, Ciompi F, de Jong PA, Oudkerk M, Willem PTM, Viergever MA, van Ginneken B (2016) Deep convolutional neural networks for automatic coronary calcium scoring in a screening study with low-dose chest ct. In: SPIE medical imaging, international society for optics and photonics, pp 978,511–978,511

    Google Scholar 

  50. Wolterink JM, Leiner T, de Vos BD, van Hamersvelt RW, Viergever MA, Išgum I (2016) Automatic coronary artery calcium scoring in cardiac CT angiography using paired convolutional neural networks. Med Image Anal 34:123–136

    Google Scholar 

  51. Sakamoto M, Nakano H (2016) Cascaded neural networks with selective classifiers and its evaluation using lung X-ray ct images. arXiv preprint arXiv:161107136

  52. Ciompi F, Chung K, van Riel SJ, Setio AAA, Gerke PK, Jacobs C, Scholten ET, Schaefer-Prokop C, Wille MM, Marchiano A et al (2016) Towards automatic pulmonary nodule management in lung cancer screening with deep learning. arXiv preprint arXiv:161009157

  53. Paul R, Hawkins SH, Hall LO, Goldgof DB, Gillies RJ (2016) Combining deep neural network and traditional image features to improve survival prediction accuracy for lung cancer patients from diagnostic CT. In: 2016 IEEE international conference on Systems, man, and cybernetics (SMC), IEEE, pp 002,570–002,575

    Google Scholar 

  54. Duggal R, Gupta A, Gupta R, Wadhwa M, Ahuja C (2016) Overlapping cell nuclei segmentation in microscopic images using deep belief networks. In: Proceedings of the tenth Indian conference on computer vision, graphics and image processing, ACM, p 82

    Google Scholar 

  55. Liskowski P, Krawiec K (2016) Segmenting retinal blood vessels with <? pub newline?> deep neural networks. IEEE Trans Med Imaging 35(11):2369–2380

    Article  Google Scholar 

  56. Ngo L, Han JH (2017) Advanced deep learning for blood vessel segmentation in retinal fundus images. In: 2017 5th International winter conference on brain-computer interface (BCI), IEEE, pp 91–92

    Google Scholar 

  57. Kamnitsas K, Ledig C, Newcombe VF, Simpson JP, Kane AD, Menon DK, Rueckert D, Glocker B (2017) Efficient multi-scale 3D CNN with fully connected CRF for accurate brain lesion segmentation. Med Image Anal 36:61–78

    Article  Google Scholar 

  58. Kleesiek J, Urban G, Hubert A, Schwarz D, Maier-Hein K, Bendszus M, Biller A (2016) Deep MRI brain extraction: a 3D convolutional neural network for skull stripping. NeuroImage 129:460–469

    Article  Google Scholar 

  59. Segu S, Drozdzal M, Pascual G, Radeva P, Malagelada C, Azpiroz F, Vitri J (2016) Deep learning features for wireless capsule endoscopy analysis. In: Iberoamerican congress on pattern recognition. Springer, pp 326–333

    Google Scholar 

  60. Yuan Y, Meng MQH (2017) Deep learning for polyp recognition in wireless capsule endoscopy images. Med Phys

    Google Scholar 

  61. Suk HI, Lee SW, Shen D (2014) Hierarchical feature representation and multimodal fusion with deep learning for AD/MCI diagnosis. Neuroimage p 569582

    Google Scholar 

  62. Dataset A (2017) Alzheimers disease neuroimaging initiative database. http://adni.loni.usc.edu/data-samples/access-data/. Accessed 22 May 2017

  63. Hosseini-Asl RK, El-Baz A (2016) Alzheimers disease diagnostics by adaptation of 3D convolutional network. In: International conference on image processing (ICIP 2016)

    Google Scholar 

  64. Payan A, Montana G (2015) Predicting alzheimers disease: a neuroimaging study with 3D convolutional neural networks. arXiv preprint p 19

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. King Saud bin Abdulaziz University for Health Sciences, Riyadh, Saudi Arabia

    Muhammad Imran Razzak

  2. GGPGC1, Abbottabad, KPK, Pakistan

    Saeeda Naz

  3. Woman Medical College, Abbottabad, KPK, Pakistan

    Ahmad Zaib

Authors
  1. Muhammad Imran Razzak
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Saeeda Naz
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ahmad Zaib
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Muhammad Imran Razzak .

Editor information

Editors and Affiliations

  1. Department of Information Technology, Techno India College of Technology, Kolkata, India

    Nilanjan Dey

  2. Faculty of Engineering, Tanta University, Tanta, Egypt

    Amira S. Ashour

  3. K.S. Institute of Technology, Bangalore, Karnataka, India

    Surekha Borra

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Razzak, M.I., Naz, S., Zaib, A. (2018). Deep Learning for Medical Image Processing: Overview, Challenges and the Future. In: Dey, N., Ashour, A., Borra, S. (eds) Classification in BioApps. Lecture Notes in Computational Vision and Biomechanics, vol 26. Springer, Cham. https://doi.org/10.1007/978-3-319-65981-7_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-65981-7_12

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-65980-0

  • Online ISBN: 978-3-319-65981-7

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation