In the recent years, deep learning has shown to have a formidable impact on image classification and has bolstered the advances in machine learning research. The scope of image recognition is going to bring big changes in the Information Technology domain. This paper aims to classify medical images by leveraging the advantages of Transfer Learning over Conventional methods. Three types of approaches are used namely, pre-trained CNN as a Feature Extractor, Feature Extractor with Image Augmentation, and Fine-tuning with Image Augmentation. The best pre-trained network architectures such as VGG16, VGG19, ResNet50, Inception, Xception and DenseNet are used for classification with each being applied to all the three approaches mentioned. The results are captured to find the best combination of pre-trained network and an approach that classifies the medical datasets with a higher accuracy.