Medical Imaging with Deep Learning has recently become the most prominent topic in the scientific world. Significant results have been obtained in the classification of medical images using deep learning methods, and there has been an increase in studies on malignant types. The main reason for choosing breast cancer is that breast cancer is one of the critical malignant types that increase the death rate in women. In this study, 1236 ultrasound images were collected from Elazig Fethi Sekin City Hospital, and three different ResNet CNN architectures were used for feature extraction. Data were trained with an SVM classifier. In addition, the three ResNet architectures were combined, and novel fused ResNet architecture was used in this study. In addition, these features were used with three different feature selection techniques, MR-MR, NCA, and Relieff. These results are 89.3% obtained from ALL-ResNet architecture and the feature selected with NCA in normal and lesion classification. Normal, malignant, and benign classification best accuracy is 84.9% with ALL-ResNet NCA. Experimental studies show that MR-MR, NCA, and Relieff feature selection algorithms reduce features and give more results that are successful. This indicates that the proposed method is more successful than classical deep learning methods.