Alzheimer's disease (AD) is a chronic brain disorder and is the most common cause of dementia. Patients suffering from AD experience memory loss, confusion, and other cognitive and behavioral complications. As the disease progresses, these symptoms become severe enough to interfere with the patient's daily life. Since AD is an irreversible disease and existing treatments can only slow down its progress, early diagnosis of AD is a key moment in fighting this disease. In this article, we propose a novel approach for diagnosing AD via deep neural networks from magnetic resonance imaging images. Additionally, we propose three new propagation rules for the layer-wise relevance propagation (LRP) method, which is a method used for visualizing evidence in deep neural networks to obtain a better understanding of the network's behavior. We also propose various rule configurations for the LRP to achieve better interpretability of the network. Our proposed classification method achieves a 92% accuracy when classifying AD versus healthy controls, which is comparable to state-of-the-art approaches and could potentially aid doctors in AD diagnosis and reduce the occurrence of human error. Our proposed visualization approaches also show improvements in evidence visualization, which helps the spread of computer-aided diagnosis in the medical domain by eliminating the “black-box” nature of the neural networks.