TY - JOUR
T1 - PAT - Probabilistic axon tracking for densely labeled neurons in large 3-D micrographs
AU - Skibbe, Henrik
AU - Reisert, Marco
AU - Nakae, Ken
AU - Watakabe, Akiya
AU - Hata, Junichi
AU - Mizukami, Hiroaki
AU - Okano, Hideyuki
AU - Yamamori, Tetsuo
AU - Ishii, Shin
N1 - Funding Information:
Manuscript received May 9, 2018; revised July 10, 2018; accepted July 10, 2018. Date of publication July 13, 2018; date of current version December 28, 2018. This work was supported in part by the Program for Brain Mapping by Integrated Neurotechnologies for Disease Studies (Brain/MINDS) from the Japan Agency for Medical Research and Development, AMED, and in part by the Ministry of Education, Culture, Sports, Science and Technology (MEXT) as Exploratory Challenge on Post-K Computer (Elucidation of How Neural Networks Realize Thinking and Its Application to Artificial Intelligence). (Corresponding author: Henrik Skibbe.) H. Skibbe, K. Nakae, and S. Ishii are with Kyoto University, Kyoto 606-8501, Japan (e-mail: skibbe-h@sys.i.kyoto-u.ac.jp).
Publisher Copyright:
© 1982-2012 IEEE.
PY - 2019/1
Y1 - 2019/1
N2 - A major goal of contemporary neuroscience research is to map the structural connectivity of mammalian brain using microscopy imaging data. In this context, the reconstruction of densely labeled axons from two-photon microscopy images is a challenging and important task. The visually overlapping, crossing, and often strongly distorted images of the axons allow many ambiguous interpretations to be made. We address the problem of tracking axons in densely labeled samples of neurons in large image data sets acquired from marmoset brains. Our high-resolution images were acquired using two-photon microscopy and they provided whole brain coverage, occupying terabytes of memory. Both the image distortions and the large data set size frequently make it impractical to apply present-day neuron tracing algorithms to such data due to the optimization of such algorithms to the precise tracing of either single or sparse sets of neurons. Thus, new tracking techniques are needed. We propose a probabilistic axon tracking algorithm (PAT). PAT tackles the tracking of axons in two steps: locally (L-PAT) and globally (G-PAT). L-PAT is a probabilistic tracking algorithm that can tackle distorted, cluttered images of densely labeled axons. L-PAT divides a large micrograph into smaller image stacks. It then processes each image stack independently before mapping the axons in each image to a sparse model of axon trajectories. G-PAT merges the sparse L-PAT models into a single global model of axon trajectories by minimizing a global objective function using a probabilistic optimization method. We demonstrate the superior performance of PAT over standard approaches on synthetic data. Furthermore, we successfully apply PAT to densely labeled axons in large images acquired from marmoset brains.
AB - A major goal of contemporary neuroscience research is to map the structural connectivity of mammalian brain using microscopy imaging data. In this context, the reconstruction of densely labeled axons from two-photon microscopy images is a challenging and important task. The visually overlapping, crossing, and often strongly distorted images of the axons allow many ambiguous interpretations to be made. We address the problem of tracking axons in densely labeled samples of neurons in large image data sets acquired from marmoset brains. Our high-resolution images were acquired using two-photon microscopy and they provided whole brain coverage, occupying terabytes of memory. Both the image distortions and the large data set size frequently make it impractical to apply present-day neuron tracing algorithms to such data due to the optimization of such algorithms to the precise tracing of either single or sparse sets of neurons. Thus, new tracking techniques are needed. We propose a probabilistic axon tracking algorithm (PAT). PAT tackles the tracking of axons in two steps: locally (L-PAT) and globally (G-PAT). L-PAT is a probabilistic tracking algorithm that can tackle distorted, cluttered images of densely labeled axons. L-PAT divides a large micrograph into smaller image stacks. It then processes each image stack independently before mapping the axons in each image to a sparse model of axon trajectories. G-PAT merges the sparse L-PAT models into a single global model of axon trajectories by minimizing a global objective function using a probabilistic optimization method. We demonstrate the superior performance of PAT over standard approaches on synthetic data. Furthermore, we successfully apply PAT to densely labeled axons in large images acquired from marmoset brains.
KW - Monte Carlo methods
KW - diffusion tensor imaging
KW - image segmentation
KW - microscopy
UR - http://www.scopus.com/inward/record.url?scp=85049978834&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85049978834&partnerID=8YFLogxK
U2 - 10.1109/TMI.2018.2855736
DO - 10.1109/TMI.2018.2855736
M3 - Article
C2 - 30010551
AN - SCOPUS:85049978834
SN - 0278-0062
VL - 38
SP - 69
EP - 78
JO - IEEE Transactions on Medical Imaging
JF - IEEE Transactions on Medical Imaging
IS - 1
M1 - 8410930
ER -