 RESEARCH PAPER
 Open Access
 Published:
Nuclear detection in 4D microscope images of a developing embryo using an enhanced probability map of topranked intensityordered descriptors
IPSJ Transactions on Computer Vision and Applications volume 8, Article number: 8 (2016)
Abstract
Nuclear detection in embryos is an indispensable process for quantitative analysis of the development of multicellular organisms. Due to the overlap in the distribution of pixel intensity of nuclear and cytoplasmic regions and the large variation of pixel intensity even within the same type of cellular components in different embryos, it is difficult to separate nuclear regions from the surrounding cytoplasmic region in differential interference contrast (DIC) microscope image. This study explores a discriminative representation of a local patch around a fixed pixel, called topranked intensityordered descriptor (TRIOD), which is prospected to distinguish the smoothed texture in the nucleus from the irregular texture in cytoplasm containing yolk granules. Then, a probability process is employed to model nuclear TRIOD prototypes, and the enhanced nuclear probability map can be constructed with the TRIODs of all pixels in a DIC microscope image. Finally, a distanceregularized level set method, which not only considers the probability change in a nearby pixel but also regularizes the contour smoothness, is applied to refine the initial localization by simply thresholding on the enhanced probability map. Experimental results show that the proposed strategy can give much better performance for segmentation of nuclear regions than the conventional strategies.
1 Introduction
Identification of gene function during animal development is the main task of developmental biology. Genetic perturbation and analysis in animal embryos often clarify the function of the specific gene. Due to the complete genome sequence (roughly 20,000 proteincoding genes [1]) and short lifetime, the nematode Caenorhabditis elegans is generally used as a model organism in biology. By observing a perturbed early C. elegans embryo using a microscope of Nomarski differential interference contrast (DIC) optics [2], biologists manually analyze early embryonic events and evaluate the roles of a specific gene in the developmental process. Detection of various components of interests in the embryo is the first indispensable step to extract the quantitative measure of the early embryonic events such as growth of cell number, changes of nuclear position and shape, and timing of cell division.
Since the early embryonic events are closely related to the position, morphological variations, number changes of nuclei, and so on, automated detection of nuclei in DIC microscope images plays an essential role for understanding animal development. This work focuses on detecting nuclei and cytoplasm in 3dimensional (3D) timelapse images of a C. elegans embryo recorded by DIC microscope [2]. Two images of the 3D DIC microscope images are shown in Fig. 1 a, which are obtained from different C. elegans embryos. It can be seen that the nuclear region is much smoother than the cytoplasmic region with yolk granules. We take one nuclear and cytoplasmic regions from both images as explored regions (Fig. 1 a) denoted by different color frames and compare the statistical distributions of (1) different types of explored regions from the same embryo and (2) the same type of explored regions from different embryos shown in Fig. 1 b. Figure 1 b manifests that the intensities of different cellular components can be completely overlapped (the middle histogram in Fig. 1 b). However, the same type of explored regions from different embryos possibly has very different intensity distributions (the right histogram in Fig. 1 b). Therefore, it would be impossible to only use the intensity to identify the nuclear and cytoplasmic regions, and thus, exploring a discriminating representation using texture is necessary for distinguishing the cytoplasmic and nuclear regions.
There are several studies that attempt to explore the dynamic information of 3D timelapse DIC microscope images. Two computerassisted systems: SIMI BioCell [3] and 3DDIASemb [4], have been constructed for tracking the changes of the 3D nuclear positions in the 3D timelapse DIC microscope images. These two systems identify the positions and sizes of the nuclei via displaying 3D timelapse DIC microscope images with a graphical user interface. However, the nuclei are still detected manually, and thus, it is a laborious task. In order to efficiently implement the task of analyzing dynamic changes in DIC microscope images, several efforts aimed to automatically identify different types of regions of the C. elegans embryo image and especially detect the nuclear regions from the surrounding cytoplasm. Yasuda et al. [5] combined several types of edge features for detecting the nuclear and membrane regions. Because of the large variation in the same type of regions and possibly similar intensity distribution between different types of regions, this method leads to a lot of numbers of false positive and missing detection, which were required to be corrected by laborious handtuning. Hamahashi et al. [6] proposed to transform a raw image in 3D timelapse DIC microscope images into local entropy domain (local entropy image) to enhance the cytoplasmic region (suppress the nuclear region) and then track the nuclei in dynamic image sequence.The method used the statistics (local entropy) of a local patch centered on the focused pixel instead of pixel intensity and can adapt any 3D timelapse images for enhancing the cytoplasmic region. However, since only one statistic of the local patch based on its distribution is computed, it produced low contrast and blurred boundary between the nuclear and cytoplasmic regions in a local entropy image. On the other hand, Ning et al. [7] explored a multilayer convolutional neural network with the intensities of local patches as the initial input and attempted to recognize five categories: cell wall, cytoplasm, nucleus membrane, nucleus, and outside medium. This complex framework needs strength effort as postprocessing for giving acceptable identification by using an energybased model and a set of elastic models and thus leads to high computational cost.
This study proposes a simple but efficient framework for automatically recognizing the nuclear regions from the surrounding cytoplasmic region. It is well known that the cytoplasm contains a lot of yolk granules which can appear in any position under irregular frequency on the background with similar intensity, in contrast to the smooth nuclear region. Therefore, it is impossible to distinguish the nuclear pixel from the cytoplasm pixel by only using pixel intensity, while it is also difficult to recognize using a local patch, which is the feature for representing the centered pixel, due to the irregular appearance of yolk granules. In this study, we explore a discriminated descriptor for a local patch centered in a pixel, called topranked intensityordered descriptor (TRIOD), which can retain the intensity variation of the yolk granules in cytoplasm local patch without destroying the smooth intensity in nuclear local patch. Due to the small variation of the TRIODs for nuclear pixel representation, we collect a set of nuclear TRIODs as prototypes and apply a probability process to model them. With the constructed model, we can transform a raw DIC microscope image into a nuclearenhanced probability map, which achieves very high contrast between the nuclear and cytoplasmic regions. Finally, a distanceregularized level set (DRLS) method [8], which not only considers the probability change in a nearby pixel but also regularizes the contour smoothness, is applied to refine the initial localization by simply thresholding on the enhanced probability map. The proposed framework for nuclear detection is shown in Fig. 2, where the top figure manifests the construction procedure of probability models for the nuclear TRIOD prototypes and the bottom part gives the computation step of a nuclearenhanced probability map, and the DRLSbased refinement is employed for obtaining final detection results. We evaluate the effectiveness and performance of our proposed framework for nuclear detection.
This paper is organized as follows. Section 2 describes the discriminated TRIOD for representing the nuclear and cytoplasm pixel and introduces the construction of the probability models for computation of the nuclearenhanced probability map. A refinement detection via a distanceregularized level set method is investigated in Section 3. Experimental results and conclusions are given in Sections 4 and 5, respectively.
2 Enhanced probability map based on topranked intensityordered descriptors
This section firstly introduces a discriminative representation for irregular texture, called topranked intensityordered descriptors. Due to the small variance of the nuclear region (smooth), we propose to model nuclear TRIODs as a multiple Gaussian process and transform the raw DIC microscope image into a nuclearenhanced probability map for final segmentation. In the following, we evaluate the transformed probability maps under different parameters.
2.1 Topranked intensityordered descriptors
As statistically analyzed in the above section, the cytoplasmic region includes a lot of yolk granules bulging out from the background, which can be considered as irregular texture variance. For local texture representation, a number of methods have been proposed in the literature for computer vision problems. The most popular strategies are based on histograms such as SIFT (ScaleInvariant Feature Transform) [9], GLOH (Gradient LocationOrientation Histogram), and their recently improved versions [10, 11] for partially dealing with some kinds of variations and distortions in the processed images. However, while the above descriptors have shown promising performance for representing local patches with regular structure in different computer vision problems, they cannot handle more complex illumination change. On the other hand, in order to obtain robust features to illumination change, local binary pattern (LBP) texture operator and its many extensions [12, 13] have been widely used in vision literature and obtained good performance visavis illumination change. All the local feature representations developed in the computer vision field would encounter difficulty for handling irregular structures like the unorganized yolk granules in the cytoplasmic region of DIC microscope images. Therefore, a local entropy method [6] was introduced to deal with the irregular texture in DIC microscope image, which only considers the frequency of pixel intensity and gives the statistic measure of information capacity in a local patch. This method can work well despite the large intensity variance in the DIC microscope images of different organisms. However, only one statistic measure (local entropy) for a local patch is extracted, and thus, the representation ability is limited for distinguishing the large variant cytoplasmic and smooth nuclear regions.
This study proposes a discriminative irregular texture representation, which is prospected to give similar descriptors for the cytoplasm texture even with large variance and also a consistent representation of nuclear but different from the cytoplasmic one. Let us represent the ith focused pixel in a DIC microscope image as a small l×l patch, which can be rearranged into a vector s _{ i }=[s _{ i,0},s _{ i,1},⋯,s _{ i,D−1}], and s _{ i }∈R ^{D} (D=l×l−1). Since the yolk granules possibly appear at any location in the local patch, they will give a very different vector even for the same cytoplasm type of pixels. Thus, we attempt to sort the unordered vector and only take a subset of the topranked value as the descriptor. In order to handle the intensity variance in DIC microscope images of different organisms, we firstly subtract the mean value from the vector s _{ i } and calculate the absolute magnitudes:
Then, we sort the vector \(\bar {\mathbf {s}}_{i}\) in a nonascending order and obtain the reordered vector \(\hat {\mathbf {s}}_{i}\) with \(\hat {s}_{i,0} \geq \hat {s}_{i,1} \geq \cdots \geq \hat {s}_{i,D1}\). Finally, we take the Klarge magnitude elements in \(\hat {\mathbf {s}}_{i}\) as the texture representation, named as topranked intensity ordered descriptors (TRIODs). For all pixels in the DIC microscope image, the Kdimensional TRIODs can be extracted from the l×l local patches around the focused pixels. We visualize the first and the second topthreemagnitude elements of all pixels by combining them into color images as shown in Fig. 3 b, c, which manifest the proposed TRIODs can obtain high contrast between the nuclear and cytoplasmic regions. The first topthreemagnitude elements denote the first to the third elements of the TRIOD, while the second topthreemagnitude elements denote the fourth to the sixth ones of the TRIOD. Since the elements in the TRIODs have already sorted in a nonascending order, the near elements in the TRIOD have no large difference, and thus, almost all pixels in the combined color images have gray intensity.
2.2 Nucleus model construction for probability map transformation
As shown in Fig. 3, it can be seen that the variance of the nuclear TRIOD elements are much smaller than those for cytoplasm pixels, and thus, it would be much easier to model the nuclear TRIODs than the cytoplasmic ones. Therefore, this study attempts to construct a probability model of nuclear TRIODs and transform any TRIOD with the constructed model to a nuclearenhanced probability map. Given some nuclear regions from the DIC microscope image of any organism, a set of nuclear TRIODs X=[x _{1},x _{2},⋯,x _{ N }], called nuclear TRIOD prototypes, can be extracted. The intuitive way to use the N TRIODs for constructing the nuclear model is to directly use M Gaussian models as follows:
where N(Xμ _{ m },Σ _{ m }) is a Gaussian model. If we set K as the nuclear TRIOD prototype number, the mean vector of the mth Gaussian model is the mth TRIOD, i.e., μ _{ m }=x _{ m }. Σ _{ m } and w _{ m } are the covariance matrix and weight parameters of the mth Gaussian model, respectively. Since the M Gaussian models are centered on the N=M TRIODs, respectively, all model weights can be set as \(\frac {1}{M}\) which means all the models have the same contribution to the final probability process. For simplicity, we assume Σ _{ k } is a diagonal matrix and its determinant is \({\sigma ^{2}_{m}}\), which is calculated as the mean of the square distances between the the mean vectors of the Gaussian model and their five nearest neighbors as follows:
where x _{ i }∈NN _{5}(μ _{ m }) denotes the five nearest neighbors in X to the mean μ _{ m } of the mth Gaussian model.
In the constructed nuclear model, if the Gaussian component number M (such as M=N) is large, it needs to calculate the fitting degrees (probability) of a test TRIOD to all constructed Gaussian models, and thus, the computational cost will be increased linearly to the component number. In order to reduce computational time, we simply cluster the N nuclear TRIOD prototypes into M (M<<N) groups and obtain group centers as the mean [μ _{1},μ _{2},⋯,μ _{ M }].
For any test TRIOD x _{ t }, we can calculate its probability belonging to the mth Gaussian model as
Since all the M Gaussian models are for fitting nuclear TRIODs, it is prospected that any test nuclear TRIOD always can be well fitted by several similar models. However, the cytoplasm TRIODs are generally far from the constructed models, and then, the probability to any constructed model will be low. This study uses the J highest probabilities to give the final map magnitude for a TRIOD x _{ t } as follows:
where \(\hat {\gamma }(j\mathbf {x}_{t})\) is the jth largest probability of the M models.
2.3 Evaluation of the transformed probability maps under different parameters
As shown in the flowchart of our proposed nuclear detection strategy (Fig. 2), we randomly select the slices from the DIC microscope images of three embryos, from which several nuclear regions can be manually given for preparing the nuclear prototypes. In our experiments, about 2000 K (\(K=\text {int}\left (\frac {l\times l1}{2}\right)+1\), “int” means taking the integer number) nuclear TRIOD prototypes are extracted from l×l local patches in the given nuclear regions, and thus, the computational cost would be high if all prototypes are used as the mean parameters of the probability models. Therefore, we employ clustering algorithm for grouping them into M representative TRIOD prototypes, which correspond to K Gaussian models. Figure 4 shows the nuclearenhanced probability maps under different model numbers of TRIODs, which are extracted from 9×9 local patches. The profiles of the horizontal lines from the map images are also manifested in Fig. 4 c, which shows the higher contrasts between the cytoplasmic and nuclear regions using larger numbers of probability models. With the probability map using the Gaussian models of all TRIOD prototypes as criterion measure, we calculate the summed squared difference of all pixels between the probability maps, and the summed difference values for four DIC slices from different organisms are given in Fig. 4 d. It can be seen that the summed differences after 50 probability models change a little and seem to give the local minimums for all four samples. The computational times (second) are also given in Fig. 4 e. In order to balance the tradeoff between computational cost and contrast, we select 50 probability models to fit the nuclear TRIODs in the following experiments.
Next, we validate the effect of the local patch sizes to the probability maps by setting the parameters l of the local patch (l×l) as 3,5,7,9,⋯, and the topranked intensityordered descriptors with \(K=\text {int}\left (\frac {l\times l1}{2}\right)+1\) elements are extracted for pixel representation. The resulted probability maps with different local patch sizes are shown in Fig. 5, which indicates that the proposed strategy with small local patch sizes can correctly enhance almost all nuclear pixels (true positive) but inaccurately emphasize some cytoplasm pixels (false positive), while using a large size of local patches would lead to missenhancement of nuclear pixels especially in the boundary regions but more clear enhanced probability maps.
Finally, the different dimensions of the TRIOD feature are evaluated. We set the dimension (K) of the TRIOD feature as 1, \(\text {int}\left (\frac {l\times l}{8}\right)+1\), \(\text {int}\left (\frac {l\times l1}{4}\right)+1\), \(\text {int}\left (\frac {\left (l\times l1\right)\times 3}{8}\right)+1\), \(\text {int}\left (\frac {l\times l}{2}\right)+1\), ⋯ with l=5, 7, and 9. Figure 6 shows the transformed probability maps with K= 1, \(\text {int}\left (\frac {l\times l}{4}\right)+1\), \(\text {int}\left (\frac {l\times l1}{2}\right)+1\), \(\text {int}\left (\frac {\left (l\times l1\right)\times 3}{4}\right)+1\) under l=5,7,9. We also define the discriminated degrees for measuring the distinguish ability of the transformed probability maps between the nuclear and the surrounding cytoplasmic regions as follows:
where p denotes a transformed probability map, m1_{ p } and m2_{ p } are the mean values of the nuclear and cytoplasmic pixels in the transformed map such as the pixel in the regions shown in Fig. 7 a, and s1_{ p } and s2_{ p } denote the variances of the nuclear and cytoplasmic pixels in the transformed map, respectively. The larger the DS(p) is, the higher the contrast between the nuclear and the surrounding cytoplasmic regions would be. Figure 7 b gives the quantitative measurements of the transformed probability maps with different K under l= 5 and 9. From Fig. 6 b, it can be seen that the discriminated degrees with \(K=\text {int}\left (\frac {l\times l}{2}\right)+1\) manifest acceptable distinguish ability and cannot be greatly improved even increasing K. Therefore, we set \(K=\text {int}{\left (\frac {l\times l}{2}\right)}+1\) for the proposed TRIOD features in all the following experiments. Segmentation of the nuclear region with the level set method introduced in the next section will be based on the enhanced probability maps with different patch sizes l and the corresponding TRIOD feature dimension K.
In addition, we will also give compared nuclear detection results with the local entropy method [6], which possibly uses different patch sizes for measuring the local entropy of a pixel. In our experiments, the local entropy method is implemented, and the transformed local entropy images with different patch sizes (l=5,9,13,17,21) are shown in Fig. 8 a. Furthermore, Fig. 8 b manifests the discriminated degrees of the transformed local entropy images with different patch sizes calculated by Eq. (6), which denotes the transformed image with patch size l=9 has much highest distinguish ability as being proven in [6]. Therefore, the following nuclear detection is based on the transformed local entropy image with the same seed points as the proposed framework for fair comparison.
3 Level setbased detection
The basic idea of the level set method is to represent a contour as the zero level set of a function, called a level set function (LSF), and formulate the contour’s motion as the evolution of the level set function. For image segmentation, the level set function can be formulated as ϕ(x,y,t), on the image coordinate space [x,y]∈Ω and time direction, which embeds the dynamic contour at the zero level set. Assuming the LSF ϕ takes positive values outside the zero level contour and negative values inside, the inward normal vector of the embedding contour can be expressed as ℵ=−∇ϕ/∇ϕ, where ∇ is the gradient operator. The evolution of the LSF ϕ can be formulated as the following partial differential equation (PDE):
where F is the speed function that controls evolution of the LSF. The conventional level set method generally results in LSF irregularity [14, 15] in the evolution procedure, and thus, Li et al. proposed a general variational level set formulation with a distance regularization term and an external energy term that controls the evolution of the zero level contour toward the desired locations. The designed objective energy function to be minimized is formulated as
where λ>0 is a constant for controlling the tradeoff between two terms and E _{ext}(ϕ) is the external energy on the processed images, which is defined such that it achieves a minimum when the zero level set of LSF ϕ is evolved to an object boundary (refer to detail in formation of [8]). R _{ p }(ϕ) is the level set regularization term as defined in [8].
This study attempts to segment the nuclear regions based on the enhanced probability maps using the level set method, which needs initial contour (initial LSF) for evolution. According to the evaluation of the proposed nuclearenhanced strategy in the above section, we can see that the probability maps with the large local patch size (13×13) can achieve a very clear nuclearenhanced region except some missed pixels in the nuclear boundary, which promises the possibility of wellrecognizing the enhanced nuclear pixels from their surround via a simple thresholding procedure. The achieved nuclear regions by thresholding can be used to produce the initial level set, which then is evolved on the enhanced probability map with a small local patch size (such as 3×3) for giving the precise nuclear boundary. In addition, the series of available DIC microscope images at a fixed time point is a 3D volume, where the nuclear regions in the middle Zslice are usually larger than others. Thus, the nuclear regions are firstly segmented in the middle Zslice using the above strategy and automatically extend the segmentation to the top/down for all slices. The procedure of automatically segmenting the nuclear regions from a 3D DIC volume at a fixed time point is as follows

(1)
Implementing the initial segmentation (Fig. 9 a) of the middle Zslice image on the nuclearenhanced probability map with 13×13 local patches by a thresholding procedure and calculating the initial LSF ϕ.

(2)
Evolving the LSF ϕ on the nuclearenhanced probability map with 3×3 local patches and achieving the final refinement of the segmentation result for the middle Zslice image (Fig. 9 b).

(3)
Topslice segmentation procedure: (a) eroding the previous segmentation regions (Fig. 9 c) using morphological filter for calculating the initial LSF and (b) refining the segmentation results (Fig. 9 d) on the probability map with 3×3 local patches.

(4)
Downslice segmentation procedure as in step (3).
With the above procedure, the nuclear regions of a 3D DIC volume can be automatically segmented
4 Experimental results
4.1 Material
Our nuclear detection method was implemented on three dimensional (3D) timelapse microscope images of a C. elegans embryo obtained from the Worm Developmental Dynamics Database (WDDD; http://so.qbic.riken.jp/wddd/cdd/index.html) constructed by Kyoda et al. [16]. WDDD provides 3D timelapse DIC microscope images for 50 wildtype embryos and 136 RNAi embryos in which one embryonic lethal gene was silenced by RNA interference. All sets of timelapse images were recorded at 40s intervals during the first three rounds of cell division of an embryo. At each time point, DIC microscope images were recorded with 66 consecutive focal planes spaced at 0.5 μ m intervals and 600×600 pixels spaced at 0.1 μ m × 0.1 μ m intervals. We randomly selected three slice images of three wildtype embryos from WDDD for constructing the nuclear models and then implemented our proposed method on the DIC microscope images of five other randomly selected wildtype embryos for evaluation.
4.2 Results
We firstly compare the transformed probability maps of two DIC microscope images from different embryos using our proposed TRIOD and directly using the local patch for pixel representation, respectively, and the local image entropy [6] in Fig. 10. From Fig. 10, we can see that the probability map images with the TRIOD can give a much clearer enhanced nuclear region than those directly using the local patch for pixel representation. On the other hand, the local entropy image can increase the contrast between the cytoplasmic and nuclear regions in some extent; however, the boundary of the transformed entropy images is quite blurred, and the intensity variance in the same regions of cellular components (cytoplasm/nucleus) is also large.
Next, the distanceregularized level set method is employed for segmentation from the middle Zslice to the top/down slices on the transformed maps (local entropy image and the probability map with TRIODs). Three images with segmented results are shown in Fig. 11, where red, green, and blue lines denote the segmented results using local entropy, our proposed probability map, and manual segmentation (groundtruth segmentation), respectively. For segmentation results using local entropy, the initial LSF of the middle Zslice is given manually, and the initial LSF for the next slice is propagated in the same way as introduced in Section 3. Figure 11 manifests that the segmented nuclear regions are easy to be diffused to the cytoplasmic region or be diminished to very small regions especially on the top/down slices. Figure 12 a, b shows the 3D visualization of the nuclear regions in groundtruth and by our proposed strategy for an embryo volume, respectively. In order to evaluate the detected nuclear regions qualitatively, we use two metrics: dice coefficient (DICE) and area overlap (AO), which are defined as follows:
where S _{G} and S _{Seg} denote the nuclear regions of groundtruth and using our proposed strategy, respectively. The compared performances are given in Fig. 13 a, b on DIC microscope images of one wildtype embryo which shows that our proposed method can give 80∼90 % dice coefficients and 70∼90 % AO values even for two sides of images while the local entropybased method failed for two sides of images despite the similar detection performances to our proposed method around the middle Zslice. The similar detection performances were achieved by our proposed method on DIC microscope images of other wildtype embryos, and some examples of the detected nuclear on our proposed probability map and the local entropy image are shown in Figs. 14 and 15, respectively. Figure 14 gives the transformed probability maps, the local entropy images, and the nuclear detection results of two slice images from one wildtype embryo, where the red and green contours denote the detected nuclear boundary on our probability maps and the local entropy images, respectively. Figure 15 gives the nuclear detection results on four slice images from four wildtype embryos and validates that our proposed strategy (red contours) achieves much better detection performance than the local entropybased method (green contours).
5 Conclusions
This study presented a nucleusenhanced probability process with topranked intensityordered descriptors (TRIOD) and employed the distanceregularized level set method for accurately localizing the nuclear regions. The proposed TRIOD is explored to represent the irregular texture and has promising discriminative property for distinguishing the smooth nuclear region and irregular cytoplasm textures. After the nucleusenhancing processing by a probability model, the distanceregularized level set method is used for automated detection of nuclear regions from 3D DIC microscope images. Experiments showed that our proposed framework can achieve very promising performance.
References
The C. elegans Sequencing Consortium (1998) Genome sequence of the nematode C. elegans: a platform for investigating biology. Science282(5396): 2012–2018.
Thomas C, DeVries P, Hardin J, White J (1996) Fourdimensional imaging: computer visualization of 3D movements in living specimens. Science 273(5275): 603–607.
Schnabel R, Hutter H, Moerman D, Schnabel H (1997) Assessing normal embryogenesis in Caenorhabditis elegans using a 4D microscope: variability of development and regional specification. Dev Biol 184(2): 234–265.
Heid PJ, Voss E, Soll DR (2002) 3DDIASemb: a computerassisted system for reconstructing and motion analyzing in 4D every cell and nucleus in a developing embryo. Dev Biol 245(2): 329–347.
Yasuda T, Bannai H, Onami S, Miyano S, Kitano H (1999) Towards automatic construction of celllineage of C. elegans from Nomarski DIC microscope images. Genome Inform 10: 144–154.
Hamahashi S, Onami S, Kitano H (2005) Detection of nuclei in 4D Nomarski DIC microscope images of early Caenorhabditis elegans embryos using local image entropy and object tracking. BMC Bioinformatics 6: 125.
Ning F, Delhomme D, LeCun Y, Piano F, Bottou L, Barbano PE (2005) Toward automatic phenotyping of developing embryos from videos. IEEE Trans Image Process 14(9): 1360–1371.
Li C, Xu C, Gui C, Fox M (2010) Distance regularized level set evolution and its application to image segmentation. IEEE Trans Image Process 19(12): 3243–3254.
Lowe DG (2004) Distinctive image features from scaleinvariant keypoints. Int J Comput Vis 60(2): 91–110.
Mikolajczyk K, Schmid C (2005) A performance evaluation of local descriptors. IEEE Trans Pattern Anal Mach Intell 27(10): 1615–1630.
Tola E, Lepetit V, Fua P (2010) DAISY: an efficient dense descriptor applied to widebaseline stereo. IEEE Trans Pattern Anal Mach Intell 32(5): 815–830.
Ojala T, Pietikainen M, Maenpaa T (2002) Multiresolution grayscale and rotation invariant texture classification with local binary patterns. IEEE Trans Pattern Anal Mach Intell 24(7): 971–987.
Gupta R, Patil H, Mittal A (2010) Robust orderbased methods for feature description In: Proceedings of 2010 IEEE Conference on Computer Vision and Pattern Recognition, 334–341.. IEEE, Piscataway.
Sethian J (1999) Level set methods and fast marching methods. Cambridge University Press, Cambridge.
Osher S, Fedkiw R (2002) Level set methods and dynamic implicit surfaces. SpringerVerlag New York, Inc., New York.
Kyoda K, Adachi E, Masuda E, Nagai Y, Suzuki Y, Oguro T, Urai M, Arai R, Furukawa M, Shimada K, Kuramochi J, Nagai E, Onami S (2013) WDDD: Worm Developmental Dynamics Database. Nucleic Acids Res 41(Database issue): D732–D737.
Acknowledgements
This work was supported in part by the National Bioscience Database Center (NBDC) of the Japan Science and Technology Agency (JST), the GrantinAid for Scientific Research from the Japanese Ministry for Education, Science, Culture and Sports (MEXT) under the Grant No. 15K00253 and 16H01436 and the New Energy and Industrial Technology Development Organization (NEDO).
Authors’ contributions
XHH carried out the nuclear detection studies, conducted the experiments, and drafted the manuscript. YT and KK participated in the acquisition of the data and the analysis and interpretation of the data and drafted the manuscript. SO, IN, and YWC have revised the draft critically for important intellectual content and given the final approval of the version to be published. All authors read and approved the final manuscript.
Competing interests
The authors declare that they have no competing interests.
About the authors
XianHua Han received a B.E. degree from Chongqing University, Chongqing, China, a M.E. degree from Shandong University, Jinan, China, and a D.E. degree in 2005, from the University of the Ryukyus, Okinawa, Japan. From April 2007 to March 2013, she was a postdoctoral fellow and an associate professor at the College of Information Science and Engineering, Ritsumeikan University, Japan. She is now a senior researcher at the National Institute of Advanced Industrial Science and Technology (AIST), Tokyo, Japan. Her current research interests include image processing and analysis, feature extraction, machine learning, computer vision, and pattern recognition. She is a member of the IEEE, IEICE.
Yukako Tohsato received her M.E. from Kyushu Institute of Technology University in 1997 and her Ph.D. degree from Osaka University in 2002. She worked as a research associate and then as an assistant researcher at Osaka University from 2002 to 2004. She was an assistant professor at Ritsumeikan University from 2004 to 2012. She is currently a research scientist at RIKEN Quantitative Biology Center. Her research interest is in bioinformatics and systems biology.
Koji Kyoda received his Ph.D. from Keio University in 2005. He is now a research scientist at RIKEN Quantitative Biology Center. His research interests include systems biology, bioimage informatics, highthroughput biological data analysis, and biological database integration.
Shuichi Onami received his D.V.M. from The University of Tokyo in 1994 and his Ph.D. from The Graduate School for Advanced Studies in 1998. He was an associate professor at Keio University from 2002 to 2006 and joined RIKEN as a senior scientist at Genomic Sciences Center in 2006. He is now a team leader at RIKEN Quantitative Biology Center. His current research interests include mathematical modeling of animal development and its application to medicine.
Ikuko Nishikawa received the degrees of Bachelor, Master, and Doctor of Science from Kyoto University by the research in physics. She is now a professor at Ritsumeikan University. Her current research interests include bioinformatics, machine learning, and optimization.
YenWei Chen received a B.E. degree in 1985 from Kobe University, Kobe, 584 Japan, a M.E. degree in 1987, and a D.E. degree in 1990, both from Osaka University, Osaka, Japan. From 1991 to 1994, he was a Research Fellow at the Institute of Laser Technology, Osaka. From October 1994 to March 2004, he was an associate professor and a professor with the Department of Electrical and Electronics Engineering, University of the Ryukyus, Okinawa, Japan. He is currently a professor with the College of Information Science and Engineering, Ritsumeikan University, Japan. He is also a chair professor with the college of Computer Science and Technology, China. He was an Overseas Assessor of the Chinese Academy of Science and Technology, an associate Editor of the International Journal of Image and Graphics (IJIG), an Editorial Board member of the International Journal of KnowledgeBased Intelligent Engineering Systems. His research interests include computer vision, pattern recognition and image processing He has published more than 300 research papers in these fields. Dr. Chen is a member of the IEEE, IEICE, Japan.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Han, XH., Tohsato, Y., Kyoda, K. et al. Nuclear detection in 4D microscope images of a developing embryo using an enhanced probability map of topranked intensityordered descriptors. IPSJ T Comput Vis Appl 8, 8 (2016). https://doi.org/10.1186/s4107401600103
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s4107401600103
Keywords
 Topranked intensityordered descriptor
 TRIOD
 Enhanced probability map
 Nuclear detection
 Level set method