Volumetric texture analysis is an import task in medical imaging domain and is widely used for characterizing tissues and tumors in medical volumes. Local binary pattern (LBP) based texture descriptors are quite successful for characterizing texture information in 2D images. Unfortunately, the number of binary patterns grows exponentially with number of bits in LBP. Hence its straightforward extension to 3D domain results in extremely large number of bit patterns that may not be relevant for subsequent tasks like classification. In this work we present an efficient extension of LBP for 3D data using decision tree. The leaves of this tree represent texture words whose binary patterns are encoded using the path being followed from the root to reach the leaf. Once trained, this tree is used to create histogram in bag-of-words fashion that can be used as texture descriptor for whole volumetric image. For training, each voxel is converted into a 3D LBP pattern and is assigned the label of it’s corresponding volumetric image. These patterns are used in supervised fashion to construct decision tree. The leaves of the corresponding tree are used as texture descriptor for downstream learning tasks. The proposed texture descriptor achieved state of the art classification results on RFAI database 1. We further showed its efficacy on MR knee protocol classification task where we obtained near perfect results. The proposed algorithm is extremely efficient, computing texture descriptor of typical MRI image in less than 100 milliseconds.
Automatically detecting anatomy orientation is an important task in medical image analysis. Specifically, the ability to automatically detect coarse orientation of structures is useful to minimize the effort of fine/accurate orientation detection algorithms, to initialize non-rigid deformable registration algorithms or to align models to target structures in model-based segmentation algorithms. In this work, we present a deep convolution neural network (DCNN)-based method for fast and robust detection of the coarse structure orientation, i.e., the hemi-sphere where the principal axis of a structure lies. That is, our algorithm predicts whether the principal orientation of a structure is in the northern hemisphere or southern hemisphere, which we will refer to as UP and DOWN, respectively, in the remainder of this manuscript. The only assumption of our method is that the entire structure is located within the scan’s field-of-view (FOV). To efficiently solve the problem in 3D space, we formulated it as a multi-planar 2D deep learning problem. In the training stage, a large number coronal-sagittal slice pairs are constructed as 2-channel images to train a DCNN to classify whether a scan is UP or DOWN. During testing, we randomly sample a small number of coronal-sagittal 2-channel images and pass them through our trained network. Finally, coarse structure orientation is determined using majority voting. We tested our method on 114 Elbow MR Scans. Experimental results suggest that only five 2-channel images are sufficient to achieve a high success rate of 97.39%. Our method is also extremely fast and takes approximately 50 milliseconds per 3D MR scan. Our method is insensitive to the location of the structure in the FOV.