Texture Feature Extraction For Classification of R
Texture Feature Extraction For Classification of R
net/publication/228771219
CITATIONS READS
120 761
3 authors, including:
Jorge Recio
Universitat Politècnica de València
44 PUBLICATIONS 919 CITATIONS
SEE PROFILE
Some of the authors of this publication are also working on these related projects:
Characterisation of forest structure by integrated analysis of methods based on LiDAR, terrestrial laser scanning and imagery View project
Analysis and assessment of forest structure parameters from LiDAR and other emergent techniques for modeling fuel potential View project
All content following this page was uploaded by Jorge Recio on 23 September 2014.
ABSTRACT:
The extraction of texture features from high resolution remote sensing imagery provides a complementary source of data for those
applications in which the spectral information is not sufficient for identification or classification of spectrally heterogeneous
landscape units. However, there is a wide range of texture analysis techniques that are used with different criteria for feature
extraction: statistical methods (grey level coocurrence matrix, semivariogram analysis); filter techniques (energy filters, Gabor
filters); or the most recent techniques based on wavelet decomposition. The combination of parameters that optimize a method for a
specific application should be decided when these techniques are used. These parameters include the neighbourhood size, the
distance between pixels, the type of filter or mother wavelet used, the frequency or the standard deviation used to create the Gabor
filters, etc. The combination of parameters and the texture method used is expected to be key in the success and efficiency of these
techniques for a particular application.
In this study, we analyze several texture methods applied to the classification of remote sensing images with different types of
landscapes, as well as the optimal combination of parameters for each group of data. For this purpose, we created a database with
high resolution satellite and aerial images from two types of environments, representing two of the main applications of texture
analysis in remote sensing: Urban and forestry. The texture classes defined in urban applications involve heterogeneity and
symmetry, while in forest applications is important to know the type and density of vegetation. The results show that the type of
application determines the technique and the combination of parameters to be used for optimizing accuracy. The combination of
texture methods and spectral information improves the results of classification. Finally, some specific methods to correct the border
effect should be developped before these techniques can be applied in practice.
P(i , j ) (1)
p(i , j ) = Ng − 1Ng − 1
The parameters that define each of the filters are:
∑ ∑ P(i , j )
i =0 j =0
1. The radial frequency (F) where the filter is centered
in the frequency domain.
2. The standard deviation (σ) of the Gaussian curve.
where Ng represents the total number of grey levels. Using this 3. The orientation (θ).
matrix, Haralick (1973) proposed several statistical features
representing texture properties, like contrast, uniformity, mean, For the purpose of simplicity, we assume that the Gaussian
variance, inertia moments, etc. Some of those features were curve is symmetrical. The filter bank was created with 6
calculated, selected and used in this study. orientations (0º, 30º, 60º, 90º, 120º and 150º) and 3
combinations of frequency and standard deviation: F=0.3536
2.2 Energy filters and edgeness and σ =2.865, F=0.1768 and σ =5.73, F=0.0884 and σ
=11.444. This operation produced a total of 18 filters covering
The energy filters (Laws, 1985) were designed to enhance some the map of frequencies. Once the filters were applied and their
textural properties of the images. This method is based on the magnitude computed, the image was convolved by a Gaussian
application of convolutions to the original image, I, using filter (σ =5) to reduce the variance.
different filters g1, g2,...,gN , therefore obtaining N new images
Jn = I * gn (n = 1,...,N). Then, the energy in the neighbourhood 2.4 Wavelet transform
of each pixel is calculated. In order to reduce the error due to
the border effect between different textures, a post-processing The use of wavelet transform was first proposed for texture
method proposed by Hsiao y Sawchuk (1989) was used. This analysis by Mallat (1989). This transform provides a robust
method is based on the calculation, for each pixel of the filtered methodology for texture analysis in different scales. The
image Jn, of the mean and variance of the four square wavelet transform allows for the decomposition of a signal
neighbourhoods in which each pixel is a corner, and assigning using a series of elemental functions called wavelets and
as the final value for that pixel the mean of the neighbourhood scaling, which are created by scalings and translations of a base
with the lowest variance, which is supposed to be more function, known as the mother wavelet:
homogeneous and, consequently, should contain only one type s ∈ ℜ+ u ∈ ℜ
of texture (no borders).
1 x−u
ψ s ,u ( x ) = ψ
The edgeness factor is a feature that represents the density of s s
edges present in a neighbourhood. Thus, the gradient of an
image I is computed as a function of the distance “d” between (5)
neighbour pixels, using the expression:
where “s” governs the scaling and “u” the translation. The
g (i, j, d ) = ∑{| I (i, j ) − I (i + d , j ) | + | I (i, j) − I (i − d , j ) | + (2) wavelet decomposition of a function is obtained by applying
( i , j )∈N
each of the elemental functions or wavelets to the original
+ | I (i, j ) − I (i, j + d ) | + | I (i, j ) − I (i, j − d ) |} function:
(6)
where g(i,j,d) represents the edgeness per unit area surrounding
1 * x − u
a generic pixel (i,j) (Sutton and Hall, 1972). Wf ( s, u ) = ∫ f ( x) ψ dx
ℜ s s
2.3 Gabor filters
In practice, wavelets are applied as high-pass filters, while
These filters are based on multichannel filtering, which scalings are equal to low-pass filters. As a result of this, the
emulates some characteristics of the human visual system. The wavelet transform decomposes the original image into a series
human visual system decomposes an image formed in the retina of images with different scales, called trends and fluctuations.
into several filtered images, each of them having variations in The former are averaged versions of the original image, and the
intensity within a limited range of frequencies and orientations latter contain the high frequencies at different scales or levels.
Since the most relevant texture information is lost in the The vegetation of this area is mainly composed of forest
lowpass filtering process, only fluctuations are used to calculate (Pinus halepensis) and mediterranean shrub, usually
texture descriptors. If the inverse transform is applied to the mixed, and mountain crops (Amigdalus communis, Olea
fluctuations, three reconstructed images, or details, are europaea, Ceratonia siliqua) sometimes forming flat
obtained: horizontal, vertical and diagonal. This process is terraces on the sides of the mountains. The trees of this
called multiresolution analysis. area are more scattered, in part because of a high
Regarding previous work in image texture analysis using recurrence of wildfires over the last several years. Nine
wavelet decomposition, different texture features have been classes were defined: high-density, mid-density and low-
extracted, sometimes from the fluctuations and in other cases density forest, high-density and low density shrub,
from the details, depending on the authors. Sometimes, basic cereals, almond trees, reforestation areas, and crops on
features directly extracted from the histogram were used, such terraces. The data were digital orthophotos with 1m of
as the local energy (Randen and Husoy, 1999) or variance filter spatial resolution, that were also mosaicked to form an
(Ferro and Warner, 2002). Simard et al. (1999), however, used image with a variety of zones (figure 1).
wavelet histogram signatures, while Van de Wouwer et al.
(1999) compared the energy, wavelet histogram signatures and
coocurrence features.
HD-forest MD-forest
We compared the use of fluctuations and details, and four
coocurrence features were calculated using them: variance,
inverse difference moment, contrast and correlation.
In a comparative study about the evaluation of the performance LD-forest HD-shrub
of texture segmentation algorithms based on wavelets, Fatemi-
Ghomi et al. (1996) stated that the identification of the most
appropriate parameters to use in a method is as important a
decision as the choice of which method to use. We also wanted Reforest. Terraces
the window size rises the level of the accuracy in the inner 83
part of the texture areas, but produces a progressive 1+2 1+2+3 1+2+3+4 1+2+3+4+5
Groups of variables
increase in error due to the border effect. A neighbourhood
Daub4 Daub8 Coif12 Coif24
size of 25x25 was used, except for the forest area 3
(Menorca), where a size of 15x15 optimized the accuracy
results. Figure 2. Results for the selection of wavelet type and level of
• Energy filters and edgeness: A common window size of 7 decomposition used for the urban area. (Groups of variables:
pixels was used to apply the filters, while for the post- 1:Original image. 2:Textural variables from original image.
processing operation the window size ranged from 7 to 15 3:Variables from details of 1st level. 4:Variables from details of
pixels, depending on the area. The optimal distance for the 2nd level. 5:Variables from details of 3rd level).
edgeness factor was 3 pixels.
• Gabor filters: The main parameters are the standard
deviation of the filter, what has an interpretation similar to 3.3 Comparison of methods
the window size, and the frequency. After the selection
process, banks of filters with standard deviations of 2.86, The algorithm used in the classification process was the
5.73 and 11.44, and respective frequencies of 0.3536, maximum likelihhod classifier, and two sets of texture samples
0.1768 and 0.0884 were created. They were defined by the were defined for each area: a training set and a testing set, both
six dominant directions and then averaged to eliminate the independent and chosen to be representative of the different
orientation factor. classes considered. After the aforementioned selection of
• Wavelet based method: Four types of wavelet families variables, several combinations of groups of variables were
were tested, Daubechies 4 and 8, and Coiflet 12 and 24, as tested to compare the texture methods. The results of the
well as 3 different levels of fluctuations and details. The different classifications, in terms of overall accuracy, are shown
best results were obtained using the wavelet Coiflet-24 and in figure 3.
its reconstructed details form the 3 levels, because each As expected, due to the spectral heterogeneity of most of the
level provides texture information from a different scale classes, the lower accuracy levels correspond to the only
(figure 2). spectral classification that uses the four multispectral bands of
the QuickBird image (only for the area of Menorca). The
As a result of these preliminary tests, a reduction of the texture accuracy increases by combining different groups of texture
features to be used in the comparative classification process was variables.
made for each of the four methods tried.
MS+Textures 83,3
76,18
GLCM+WV+Gabor+Energy 82,06
81,4
88,41
73,92
GLCM+Energy 75,6
78,03
85,82
71,03
GLCM+Gabor 76,56
76,6
86,45
72,42
FOREST 1
GLCM+WV(Coif24) 75,16
80,05
87,24
FOREST 2
67,44 FOREST 3
Energy 57,35
62,96
70,7
65,7 URBAN
Gabor 61,73
68,4
68,14
53,75
WV(Coif24) 65,47
66,4
79,28
65,97
GLCM(8) 71,17
74,7
84,25
MS 61,9
50 55 60 65 70 75 80 85 90 95
Figure 3. Overall accuracy percentages obtained for the four test areas using different methods and combinations of texture variables.
Considering the different texture methods independently, it
cannot be stated that there is a universal method that is best for Class Producer’s User’s
all cases, since the results seem to depend on the type of accuracy accuracy
problem treated. However, they are usually better when Citrus orchards 80.07 86.18
statistical coocurrence features are used. The combination of New Urban 88.09 92.23
these statistical variables with any of the other methods, energy Horticulture 86.38 87.66
filters, Gabor filters or wavelets, produce a significant increase Old Urban 89.04 94.70
in the overall accuracy levels, especially with the latter. This is
Residential 96.70 98.83
problably due to the complementary condition of the methods
Industrial 94.10 65.99
based on filtering with respect to the direct statistical method
based on the GLCM. It is interesting to note that using only
three Gabor filters (three features) it is possible to obtain Table 1. Accuracy percentages of the classification of the urban
relatively good classification results. area using all the texture features (4 methods) combined.
Table 2. Results of the classification of Menorca using spectral variables, texture variables and a combination of both.
Comparing the spectral and texture classifications in table 2, we important errors in the transition areas between texture
see that spectral classification is better suited for those units. Further work should be done to reduce this effect.
landscape units with a specific spectral response pattern and
well differenciated from the rest of the units, such as pasture REFERENCES
land and cereal crops, or fallow. The distribution of grey levels
in these two classes is very homogeneous, so they are more Fatemi-Ghomi, N., Palmer, P.L., Petrou, M., 1996. Performance
difficult to discriminate by texture methods. On the other hand, of texture segmentation algorithms based on wavelets.
texture techniques are very efficient in classifying lanscape Technical Report. Electronic and Electrical Engineering
units that contain a high spectral heterogeneity, such as Department. University of Surrey.
scattered trees, forest-shrub and dense shrub. These classes are
not very accurate when classified using only spectral band. Ferro, C.J. and Warner, T.A., 2002. Scale and texture in digital
Another interesting aspect is the the integration of spectral and image classification. Photogrammetric Engineering and Remote
texture bands for classification has a synergic effect on the Sensing, 68(1), pp. 51-63.
results, in some cases even improving the accuracy of both
Haralick, R.M., K Shanmugam and Dinstein, 1973. Texture
groups of classes.
features for image classification. IEEE Transactions on
However, it is important to note that the reported results refer to
Systems, Man. and Cibernetics. SMC-3 : pp. 610-622.
the inner areas of the texture units and not to the borders
between textures. In these areas, the border effect decreases the Hsiao, J.Y. and A.A. Sawchuk, 1989. Unsupervised image
overall accuracy to 47%. An example of this effect is shown on segmentation using feature smoothing and probabilisatic
the detail image of figure 6. Some previous tests have shown relaxation techniques. Computer Vision, Graphics and Image
how the post-processing operation, described for the energy Processing, vol. 48, pp. 1-21.
filters, increases the accuracy in the border areas in a 27% (Ruiz
et al., 2001) Laws, K.I., 1985. Goal-directed texture image segmentation.
Applications of Artificial Intelligence II, SPIE (548), pp.19-26.