|
|
||||||||
ENVIRONMENT, WELL-BEING, AND BEHAVIOR |




* Animal Husbandry and Welfare, Animal Sciences, Institute for Agricultural and Fisheries Research, 9090 Melle, Belgium;
Agricultural Engineering, Technology and Food, Institute for Agricultural and Fisheries Research, 9820 Merelbeke, Belgium;
Group of Evolutionary Biology, Department of Biology, University of Antwerp, 2000 Antwerp, Belgium; and
Terrestrial Ecology Unit, Department of Biology, Ghent University, 9000 Ghent, Belgium
1 Corresponding author: els.vanpoucke{at}ilvo.vlaanderen.be
| ABSTRACT |
|---|
|
|
|---|
Key Words: farm animal welfare developmental instability emotional stress physical stress statistical power
| INTRODUCTION |
|---|
|
|
|---|
Recently, FA has been suggested to comprise a putative measure of animal welfare (Møller et al., 1999; Møller and Manning, 2003), because it reflects the ability of the individual to cope with the sum of challenges that it faces during its development (Swaddle and Witter, 1997; Kellner and Alford, 2003; Knierim et al., 2007). Animal welfare is a complex and multidimensional concept (Mason and Mendl, 1993; Fraser, 1995). Different definitions and perceptions concerning animal welfare exist, but it is generally accepted that animal welfare covers 2 main properties of an animal (i.e., its physical state and its emotional state; Fraser, 1995; Anonymous, 2001; Bracke, 2001). Given this multidimensional property, a wide variety of indicators are required to assess animal welfare (Mason and Mendl, 1993; Duncan and Fraser, 1997; Spoolder et al., 2003), including estimates of performance, health, behavior, and physiology. However, there is a lack of valid, sensitive, reliable, and robust animal-based indicators that can feasibly be measured or scored for monitoring animal welfare on-farm or at slaughter.
This explains the growing interest in FA as a presumably integrated, reliable, and objective welfare indicator (Møller et al., 1995, 1999; Campo et al., 2000, 2002; Kellner and Alford, 2003). At present, however, it is unclear how sensitive FA is as an indicator of the welfare of farm animals. On the one hand, strong selection by animal breeders to optimize production-related traits may have rendered farm animals particularly prone to disruption of their developmental processes, hence supporting the use of phenotypic markers (such as FA) that are designed to estimate levels of developmental stability (Møller, 1993; Møller et al., 1995, 1999). On the other hand, however, the fact that farm animals are generally fed ad libitum and housed under conditions that minimize their energy expenditure may lower the likelihood of detecting relationships with indices of DI (such as FA) that are assumed to reflect energy allocation constraints. Possibly as a result of these opposing expectations, empirical studies of the link between FA and farm animal welfare yield heterogeneous results (Tuyttens, 2003). Other factors such as the type of stress (e.g., stressors affecting the physical state of the animal are more likely to induce an effect on FA compared with emotional stressors; Tuyttens, 2003), inappropriate protocols for measuring (e.g., poor choice of traits, because DI is assumed to be trait-specific; Clarke, 2003), and analyzing FA (e.g., not integrating multiple traits; Leung et al., 2000; or low statistical power; Knierim et al., 2007) may intensify this heterogeneity.
In this study, we exposed growing broiler chickens to 4 different types of chronic or repeated stressors and measured their levels of FA at slaughter age in a suite of bilateral traits. Two of the 4 stressors were known not to affect a series of conventional welfare indicators at slaughter age (Van Nuffel et al., 2005; Van Poucke et al., 2006). These 2 stress treatments (pain and frustration) were designed to predominantly affect the emotional state of the broilers. Both other stress treatments (wet litter and high temperature and density) were predicted to negatively affect their physical state. The objectives of the present study are to test the level of stress sensitivity of FA compared with these other welfare indicators in commercial broiler chickens and to compare the strength of the relationship with FA between emotional and physical stressors.
| MATERIALS AND METHODS |
|---|
|
|
|---|
Each treatment was replicated 5 times (1, 1, 2, and 3 wk after the start of the first round; Table 1
), and in each replicate, broilers of the different treatments were housed in separate pens within the same compartment (1 compartment was used twice). The first group of 5 x 50 broilers (replicate 1) was housed in the first compartment with broilers randomly allocated to 1 of the pens. At the beginning, stocking density was 16.7 animals/m2 (i.e., 50 broilers/pen) except for the TD treatment in which density was permanently raised to 53 kg/m2 by adjusting pen length (see below). At the age of 12 and 24 d, 10 broilers were removed in all pens as part of other welfare measurements (Van Nuffel et al., 2005; Van Poucke et al., 2006). The distribution of treatments over the pens was randomized.
|
The WL and TD treatments were designed to primarily affect the physical state of the broilers. Under the WL treatment, broilers had their litter moistened daily with 5 L of tap water. Wet litter is a principal factor in causing painful foot pad dermatitis, which is considered a major welfare problem in broilers (Greene et al., 1985; Mayne, 2005). Because of the severity of these lesions, moistening was stopped at d 19 for ethical reasons. Broilers of the TD treatment group were exposed to a combination of 2 stressors: an elevated temperature of 35°C from 10 to 17 h each day (induced by two 250-W lamps) and an increased stocking density of 53 kg/m2 (by adjusting the pen length according to the estimated live weight). Heat stress in broilers may reduce feed intake, resulting in lower BW (Johnson et al., 1991; Rose, 1997; Yalçin et al., 1997), and is further known to affect their physiology (e.g., increased heterophil:lymphocyte ratio; McFarlane and Curtis, 1989; Altan et al., 2003) and behavior (e.g., longer duration of tonic immobility indicating higher fearfulness; Altan et al., 2003). Increased stocking density may lead to reduced activity levels (Lewis and Hurnik, 1990; Hall, 2001) and a higher prevalence of leg injuries, which may cause reduced mobility (Sørensen et al., 2000; Sanotra et al., 2001; Dawkins et al., 2004) and food pad dermatitis or hock burns (Proudfoot et al., 1979; Cravener et al., 1992; Hall, 2001; Dozier et al., 2005, 2006). As such, stocking density is a major issue in broiler welfare (SCAHAW, 2000), and a combined heat stress-stocking density treatment is believed to be particularly stressful, because poultry show the tendency to increase their nearest neighbor distance if temperature is raising (Rose, 1997).
Measurements of Fluctuating Asymmetry
Measurements on Intact Carcasses.
At the age of 42 d (i.e., standard slaughter age), 10 randomly chosen broilers per pen were euthanized by cervical dislocation after electrical stunning (90 V for 15 s). The left and right sides of the following 7 bilateral traits were measured twice on intact carcasses by a single person: wattle width (distance between outer junctures), eye length (distance between eye corners), first secondary feather length (total feather length after plucking), tarsometatarsus length (distance between the joint of the tarsometatarsus with the tibiotarsus and the proximal skin fold on the midtoe, holding the tibiotarsus perpendicular to the tarsometatarsus and holding the midtoe in line with the latter), outertoe length (i.e., distance between the outer skin folds on the fourth phalanx when folding the outertoe), midtoe length (i.e., distance between the outer skin folds on the third phalanx when folding the midtoe), and backtoe length (distance between the tarsometatarsus and the nail, holding the backtoe perpendicular to the tarsometatarsus). All measurements were taken with a digital caliper (to the nearest 0.01 mm), apart from the first secondary feather length, which was measured with a ruler (to the nearest 0.5 mm). We refer to Van Poucke et al. (2006) or Van Nuffel et al. (2007) for additional illustrations, protocols, and methodological details about these measurements. In a preliminary study, all these traits were deemed suitable for the study of FA in broilers based on the presence of a high signal (FA)-to-noise (measurement error) ratio and the absence of DA, AS, and correlation in the signed FA values (Van Poucke et al., 2006).
Measurements on Fleshed Bones.
Following the measurements on intact carcasses, bones were extracted from the carcasses using the method described by Mc-Donald and Vaughan (1999). Head, wings, and legs were immersed into a 60-g sodium perborate tetrahydrate solution in hot water (1 L) and incubated in a water bath (65°C) for 1 d. Afterwards, most of the flesh was removed manually, and the bones were incubated again in a 30-g sodium perborate tetrahydrate solution. The next day, remaining flesh was removed manually with a water jet pump and small brushes, after which the bones were kept in a drying oven (50°C) for 1 d. The following bilateral measurements were taken by a single person using a digital caliper (same protocols, methods, and criteria as above): humerus length, radius length, metacarpal minus length, tarsometatarsus length, radius width (i.e., the smallest width), tarsometatarsus width (i.e., width at the joint of the tarsometatarsus with the tibiotarsus), and fibula width (i.e., the largest width). See Van Poucke et al. (2006) or Van Nuffel et al. (2007) for additional illustrations and further details about these measurements.
Statistical Analysis and Power Simulations
A mixed regression model (Van Dongen et al., 1999) was used to test for DA (by F-tests) and significance of FA (by likelihood ratio tests) and to obtain unbiased, trait-specific FA estimates at individual broiler level. Based on variance components estimated for the random side effects (reflecting variation between trait sides) and residual variance (reflecting variation within trait sides), the signal (FA)-to-noise (measurement error) ratio was estimated for each trait. The kurtosis values of the distributions of the signed asymmetries were estimated, and values smaller than –1 were considered as indicative for the presence of AS. Only traits that showed significant FA and did not show DA nor AS were used in subsequent analyses.
Differences in mean FA among treatments were tested with linear mixed models. Individual FA estimates, standardized to zero mean and unit variance for each trait, were included as dependent variable; factor treatment and its interaction with trait were included as fixed effects; and factor replicate and its interaction with factor treatment were included as random effects. Different traits were modeled as repeated measurements at the individual broiler level (see above), and the covariance between the residual values was modeled by a compound symmetry structure. Analyses were also done for each trait separately.
To assess the power of our experiment and analyses, we performed post hoc simulations. We sampled 1,000 datasets from a distribution with mean asymmetry values equal to the observed ones in our study and determined the proportion of tests that would be statistically significant. This was done for both the overall F-test and the pairwise comparison between the 2 treatments that showed the highest difference in average FA.
All analyses were performed in SAS, version 8, and we refer to Verbeke and Molenberghs (2000) for more details on the mixed model approach.
| RESULTS |
|---|
|
|
|---|
|
|
The power of the overall F-test with a sample size of 50 individuals (10 individuals per replicate and 5 replicates) equaled 35%. Increasing the number of replicates to 10 (and thus 100 individuals in each treatment) resulted in a power of 70%. For 15 replicates, power became reasonably high at 90%. Thus, we would have needed over 100 individuals per treatment to achieve a reasonably high power when the expected differences in average FA would have been equal to the observed values. Comparable results were obtained when comparing control and TD treatments (showing the highest difference in average FA).
| DISCUSSION |
|---|
|
|
|---|
Previous measurements of conventional welfare indicators at slaughter age confirmed that broilers from the physical stress treatments experienced elevated stress levels. Compared with the other treatment groups, these broilers scored worse on the latency-to-lie test (a test for leg health), on the tonic immobility test (a test for fearfulness), and on the physical scores (the condition of the foot pad, hock, breast, and thigh), whereas performance, frequency of behavioral activities, and physiological data were not influenced (Van Nuffel et al., 2005; Van Poucke et al., 2006). The emotional stress treatments did not affect any of these welfare indicators, despite prior evidence for stress effects in related species and stressors (see references in materials and methods section) and circumstantial data from our experiment (e.g., withdrawing legs and uttering distress calls when feathers were plucked in the PAIN group, running to the opposite side of the pen or sitting motionless when exposed to a dummy raptor, and eliciting alarm calls when physically isolated from group members in the FRUS group, all suggesting elevated stress levels). Given that our physical stress treatments did not result in increased FA, either, severe welfare problems stemming from long-term selection for increased BW and improved feed efficiency (i.e., skeletal disorder, muscle disorder, contact dermatitis, ascites, and respiratory problems; SCAHAW, 2000) may have masked additional (experimental) stress effects on developmental processes. Alternatively, FA may not be a sensitive indicator of stress in broiler chickens due to the general absence of energy allocation constraints in ad libitum-fed organisms housed under conditions that optimize growth and feed conversion efficiency. Enlarging the difference in stress effects between stress treatment and control groups, either by decreasing background stress (in line with findings of Tuyttens et al., 2007) or by superimposing nutritional stress, may allow discrimination between both hypotheses.
It is further known that FA constitutes an exceedingly small signal (often <1% of the trait size; Palmer, 1994) and that its applicability depends on both measurement accuracy and statistical power. For all but 1 trait under study, measurement error was smaller than the level of FA. But, even if measurement accuracy was theoretically sufficient to detect between-group differences in FA, it might still not have been possible to demonstrate such differences due to insufficient statistical power and also when combining information from different traits into a single analysis, which is generally believed to increase the probability of detecting stress effects (Leung et al., 2000). Higher statistical power could have been achieved either by increasing sample size or by increasing the number of repeated measurements per individual (Van Dongen et al., 1999; Knierim et al., 2007).
| ACKNOWLEDGMENTS |
|---|
Received for publication November 21, 2006. Accepted for publication June 9, 2007.
| REFERENCES |
|---|
|
|
|---|
Anonymous. 2001. Scientists assessment of the impact of housing and management on animal welfare. J. Appl. Anim. Welf. Sci. 4:3–52.
Bracke, M. B. M. 2001. Modelling of animal welfare. The development of a decision support system to assess the welfare status of pregnant sows. PhD Thesis. Wageningen Univ., Wageningen, the Netherlands.
Campo, J. L., M. García Gil, I. Muñoz, and M. Alonso. 2000. Relationships between bilateral asymmetry and tonic immobility reaction or heterophil to lymphocyte ratio in five breeds of chickens. Poult. Sci. 79:453–459.
Campo, J. L., M. G. Gil, O. Torres, and S. G. Dávila. 2002. Fluctuating asymmetry in male secondary sexual traits: Association with indicators of stress in chickens. Arch. Geflügelkd. 66:85–89.
Clarke, G. M. 2003. Developmental stability-fitness relationships in animals: Some theoretical considerations. Pages 187–195 in Developmental Instability: Causes and Consequences. M. Polak, ed. Oxford Univ. Press, Oxford, UK.
Cravener, T. L., W. B. Roush, and M. M. Mashaly. 1992. Broiler production under varying population densities. Poult. Sci. 71:427–433.[ISI][Medline]
Dawkins, M. S., C. A. Donnelly, and T. A. Jones. 2004. Chicken welfare is influenced more by housing conditions than by stocking density. Nature 427:342–344.[Medline]
Dozier, W. A., III, J. P. Thaxton, S. L. Branton, G. W. Morgan, D. M. Miles, W. B. Roush, B. D. Lott, and Y. Vizzier-Thaxton. 2005. Stocking density effects on growth performance and processing yields of heavy broilers. Poult. Sci. 84:1332–1338.
Dozier, W. A., III, J. P. Thaxton, J. L. Purswell, H. A. Olanrewaju, S. L. Branton, and W. B. Roush. 2006. Stocking density effects on male broilers grown to 1.8 kilograms of body weight. Poult. Sci. 85:344–351.
Duncan, I. J. H., and D. Fraser. 1997. Understanding Animal Welfare. Pages 19–31 in Animal Welfare. M. C. Appelby and B. O. Hughes, ed. CAB Int., Wallingford, UK.
Duncan, I. J. H., and D. G. M. Wood-Gush. 1971. Frustration and aggression in the domestic fowl. Anim. Behav. 19:500–504.[ISI][Medline]
Evans, C. S., J. M. Macedonia, and P. Marler. 1993. Effects of apparent size and speed on the response of chickens, Gallus gallus, to computer-generated simulations of aerial predators. Anim. Behav. 46:1–11.[ISI]
Evans, C. S., and P. Marler. 1992. Female appearance as a factor in the responsiveness of male chickens during anti-predator behaviour and courtship. Anim. Behav. 43:137–145.[ISI]
Feltenstein, M. W., N. G. Ford, K. B. Freeman, and K. J. Sufka. 2002. Dissociation of stress behaviours in the chick social-separation-stress procedure. Physiol. Behav. 75:675–679.[Medline]
Fraser, D. 1995. Science, values and animal welfare: Exploring the inextricable connection. Anim. Welf. 4:103–117.
Gentle, M. J., and L. N. Hunter. 1990. Physiological and behavioural responses associated with feather removal in Gallus gallus var domesticus. Res. Vet. Sci. 50:95–101.[ISI]
Greene, J. A., R. M. McRacken, and R. T. Evans. 1985. A contact dermatitis of broilers – clinical and pathological findings. Avian Pathol. 14:23–38.[ISI]
Hall, A. L. 2001. The effect of stocking density on the welfare and behaviour of broiler chickens reared commercially. Anim. Welf. 10:23–40.[Medline]
Haskell, M., N. C. A. Coerse, and B. Forkman. 2000. Frustration-induced aggression in the domestic hen: The effect of thwarting access to food and water on aggressive responses and subsequent approach tendencies. Behaviour 137:531–546.
Haskell, M. J., N. C. A. Coerse, P. A. E. Taylor, and C. McCorquodale. 2004. The effect of previous experience over control of access to food and light on the level of frustration-induced aggression in the domestic hen. Ethology 110:501–513.[ISI]
Johnson, R. W., S. E. Curtis, and R. D. Shanks. 1991. Effects on chick performance of ammonia and heat stressors in various combination sequences. Poult. Sci. 70:1132–1137.[ISI][Medline]
Kellner, J. R., and R. A. Alford. 2003. The ontogeny of fluctuating asymmetry. Am. Nat. 161:931–947.[ISI][Medline]
Knierim, U., S. Van Dongen, B. Forkman, F. A. M. Tuyttens, M.
pinka, J. L. Campo, and G. E. Weissengruber. 2007. Fluctuating asymmetry as an animal welfare indicator – A review of methodology and validity. Physiol. Behav. doi:10.1016/j.physbeh.2007.02.014
Lens, L., S. Van Dongen, S. Kark, and E. Matthysen. 2002. Fluctuating asymmetry as an indicator of fitness: Can we bridge the gap between studies? Biol. Rev. Camb. Philos. Soc. 77:27–38.[Medline]
Leung, B., M. R. Forbes, and D. Houle. 2000. Fluctuating asymmetry as a bioindicator of stress: Comparing efficacy of analyses involving multiple traits. Am. Nat. 155:101–115.[ISI][Medline]
Lewis, N. J., and J. F. Hurnik. 1990. Locomotion of broiler chickens in floor pens. Poult. Sci. 69:1087–1093.[ISI][Medline]
Ludwig, W. 1932. Das Rechts-Links Problem im Tierreich und beim Menschen. Springer, Berlin, Germany.
Marx, G., J. Leppelt, and F. Ellendorff. 2001. Vocalization in chicks (Gallus gallus dom.) during stepwise social isolation. Appl. Anim. Behav. Sci. 75:61–74.[ISI]
Mason, G., and M. Mendl. 1993. Why is there no simple way of measuring animal welfare? Anim. Welf. 2:301–319.
Mayne, R. K. 2005. A review of the aetiology and possible causative factors of foot pad dermatitis in growing turkeys and broilers. Worlds Poult. Sci. J. 61:256–267.[ISI]
McDonald, R. A., and N. Vaughan. 1999. An efficient way to prepare mammalian skulls and bones. Mamm. Rev. 29:265–266.
McFarlane, J. M., and S. E. Curtis. 1989. Multiple concurrent stressors in chicks. 3. Effects on plasma corticosterone and heterophil:lymphocyte ratio. Poult. Sci. 68:522–527.[ISI][Medline]
Møller, A. P. 1993. Developmental instability, sexual selection and speciation. J. Evol. Biol. 6:493–509.[ISI]
Møller, A. P., and J. T. Manning. 2003. Growth and developmental instability. Vet. J. 166:19–27.[ISI][Medline]
Møller, A. P., G. S. Sanotra, and K. S. Vestergaard. 1995. Developmental stability in relation to population density and breed of chickens Gallus gallus. Poult. Sci. 74:1761–1771.[ISI][Medline]
Møller, A. P., G. S. Sanotra, and K. S. Vestergaard. 1999. Developmental instability and light regime in chickens (Gallus gallus). Appl. Anim. Behav. Sci. 62:57–71.[ISI]
Møller, A. P., and J. P. Swaddle. 1997. Asymmetry, developmental stability and evolution. Oxford Univ. Press, Oxford, UK.
Palmer, A. R. 1994. Fluctuating asymmetry analyses: A primer. Pages 335–364 in Developmental Stability: Its Origins and Evolutionary Implications. T. A. Markow, ed. Kluwer Acad. Publ., Dordrecht, the Netherlands.
Palmer, A. R., and C. Strobeck. 1992. Fluctuating asymmetry as a measure of developmental stability: Implications of non-normal distributions and power of statistical tests. Acta Zool. Fenn. 191:57–72.
Proudfoot, F. G., H. W. Hulan, and D. R. Ramey. 1979. The effect of four stocking densities on broiler carcass grade, the incidence of breast blisters, and other performance traits. Poult. Sci. 58:791–793.[ISI]
Rose, S. P. 1997. Principles of Poultry Science. CAB Int., Wallingford, UK.
Sanotra, G. S., L. G. Lawson, K. S. Vestergaard, and M. G. Thomson. 2001. Influence of stocking density on tonic immobility, lameness and tibial dyschondroplasia in broilers. J. Appl. Anim. Welf. Sci. 4:71–87.
SCAHAW. 2000. The welfare of chickens kept for meat production (broilers). http://ec.europa.eu/food/animal/welfare/farm/initiatives_en.htm Accessed Nov. 2006.
Sørensen, P., G. Su, and S. C. Kestin. 2000. Effects of age and stocking density on leg weakness in broiler chickens. Poult. Sci. 79:864–870.
Spoolder, H., G. De Rosa, B. Hörning, S. Waiblinger, and F. Wemelsfelder. 2003. Integrating parameters to assess on-farm welfare. Anim. Welf. 12:529–534.[ISI]
Swaddle, J. P., and M. S. Witter. 1997. On the ontogeny of developmental stability in a stabilized trait. Proc. R. Soc. Lond. B Biol. Sci. 264:329–334.
Taylor, P. A., N. C. A. Coerse, and M. Haskell. 2001. The effects of operant control over food and light on the behaviour of domestic hens. Appl. Anim. Behav. Sci. 71:319–333.[ISI][Medline]
Tuyttens, F. A. M. 2003. Measures of developmental instability as an integrated, a posteriori indicator of farm animal welfare: A review. Anim. Welf. 12:535–540.[ISI]
Tuyttens, F., M. Heyndrickx, M. De Boeck, A. Moreels, A. Van Nuffel, E. Van Poucke, E. Van Coillie, S. Van Dongen, and L. Lens. 2007. Broiler chicken health, welfare and fluctuating asymmetry in organic versus conventional production systems. Livest. Sci. doi:10.1016/j.livsci.2007.02.019
Tuyttens, F. A. M., L. Maertens, E. Van Poucke, A. Van Nuffel, S. Debeuckelaere, J. Creve, and L. Lens. 2005. Measuring fluctuating asymmetry in fattening rabbits: A valid indicator of performance and housing quality? J. Anim. Sci. 83:2645–2652.
Van Dongen, S., G. Molenberghs, and E. Matthysen. 1999. The statistical analysis of fluctuating asymmetry: REML estimation of a mixed regression model. J. Evol. Biol. 12:94–102.[ISI]
Van Nuffel, A., E. Van Poucke, S. Van Dongen, L. Lens, and F. Tuyttens. 2007. Measuring fuctuating asymmetry in broilers. http://www.ilvo.vlaanderen.be/documents/fluctasbroilers.pdf Accessed Aug. 2007.
Van Nuffel, A., E. Van Poucke, S. Van Dongen, W. Talloen, B. Sonck, L. Lens, and F. Tuyttens. 2005. The use of welfare indicators to evaluate different types of stress in broilers. Anim. Sci. Pap. Rep. 23(Suppl. 1):275–276.
Van Poucke, E., A. Van Nuffel, S. Van Dongen, G. Huyghebaert, D. De Brabander, B. Sonck, L. Lens, and F. Tuyttens. 2006. Fluctuerende asymmetrie bij vleeskippen als een indicator van welzijn. Inst. Agric. Fish. Res., Merelbeke, Belgium.
Verbeke, G., and G. Molenberghs. 2000. Linear mixed models for longitudinal data. Springer, New York, NY.
Weiss, J. M. 1972. Psychological factors in stress and disease. Sci. Am. 226:104–113.[ISI][Medline]
Yalçin, S., P. Settar, S. Özkan, and A. Cahaner. 1997. Comparative evaluation of three commercial broiler stocks in hot versus temperate climates. Poult. Sci. 76:921–929.
Zimmerman, P. H., and P. Koene. 1998. The effect of loss of predictability and controllability of reward during frustration on behaviour in two strains of laying hens, Gallus gallus domesticus. Neth. J. Zool. 48:255–265.
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |