Hostname: page-component-745bb68f8f-f46jp Total loading time: 0 Render date: 2025-02-11T18:24:04.281Z Has data issue: false hasContentIssue false

From Acquisition to Deterioration of Semantic Knowledge: A Mechanistic Theory of Semantic Cognition

Published online by Cambridge University Press:  26 August 2005

Anna Adlam
Affiliation:
Career Development Fellow, Cognition & Brain Sciences Unit, Medical Research Council, Cambridge, United Kingdom
Rights & Permissions [Opens in a new window]

Extract

Semantic Cognition: A Parallel Distributed Processing Approach, by Timothy T. Rogers and James L. McClelland. (2004). Cambridge, MA: MIT Press, 425 pp., $50.00/£32.95.

This book is aimed at all scientists interested in semantic cognition, even those with limited experience of computational modeling. It benefits from concise and logically presented text and the effective use of figures and illustrations, with details of simulations tucked away in the Appendix. The length of the book defines it not only as a useful addition to a reference collection, but also an excellent primer for young researchers, postgraduates, and even advanced undergraduates.

Type
BOOK REVIEWS
Copyright
© 2005 The International Neuropsychological Society

This book is aimed at all scientists interested in semantic cognition, even those with limited experience of computational modeling. It benefits from concise and logically presented text and the effective use of figures and illustrations, with details of simulations tucked away in the Appendix. The length of the book defines it not only as a useful addition to a reference collection, but also an excellent primer for young researchers, postgraduates, and even advanced undergraduates.

This timely text provides an account of the parallel distributed processing (PDP) approach to semantic cognition. Building on the work of Geoffrey Hinton (1981, 1986) and David Rumelhart (1990; Rumelhart et al., 1986) and the observations of Frank Keil (1979, 1989, 1991) and Jean Mandler (1988, 1990, 1992, 1997, 2000a, 2000b, 2002), the authors propose that distributed connectionist networks provide a promising mechanism for implementing and studying semantic cognition. This approach integrates the strengths and overcomes many weaknesses apparent in more “classical” approaches to this topic.

In the PDP framework, all cognitive performance arises through the propagation of graded signals in a system of interconnected processing units. The representations used in performing these tasks are patterns of activation across units, governed by weighted connections among them. Semantic knowledge is acquired through the gradual adjustment of the strengths of these connections in the course of day-to-day experience. In line with Rumelhart's earlier work, the model remains in a simplified form to maintain clarity and tractability. However, the authors extend Rumelhart's model to address the progressive differentiation of conceptual knowledge in development and the progressive deterioration of conceptual knowledge in some forms of dementia.

As a whole, the book is well structured with a pleasant conversational style. Each chapter begins with a brief introduction outlining its aims, tying in the new topic with those discussed in earlier chapters, and ends with an overall summary. Key points are elucidated in each chapter and tangible examples are given to explain complex concepts. Relevant subheadings throughout the book help guide the reader through the text. The authors have a talent to predict the reader's questions and answers are often found in subsequent paragraphs.

The book begins with a short preface outlining the authors' perspective and introducing the key elements of their approach. The first chapter reviews findings and theories central to the field of semantic cognition (e.g., Carey, 1985; Collins & Quillian, 1969; Keil, 1989, 1991). It also introduces the intriguing observation that conceptual knowledge undergoes a progressive differentiation in development, resulting in the gradual elaboration of a conceptual hierarchy, and that this process is reversed in some forms of dementia, resulting in progressive loss of first the finest and later the coarser conceptual distinctions. Chapter 2 provides an overview of PDP theory, with a focus on the seminal work of Rumelhart and Hinton. In the third chapter, the authors describe preliminary simulations addressing the reasons for the observed patterns of development and disintegration of semantic knowledge. The subsequent chapters (4 through 7) in turn describe more targeted simulations to address specific issues including, preverbal conceptual development, naming ability, category coherence, and inductive projection. Each of these chapters conjoins experimental findings with results from the simu\.lations. Readers with minimal knowledge of computational modeling will appreciate the simplicity with which the simulations are described. Chapter 8 reviews the role of causal knowledge in semantic task performance, with a return to the discursive approach used in the opening chapter. In the final chapter, the authors discuss the key principles of their model in relation to the work presented in earlier chapters, and speculate on remaining questions, such as “how is PDP theory implemented in the brain?”

In describing their contribution to understanding human semantic cognition as “a small step in the right direction” (p. 380), I believe that the authors provide a modest description of their work. Indeed, they provide a much-needed mechanistic model of semantic cognition, filling an essential gap often overlooked in most theories of semantic cognition.

For example, although a number of theories of conceptual development have been put forward (Carey, 1985; 2000; Mandler, 2002; Quinn, 2002; Quinn & Eimas, 1997, 2000; Rakison, 2003), the authors of this book are the first to provide a mechanism for an infant's ability to associate different objects as belonging to the same category (Chapter 4). Here, they describe coherent covariation (Chapter 3); a process whereby changes are made to the connection weights in the network capturing shared properties among related items (e.g., can move is shared by all animals, and covaries with properties such as has wings and has feet). Using this process, the network rapidly learns shared properties, and thus forms general categories (e.g., animals). With time, and therefore development, categories become fine-tuned forming specific-level properties, such as, a canary is yellow. This progressive differentiation results from the gradual accumulation of weak error signals associated with unshared properties.

Building on previous theories, coherent covariation can account for the shift in development from general categories to specific-level categories, the acquisition of property salience (see Rakison, 2003), and provides a mechanism for the extraction of conceptual representations from perceptual experience (see Mandler, 1990, 2000a, 2000b, 2002). Although the authors suggest that there are no innate “core” properties on which category formation is based (e.g., Carey, 1985, 2000), they do suggest that the influence of coherent covariation on concept development depends on the infant's initial (and therefore, possibly innate) ability to detect similarities and differences among particular events.

This book will provoke a great deal of discussion and debate in the field of semantic cognition, and hopefully will generate new research ideas. With this in mind, I have no hesitation in recommending that you read this book.

References

REFERENCES

Carey, S. (1985). Conceptual Change in Childhood. Cambridge, MA: MIT Press.
Carey, S. (2000). The origin of concepts. Cognition and Development, 1, 3742.Google Scholar
Collins, A.M. & Quillian, M.R. (1969). Retrieval time from semantic memory. Journal of Verbal Learning and Verbal Behaviour, 8, 240247.Google Scholar
Hinton, G.E. (1981). Implementing semantic networks in parallel hardware. In G.E. Hinton & J.A. Anderson (Eds.), Parallel Models of Associative Memory. Hillsdale, NJ: Erlbaum.
Hinton, G.E. (1986). Learning distributed representations of concepts. In Proceedings of the Eighth Annual Conference of the Cognitive Science Society. Hillsdale, NJ: Erlbaum
Keil, F. (1979). Semantic and Conceptual Development: An Ontological Perspective. Cambridge, MA: Harvard University Press.
Keil, F. (1989). Concepts, Kinds and Cognitive Development. Cambridge, MA: MIT Press.
Keil, F. (1991). The emergence of theoretical beliefs as constraints on concepts. In S. Carey & R. Gelman (Eds.), The Epigenesis of Mind: Essays on Biology and Cognition. Hillsdale, NJ: Erlbaum.
Mandler, J.M. (1988). How to build a baby: On the development of an accessible representational system. Cognitive Development, 3, 113136.Google Scholar
Mandler, J.M. (1990). From perception to conception. In P. van Geert & L. Mos (Eds.), Developmental Psychology. New York: Plenum.
Mandler, J.M. (1992). How to build a baby II: Conceptual primitives. Psychological Review, 99, 587604.Google Scholar
Mandler, J.M. (1997). Representation. In D. Kuhn & R. Siegler (Eds.), Cognition, Perception and Language, vol. 2, Handbook of Child Psychology (5th ed.). New York: Wiley.
Mandler, J.M. (2000a). Perceptual and conceptual processes in infancy. Journal of Cognition and Development, 1, 336.Google Scholar
Mandler, J.M. (2000b). What global-before-basic trend? Commentary on perceptually based approaches to early categorization. Infancy, 1, 99110.Google Scholar
Mandler, J.M. (2002). On the foundations of the semantic system. In E.M. Forde & G. Humphreys (Eds.), Category specificity in mind and brain. Hove, UK: Psychology Press.
Quinn, P. & Eimas, P. (1997). Perceptual organization and categorization in young infants. In C. Rovee-Collier & L.P. Lipsitt (Eds.), Advances in Infancy Research, vol. 11. Norwood, NJ: Ablex.
Quinn, P. & Eimas, P. (2000). The emergence of category representations during infancy: Are separate perceptual and conceptual processes really required? Journal of Cognition and Development, 1, 5561.Google Scholar
Quinn, P.C. (2002). Early categorization: A new synthesis. In U. Goswami (Ed.), Blackwell Handbook of Childhood Cognitive Development. Oxford: Blackwell.
Rakison, D. (2003). Parts, categorization and the animate-inaminate distinction in infancy. In L.M. Oakes & D.H. Rakison (Eds.), Early Concept and Category Development: Making Sense of the Blooming, Buzzing Confusion. New York: Oxford University Press.
Rumelhart, D.E., Smolensky, P., McClelland, J.L., & Hinton, G.E. (1986). Schemata and sequential thought processes in PDP models. In J.L. McClelland, D.E. Rumelhart, & the PDP research group (Eds.), Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol. 2. Cambridge, MA: MIT Press.
Rumelhart, D.E. (1990). Brain style computation: Learning and generalization. In S.F. Zornetzer, J.L. Davis, & C. Lau (Eds.), An Introduction to Neural and Electronic Networks. San Diego, CA: Academic Press.\.