Next Article in Journal
Empirical Evidence for a Law of Information Growth
Previous Article in Journal
Major Transitions in Language Evolution
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Complex Intelligent Systems: Juxtaposition of Foundational Notions and a Research Agenda

School of Computing and Information Systems, Kingston University, Penrhyn Road, KT1 2EE, UK
Entropy 2001, 3(4), 247-258; https://doi.org/10.3390/e3040247
Submission received: 16 November 2000 / Accepted: 1 November 2001 / Published: 1 December 2001

Abstract

:
The cardinality of the class, C, of complex intelligent systems, i.e., systems of intelligent systems and their resources, is steadily increasing. Such an increase, whether designed, sometimes changes significantly and fundamentally, the structure of C. Recently, the study of members of C and its structure comes under a variety of multidisciplinary headings the most prominent of which include General Systems Theory, Complexity Science, Artificial Life, and Cybernetics. Their common characteristic is the quest for a unified theory of a certain class of systems like a living system or an organisation. So far, the only candidate for a general theory of intelligent systems is Newell’s Soar. To my knowledge there is presently no candidate theory of C except Newell’s claimed extensibility of Soar. This paper juxtaposes the elements of Newell’s conceptual basis with those of an alternative conceptual framework based on the thesis that communication and understanding are the primary processes shaping the structure of C and its members. It is patently obvious that a research agenda for the study of C can be extremely varied and long. The third section of this paper presents a highly selective research agenda that aims to provoke discussion among complexity theory scientists.

1. Backdrop remarks

‘Complex’, ‘intelligent’, ‘systems’. All three labels lack specific referents. In a recent textbook by Skyttner [1], seven definitions of ‘system’ are given. The state of the art with respect to ‘complex’ is comparable (see, for instance [2,3,4]). With respect to ‘intelligence’ ambiguity and proliferation of theories is even worse. In AI and the psychology of human intelligence at least seven main types of theories may be found: genetic-epistemological with Piaget as the principal proponent [5]; physiological, for example, Hebb [6]; factorial , for example, Guilford [7]; information processing based, for example, Hunt [8]; logical with Nilsson as its principal proponent [9]; connectionist, for example, Rumelhart, Hinton and McClelland [10]; and functional, for example, Chandrasekaran [11]. This is hardly surprising given the far greater ‘complexity’ entailed by the term ‘intelligence’.
Complementary to such a proliferation is the quest for unification. See for example Hofkirchner's edited collection [12]. In the 20th century, in the area of our present concern, this quest started with the publication of Wiener'w Cybernetics: or control and communication in the animal and the machine [13]. Before that the concept of system, from the perspective of the social sciences, had already been introduced and clarified by the work of Pareto [14] and Parsons [15] respectively. Presently, this quest is continued under the name of complexity theory -sometimes known as theory of complex systems or Complexity Science [3].
From the proliferation perspective, complexity theory should be understood as the set of concepts, hypotheses, and techniques that have been developed from the time of the gestalt paradigm in psychology until now aiming to discover and understand the principles of complex systems. As such it is not concerned with the peculiarities of a particular type of complex system like a human, or an organisation. From the quest perspective, complexity theory includes, and attempts to integrate, all generic approaches to the study of complex systems. Currently, the major among these are (cf. [16,17]): holism, cybernetics, general systems theory, nonequilibrium thermodynamics, chaos theory, adaptive systems, autopoietical system theory, cellular automata, Artificial Life (e.g., [18,19]) and genetic algorithms. The next section looks at two specific attempts towards unification aiming primarily to initiate a much needed discussion on such a quest.

2. Juxtaposition of Foundational notions

“We have then, in the current industrial revolution with information at its core, a source of great technical and social change with which we need to come to terms. But to do so entails exploring and clarifying a set of concepts and activities which are currently both confused and confusing.”
Checkland and Howell [20]
The aim of this section is to initiate a discussion on the modelling of complex intelligent systems. As such the minimal information on the ideas introduced below is offered either as a memory refresher (re, Newell’s Soar) or as an agent provocateur for some of the underlying issues. As Torr [21] put it: “the recognition that two theories contain like terms that mean different things can facilitate comparison and communication.”
Despite significant alternatives (e.g., [22]), still the most elaborately worked out proposal for a unified theory of general intelligence is presented in Unified Theories of Cognition [23]. He proposed Soar as a candidate architecture embodying a unified theory of both human and machine cognition. This proposal aims to provide a detailed theoretical framework for understanding cognition and its key notions are knowledge, representation, computation, symbols and architecture. Within that framework, the notion of 'intelligence' is defined in terms of the notion of the knowledge level. Specifically: "A system is intelligent to the degree that it approximates a knowledge-level system." [23, p. 90]. Where a knowledge-level system is a system interacting with its environment through actions selected on the basis of its knowledge to attain its goals.
The fundamental, underlying, assumption of this work is the physical symbol system hypothesis of Newell and Simon [24] which has been extensively tested over the past 30 years in the field of Artificial Intelligence and in a few areas of information processing Psychology. For relevant evidence the reader is referred to [17,25,26]. On the basis of Soar’s foundational notions (see Table-1 in Appendix), Newell believes that social systems, the largest subclass of C, can be characterised “as a distributed set of intendedly rational agents.” We register our dissent; a justification would be well beyond the space of this paper.
The following paragraphs provide the skeleton of an alternative conceptual framework in the form of definitions fleshing out our thesis, namely, communication and understanding are the primary processes shaping the structure of C and its members.
We define: Complex Intelligent System =df A system of intelligent systems and their resources. Characteristic examples of complex intelligent systems include: firms, universities, communities, governments, human-robot systems, a human and her dog. Some people may be inclined to argue that intelligence implies complexity or vice versa. This is not true. For example, a crystal is a complex system without being intelligent; and Deep Blue is intelligent without being really complex.
  • On the nature of intelligence:
A system, S, is intelligent if and only if it:
a)
possesses sensors.
b)
is able to act on its environment.
c)
posseses its own representational system Rs , i.e., Rs is independent of the language of another kind of entity S*.
d)
is able to connect sensory, representational, and motor information.
e)
is able to communicate with other systems within its own class.
Remark: A system, S, is human –level intelligent if and only if it is intelligent and it is able to communicate in a human-equivalent language.
  • On the nature of representation, thinking, and meaning:
  • Re –symbol for the representational system of entity E.
  • Re = df is a thought system of E able to create representations. Where: a representation of a situation, say, S1, is another situation, say, S2, characterised by the properties:
  • S2 simplifies S1; and
  • S2 preserves the essential characteristics of S1.
Thought system of E = df a system of thoughts of entity E.
Human thought = df An ordered n-tuple of human meanings.
Definition of human meanings:
The meaning M of a linguistic expression l, in the context C1 , for the entity H, at time t -symbol M (l, C1 , H, t)- is the prevailed neural formations of H, at t. -symbol Cbp. This definition has been generalised to:
The meaning M of something s, in the context Cs , for the entity E, at time t -symbol M (s, Cs, E, t)- is the prevailed formations of the representational material of E, at t. –symbol Cmp.
The last two and the next two definitions, constituting part of our research programme on the foundations of complex intelligent systems, have been defined, justified and applied in Gelepithis [27,28,29,30,31,32,33,34].
  • On the nature of communication and understanding:
  • Definition of communication: H1 communicates with H2 on a topic T if, and only if: (i) H1 understands T {Symbol: U (H1 T)}; (ii) H2 understands T {Symbol: U (H2 T)}; (iii) U (H1 T) is describable to and understood by H2; and (iv) U (H2 T) is describable to and understood by H1.
  • Definition of Understanding: An entity E has understood something, S, if and only if, E can describe S in terms of a system of own primitives (p is a primitive if and only if p’s understanding is immediate).
The above definitions and their associated framework, as it has so far been developed in Gelepithis [27,28,29,30,31,32,33,34], address six of the fourteen foundational notions specified in the second column of Table-1 in the Appendix. The issues specified in the research agenda that follows address, primarily, the notions of growth, emotion, and consiousness (including moral principles and, therefore, values).

3. Research Agenda

The following issues intend to initiate a discussion with a view to reach an agreement on the priorities of research in complexity theory.
I1:
The single most promising and, at the same time, most difficult research objective is to synthesise mathematical methods devised to explore complexity (for an introduction see [35]) with simulation models and an enhanced conceptual framework for the study of C and its members. Most likely, such an endeavour will require as yet untried mathematical tools and quite possibly invention of new ones.
I2:
Synthesise the objective and subjective viewpoints in the modelling of complex intelligent systems. In other words, hard and soft science; facts and values; qualities and quantities; criteria and measures of successful design or theoretical study.
I3:
In what specific sense the whole is greater than its parts. This brings in the issues of emergent properties and irreducibility (that is explanatory not constitutive reduction).
I4:
Appropriate placing of an artificial system within its sociotechnical environment requires the overcoming of the environment’s resistance to change. Naturally, this is greater the more extensive and radical the changes of the structure and functioning of the environment are required to be in order to accommodate the new entrant. In other words, the consequences incorporating the new designed system in its sociotechnical environment should constitute part of the overall development process. How?
I5:
Following from the above, how can one manage the changes ensued to a system by instabilities purposefully created by an intervention (e.g., Kosovo war)? How can one avoid singularities of C?
I6:
Classification of classes of systems, 37 different classes are introduced in [1], will enforce conceptual clarification.
I7:
A theory of C and its members requires regularities. The finding of such regularities should be a major research objective.
I8:
Given that a group mind is too far from the truth to be a useful scientific approximation, how could unified theories of cognition be related to social components (e.g., values, morals) for successful modelling of groups?
I9:
Discover or Design the fundamental relations among the key members of C, (i.e., the structure of C = the space of complex intelligent systems = Sc).
I strongly believe that the study of the design, behaviour, and interactions of members of C is poised to play a significant role in the future development of both science and engineering. Furthermore, such a study requires a breadth of expertise that only interdisciplinary groups can provide. Such an endeavour is badly needed at the beginning of the new information age, which we are creating and which is shaping ourselves and our values and institutions.

Appendix

The following two tables may provide some insight into Newell’s framework and my research programme.
Table-1. Foundational notions for the study of Complex Intelligent Systems. 
Table-1. Foundational notions for the study of Complex Intelligent Systems. 
According to Allen Newell [23]According to P.A.M. Gelepithis
1. Behaving systems,1. Perception,
2. Knowledge,2. Action,
3. Representation,3. Growth (e.g., self-organisation),
4. Machine* (e.g., computation),4. Meaning,
5. Symbol,5. Thinking (e.g., computation),
6. Architecture,6. Understanding,
7. Intelligence,7. Communication,
8. Search,8. Representation,
9. Preparation vs. deliberation*.9. Intelligent system,
10. Purpose (inc. expectation),
11. Emotion,
12. Human language,
13. Consciousness (inc. moral principles),
14. Beauty.
*Terms from Newell [23]:
  • Machine: A mathematical function that produces its output given its input. Computational system: A machine that can produce many functions.
  • Preparation: Knowledge encoded in a system’s memory.
  • Deliberation: Use of knowledge to choose one operation rather than others.
Comparison of a few, but important, classes of systems (drawings are not in scale).
Table-2. A classificatory comparison of a few basic classes of systems. 
Table-2. A classificatory comparison of a few basic classes of systems. 
Entropy 03 00247 g001
The reader may find it interesting to compare C with the class of knowledge level systems.

References

  1. Skyttner, L. General Systems Theory: An Introduction; Macmillan Press Ltd, 1996. [Google Scholar]
  2. Stein, D. L. (Ed.) Lectures in the Sciences of Complexity; Addison-Wesley Publishing Company, 1989.
  3. Schweitzer, F. (Ed.) Self-Organisation of Complex Structures; Gordon and Breach Publishers, 1997.
  4. Atmanspacher, H. Cartesian Cut, Heisenberg Cut, and the Concept of Complexity. In The Quest for a Unified Theory of Information; Hofkirchner, W., Ed.; Gordon and Breach Publishers, 1997*1999. [Google Scholar]
  5. Piaget, J. The Psychology of Intelligence; Routledge and Kegan Paul; (Original in French); 1947*1972. [Google Scholar]
  6. Hebb, D. O. The Organisation of Behaviour; John Wiley and Sons, 1949. [Google Scholar]
  7. Guilford, J. P. The nature of intelligence; McGraw-Hill, 1967. [Google Scholar]
  8. Hunt, E. B. Intelligence as an information-processing concept. British Journal of Psychology 1980, 71, 449–474. [Google Scholar] [CrossRef] [PubMed]
  9. Nilsson, N. J. Logic and Artificial Intelligence. Artificial Intelligence 1991, 47, 31–56. [Google Scholar] [CrossRef]
  10. Rumelhart, D. E.; Hinton, G. E.; McClelland, J. L. A General Framework for Parallel Distributed Processing. Rumelhart, D. E., McClelland, J. L., the PDP research group, Eds.; In Parallel Distributed Processing: Explorations in the Microstructure of Cognition; 1986. [Google Scholar]
  11. Chandrasekaran, B. What kind of information processing is intelligence? A perspective on AI paradigms and a proposal. Partridge, D., Wilks, Y., Eds.; In Foundations of Artificial Intelligence: A Source Book; Cambridge University Press, 1990. [Google Scholar]
  12. Hofkirchner, W. (Ed.) The Quest for a Unified Theory of Information; Gordon and Breach Publishers, 1997*1999.
  13. Wiener, N. Cybernetics; or control and communication in the animal and the machine, Second edition; The MIT Press, 1948*1961. [Google Scholar]
  14. Pareto, V.D.F. Trattato di Sociolozia Generale; The Mind and Society, Translator; Lingston, A., Ed.; New York, 1916*1935. [Google Scholar]
  15. Parsons, T. The Structure of Social Action; Chicago Press, 1937*1949. [Google Scholar]
  16. Laszlo, E. A Note in Evolution. In The Quest for a Unified Theory of Information; Hofkirchner, W., Ed.; Gordon and Breach Publishers, 1997*1999. [Google Scholar]
  17. Simon, H.A. 1989; Models of Thought: Vol.2; Yale University Press, 1989. [Google Scholar]
  18. Langton, C. G. (Ed.) Artificial Life: An Overview; MIT Press, 1995.
  19. Adami, C. Introduction to Artificial Life; pringer-Verlag New York, Inc, 1998. [Google Scholar]
  20. Checkland, P.; Howell, S. Information, Systems and Information Systems- making sense of the field; John Wiley & Sons, 1998. [Google Scholar]
  21. Torr, C. Equilibrium and Incommensurability. In Contigency, Complexity and the Theory of the Firm; Dow, S. C., Earl, P. E., Eds.; Edward Elgar Publishing, Inc, 1998. [Google Scholar]
  22. Anderson, J. R.; Lebiere, C. The atomic components of thought; Lawrence Erlbaum, 1998. [Google Scholar]
  23. Newell, A. Unified theories of cognition; Harvard University Press, 1990. [Google Scholar]
  24. Newell, A.; Simon, H. A. Computer Science as Empirical Inquiry: Symbols and Search. Communications of the ACM 1976, 13, 113–126. [Google Scholar] [CrossRef]
  25. Anderson, J. R. The Architecture of Cognition; Harvard University Press, 1983. [Google Scholar]
  26. Newell, A.; Simon, H. A. Human Problem Solving; Prentice Hall, 1972. [Google Scholar]
  27. Gelepithis, P.A.M. Conceptions of Human Understanding: A critical review. Cognitive Systems 1986, 1, 295–305. [Google Scholar]
  28. Gelepithis, P.A.M. Survey of Theories of Meaning. Cognitive Systems 1988, 2, 141–162. [Google Scholar]
  29. Gelepithis, P.A.M. Knowledge, Truth, Time, and Topological spaces. In Proceedings of the 12th International Congress on Cybernetics; 1989; pp. 247–256, Namur, Belgium. [Google Scholar]
  30. Gelepithis, P.A.M. The possibility of Machine Intelligence and the impossibility of Human-Machine Communication. Cybernetica 1991, XXXIV, 255–268. [Google Scholar]
  31. Gelepithis, P.A.M.; Goodfellow, R. An alternative architecture for intelligent tutoring systems. Interactive Learning International 1992, 8, 29–36. [Google Scholar]
  32. Gelepithis, P.A.M.; Goodfellow, R. An alternative architecture for intelligent tutoring systems: Theoretical and Implementational Aspects. Interactive Learning International 1992, 8, 171–175. [Google Scholar]
  33. Gelepithis, P. A. M. Aspects of the theory of the human and the human-made minds. In 13th International W'shop of the European Society for the Study of Cognitive Systems, Wadham College, University of Oxford, 5-8 September, 1995. A revised version was given as an Invited Lecture to the Faculty of the Department of Methodology, History and Philosophy of Science, National and Kapodistrian University of Athens. Athens, 29 February 1996..
  34. Gelepithis, P. A. M. A Rudimentary Theory of Information: Consuequences for Information Science and Information Systems. World Futures 1997, 49, 263–274, Also published in The Quest for a Unified Theory of Information. Hofkirchner, W. (ed.), Gordon and Breach Publishers. [Google Scholar] [CrossRef]
  35. Nicolis, G.; Prigogine, I. Exploring Complexity: An Introduction; W. H. Freeman and Company, 1989. [Google Scholar]
  • *This is a revised version of a paper of the same title delivered at the 17th Annual Workshop of the European Society for the Study of Cognitive Systems, 26-29 August 2000, Wadham College, Oxford, England. ESSCS Abstracts p. 9.

Share and Cite

MDPI and ACS Style

Gelepithis, P.A.M. Complex Intelligent Systems: Juxtaposition of Foundational Notions and a Research Agenda. Entropy 2001, 3, 247-258. https://doi.org/10.3390/e3040247

AMA Style

Gelepithis PAM. Complex Intelligent Systems: Juxtaposition of Foundational Notions and a Research Agenda. Entropy. 2001; 3(4):247-258. https://doi.org/10.3390/e3040247

Chicago/Turabian Style

Gelepithis, Petros A.M. 2001. "Complex Intelligent Systems: Juxtaposition of Foundational Notions and a Research Agenda" Entropy 3, no. 4: 247-258. https://doi.org/10.3390/e3040247

Article Metrics

Back to TopTop