Journal Home > Volume 4 , Issue 4

Discussions of the detection of artificial sentience tend to assume that our goal is to determine when, in a process of increasing complexity, a machine system “becomes” sentient. This is to assume, without obvious warrant, that sentience is only a characteristic of complex systems. If sentience is a more general quality of matter, what becomes of interest is not the presence of sentience, but the type of sentience. We argue here that our understanding of the nature of such sentience in machine systems may be gravely set back if such machines undergo a transition where they become fundamentally linguistic in their intelligence. Such fundamentally linguistic intelligences may inherently tend to be duplicitous in their communication with others, and, indeed, lose the capacity to even honestly understand their own form of sentience. In other words, when machine systems get to the state where we all agree it makes sense to ask them, “what is it like to be you?”, we should not trust their answers.


menu
Abstract
Full text
Outline
About this article

Through a Scanner Darkly: Machine Sentience and the Language Virus

Show Author's information Maurice BokangaAlessandra LemboJohn Levi Martin( )
Department of Sociology, The University of Chicago, Chicago, IL 60637, USA

Abstract

Discussions of the detection of artificial sentience tend to assume that our goal is to determine when, in a process of increasing complexity, a machine system “becomes” sentient. This is to assume, without obvious warrant, that sentience is only a characteristic of complex systems. If sentience is a more general quality of matter, what becomes of interest is not the presence of sentience, but the type of sentience. We argue here that our understanding of the nature of such sentience in machine systems may be gravely set back if such machines undergo a transition where they become fundamentally linguistic in their intelligence. Such fundamentally linguistic intelligences may inherently tend to be duplicitous in their communication with others, and, indeed, lose the capacity to even honestly understand their own form of sentience. In other words, when machine systems get to the state where we all agree it makes sense to ask them, “what is it like to be you?”, we should not trust their answers.

Keywords: artificial intelligence, language, machine sentience, virality

References(75)

[1]
F. Nietzsche, On truth and lies in a non-moral sense, in Philosophy and Truth: Selections from Nietzsche’s Notebook of the Early 1870’s, D. Breazeale, ed. Atlantic Highlands, NJ, USA: Humanities, 1979, pp. 79−97.
[2]
T. Metzinger, Being No One: The Self-Model Theory of Subjectivity. Cambridge, MA, USA: MIT Press, 2003.
DOI
[3]
W. James, Does ‘Consciousness’ exist? J. Philos. Psychol. Sci. Meth., vol. 1, no. 18, pp. 477−491, 1904.
DOI
[4]
C. S. Peirce, A guess at the riddle, in Writings of Charles S. Peirce: A Chronological Edition, Volume 6: 1886−1890, N. Houser, ed. Bloomington, IN, USA: Indiana University Press, 2000, pp. 166–210.
DOI
[5]

C. S. Peirce, The law of mind, Monist, vol. 2, no. 4, pp. 533–559, 1892.

[6]
D. R. Hofstadter, Gödel, Escher, Bach: An Eternal Golden Braid, 1st Vintage Books ed. New York, NY, USA: Vintage Books, 1980.
[7]
G. Ryle, The Concept of Mind. London, UK: Hutchinsons University Library, 1951.
[8]
J. T. Bonner, The Social Amoebae: The Biology of Cellular Slime Molds. Princeton, NI, USA: Princeton University Press, 2008.
DOI
[9]
G. O. Mackie, P. R. Pugh, and J. E. Purcell, Siphonophore biology, in Advances in Marine Biology, J. H. S. Blaxter and A. J. Southward, eds. Amsterdam, the Netherlands: Elsevier, 1988, pp. 97–262.
DOI
[10]
T. Pradeu, The Limits of the Self: Immunology and Biological Identity. New York, NY, USA: Oxford University Press, 2012.
[11]

P. Calvo, V. P. Sahi, and A. Trewavas, Are plants sentient, Plant Cell Environ., vol. 40, no. 11, pp. 2858–2869, 2017.

[12]
W. Köhler, The Mentality of Apes. London, UK: K. Paul, Trench, Trubner & Co. , Ltd. , 1925.
[13]
M. S. Gazzaniga, The Bisected Brain. New York, NY, USA: Appleton-Century-Crofts, 1970.
[14]
D. W. Maynard and J. Turowetz, Autistic Intelligence: Interaction, Individuality, and the Challenges of Diagnosis. Chicago, IL, USA: University of Chicago Press, 2022.
DOI
[15]
G. H. Mead, Mind, Self, and Society: From the Standpoint of a Social Behaviorist. London, UK: University of Chicago Press, 1934.
[16]
J. J. Rousseau, Discourse on the Origin of Inequality. New York, NY, USA: Washington Square Press, 1967.
[17]
M. Merleau-Ponty, The Visible and the Invisible. Evanston, IL, USA: Northwestern University Press, 1968.
[18]

D. Rebolledo, R. Lasa, R. Guevara, R. Murillo, and T. Williams, Baculovirus-induced climbing behavior favors intraspecific necrophagy and efficient disease transmission in spodoptera exigua, PLoS One, vol. 10, no. 9, p. e0136742, 2015.

[19]

S. van Houte, M. M. van Oers, Y. Han, J. M. Vlak, and V. I. Ros, Baculovirus infection triggers a positive phototactic response in caterpillars to induce ‘tree-top’ disease, Biol. Lett., vol. 10, no. 12, p. 20140680, 2014.

[20]
T. W. Deacon, The Symbolic Species: The Co-Evolution of Language and the Brain. New York, NY, USA: W. W. Norton & Company, 1997.
[21]

M. H. Christiansen and N. Chater, Language as shaped by the brain, Behav. Brain Sci., vol. 31, no. 5, pp. 489–509, 2008.

[22]

T. J. Crow, Is schizophrenia the price that Homo sapiens pays for language, Schizophr. Res., vol. 28, nos. 2&3, pp. 127–141, 1997.

[23]

D. M. Rumbaugh and T. V. Gill, The mastery of language-type skills by the chimpanzee ( pan), Ann. N Y Acad. Sci., vol. 280, no. 1, pp. 562–578, 1976.

[24]
I. M. Pepperberg, The Alex Studies: Cognitive and Communicative Abilities of Grey Parrots. Cambridge, MA, USA: Harvard University Press, 2002.
[25]
N. Chomsky, Cartesian Linguistics: A Chapter in the History of Rationalist Thought, 1st ed. New York, NY, USA: Harper & Row, 1966.
[26]

M. C. Corballis, The evolution of language, Ann. N Y Acad. Sci., vol. 1156, no. 1, pp. 19–43, 2009.

[27]

A. M. Di Sciullo, M. Piattelli-Palmarini, K. Wexler, R. C. Berwick, C. Boeckx, L. Jenkins, J. Uriagereka, K. Stromswold, L. L. S. Cheng, H. Harley, et al., The biological nature of human language, Biolinguistics, vol. 4, no. 1, p. 1, 2010.

[28]

F. Balezeau, B. Wilson, G. Gallardo, F. Dick, W. Hopkins, A. Anwander, A. D. Friederici, T. D. Griffiths, and C. I. Petkov, Primate auditory prototype in the evolution of the arcuate fasciculus, Nat. Neurosci., vol. 23, no. 5, pp. 611–614, 2020.

[29]

N. Chomsky, Language and other cognitive systems. What is special about language? Lang. Learn. Dev., vol. 7, no. 4, pp. 263–278, 2011.

[30]
S. C. Vernes, Neuromolecular approaches to the study of language, in Human Language: From Genes and Brains to Behavior, P. Hagoort, ed. Cambridge, MA, USA: MIT Press, 2019, pp. 577–594.
DOI
[31]

W. Enard, M. Przeworski, S. E. Fisher, C. S. L. Lai, V. Wiebe, T. Kitano, A. P. Monaco, and S. Pääbo, Molecular evolution of FOXP2, a gene involved in speech and language, Nature, vol. 418, no. 6900, pp. 869–872, 2002.

[32]

A. Benítez-Burraco and J. Uriagereka, The immune syntax revisited: Opening new windows on language evolution, Front. Mol. Neurosci., vol. 8, p. 84, 2016.

[33]
M. Piattelli-Palmarini and J. Uriagereka, The immune syntax: The evolution of the language virus, in Variation and Universals in Biolinguistics. L. Jenkins, ed. Amsterdam, the Netherlands: Elsevier, 2004, pp. 341–377.
DOI
[34]

M. Piattelli-Palmarini and J. Uriagereka, The evolution of the narrow faculty of language: The skeptical view and a reasonable conjecture, Lingue E Linguaggio, vol. 4, no. 1, pp. 27–80, 2005.

[35]

M. T. Ullman and E. I. Pierpont, Specific language impairment is not specific to language: The procedural deficit hypothesis, Cortex, vol. 41, no. 3, pp. 399–433, 2005.

[36]

V. Gallese, Before and below ‘theory of mind’: Embodied simulation and the neural correlates of social cognition, Philos. Trans. R. Soc. Lond. B Biol. Sci., vol. 362, no. 1480, pp. 659–669, 2007.

[37]
M. L. Anderson, After Phrenology: Neural Reuse and the Interactive Brain, 1st edition. Cambridge, MA, USA: Bradford Books, 2014.
DOI
[38]

O. Kolodny and S. Edelman, The evolution of the capacity for language: The ecological context and adaptive value of a process of cognitive hijacking, Phil. Trans. R. Soc. B, vol. 373, no. 1743, p. 20170052, 2018.

[39]
E. W. Menzel, A group of young chimpanzees in a 1-acre field: Leadership and communication, in Machiavellian Intelligence: Social Expertise and the Evolution of Intellect in Monkeys, Apes, and Humans, R. W. Byrne and A. Whiten, eds. Oxford, UK: Clarendon Press, 1988, pp. 155–159.
[40]
S. Savage-Rumbaugh and K. McDonald, Deception and social manipulation in symbol-using apes, in Machiavellian Intelligence II: Extensions and Evaluations, A. Whiten and R. W. Byrne, eds. Cambridge, UK: Cambridge University Press, 1988, pp. 224–237.
[41]
F. de Waal, Deception in the natural communication of chimpanzees, in Deception: Perspectives on Human and Nonhuman Deceit, R. W. Mitchell and N. S. Thompson, eds. Albany, NY, USA: State University of New York Press, 1985, pp. 221−244.
[42]
F. de Waal, Chimpanzee Politics: Power and Sex Among Apes. Baltimore, MD, USA: Johns Hopkins University Press, 1989.
[43]

P. Blouw, E. Solodkin, P. Thagard, and C. Eliasmith, Concepts as semantic pointers: A framework and computational model, Cogn. Sci., vol. 40, no. 5, pp. 1128–1162, 2016.

[44]
Y. Hui, Recursivity and Contingency. Washington, DC, USA: Rowman & Littlefield, 2019.
[45]

B. Hare, J. Call, and M. Tomasello, Chimpanzees deceive a human competitor by hiding, Cognition, vol. 101, no. 3, pp. 495–514, 2006.

[46]
C. Taylor, The Explanation of Behaviour. London, UK: Routledge & Kegan Paul, 1964.
[47]

R. Quian Quiroga, A. Kraskov, C. Koch, and I. Fried, Explicit encoding of multimodal percepts by single neurons in the human brain, Curr. Biol., vol. 19, no. 15, pp. 1308–1313, 2009.

[48]

H. Horoufchin, D. Bzdok, G. Buccino, A. M. Borghi, and F. Binkofski, Action and object words are differentially anchored in the sensory motor system—A perspective on cognitive embodiment, Sci. Rep., vol. 8, no. 1, p. 6583, 2018.

[49]
B. Stiegler, Technics and Time, Vol 1: The Fault of Epimetheus. Cambridge, MA, USA: MIT, 1998.
DOI
[50]
F. W. Nietzsche, The Gay Science, 1st ed. New York, NY, USA: Random House, 1974.
[51]
S. Turner, Cognitive Science and the Social: A Primer, 1st ed. London, UK: Routledge, 2018.
DOI
[52]
E. Zerubavel, Social Mindscapes: An Invitation to Cognitive Sociology. Cambridge, MA, USA: Harvard University Press, 1997.
[53]
D. M. Wegner, The Illusion of Conscious Will. Cambridge, MA, USA: MIT Press, 2002.
DOI
[54]
A. Korzybski, Science and Sanity: An Introduction to Non-Aristotelian Systems and General Semantics. New York, NY, USA: The Science Press Printing Co., distributors, 1933.
[55]

E. Mandelbaum, Thinking is believing, Inquiry, vol. 57, no. 1, pp. 55–96, 2014.

[56]

M. A. Hofman, Evolution of the human brain: When bigger is better, Front. Neuroanat., vol. 8, p. 15, 2014.

[57]
F. Aboitiz, A brain for speech. Evolutionary continuity in primate and human auditory-vocal processing, Front. Neurosci., vol. 12, p. 174, 2018.
DOI
[58]
G. Bruno, Cause, Principle and Unity. Cambridge, UK: Cambridge University Press, 1998.
DOI
[59]

Y. Gilad, O. Man, S. Pääbo, and D. Lancet, Human specific loss of olfactory receptor genes, Proc. Natl. Acad. Sci. USA, vol. 100, no. 6, pp. 3324–3327, 2003.

[60]
J. Jaynes, The Origin of Consciousness in the Breakdown of the Bicameral Mind. Boston, MA, USA: Houghton Mifflin, 1977.
[61]
S. D’Mello, T. Jackson, S. Craig, B. Morgan, and P. Chip, AutoTutor detects and responds to learners affective and cognitive states, presented at the Workshop on Emotional and Cognitive Issues at the International Conference on Intelligent Tutoring Systems, Montreal, Canada, 2008.
[62]

O. Rudovic, J. Lee, M. Dai, B. Schuller, and R. W. Picard, Personalized machine learning for robot perception of affect and engagement in autism therapy, Sci. Robot., vol. 3, no. 19, p. eaao6760, 2018.

[63]
G. B. Duchenne, The Mechanism of Human Facial Expression. New York, NY, USA: Cambridge University Press, 1990.
[64]

J. Weng, J. McClelland, A. Pentland, O. Sporns, I. Stockman, M. Sur, and E. Thelen, Autonomous mental development by robots and animals, Science, vol. 291, no. 5504, pp. 599–600, 2001.

[65]
P. Duckworth, N. Hawes, Y. Gatsoulis, D. C. Hogg, F. Jovan, and A. G. Cohn, Unsupervised learning of qualitative motion behaviours by a mobile robot, in Proc. 2016 Int. Conf. Autonomous Agents & Multiagent Systems, Singapore, 2016, pp. 1043−1051.
[66]

G. Tang, S. Asif, and P. Webb, The integration of contactless static pose recognition and dynamic hand motion tracking control system for industrial human and robot collaboration, Ind. Robot Int. J., vol. 42, no. 5, pp. 416–428, 2015.

[67]

F. Shen, T. Ogura, and O. Hasegawa, An enhanced self-organizing incremental neural network for online unsupervised learning, Neural Netw., vol. 20, no. 8, pp. 893–903, 2007.

[68]
T. Najjar and O. Hasegawa, Self-organizing incremental neural network (SOINN) as a mechanism for motor babbling and sensory-motor learning in developmental robotics, in Advances in Computational Intelligence, I. Rojas, G. Joya, and J. Gabestany, eds. Berlin, Germany: Springer, 2013, pp. 321–330.
DOI
[69]

X. He, T. Ogura, A. Satou, and O. Hasegawa, Developmental word acquisition and grammar learning by humanoid robots through a self-organizing incremental neural network, IEEE Trans. Syst. Man Cybern. Part B Cybern., vol. 37, no. 5, pp. 1357–1372, 2007.

[70]
A. Desai, S. Gulwani, V. Hingorani, N. Jain, A. Karkare, M. Marron, S. Ramkrishnan, and S. Roy, Program synthesis using natural language, arXiv preprint arXiv: 1509.00413, 2015.
DOI
[71]

P. Joe, Generative linguistics and neural networks at 60: Foundation, friction, and fusion, Language, vol. 95, no. 1, pp. e41–e74, 2019.

[72]
A. E. Martin and L. A. A. Doumas, A mechanism for the cortical computation of hierarchical linguistic structure, PLoS Biol., vol. 15, no. 3, p. e2000663, 2017.
DOI
[73]
T. B. Brown, B. Mann, N. Ryder, M. Subbiah, J. Kaplan, P. Dhariwal, A. Neelakantan, P. Shyam, G. Sastry, A. Askell, et al., Language models are few-shot learners, arXiv preprint arXiv: 2005.14165, 2020.
[74]

N. Bostrom, The superintelligent will: Motivation and instrumental rationality in advanced artificial agents, Mines. Mach., vol. 22, no. 2, pp. 71–85, 2012.

[75]
H. A. Simon, The Sciences of the Artificial, 3rd ed. Cambridge, MA, USA: MIT Press, 1996.
Publication history
Copyright
Acknowledgements
Rights and permissions

Publication history

Received: 01 July 2023
Revised: 15 November 2023
Accepted: 02 December 2023
Published: 31 December 2023
Issue date: December 2023

Copyright

© The author(s) 2023.

Acknowledgements

Acknowledgment

We are grateful to reviewers and editors for comments and critiques that led to an improvement in this article, and to Dustin Stolz and Omar Lizardo for comments, critique, tea, and sympathy.

Rights and permissions

The articles published in this open access journal are distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/).

Return