Open Access
Issue
Published:
13 December 2022
Survey and Tutorial on Hybrid Human-Artificial Intelligence
Fang Zhou1(
),
),
Keywords:
Internet of Things (IoT), artificial intelligence (AI), hybrid human-artificial intelligence (H-AI)
Cite this article:
Shi F, Zhou F, Liu H, et al.
Survey and Tutorial on Hybrid Human-Artificial Intelligence.
Tsinghua Science and Technology,
2023, 28(3): 486-499.
https://doi.org/10.26599/TST.2022.9010022
Download citation
1517
Views
290
Downloads
Citations
3
Crossref
2
WoS
3
Scopus
0
CSCD
The growing computing power, easy acquisition of large-scale data, and constantly improved algorithms have led to a new wave of artificial intelligence (AI) applications, which change the ways we live, manufacture, and do business. Along with this development, a rising concern is the relationship between AI and human intelligence, namely, whether AI systems may one day overtake, manipulate, or replace humans. In this paper, we introduce a novel concept named hybrid human-artificial intelligence (H-AI), which fuses human abilities and AI capabilities into a unified entity. It presents a challenging yet promising research direction that prompts secure and trusted AI innovations while keeping humans in the loop for effective control. We scientifically define the concept of H-AI and propose an evolution road map for the development of AI toward H-AI. We then examine the key underpinning techniques of H-AI, such as user profile modeling, cognitive computing, and human-in-the-loop machine learning. Afterward, we discuss H-AI’s potential applications in the area of smart homes, intelligent medicine, smart transportation, and smart manufacturing. Finally, we conduct a critical analysis of current challenges and open gaps in H-AI, upon which we elaborate on future research issues and directions.
menu
Abstract
Full text
Outline
About this article
Survey and Tutorial on Hybrid Human-Artificial Intelligence
Fang Zhou1(
),
),
Abstract
The growing computing power, easy acquisition of large-scale data, and constantly improved algorithms have led to a new wave of artificial intelligence (AI) applications, which change the ways we live, manufacture, and do business. Along with this development, a rising concern is the relationship between AI and human intelligence, namely, whether AI systems may one day overtake, manipulate, or replace humans. In this paper, we introduce a novel concept named hybrid human-artificial intelligence (H-AI), which fuses human abilities and AI capabilities into a unified entity. It presents a challenging yet promising research direction that prompts secure and trusted AI innovations while keeping humans in the loop for effective control. We scientifically define the concept of H-AI and propose an evolution road map for the development of AI toward H-AI. We then examine the key underpinning techniques of H-AI, such as user profile modeling, cognitive computing, and human-in-the-loop machine learning. Afterward, we discuss H-AI’s potential applications in the area of smart homes, intelligent medicine, smart transportation, and smart manufacturing. Finally, we conduct a critical analysis of current challenges and open gaps in H-AI, upon which we elaborate on future research issues and directions.
Keywords:
Internet of Things (IoT), artificial intelligence (AI), hybrid human-artificial intelligence (H-AI)
References(83)
[2]
N. Kumar, N. Kharkwal, R. Kohli, and S. Choudhary, Ethical aspects and future of artificial intelligence, in Proc. 2016 Int. Conf. Innovation and Challenges in Cyber Security (ICICCS-INBUSH), Greater Noida, India, 2016, pp. 111–114.
[3]
P. Rashidi and D. J. Cook, Keeping the resident in the loop: Adapting the smart home to the user, IEEE Trans. Syst., Man, Cybern. – Part A: Syst. Humans, vol. 39, no. 5, pp. 949–959, 2009.
[4]
T. L. Parapugna, G. Petroselli, R. Erra-Basells, and M. G. Lagorio, Biospectroscopy, biospectrometry and imaging of Ilex paraguariensis. Basis for non-destructive quality evaluation using artificial vision, Photochem. Photobiol. Sci., vol. 15, no. 7, pp. 879–888, 2016.
[5]
K. H. Yu, A. L. Beam, and I. S. Kohane, Artificial intelligence in healthcare, Nat. Biomed. Eng., vol. 2, no. 10, pp. 719–731, 2018.
[6]
M. U. Scherer, Regulating artificial intelligence systems: Risks, challenges, competencies, and strategies, Harv. J. Law Technol., vol. 29, no. 2, pp. 353–400, 2016.
[7]
L. Chen, H. Ning, C. D. Nugent, and Z. Yu, Hybrid human-artificial intelligence, Computer, vol. 53, no. 8, pp. 14–17, 2020.
[8]
J. B. Carroll, Reviews: Guilford, J. P. The nature of human intelligence. New York: McGraw-Hill, 1967. 538 + xii pp. $14.75, Am. Educ. Res. J., vol. 5, no. 2, pp. 249–256, 1968.
[9]
F. Tao, J. Cheng, Q. Qi, M. Zhang, H. Zhang, and F. Sui, Digital twin-driven product design, manufacturing and service with big data, Int. J. Adv. Manuf. Technol., vol. 94, no. 9–12, pp. 3563–3576, 2018.
[10]
J. R. Searle, Minds, brains, and programs, Behav. Brain Sci., vol. 3, no. 3, pp. 417–424, 1980.
[11]
D. M. W. Powers, Characteristics and heuristics of human intelligence, in Proc. 2013 IEEE Symp. Computational Intelligence for Human-like Intelligence (CIHLI), Singapore, 2013, pp. 100–107.
[12]
A. S. Ahmad and A. D. W. Sumari, Cognitive artificial intelligence: Brain-inspired intelligent computation in artificial intelligence, in Proc. 2017 Computing Conf., London, UK, 2017, pp. 135–141.
[13]
N. N. Zheng, Z. Y. Liu, P. J. Ren, Y. Q. Ma, S. T. Chen, S. Y. Yu, J. R. Xue, B. D. Chen, and F. Y. Wang, Hybrid-augmented intelligence: Collaboration and cognition, Front. Inf. Technol. Electron. Eng., vol. 18, no. 2, pp. 153–179, 2017.
[14]
Z. Akata, D. Balliet, M. de Rijke, F. Dignum, V. Dignum, G. Eiben, A. Fokkens, D. Grossi, K. Hindriks, and H. Hoos, et al., A research agenda for hybrid intelligence: Augmenting human intellect with collaborative, adaptive, responsible, and explainable artificial intelligence, Computer, vol. 53, no. 8, pp. 18–28, 2020.
[15]
A. S. Ahmad, Brain inspired cognitive artificial intelligence for knowledge extraction and intelligent instrumentation system, in Proc. 2017 Int. Symp. Electronics and Smart Devices (ISESD), Yogyakarta, Indonesia, 2017, pp. 352–356.
[16]
J. M. Hoc, From human-machine interaction to human-machine cooperation, Ergonomics, vol. 43, no. 7, pp. 833–843, 2000.
[17]
D. A. Norman, Natural user interfaces are not natural, Interactions, vol. 17, no. 3, pp. 6–10, 2010.
[18]
M. E. Clynes and N. Kline, Cyborgs and space, Astronautics, vol. 14, no. 9, pp. 26–27, 1960.
[19]
S. Ouaftouh, A. Zellou, and A. Idri, User profile model: A user dimension based classification, in Proc. 10th Int. Conf. Intelligent Systems: Theories and Applications (SITA), Rabat, Morocco, 2015, pp. 1–5.
[20]
S. Calegari and G. Pasi, Ontology-based information behaviour to improve web search, Future Internet, vol. 2, no. 4, pp. 533–558, 2010.
[21]
T. R. Gruber, A translation approach to portable ontology specifications, Knowl. Acquis., vol. 5, no. 2, pp. 199–220, 1993.
[22]
F. Shi, Q. Li, T. Zhu, and H. Ning, A survey of data semantization in internet of things, Sensors, vol. 18, no. 1, p. 313, 2018.
[23]
H. Ning, Y. Fu, S. Hu, and H. Liu, Tree-code modeling and addressing for non-id physical objects in the internet of things, Telecommun. Syst., vol. 58, no. 3, pp. 195–204, 2015.
[24]
H. Ning, F. Shi, T. Zhu, Q. Li, and L. Chen, A novel ontology consistent with acknowledged standards in smart homes, Comput. Networks, vol. 148, pp. 101–107, 2019.
[25]
G. Amato and U. Straccia, User profile modeling and applications to digital libraries, in Proc. 3rd Int. Conf. on Theory and Practice of Digital Libraries, Paris, France, 1999, pp. 184–197.
[26]
P. Jayakumar and P. Shobana, Creating ontology based user profile for searching web information, in Proc. Int. Conf. on Information Communication and Embedded Systems (ICICES2014), Chennai, India, 2014, pp. 1–6.
[27]
S. He and M. Fang, Ontological user profiling on personalized recommendation in e-commerce, in Proc. 2008 IEEE Int. Conf. on e-Business Engineering, Xi’an, China, 2008, pp. 585–589.
[28]
J. Stan, V. H. Do, and P. Maret, Semantic user interaction profiles for better people recommendation, in Proc. 2011 Int. Conf. on Advances in Social Networks Analysis and Mining, Washington, DC, USA, 2011, pp. 434–437.
[29]
G. Kbar and W. Mansoor, Mobile station location based on hybrid of signal strength and time of arrival, in Proc. Int. Conf. on Mobile Business (ICMB’05), Sydney, Australia, 2005, pp. 585–591.
[30]
M. M. Shakir and S. A. Mawjoud, U-TDOA position location technique for WCDMA, Tikrit J. Eng. Sci., vol. 20, no. 1, pp. 29–41, 2013.
[31]
W. Yao and X. Yang, Design of mobile terminal location system in WCDMA, in Proc. 16th Int. Symp. Communications and Information Technologies (ISCIT), Qingdao, China, 2016, pp. 22–26.
[32]
L. Guo, F. Wang, M. Zhang, and L. Sun, Study on robot perception system of multi-sensors information fusion based on fuzzy neural network, in Proc. 7th World Congress on Intelligent Control and Automation, Chongqing, China, 2008, pp. 5728–5732.
[33]
R. Berri, D. Wolf, and F. Osório, Telepresence robot with image-based face tracking and 3D perception with human gesture interface using Kinect sensor, in Proc. 2014 Joint Conf. Robotics: SBR-LARS Robotics Symp. and Robocontrol, Sao Carlos, Brazil, 2014, pp. 205–210.
[34]
M. R. L. Varshini and C. M. Vidhyapathi, Dynamic fingure gesture recognition using KINECT, in Proc. 2016 Int. Conf. Advanced Communication Control and Computing Technologies (ICACCCT), Ramanathapuram, India, 2016, pp. 212–216.
[35]
S. Bhattacharya, B. Czejdo, and N. Perez, Gesture classification with machine learning using Kinect sensor data, in Proc. Third Int. Conf. Emerging Applications of Information Technology, Kolkata, India, 2012, pp. 348–351.
[36]
C. D. Manning and H. Schütze, Foundations of Statistical Natural Language Processing, Cambridge, MA, USA: MIT Press, 1999.
[37]
W. Chen, B. Chen, T. Xiang, and Z. Zhang, A pragmatic approach to increase accuracy of Chinese word-segmentation, in Proc. 2010 Int. Forum on Information Technology and Applications, Kunming, China, 2010, pp. 389–391.
[38]
L. Zhao, W. Kong, and B. Chai, A Chinese word segmentation model for energy literature based on conditional random fields, in Proc. 2nd IEEE Conf. Energy Internet and Energy System Integration (EI2), Beijing, China, 2018, pp. 1–4.
[39]
L. Y. Zhang, M. Qin, X. M. Zhang, and H. X. Ma, A Chinese word segmentation algorithm based on maximum entropy, in Proc. 2010 Int. Conf. Machine Learning and Cybernetics, Qingdao, China, 2010, pp. 1264–1267.
[40]
T. Jiang, H. Yu, and Y. Jam, Tibetan word segmentation system based on conditional random fields, in Proc. IEEE 2nd Int. Conf. Software Engineering and Service Science, Beijing, China, 2011, pp. 446–448.
[41]
K. Nath, S. Jelil, and L. Rahul, Line, word, and character segmentation of Manipuri machine printed text, in Proc. 2014 Int. Conf. Computational Intelligence and Communication Networks, Bhopal, India, 2014, pp. 203–206.
[42]
D. Huang, M. Li, R. Zheng, S. Xu, and J. Bi, Synthetic data and DAG-SVM classifier for segmentation-free Manchu word recognition, in Proc. 2017 Int. Conf. Computing Intelligence and Information System (CIIS), Nanjing, China, 2017, pp. 46–50.
[43]
Y. U. Park and H. C. Kwon, Korean syntactic analysis using dependency rules and segmentation, in Proc. 2008 Int. Conf. Advanced Language Processing and Web Information Technology, Dalian, China, 2008, pp. 59–63.
[44]
I. A. Bessmertny, A. V. Platonov, E. A. Poleschuk, and P. Ma, Syntactic text analysis without a dictionary, in Proc. IEEE 10th Int. Conf. Application of Information and Communication Technologies (AICT), Baku, Azerbaijan, 2016, pp. 1–3.
[45]
D. M. Berry, E. Kamsties, and M. M. Krieger, From contract drafting to software specification: Linguistic sources of ambiguity, https://cs.uwaterloo.ca/∼dberry/handbook/ambiguityHandbook.pdf, 2003.
[46]
M. Ceccato, N. Kiyavitskaya, N. Zeni, L. Mich, and D. M. Berry, Ambiguity identification and measurement in natural language texts, http://eprints.biblio.unitn.it/727/1/Report_v26_DIT_04_111.pdf, 2004.
[47]
R. Sharma, N. Sharma, and K. K. Biswas, Machine learning for detecting pronominal anaphora ambiguity in NL requirements, in Proc. 4th Int. Conf. Applied Computing and Information Technology/3rd Int. Conf. Computational Science/Intelligence and Applied Informatics/1st Int. Conf. on Big Data, Cloud Computing, Data Science & Engineering (ACIT-CSII-BCD), Las Vegas, NV, USA, 2016, pp. 177–182.
[48]
L. Chen, N. R. Shadbolt, F. Tao, S. J. Cox, A. J. Keane, G. Goble, A. Roberts, and P. Smart, Engineering knowledge for engineering grid applications, in Proc. 2002 Int. Conf. EuroWeb, Oxford, UK, 2002, p. 2.
[49]
K. Bartlmae and N. Heumesser, A framework for the evaluation of web-based experience and case base applications for decision support, in Proc. Professionelles Wissensmanagement Erfahrungen Und Visionen Proc. 9th German Workshop on CaseBased Reasoning GWCBR 2001, Baden-Baden, Germany, 2001, pp. 159–168.
[50]
K. D. Althoff, A. Birk, C. G. von Wangenheim, and C. Tautz, CBR for experimental software engineering, in Case-Based Reasoning Technology, M. Lenz, H. D. Burkhard, B. Bartsch-Spörl, and S. Wess, eds. Heidelberg, Germany: Springer, 1998, pp. 235–254.
[51]
L. Verma, S. Srinivasan, and V. Sapra, Integration of rule based and case based reasoning system to support decision making, in Proc. 2014 Int. Conf. Issues and Challenges in Intelligent Computing Techniques (ICICT), Ghaziabad, India, 2014, pp. 106–108.
[52]
S. S. Feng, Y. G. Zhang, and J. G. Sun, Revisit Boolean lattice based fuzzy description logic, in Proc. 2009 Int. Conf. Machine Learning and Cybernetics, Baoding, China, 2009, pp. 297–301.
[53]
L. Chen, C. Nugent, and G. Okeyo, An ontology-based hybrid approach to activity modeling for smart homes, IEEE Trans. Human-Mach. Syst., vol. 44, no. 1, pp. 92–105, 2013.
[54]
R. M. Monarch, Human-in-the-Loop Machine Learning, Shelter Island, NY, USA: Manning Publications, 2021.
[55]
B. Nushi, E. Kamar, and E. Horvitz, Towards accountable AI: Hybrid human-machine analyses for characterizing system failure, in Proc. 6th AAAI Conf. Human Computation and Crowdsourcing, Zürich, Switzerland, 2018, pp. 126–135.
[56]
E. Kamar, Directions in hybrid intelligence: Complementing AI systems with human intelligence, in Proc. 25th Int. Joint Conf. Artificial Intelligence, New York, NY, USA, 2016, pp. 4070–4073.
[57]
E. Kamar and L. Manikonda, Complementing the execution of AI systems with human computation, in Proc. Workshops of the Thirty-First AAAI Conf. Artificial Intelligence, San Francisco, CA, USA, 2017.
[58]
T. L. Simons and R. S. Peterson, Task conflict and relationship conflict in top management teams: The pivotal role of intragroup trust, J. Appl. Psychol., vol. 85, no. 1, pp. 102–111, 2000.
[59]
R. Parasuraman and V. Riley, Humans and automation: Use, misuse, disuse, abuse, Human Factors, vol. 39, no. 2, pp. 230–253, 1997.
[60]
C. R. B. Azevedo, K. Raizer, and R. Souza, A vision for human-machine mutual understanding, trust establishment, and collaboration, in Proc. 2017 IEEE Conf. Cognitive and Computational Aspects of Situation Management (CogSIMA), Savannah, GA, USA, 2017, pp. 1–3.
[61]
S. Kothari, A. Tamrawi, and J. Mathews, Rethinking verification: Accuracy, efficiency, and scalability through human-machine collaboration, in Proc. IEEE/ACM 38th Int. Conf. Software Engineering Companion (ICSE-C), Austin, TX, USA, 2016, pp. 885–886.
[62]
O. Russakovsky, L. J. Li, and F. F. Li, Best of both worlds: Human-machine collaboration for object annotation, in Proc. 2015 IEEE Conf. Computer Vision and Pattern Recognition, Boston, MA, USA, 2015, pp. 2121–2131.
[63]
J. R. Wolpaw, N. Birbaumer, W. J. Heetderks, D. J. McFarland, P. H. Peckham, G. Schalk, E. Donchin, L. A. Quatrano, C. J. Robinson, and T. M. Vaughan, Brain-computer interface technology: A review of the first Int. meeting, IEEE Trans. Rehabil. Eng., vol. 8, no. 2, pp. 164–173, 2000.
[64]
S. Kirsner, CyberKinetics’ Brain-to-computer interface gets a second chance, http://archive.boston.com/business/technology/innoeco/2009/08/cyberkinetics_braintocomputer.html, 2022.
[65]
H. Walters, The sound of color: Neil harbisson’s talk visualized, https://ideas.ted.com/the-sound-of-color-neil-harbissons-talk-visualized/, 2022.
[66]
S. Steinert and O. Friedrich, Wired emotions: Ethical issues of affective brain–computer interfaces, Sci. Eng. Ethics, vol. 26, no. 1, pp. 351–367, 2020.
[67]
R. Heilweil, Elon musk is one step closer to connecting a computer to your brain, https://www.vox.com/recode/2020/8/28/21404802/elon-musk-neuralink-brain-machine-interface-research, 2022.
[68]
J. Bennett, O. Rokas, and L. Chen, Healthcare in the smart home: A study of past, present and future, Sustainability, vol. 9, no. 5, p. 840, 2017.
[69]
Agile Ageing Alliance, Creating a brighter future for our older selves, https://www.agileageing.org/, 2022.
[70]
K. Takayanagi, T. Kirita, and T. Shibata, Comparison of verbal and emotional responses of elderly people with mild/moderate dementia and those with severe dementia in responses to seal robot, PARO, Front. Aging Neurosci., vol. 6, p. 257, 2014.
[71]
J. Synnott, L. Chen, C. D. Nugent, and G. Moore, WiiPD-objective home assessment of parkinson’s diseaseusing the Nintendo Wii remote, IEEE Trans. Inf. Technol. Biomed., vol. 16, no. 6, pp. 1304–1312, 2012.
[72]
J. Synnott, L. Chen, C. D. Nugent, and G. Moore, The creation of simulated activity datasets using a graphical intelligent environment simulation tool, in Proc. 36th Annu. Int. Conf. of the IEEE Engineering in Medicine and Biology Society, Chicago, IL, USA, 2014, pp. 4143–4146.
[73]
N. Ekekwe, Neuromorphs: Replaceable human organs of the future? IEEE Potentials, vol. 27, no. 1, pp. 8–25, 2008.
[74]
D. Huh, B. D. Matthews, A. Mammoto, M. Montoya-Zavala, H. Y. Hsin, and D. E. Ingber, Reconstituting organ-level lung functions on a chip, Science, vol. 328, no. 5986, pp. 1662–1668, 2010.
[75]
A. Van Den Berg, LABS, cells and organs on chip: Technologies and biomedical applications, in Proc. 19thInt. Conf. Solid-State Sensors, Actuators and Microsystems (TRANSDUCERS), Kaohsiung, China, 2017, pp. 6–9.
[76]
G. Dounias and D. Linkens, Adaptive systems and hybrid computational intelligence in medicine, Artif. Intell. Med., vol. 32, no. 3, pp. 151–155, 2004.
[77]
R. K. Ando, M. Dredze, and T. Zhang, TREC 2005 genomics track experiments at IBM WATSON, in Proc. Fourteenth Text Retrieval Conf., Gaithersburg, MD, USA, 2005.
[78]
M. M. Waldrop, Autonomous vehicles: No drivers required, Nature, vol. 518, no. 7537, pp. 20–23, 2015.
[79]
N. V. Jungum, R. M. Doomun, S. D. Ghurbhurrun, and S. Pudaruth, Collaborative driving support system in mobile pervasive environments, in Proc. 2008 the Fourth Int. Conf. Wireless and Mobile Communications, Athens, Greece, 2008, pp. 358–363.
[80]
W. Li, F. Duan, and C. Xu, Design and performance evaluation of a simple semi-physical human-vehicle collaborative driving simulation system, IEEE Access, vol. 7, pp. 31971–31983, 2019.
[81]
A. Kusiak, Smart manufacturing, Int. J. Prod. Res., vol. 56, nos. 1&2, pp. 508–517, 2018.
[82]
Ford Media Center, Ford choreographs robots to help people and each other on the fiesta assembly line, https://media.ford.com/content/fordmedia/feu/en/news/2019/09/26/ford-choreographs-robots-to-help-people–and-each-other–on-the-.html, 2022.
[83]
L. D. Evjemo, T. Gjerstad, E. I. Grøtli, and G. Sziebig, Trends in smart manufacturing: Role of humans and industrial robots in smart factories, Curr. Robot. Rep., vol. 1, no. 2, pp. 35–41, 2020.
Publication history
Copyright
Acknowledgements
Rights and permissions
Publication history
Received: 15 January 2022
Revised: 15 June 2022
Accepted: 20 June 2022
Published:
13 December 2022
Issue date: June 2023
Copyright
© The author(s) 2023.
Acknowledgements
This work was supported by the National Natural Science Foundation of China (No. 61872038), the UK Royal Society-Newton Mobility Grant (No. IEC
Rights and permissions
The articles published in this open access journal are distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/).
FEEDBACK 
TOP