Artificial intelligence foundation model risk identification and governance model from ESG perspective

Authors

Jincheng SHI, AI Safety and Trustworthy Center, Shanghai Artificial Intelligence Laboratory, Shanghai 200232, ChinaFollow
Guoyu WANG, AI Safety and Trustworthy Center, Shanghai Artificial Intelligence Laboratory, Shanghai 200232, China; School of Philosophy, Fudan University, Shanghai 200433, China; Institute of Technology Ethics for Human Future, CAST-FDU, Shanghai 200433, China
Yingchun WANG, AI Safety and Trustworthy Center, Shanghai Artificial Intelligence Laboratory, Shanghai 200232, ChinaFollow

Keywords

artificial intelligence; foundation model; ESG; risk analysis; governance strategy

Document Type

Ethical Risk of Frontier S & T and Its Governance

Abstract

The application ecology of artificial intelligence foundation model is rapidly expanding. The environment, society, and governance are facing new challenges and opportunities. Exploring the construction of a governance framework for the development risks of foundation model has important theoretical value and practical significance for promoting the healthy and sustainable development of artificial intelligence. Based on the theories of ESG and artificial intelligence governance, this study analyzes the development benefits and typical risks of foundation model from the perspective of ESG and then constructs a risk governance framework and implementation strategies for artificial intelligence foundation models. This study shows that a dual approach of technological governance and institutional innovation is necessary to address the development risks of foundation models. Following the logic of “entry perspective → risk identification → governance mechanism → governance strategy”, the study exploringly proposes the risk governance framework of foundation model. Based on the impact cycle and scope of the foundation model risk, this study proposes four differentiated governance strategies, including “release, control, pilot, and iteration”.

First page

1845

Last Page

1859

Language

Chinese

Publisher

Bulletin of Chinese Academy of Sciences

References

1 Eccles R G, Lee L E, Stroehle J C. The social origins of ESG: An analysis of innovest and KLD. Organization & Environment, 2020, 33(4): 575-596.

2 Rau P R, Yu T. A survey on ESG: Investors, institutions and firms. China Finance Review International, 2023, 14(1): 3-33.

3 Tsang A, Frost T, Cao H J. Environmental, social, and governance (ESG) disclosure: A literature review. The British Accounting Review, 2023, 55(1): 101149.

4 De Giuli M E, Grechi D, Tanda A. What do we know about ESG and risk?A systematic and bibliometric review. Corporate Social Responsibility and Environmental Management, 2024, 31(2): 1096-1108.

5 张兆翔, 张吉豫, 谭铁牛. 人工智能伦理问题的现状分析与对策. 中国科学院院刊, 2021, 36(11): 1270-1277.Zhang Z X, Zhang J Y, Tan T N. Analysis and strategy of AI ethical problems. Bulletin of Chinese Academy of Sciences, 2021, 36(11): 1270-1277. (in Chinese)

6 Buhmann A, Fieseler C. Towards a deliberative framework for responsible innovation in artificial intelligence. Technology in Society, 2021, 64: 101475.

7 Vallès-Peris N, Domènech M. Caring in the in-between: A proposal to introduce responsible AI and robotics to healthcare. AI & SOCIETY, 2023, 38(4): 1685-1695.

8 Keding C, Meissner P. Managerial overreliance on AI-augmented decision-making processes: How the use of AI-based advisory systems shapes choice behavior in R&D investment decisions. Technological Forecasting and Social Change, 2021, 171: 120970.

9 Tian H N, Zhao L Y, Li Y F, et al. Can enterprise green technology innovation performance achieve “corner overtaking” by using artificial intelligence?—Evidence from Chinese manufacturing enterprises. Technological Forecasting and Social Change, 2023, 194: 122732.

10 Priya A K, Devarajan B, Alagumalai A, et al. Artificial intelligence enabled carbon capture: A review. Science of the Total Environment, 2023, 886: 163913.

11 Vinuesa R, Azizpour H, Leite I, et al. The role of artificial intelligence in achieving the sustainable development goals. Nature Communications, 2020, 11(1): 1-10.

12 Moon M J. Searching for inclusive artificial intelligence for social good: Participatory governance and policy recommendations for making AI more inclusive and benign for society. Public Administration Review, 2023, 83(6): 1496-1505.

13 Bi K F, Xie L X, Zhang H H, et al. Accurate medium-range global weather forecasting with 3D neural networks. Nature, 2023, 619: 533-538.

14 Mannuru N R, Shahriar S, Teel Z A, et al. Artificial intelligence in developing countries: The impact of generative artificial intelligence (AI) technologies for development. Information Development, 2023, doi: 10.1177/02666669231200628.

15 Khan O, Parvez M, Alansari M, et al. Application of artificial intelligence in green building concept for energy auditing using drone technology Cunder different environmental conditions. Scientific Reports, 2023, 13: 8200.

16 Bouschery S G, Blazevic V, Piller F T. Augmenting human innovation teams with artificial intelligence: Exploring transformer-based language models. Journal of Product Innovation Management, 2023, 40(2): 139-153.

17 何赛克, 张培杰, 张玮光, 等. 大模型时代下的决策范式转变. 中国地质大学学报（社会科学版）, 2023, 23(4): 82-91.He S K, Zhang P J, Zhang W G, et al. Paradigm shift in decision-making in the era of large language models. Journal of China University of Geosciences (Social Sciences Edition), 2023, 23(4): 82-91. (in Chinese)

18 Verganti R, Vendraminelli L, Iansiti M. Innovation and design in the age of artificial intelligence. Journal of Product Innovation Management, 2020, 37(3): 212-227.

19 Kanbach D K, Heiduk L, Blueher G, et al. The GenAI is out of the bottle: Generative artificial intelligence from a business model innovation perspective. Review of Managerial Science, 2024, 18(4): 1189-1220.

20 Wei R Q, Vize R, Geiger S. Boundary resource interactions in solution networks. European Journal of Marketing, 2022, 56(2): 532-561.

21 Lee J, Kim M. ESG information extraction with cross-sectoral and multi-source adaptation based on domain-tuned language models. Expert Systems with Applications, 2023, 221: 119726.

22 Asif M, Searcy C, Castka P. ESG and Industry 5.0: The role of technologies in enhancing ESG disclosure. Technological Forecasting and Social Change, 2023, 195: 122806.

23 Maragno G, Tangi L, Gastaldi L, et al. AI as an organizational agent to nurture: Effectively introducing chatbots in public entities. Public Management Review, 2023, 25(11): 2135-2165.

24 Watson H J. Preparing for the cognitive generation of decision support. MIS Quarterly Executive, 2017, 16(3): 153-169.

25 Cortés-Cediel M E, Segura-Tinoco A, Cantador I, et al. Trends and challenges of e-government chatbots: Advances in exploring open government data and citizen participation content. Government Information Quarterly, 2023, 40(4): 101877.

26 Siddik M A B, Shehabi A, Marston L. The environmental footprint of data centers in the United States. Environmental Research Letters, 2021, 16(6): 064017.

27 Mytton D. Data centre water consumption. NPJ Clean Water, 2021, 4: 11.

28 Chang C H, Kidman G. The rise of generative artificial intelligence (AI) language models-challenges and opportunities for geographical and environmental education. International Research in Geographical and Environmental Education, 2023, 32(2): 85-89.

29 Chien A A, Lin L, Nguyen H, et al. Reducing the Carbon Impact of Generative AI Inference (today and in 2035)// Proceedings of the 2nd Workshop on Sustainable Computer Systems. Boston: ACM, 2023: 1-7.

30 Strubell E, Ganesh A, McCallum A. Energy and policy considerations for deep learning in NLP// Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. Italy: Association for Computational Linguistics, 2019: 3645-3650

31 Patterson D, Gonzalez J, Hölzle U, et al. The carbon footprint of machine learning training will plateau, then shrink. Computer, 2022, 55(7): 18-28.

32 滕妍, 王国豫, 王迎春. 通用模型的伦理与治理: 挑战及对策. 中国科学院院刊, 2022, 37(9): 1290-1299.Teng Y, Wang G Y, Wang Y C. Ethics and governance of general models: Challenges and countermeasures. Bulletin of Chinese Academy of Sciences, 2022, 37(9): 1290-1299. (in Chinese)

33 孔祥维, 王子明, 王明征, 等. 人工智能使能系统的可信决策: 进展与挑战. 管理工程学报, 2022, 36(6): 1-14.Kong X W, Wang Z M, Wang M Z, et al. Trustworthy decision-making in artificial intelligence-enabled systems: Progress and challenges. Journal of Industrial Engineering and Engineering Management, 2022, 36(6): 1-14. (in Chinese)

34 郁建兴, 刘宇轩, 吴超. 人工智能大模型的变革与治理. 中国行政管理, 2023, (4): 6-13.Yu J X, Liu Y X, Wu C. The social transformation and governance of large generative artificial intelligence models. Chinese Public Administration, 2023, (4): 6-13. (in Chinese)

35 Xu H W, Usuyama N, Bagga J, et al. A whole-slide foundation model for digital pathology from real-world data. Nature, 2024, 630: 181-188.

36 Shevlane T, Farquhar S, Garfinkel B, et al. Model evaluation for extreme risks. ArXiv, 2023, doi: 10.48550/arXiv.2305.15324.

Recommended Citation

SHI, Jincheng; WANG, Guoyu; and WANG, Yingchun (2024) "Artificial intelligence foundation model risk identification and governance model from ESG perspective," Bulletin of Chinese Academy of Sciences (Chinese Version): Vol. 39 : Iss. 11 , Article 5.
DOI: https://doi.org/10.16418/j.issn.1000-3045.20240415001
Available at: https://bulletinofcas.researchcommons.org/journal/vol39/iss11/5