<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.3 20210610//EN" "JATS-journalpublishing1-3.dtd">
<article article-type="research-article" dtd-version="1.3" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xml:lang="ru"><front><journal-meta><journal-id journal-id-type="publisher-id">finance</journal-id><journal-title-group><journal-title xml:lang="ru">Финансы: теория и практика/Finance: Theory and Practice</journal-title><trans-title-group xml:lang="en"><trans-title>Finance: Theory and Practice</trans-title></trans-title-group></journal-title-group><issn pub-type="ppub">2587-5671</issn><issn pub-type="epub">2587-7089</issn><publisher><publisher-name>Financial University under The Government of Russian Federation</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.26794/2587-5671-2024-28-3-206-217</article-id><article-id custom-type="elpub" pub-id-type="custom">finance-2967</article-id><article-categories><subj-group subj-group-type="heading"><subject>Research Article</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="ru"><subject>ИНВЕСТИЦИИ В ИННОВАЦИИ</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="en"><subject>INNOVATION  INVESTMENT</subject></subj-group></article-categories><title-group><article-title>Применение жизненного цикла модели для оценки инвестиций в искусственный интеллект на примере больших языковых моделей</article-title><trans-title-group xml:lang="en"><trans-title>Application of a Model Life Cycle Concept to Investments in Artificial Intelligence Evaluation on the Example of Large Language Models</trans-title></trans-title-group></title-group><contrib-group><contrib contrib-type="author" corresp="yes"><contrib-id contrib-id-type="orcid">https://orcid.org/0000-0003-1217-713X</contrib-id><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Никитин</surname><given-names>Н. А.</given-names></name><name name-style="western" xml:lang="en"><surname>Nikitin</surname><given-names>N. A.</given-names></name></name-alternatives><bio xml:lang="ru"><p>Никита Александрович Никитин — аспирант департамента финансового и инвестиционного менеджмента, факультет «Высшая школа управления»</p><p>Москва</p></bio><bio xml:lang="en"><p>Nikita A. Nikitin — postgraduate student, Department of Financial and Investment Management, Graduate School of Management</p><p>Moscow</p></bio><email xlink:type="simple">nikitanrus@mail.ru</email><xref ref-type="aff" rid="aff-1"/></contrib></contrib-group><aff-alternatives id="aff-1"><aff xml:lang="ru"><institution>Финансовый университет</institution><country>Россия</country></aff><aff xml:lang="en"><institution>Financial University</institution><country>Russian Federation</country></aff></aff-alternatives><pub-date pub-type="collection"><year>2024</year></pub-date><pub-date pub-type="epub"><day>12</day><month>07</month><year>2024</year></pub-date><volume>28</volume><issue>3</issue><fpage>206</fpage><lpage>217</lpage><permissions><copyright-statement>Copyright &amp;#x00A9; Никитин Н.А., 2024</copyright-statement><copyright-year>2024</copyright-year><copyright-holder xml:lang="ru">Никитин Н.А.</copyright-holder><copyright-holder xml:lang="en">Nikitin N.A.</copyright-holder><license xml:lang="ru" license-type="creative-commons-attribution" xlink:href="https://creativecommons.org/licenses/by/4.0/" xlink:type="simple"><license-p>Данная работа распространяется под лицензией Creative Commons Attribution 4.0.</license-p></license><license xml:lang="en" license-type="creative-commons-attribution" xlink:href="https://creativecommons.org/licenses/by/4.0/" xlink:type="simple"><license-p>This work is licensed under a Creative Commons Attribution 4.0 License.</license-p></license></permissions><self-uri xlink:href="https://financetp.fa.ru/jour/article/view/2967">https://financetp.fa.ru/jour/article/view/2967</self-uri><abstract><p>Объект исследования — жизненный цикл модели искусственного интеллекта (ИИ). Цель исследования состоит в разработке методологии жизненного цикла модели, описывающей экономическое содержание инвестиционного процесса в технологии искусственного интеллекта. В процессе исследования использовались как общенаучные методы анализа, синтеза, сравнения, абстракции, индукции и дедукции, так и проектные методологии жизненного цикла, взятые в качестве основы для разработки жизненного цикла модели с точки зрения создания стоимости. Анализ основывался на выявлении необходимых этапов разработки модели в терминах методологии CRISP-DM и определении особенностей каждого из них с точки зрения денежных потоков. Также были учтены модифицированные версии жизненного цикла модели, содержащие оценку рисков, в том числе модельного риска. В процессе исследования предложенная обобщенная методология жизненного цикла модели была уточнена для конкретной технологии ИИ — больших языковых моделей. В результате исследования автором предложена трехэтапная модель: описаны возможные опциональности между этапами и характеристика денежных потоков. Сделан вывод о том, что инвестиционный проект разработки ИИ содержит в себе несколько реальных опционов — на отказ, на сокращение, на расширение, на смену. Для больших языковых моделей сохраняется структура жизненного цикла и возможные опциональности. Особенность состоит в том, что в создании стоимости участвуют денежные потоки от разных направлений применения модели в бизнес-процессах. Результаты исследования имеют практическую значимость для среднего и крупного бизнеса, занимающегося самостоятельной разработкой ИИ моделей и/или применяющих их в своих бизнес-процессах. Предложенная концепция жизненного цикла модели также может использоваться для развития методологии оценки инвестиций в ИИ с использованием реальных опционов.</p></abstract><trans-abstract xml:lang="en"><p>The life cycle of an artificial intelligence model is the object of research. The purpose of the study is to develop a model life-cycle methodology that describes the economic content of the investment process in artificial intelligence technology. During the study, both general scientific methods such as analysis, synthesis, comparison, abstraction, induction and deduction were used, as well as project methodologies of the life-cycle, employed as the basis for the value creation life-cycle of the model. The analysis was based on identifying the necessary stages of model development in terms of the CRISP-DM methodology and determining the features of each of them in terms of cash flows. Modified versions of the model life-cycle containing risk assessment, including model risk, were also taken into account. In the process of research, the proposed generalized model life-cycle methodology was specified for a specific AI technology — large language models. As a result of the study, the author proposed a three-stage model. The possible optionality between the stages and the characteristics of cash flows are described. It was concluded that an investment project for the development of AI contains several real options — abandonment, reduction, expansion and replacement. For large language models, the life cycle structure and possible optionalities are preserved. The peculiarity is that the value creation process involves cash flows from different areas of application of the model in business processes. The results of the study are of practical importance for medium and large businesses engaged in the independent development of AI models and/or applying them to their business processes. The proposed concept of the model life-cycle can also be used to develop a methodology for evaluating investments in AI using real options.</p></trans-abstract><kwd-group xml:lang="ru"><kwd>жизненный цикл модели</kwd><kwd>инвестиционная оценка</kwd><kwd>искусственный интеллект</kwd><kwd>денежные потоки</kwd><kwd>большие языковые модели</kwd></kwd-group><kwd-group xml:lang="en"><kwd>model life-cycle</kwd><kwd>investment valuation</kwd><kwd>artificial intelligence</kwd><kwd>cash flows</kwd><kwd>large language models</kwd></kwd-group></article-meta></front><back><ref-list><title>References</title><ref id="cit1"><label>1</label><citation-alternatives><mixed-citation xml:lang="ru">Maslej N., Fattorini L., Brynjolfsson E., et al. Artificial intelligence index report 2023. Stanford, CA: Institute for Human-Centered AI, Stanford University; 2023. 386 p. URL: https://aiindex.stanford.edu/wp-content/uploads/2023/04/HAI_AI–Index-Report_2023.pdf (дата обращения: 01.08.2023).</mixed-citation><mixed-citation xml:lang="en">Maslej N., Fattorini L., Brynjolfsson E., et al. Artificial intelligence index report 2023. Stanford, CA: Institute for Human-Centered AI, Stanford University; 2023. 386 p. URL: https://aiindex.stanford.edu/wp-content/uploads/2023/04/HAI_AI–Index-Report_2023.pdf (дата обращения: 01.08.2023).</mixed-citation></citation-alternatives></ref><ref id="cit2"><label>2</label><citation-alternatives><mixed-citation xml:lang="ru">Chen L., Zaharia M., Zou J. How is ChatGPT’s behavior changing over time? Harvard Data Science Review. 2024;(6.2):1–47. DOI: 10.1162/99608f92.5317da47</mixed-citation><mixed-citation xml:lang="en">Chen L., Zaharia M., Zou J. How is ChatGPT’s behavior changing over time? Harvard Data Science Review. 2024;(6.2):1–47. DOI: 10.1162/99608f92.5317da47</mixed-citation></citation-alternatives></ref><ref id="cit3"><label>3</label><citation-alternatives><mixed-citation xml:lang="ru">Shearer C. The CRISP-DM model: The new blueprint for data mining. Journal of Data Warehousing. 2000;5(4):13– 22. URL: https://mineracaodedados.wordpress.com/wp-content/uploads/2012/04/the-crisp-dm-model-the-newblueprint-for-data-mining-shearer-colin.pdf</mixed-citation><mixed-citation xml:lang="en">Shearer C. The CRISP-DM model: The new blueprint for data mining. Journal of Data Warehousing. 2000;5(4):13– 22. URL: https://mineracaodedados.wordpress.com/wp-content/uploads/2012/04/the-crisp-dm-model-the-newblueprint-for-data-mining-shearer-colin.pdf</mixed-citation></citation-alternatives></ref><ref id="cit4"><label>4</label><citation-alternatives><mixed-citation xml:lang="ru">Tabladillo M. The Team Data Science Process lifecycle. 2017;552–554. URL: https://learn.microsoft.com/pdf?url=https%3A%2F%2Flearn.microsoft.com%2Fen-us%2Fazure%2Farchitecture%2Fai-ml%2Ftoc.json (дата обращения: 01.08.2023).</mixed-citation><mixed-citation xml:lang="en">Tabladillo M. The Team Data Science Process lifecycle. 2017;552–554. URL: https://learn.microsoft.com/pdf?url=https%3A%2F%2Flearn.microsoft.com%2Fen-us%2Fazure%2Farchitecture%2Fai-ml%2Ftoc.json (дата обращения: 01.08.2023).</mixed-citation></citation-alternatives></ref><ref id="cit5"><label>5</label><citation-alternatives><mixed-citation xml:lang="ru">Haakman M., Cruz L., Huijgens H., van Deursen A. AI lifecycle models need to be revised. Empirical Software Engineering. 2021;26:95. DOI: 10.1007/s10664–021–09993–1</mixed-citation><mixed-citation xml:lang="en">Haakman M., Cruz L., Huijgens H., van Deursen A. AI lifecycle models need to be revised. Empirical Software Engineering. 2021;26:95. DOI: 10.1007/s10664–021–09993–1</mixed-citation></citation-alternatives></ref><ref id="cit6"><label>6</label><citation-alternatives><mixed-citation xml:lang="ru">De Silva D., Alahakoon D. An artificial intelligence life cycle: From conception to production. Patterns. 2022;3(6):100489. DOI: 10.1016/j.patter.2022.100489</mixed-citation><mixed-citation xml:lang="en">De Silva D., Alahakoon D. An artificial intelligence life cycle: From conception to production. Patterns. 2022;3(6):100489. DOI: 10.1016/j.patter.2022.100489</mixed-citation></citation-alternatives></ref><ref id="cit7"><label>7</label><citation-alternatives><mixed-citation xml:lang="ru">Голубев А.А. Жизненный цикл инновации и ресурсное обеспечение инновационной деятельности. Современные проблемы науки и образования. 2015;(2–2):414. URL: https://science-education.ru/ru/article/view?id=22026 (дата обращения: 05.08.2023).</mixed-citation><mixed-citation xml:lang="en">Golubev A.A. The life cycle of innovation and resource support innovation. Sovremennye problemy nauki i obrazovaniya = Modern Problems of Science and Education. 2015;(2–2):414. URL: https://science-education.ru/ru/article/view?id=22026 (accessed on 05.08.2023). (In Russ.</mixed-citation></citation-alternatives></ref><ref id="cit8"><label>8</label><citation-alternatives><mixed-citation xml:lang="ru">Городнова Н.В. Применение искусственного интеллекта в бизнес-сфере: современное состояние и перспективы. Вопросы инновационной экономики. 2021;11(4):1473–1492. DOI: 10.18334/vinec.11.4.112249</mixed-citation><mixed-citation xml:lang="en">Gorodnova N.V.Application of artificial intelligence in the business sphere: Current state and prospects Voprosy innovatsionnoi ekonomiki = Russian Journal of Innovation Economics. 2021;11(4):1473–1492. (In Russ.). DOI: 10.18334/vinec.11.4.112249</mixed-citation></citation-alternatives></ref><ref id="cit9"><label>9</label><citation-alternatives><mixed-citation xml:lang="ru">Кашеварова Н.А., Панова Д.А.Анализ современной практики применения технологии искусственного интеллекта в финансовой сфере и его влияния на трансформацию финансовой экосистемы. Креативная экономика. 2020;14(8):1565–1580. DOI: 10.18334/ce.14.8.110708</mixed-citation><mixed-citation xml:lang="en">Kashevarova N.A., Panova D.A.Analysis of the current practice of applying artificial intelligence in the financial sector and its impact on the transformation of the financial ecosystem. Kreativnaya ekonomika = Journal of Creative Economy. 2020;14(8):1565–1580. (In Russ.). DOI: 10.18334/ce.14.8.110708</mixed-citation></citation-alternatives></ref><ref id="cit10"><label>10</label><citation-alternatives><mixed-citation xml:lang="ru">Устинова О.Е. Искусственный интеллект в менеджменте компаний. Креативная экономика. 2020;14(5):885– 904. DOI: 10.18334/ce.14.5.102145</mixed-citation><mixed-citation xml:lang="en">Ustinova O.E.Artificial intelligence in company management. Kreativnaya ekonomika = Journal of Creative Economy. 2020;14(5):885–904. (In Russ.). DOI: 10.18334/ce.14.5.102145</mixed-citation></citation-alternatives></ref><ref id="cit11"><label>11</label><citation-alternatives><mixed-citation xml:lang="ru">Åström J., Reim W., Parida V.Value creation and value capture for AI business model innovation: A three-phase process framework. Review of Managerial Science. 2022;16(7):2111–2133. DOI: 10.1007/s11846–022–00521-z</mixed-citation><mixed-citation xml:lang="en">Åström J., Reim W., Parida V.Value creation and value capture for AI business model innovation: A three-phase process framework. Review of Managerial Science. 2022;16(7):2111–2133. DOI: 10.1007/s11846–022–00521-z</mixed-citation></citation-alternatives></ref><ref id="cit12"><label>12</label><citation-alternatives><mixed-citation xml:lang="ru">Moro-Visconti R. The valuation of artificial intelligence. In: The valuation of digital intangibles: Technology, marketing, and the metaverse. Cham: Palgrave Macmillan; 2022:265–282. DOI: 10.1007/978–3–031–09237–4_8</mixed-citation><mixed-citation xml:lang="en">Moro-Visconti R. The valuation of artificial intelligence. In: The valuation of digital intangibles: Technology, marketing, and the metaverse. Cham: Palgrave Macmillan; 2022:265–282. DOI: 10.1007/978–3–031–09237–4_8</mixed-citation></citation-alternatives></ref><ref id="cit13"><label>13</label><citation-alternatives><mixed-citation xml:lang="ru">Никитин Н.А. Финансовая оценка проектов с искусственным интеллектом в банковском секторе. Финансовый бизнес. 2022;(5):122–125.</mixed-citation><mixed-citation xml:lang="en">Nikitin N.A. Financial evaluation of projects with artificial intelligence in the banking sector. Finansovyi biznes = Financial Business. 2022;(5):122–125. (In Russ.).</mixed-citation></citation-alternatives></ref><ref id="cit14"><label>14</label><citation-alternatives><mixed-citation xml:lang="ru">Agarwal N., Moehring A., Rajpurkar P., Salz T. Combining human expertise with artificial intelligence: Experimental evidence from radiology. NBER Working Paper. 2023;(31422). URL: https://www.nber.org/system/files/working_papers/w31422/w31422.pdf (дата обращения: 09.08.2023).</mixed-citation><mixed-citation xml:lang="en">Agarwal N., Moehring A., Rajpurkar P., Salz T. Combining human expertise with artificial intelligence: Experimental evidence from radiology. NBER Working Paper. 2023;(31422). URL: https://www.nber.org/system/files/working_papers/w31422/w31422.pdf (дата обращения: 09.08.2023).</mixed-citation></citation-alternatives></ref><ref id="cit15"><label>15</label><citation-alternatives><mixed-citation xml:lang="ru">Помулев А.А. Искусственный интеллект как объект стоимостной оценки. Имущественные отношения в Российской Федерации. 2022;(6):42–56. DOI: 10.24412/2072–4098–2022–6249–42–56</mixed-citation><mixed-citation xml:lang="en">Pomulev A.A.Artificial intelligence as an object of valuation. Imushchestvennye otnosheniya v Rossiiskoi Federatsii = Property Relations in the Russian Federation. 2022;(6):42–56. (In Russ.). DOI: 10.24412/2072–4098–2022–6249–42–56</mixed-citation></citation-alternatives></ref><ref id="cit16"><label>16</label><citation-alternatives><mixed-citation xml:lang="ru">Никитин Н.А. Вероятностные методы учета модельных рисков при оценке инвестиций в технологии искусственного интеллекта. Инновационное развитие экономики. 2023;(2):123–134. DOI: 10.51832/2223798420232123</mixed-citation><mixed-citation xml:lang="en">Nikitin N.A. Probabilistic methods for accounting model risks in assessing investments in artificial intelligence technologies. Innovatsionnoe razvitie ekonomiki = Innovative Development of Economy. 2023;(2):123–134. (In Russ.). DOI: 10.51832/2223798420232123</mixed-citation></citation-alternatives></ref><ref id="cit17"><label>17</label><citation-alternatives><mixed-citation xml:lang="ru">Kiela D., Bartolo M., Yixin Nie Y., et al. Dynabench: Rethinking benchmarking in NLP. In: Proc. 2021 conf. North American Chapter of the Association for Computational Linguistics: Human language technologies. Stroudsburg, PA: Association for Computational Linguistics; 2021:4110–4124. URL: https://aclanthology.org/2021.naaclmain.324.pdf (дата обращения: 11.08.2023).</mixed-citation><mixed-citation xml:lang="en">Kiela D., Bartolo M., Yixin Nie Y., et al. Dynabench: Rethinking benchmarking in NLP. In: Proc. 2021 conf. North American Chapter of the Association for Computational Linguistics: Human language technologies. Stroudsburg, PA: Association for Computational Linguistics; 2021:4110–4124. URL: https://aclanthology.org/2021.naaclmain.324.pdf (дата обращения: 11.08.2023).</mixed-citation></citation-alternatives></ref><ref id="cit18"><label>18</label><citation-alternatives><mixed-citation xml:lang="ru">Bubeck S., ChandrasekaranV., Eldan R., et al. Sparks of artificial general intelligence: Early experiments with GPT 4. Cornell University. arXiv:2303.12712 [cs.CL]. 2023. DOI: 10.48550/arXiv.2303.12712</mixed-citation><mixed-citation xml:lang="en">Bubeck S., ChandrasekaranV., Eldan R., et al. Sparks of artificial general intelligence: Early experiments with GPT 4. Cornell University. arXiv:2303.12712 [cs.CL]. 2023. DOI: 10.48550/arXiv.2303.12712</mixed-citation></citation-alternatives></ref><ref id="cit19"><label>19</label><citation-alternatives><mixed-citation xml:lang="ru">Sevilla J., Heim L., Ho A., et al. Compute trends across three eras of machine learning. In: 2022 Int. joint conf. on neural networks (IJCNN). (Padua, July 18–23, 2022). Piscataway, NJ: IEEE; 2022. DOI: 10.1109/ IJCNN 55064.2022.9891914</mixed-citation><mixed-citation xml:lang="en">Sevilla J., Heim L., Ho A., et al. Compute trends across three eras of machine learning. In: 2022 Int. joint conf. on neural networks (IJCNN). (Padua, July 18–23, 2022). Piscataway, NJ: IEEE; 2022. DOI: 10.1109/IJCNN55064.2022.9891914</mixed-citation></citation-alternatives></ref><ref id="cit20"><label>20</label><citation-alternatives><mixed-citation xml:lang="ru">Waisberg E., Ong J., Masalkhi M., et al. GPT 4: A new era of artificial intelligence in medicine. Irish Journal of Medical Science. 2023;192(6):3197–3200. DOI: 10.1007/s11845–023–03377–8</mixed-citation><mixed-citation xml:lang="en">Waisberg E., Ong J., Masalkhi M., et al. GPT 4: A new era of artificial intelligence in medicine. Irish Journal of Medical Science. 2023;192(6):3197–3200. DOI: 10.1007/s11845–023–03377–8</mixed-citation></citation-alternatives></ref><ref id="cit21"><label>21</label><citation-alternatives><mixed-citation xml:lang="ru">Rivas P., Zhao L. Marketing with ChatGPT: Navigating the ethical terrain of GPT-based chatbot technology. AI. 2023;4(2):375–384. DOI: 10.3390/ai4020019</mixed-citation><mixed-citation xml:lang="en">Rivas P., Zhao L. Marketing with ChatGPT: Navigating the ethical terrain of GPT-based chatbot technology. AI. 2023;4(2):375–384. DOI: 10.3390/ai4020019</mixed-citation></citation-alternatives></ref><ref id="cit22"><label>22</label><citation-alternatives><mixed-citation xml:lang="ru">Dohmke T., Iansiti M., Richards G. Sea change in software development: Economic and productivity analysis of the AI-powered developer lifecycle. New Hyde Park, NY: Keystone; 2023. 30 p. URL: https://github.blog/wp-content/uploads/2023/06/Sea-Change-in-Software-Dev.pdf</mixed-citation><mixed-citation xml:lang="en">Dohmke T., Iansiti M., Richards G. Sea change in software development: Economic and productivity analysis of the AI-powered developer lifecycle. New Hyde Park, NY: Keystone; 2023. 30 p. URL: https://github.blog/wp-content/uploads/2023/06/Sea-Change-in-Software-Dev.pdf</mixed-citation></citation-alternatives></ref><ref id="cit23"><label>23</label><citation-alternatives><mixed-citation xml:lang="ru">Chung H.W., Hou L., Longpre S., et al. Scaling instruction-finetuned language models. Journal of Machine Learning Research. 2024;25:1–53. URL: https://www.jmlr.org/papers/volume25/23–0870/23–0870.pdf</mixed-citation><mixed-citation xml:lang="en">Chung H.W., Hou L., Longpre S., et al. Scaling instruction-finetuned language models. Journal of Machine Learning Research. 2024;25:1–53. URL: https://www.jmlr.org/papers/volume25/23–0870/23–0870.pdf</mixed-citation></citation-alternatives></ref></ref-list><fn-group><fn fn-type="conflict"><p>The authors declare that there are no conflicts of interest present.</p></fn></fn-group></back></article>
