The Growing Proliferation of Large Language Models Requires AI Governance for Enterprises

The article discusses the need for businesses to develop a governance framework to manage their generative artificial intelligence (AI) applications as the number of large language models (LLMs) in the market continues to grow and branch out. According to Frederic Giron, Forrester’s vice president and senior research director, organizations will require layers of intelligence that pull together internal and external capabilities. This approach will encompass the use of paid and open-source LLMs from third parties, as well as embedded AI tools. It will also involve the use of structured and unstructured data, with the latter expected to double amid the adoption of generative AI.

The complexities around AI governance mean that businesses might take a while before seeing real results from their adoption of a framework. Forrester predicts that the transformative impact of generative AI will benefit just 30% of Asia-Pacific firms over the next year, with key challenges related to data governance, quality, and infrastructure. To address these challenges, service providers are investing in transforming their operations and delivering new platforms, such as AI studios and model comparisons.

The article also highlights the potential impact of generative AI on websites and search. Dane Anderson, Forrester’s senior vice president of international research and product, predicted that “static” websites will gradually be abandoned over the next 20 years, as users evolve to prompt or ask a query and receive a continually updated response powered by generative AI. Anderson also noted the potential for more market players to start embedding generative AI capabilities for free into their existing customer enterprise applications.

Ultimately, the value for businesses lies in integrating generative AI features into their products and driving a workplace environment where generative AI capabilities are more ingrained into how employees work, making the technology more affordable for businesses.