NEC improves reliability of large language models to accelerate business applications

HEIDELBERG, Germany, Sept. 26, 2024 /PRNewswire/ -- NEC Laboratories Europe, the European research and development center for NEC Corporation, is improving NEC cotomi generative AI services for Japan by introducing LLM Explainer, an NEC technology that helps detect and explain hallucinations in output generated by commonly available large language models (LLMs).

LLMs are a type of generative AI that understands and generates natural language and other content. While increasingly adopted by industries and end users to enhance knowledge-based activities, LLMs frequently produce incorrect output – commonly called hallucinations. This limits their use in situations that require accurate information or involve risk, for example, in business-critical operations or managing critical infrastructure.

Dr. Carolin Lawrence, Manager and Chief Research Scientist of NEC Laboratories Europe, explains, "Currently, organizations using LLMs must manually check that output is correct, which can be time-consuming and costly. By incorporating LLM Explainer, NEC cotomi generative AI allows users to compare LLM output with relevant source documentation. This lets users efficiently check and verify the correctness of LLM-generated text and, if needed, correct it."

Using the latest advances in natural-language processing, LLM Explainer compares both the words and meaning of sentences to detect omissions, duplications and changes in meaning between original source documentation and generated output sentences. For each output sentence, users can view relevant sentences from original source documentation, which lets them determine if the LLM-generated text is correct.

Dr. Lawrence adds, "Highlighting evidence and potential discrepancies in a simple format, for what is often complex information, allows users to make corrections and quickly adapt LLM-generated text to their needs."

NEC plans to enhance the detection of LLM hallucinations in generative AI services by adding functions such as finding hallucinated entities and identifying contradictions – further accelerating the detection and correction of LLM discrepancies.

LLM Explainer will be integrated into NEC cotomi generative AI API services for Japan beginning at the end of October. A version of the service will also be available on premise.

About NEC Corporation
NEC Corporation has established itself as a leader in the integration of IT and network technologies while promoting the brand statement of "Orchestrating a brighter world." NEC enables businesses and communities to adapt to rapid changes taking place in both society and the market as it provides for the social values of safety, security, fairness and efficiency to promote a more sustainable world where everyone has the chance to reach their full potential.

For more information, visit NEC at https://www.nec.com.

About NEC Laboratories Europe GmbH
NEC Laboratories Europe research and develop cutting-edge technology to create innovative social solutions. Located in Heidelberg, Germany, major research areas of NEC Laboratories Europe include artificial intelligence, blockchain security, 5G and 6G networks, and IoT platforms. These technologies promote NEC Group solutions for a better society in the fields of digital health, safer cities, public services and communication infrastructure. 

For more information visit https://www.neclab.eu.

Photo: https://mma.prnewswire.com/media/2515254/NEC_LLM_Explainer.jpg

View original content to download multimedia:https://www.prnewswire.com/news-releases/nec-improves-reliability-of-large-language-models-to-accelerate-business-applications-302259229.html

SOURCE NEC Laboratories Europe GmbH