How do I build my own language model? Fine-tuning a Large Language Model (LLM)

by Helle Hannken-Illjes on May 24, 2024

Large Language Models (LLM), such as those behind ChatGPT, are transforming technical communication. There are many use cases for AI, from text generation to voice assistants. However, despite their power, generic LLMs sometimes do not provide the right solution for a company's specific projects. Generic AIs have a lot of general knowledge and can handle many languages and general texts – but they often struggle with requests from specific domains.

Is it possible to train a generative AI in a corporate language and to train it with the knowledge of the company?

We have trained and fine-tuned an LLM with technical documentation in two languages and examined the effects. In our presentation, we show the selection criteria for an LLM, the process of fine-tuning the LLM, and the results of the company-specific LLM.

What you will learn:

  • What are Large Language Models?
  • Use of language models in technical communication
  • Fine-tuning a large language model: process and results
  • Outlook for productive use in technical communication

The video is a recording of the presentation given by Helle Hannken-Illjes and Ulrike Parson at the tekom annual conference 2023. The presentation is in German.

How do I build my own language model? Fine-tuning a Large Language Model

We advise on the use of artificial intelligence, for example through the use of language models such as ChatGPT, in technical communication and for the various target-group- oriented channels. Find out more!

Add new comment

Your email address will not be published.

You might also be interested in

Webinar: Is everything AI? A reality check on the use of artificial intelligence in chatbots, customer portals, and knowledge management

September 02, 2024

AI has undergone remarkable development in recent years. Especially in the areas of customer support and knowledge management, AI has the potential to make processes more efficient and improve the user experience. But what does this look like in practice? What approaches are there and what are the potential hurdles in implementing AI tools? 

Learn more about this and more in our webinar on September 12, 2024 from 10:00 - 11:00 a.m. with our experts Roman Senger, Channel Sales Manager at Empolis, and Ulrike Parson, CEO of parson AG. more...

Technical documentation – why it matters and how to create it

by parson on August 20, 2024

For suppliers and for users of technical equipment, processes, or systems, technical documentation is critical f. But what exactly is technical documentation? When do we need it and when is it even mandatory? How can you efficiently create high-quality technical documentation as a manufacturer? This article will answer these questions. more...

tekom regional group Munich on June 27: AI in technical communication: Use cases, legal aspects, and the future of our profession

June 05, 2024

AI applications such as ChatGPT are disrupting traditional text and image generation and will have a profound impact on technical communication.

In her presentation, Ulrike Parson will give an overview of current developments in AI and possible applications of AI in the creation and use of technical documentation, using examples from various systems. She will also discuss legal aspects such as the AI Act and the implications for our profession. more...