Generic filters

What is a large language model (LLM)?

A large language model (LLM) is an AI model trained on very large volumes of text that can understand, summarize, and generate language. In companies, LLMs can make information from reports and data available more quickly, for example. For accurate answers, an LLM needs a reliable data foundation. Bissantz connects LLMs with data from the BI system so that controllers can use natural-language questions to drill down from a variance to its underlying cause.

Feature Details
Category Artificial intelligence (AI), generative AI, NLP
Application area Business intelligence, controlling, reporting, knowledge management
Typical use cases Natural-language data queries, automatic report commentary, root cause analysis, analysis of unstructured text
Related terms Machine learning, neural networks, agentic AI, MCP server, conversational analytics
Benefits Faster access to information, less manual effort for commentary, analysis without specialized BI knowledge

At a glance

  • LLM stands for Large Language Model.

  • LLMs use learned patterns to calculate which word is most likely to come next.

  • Multimodal LLMs process not only text but also images, audio, or documents.

  • In business intelligence, LLMs explain numbers but do not calculate them reliably. KPIs should come from the BI system.

  • DeltaMaster and DeltaApp include LLM-based features for chat, voice control, root cause analysis, and executive summaries.

Mehr anzeigen

Large language models: definition and classification

LLM stands for Large Language Model and roughly translates into German as “large language model.” It describes a neural network that statistically models language and can therefore understand and generate text.

“Large” refers to two dimensions: the amount of training data and the number of parameters, which for current models is in the billions.

LLMs are a form of generative AI and are based on deep learning. They are the technology behind well-known AI assistants and many AI features in business software.

How do large language models work?

An LLM predicts step by step which piece of text is most likely to come next. This simple task gives rise to capabilities such as summarization, translation, and question answering when combined with enormous amounts of data.

Technically, almost all current LLMs are based on the transformer architecture. At their core is the attention mechanism: For each word, the model determines which other words in the text are important for its meaning.

 

Step What happens Practical significance
Tokenization Text is split into tokens, such as words or parts of words. Costs and length limits are measured in tokens.
Embeddings Each token is translated into a numerical vector representing its meaning. Similar terms are located close to one another in vector space.
Attention The model identifies relationships between words across the entire context. References across long passages of text are preserved.
Pretraining The model learns from large volumes of text by predicting the next token. It acquires language and general knowledge, but no knowledge of your company data.
Fine-tuning Additional training using examples and human feedback. The model follows instructions and provides more helpful answers.
Inference The finished model generates answers to new inputs (prompts). The answer depends heavily on the prompt and the context provided.

 

Important for business use: An LLM does not store a fact database; it stores probabilities. As a result, it can generate convincing but incorrect statements. These so-called hallucinations can only be mitigated through verified data sources and human oversight.

What types of LLMs are there?

LLMs differ in terms of input type, size, and deployment. For companies, it is particularly relevant whether a model can process images and whether it can be operated in their own data center.

A multimodal large language model (MLLM), for example, processes multiple types of data, such as text, images, audio, or video. It can describe a chart, extract information from a scanned invoice, or answer a question about a screenshot, for example.

 

Type Feature Typical use
Text LLM Processes and generates text only. Summaries, report commentary, chat
Multimodal LLM Processes text, images, audio, or video. Extracting data from documents, describing charts, voice control
Reasoning model Breaks tasks down into intermediate steps before answering. Complex analytical questions, multi-step tasks
Small language model (SLM) Fewer parameters, lower computational requirements. Clearly defined tasks, operation on own hardware
Proprietary model Used through the provider’s cloud service or API. Fast start without own infrastructure
Open-weight model Model weights are freely available. On-premises operation, full control over data

What are some examples of large language models?

The best-known large language models include the GPT, Claude, Gemini, Llama, and Mistral model families. Providers release new versions at short intervals, so the table below lists only the model families.

 

Model family Provider Deployment
GPT OpenAI (USA) Proprietary, via ChatGPT, API, and Microsoft Azure
Claude Anthropic (USA) Proprietary, via Claude apps, API, and cloud platforms
Gemini Google (USA) Proprietary, via Gemini apps, API, and Google Cloud
Llama Meta (USA) Open weight, also available for on-premises deployment
Mistral Mistral AI (France) Proprietary and open models, European provider
Qwen, DeepSeek Alibaba, DeepSeek (China) Primarily open weight

 

For selecting an LLM for business use, the model name matters less than where the data is processed, which contracts apply, and how well the model fits into existing systems.

What do companies need large language models for?

Many companies use LLMs to make knowledge from data and documents available more quickly. In controlling and business intelligence, LLMs primarily shorten the path from a number to an explanation.

Typical tasks in controlling include:

An LLM does not replace a data warehouse or BI software. It sits above them as a language layer and is only as good as the data quality underneath.

What does large language model optimization mean?

Large Language Model Optimization refers to two different things: the technical adaptation of a model to a specific task and, in marketing, the visibility of content in AI-generated answers.

In the technical sense, optimization initially refers to a mathematical process. During training, a loss function is minimized until the model produces predictions that are as accurate as possible. For users, the more relevant question is how to adapt a finished model for their own use:

 

Approach Method Effort Suitable for
Prompt engineering Refine instructions and examples in the prompt Low Quickly improving recurring tasks
Retrieval-augmented generation (RAG) Relevant documents or data are provided with the query Medium Answers based on current company data
Tool integration (for example, via MCP) The LLM retrieves data and functions through defined interfaces Medium Access to BI systems with authorization controls
Fine-tuning The model is further trained using proprietary example data High Specialized language, fixed output formats
Quantization and distillation Models are reduced in size to lower computational requirements High Operation on own hardware

Which LLM solution is right for each use case?

The right solution depends on which data the LLM is supposed to process and how reliable the result needs to be. For KPIs, the rule is: The higher the accuracy requirements, the more closely the LLM needs to be tied to a verified data model.

 

Use case Suitable approach Note
Drafting text, generating ideas Public AI assistant Do not enter confidential data
Questions about internal policies and documents LLM with RAG using an in-house document repository Require sources to be cited in the answers
Querying KPIs and explaining variances AI integrated into BI software, such as AI analysis in DeltaMaster Numbers come from the BI model; the LLM explains them
Automatically commenting on reports AI in reporting Review comments before distribution
Adding explanations to planning AI in planning Approval remains with the human
Strict data sovereignty requirements On-premises open-weight model or controlled access via MCP server Plan for operational effort

What are common mistakes when using LLMs, and how can they be avoided?

The most common mistakes occur when companies assign an LLM tasks it was not designed for or when the underlying data is missing.

 

Mistake Consequence How to avoid it
The LLM calculates KPIs itself Incorrect totals and percentages Perform calculations in the BI system and have the LLM formulate the results
Accepting answers without verification Hallucinations make their way into management reports Build in human-in-the-loop processes and have sources displayed
Confidential data in public chatbots Data protection and compliance risks Use approved tools with a clear authorization concept
No clearly defined use case Pilot projects without measurable benefits Start with a specific use case, such as financial analysis
Inconsistent data foundation Conflicting answers depending on the source Establish a single source of truth and data governance
Lack of transparency Users do not trust the results Provide explainable analytical paths based on the principles of explainable AI

How does Bissantz use large language models?

Bissantz uses LLMs in DeltaMaster and DeltaApp as a language layer above the BI data model.

The roles are clearly defined. DeltaMaster provides the KPIs from the verified data model and automatically identifies variances and anomalies. The LLM translates the results into executive summaries, answers follow-up questions via chat or voice control, and guides users to the underlying cause through drill-downs.

Through AI-powered data integration, the analysis also incorporates unstructured sources, such as sales meeting transcripts or production reports. Bissantz controls access through MCP servers. Companies determine themselves which systems are connected and which information is included in the AI analyses.

Business intelligence with AI capabilities

Our software utilizes integrated AI capabilities for data integration, analysis, planning, and reporting.

This turns your data into a clear basis for decision-making across the entire company. You can quickly identify what is most relevant and make business decisions more efficiently and securely.

Business Intelligence with AI

 

Practical example: contribution margin variance in sales controlling

A manufacturing company identifies the following in its monthly report: The contribution margin in the South region is 8% below plan. Previously, the controller would have set filters, reconfigured reports, and written a management summary manually.

With DeltaMaster, the sales manager asks directly: “Why is the contribution margin in the South region below plan?” The AI analysis performs a drill-down across product groups and customers. It identifies the cause: Two major customers received higher discounts, while sales volume is on plan.

The LLM adds context from the connected sales meeting transcripts. One of them documents a competitor’s offer that explains the discounts. The AI turns this information into an assessment and suggests measures, such as reviewing the discount structure. After review by the controller, the DeltaMaster Publisher sends the summary to the CFO.

The key is the division of labor: The numbers come from the BI data model, while the LLM explains them. This ensures that every statement can be traced back to a KPI.

FAQ: frequently asked questions

What is a large language model in simple terms?

A large language model is a computer program that has learned how language works by reading enormous amounts of text. Similar to autocomplete on a smartphone, an LLM predicts which word is most likely to come next, but with much more context. In Bissantz BI software, an LLM makes business figures accessible through questions and answers.

What is the difference between an LLM and generative AI?

Generative AI is the umbrella term for all AI systems that generate new content, including text, images, music, or code. A large language model is a form of generative AI specialized in language. Bissantz uses LLMs in DeltaMaster to translate analytical results into understandable text.

What is the difference between an LLM and NLP?

Natural language processing (NLP) refers to the broader field of research concerned with machine-based language processing. Large language models are currently the most powerful approach within NLP. Older NLP methods typically solve a single task, whereas an LLM can handle many language tasks at once. Bissantz uses NLP and LLMs for natural-language data queries.

How secure is company data when using LLMs?

The security of company data when using LLMs depends on where the model runs and how data access is controlled. Public chatbots without a company agreement pose particular risks. Bissantz controls access to the AI features in DeltaMaster through MCP servers, allowing companies to define which data the AI is permitted to access.

Do companies need data scientists to use LLMs in controlling?

Integrated solutions do not require data scientists to use LLM features in controlling. In DeltaMaster from Bissantz, controllers and business users can use the AI features directly in their reports. Getting started typically involves a workshop and a clearly defined use case.

Summary

A large language model is a language model that understands and generates text by calculating the most likely next word. In controlling, an LLM delivers value when it works on a verified data foundation and explains numbers rather than calculating them itself. Bissantz combines both in DeltaMaster: KPIs come from the BI model, while explanations and recommendations are generated by the LLM.

Free of charge for you

How AI takes over the work of interpretation—and helps companies move more quickly from analysis to action

Whitepaper Decision Intelligence

Nicolas Bissantz

Diagramme im Management

Besser entscheiden mit der richtigen Visualisierung von Daten

Erhältlich überall, wo es Bücher gibt, und im Haufe-Onlineshop.