ConsultingProductsAIReferencesMediaCompanyDeutsch
Glossary

What is a large language model (LLM)?

A large language model (LLM) is an AI model trained on very large volumes of text that can understand, summarize, and generate language. In companies, LLMs can make information from reports and data available more quickly, for example. For accurate answers, an LLM needs a reliable data foundation. Bissantz connects LLMs with data from the BI system so that controllers can use natural-language questions to drill down from a variance to its underlying cause.

AT A GLANCE

At a glance

  • LLM stands for Large Language Model.
  • LLMs use learned patterns to calculate which word is most likely to come next.
  • Multimodal LLMs process not only text but also images, audio, or documents.
  • In business intelligence, LLMs explain numbers but do not calculate them reliably. KPIs should come from the BI system.
  • DeltaMaster and DeltaApp include LLM-based features for chat, voice control, root cause analysis, and executive summaries.

What question do you have about large language models (LLMs)?

Your input is sent to an AI service to answer it and is stored to improve the answers. Please do not enter any personal data. Privacy policy

DEFINITION

Large language models: definition and classification

LLM stands for Large Language Model and roughly translates into German as “large language model.” It describes a neural network that statistically models language and can therefore understand and generate text.

“Large” refers to two dimensions: the amount of training data and the number of parameters, which for current models is in the billions.

LLMs are a form of generative AI and are based on deep learning. They are the technology behind well-known AI assistants and many AI features in business software.

„Today we ask our questions about variances in natural language and are guided to the root cause via drill-down. The key figures still come from our audited data model; the LLM only explains them to us.“
Head of Sales Controlling
Industrial company
BACKGROUND

How do large language models work?

An LLM predicts step by step which piece of text is most likely to come next. This simple task gives rise to capabilities such as summarization, translation, and question answering when combined with enormous amounts of data.

Technically, almost all current LLMs are based on the transformer architecture. At their core is the attention mechanism: For each word, the model determines which other words in the text are important for its meaning.

StepWhat happensPractical significance
TokenizationText is split into tokens, such as words or parts of words.Costs and length limits are measured in tokens.
EmbeddingsEach token is translated into a numerical vector representing its meaning.Similar terms are located close to one another in vector space.
AttentionThe model identifies relationships between words across the entire context.References across long passages of text are preserved.
PretrainingThe model learns from large volumes of text by predicting the next token.It acquires language and general knowledge, but no knowledge of your company data.
Fine-tuningAdditional training using examples and human feedback.The model follows instructions and provides more helpful answers.
InferenceThe finished model generates answers to new inputs (prompts).The answer depends heavily on the prompt and the context provided.

Important for business use: An LLM does not store a fact database; it stores probabilities. As a result, it can generate convincing but incorrect statements. These so-called hallucinations can only be mitigated through verified data sources and human oversight.

Trusted by market leaders and hidden champions

TYPES

What types of LLMs are there?

LLMs differ in terms of input type, size, and deployment. For companies, it is particularly relevant whether a model can process images and whether it can be operated in their own data center.

A multimodal large language model (MLLM), for example, processes multiple types of data, such as text, images, audio, or video. It can describe a chart, extract information from a scanned invoice, or answer a question about a screenshot, for example.

TypeFeatureTypical use
Text LLMProcesses and generates text only.Summaries, report commentary, chat
Multimodal LLMProcesses text, images, audio, or video.Extracting data from documents, describing charts, voice control
Reasoning modelBreaks tasks down into intermediate steps before answering.Complex analytical questions, multi-step tasks
Small language model (SLM)Fewer parameters, lower computational requirements.Clearly defined tasks, operation on own hardware
Proprietary modelUsed through the provider’s cloud service or API.Fast start without own infrastructure
Open-weight modelModel weights are freely available.On-premises operation, full control over data
EXAMPLES

What are some examples of large language models?

The best-known large language models include the GPT, Claude, Gemini, Llama, and Mistral model families. Providers release new versions at short intervals, so the table below lists only the model families.

Model familyProviderDeployment
GPTOpenAI (USA)Proprietary, via ChatGPT, API, and Microsoft Azure
ClaudeAnthropic (USA)Proprietary, via Claude apps, API, and cloud platforms
GeminiGoogle (USA)Proprietary, via Gemini apps, API, and Google Cloud
LlamaMeta (USA)Open weight, also available for on-premises deployment
MistralMistral AI (France)Proprietary and open models, European provider
Qwen, DeepSeekAlibaba, DeepSeek (China)Primarily open weight

For selecting an LLM for business use, the model name matters less than where the data is processed, which contracts apply, and how well the model fits into existing systems.

The people shown were generated with artificial intelligence and are fictitious.

The latest developments in BI and controlling

Articles, insights and expert perspectives on business intelligence, data analytics and artificial intelligence. Discover the latest trends, practical applications and strategies for making better data-driven decisions.

To the blog
Controllerin arbeitet mit Prognosedaten auf einem Tablet
BACKGROUND

What do companies need large language models for?

Many companies use LLMs to make knowledge from data and documents available more quickly. In controlling and business intelligence, LLMs primarily shorten the path from a number to an explanation.

Typical tasks in controlling include:

An LLM does not replace a data warehouse or BI software. It sits above them as a language layer and is only as good as the data quality underneath.

Use caseSuitable approachNote
Drafting text, generating ideasPublic AI assistantDo not enter confidential data
Questions about internal policies and documentsLLM with RAG using an in-house document repositoryRequire sources to be cited in the answers
Querying KPIs and explaining variancesAI integrated into BI software, such as AI analysis in DeltaMasterNumbers come from the BI model; the LLM explains them
Automatically commenting on reportsAI in reportingReview comments before distribution
Adding explanations to planningAI in planningApproval remains with the human
Strict data sovereignty requirementsOn-premises open-weight model or controlled access via MCP serverPlan for operational effort
LLMO

What does Large Language Model Optimization mean?

Large Language Model Optimization refers to two different things: the technical adaptation of a model to a task and, in marketing, the visibility of content in AI answers.

In the technical sense, optimization is first of all meant mathematically. During training, a loss function is minimized until the model delivers the best possible predictions. More relevant for users are the ways to adapt a finished model for their own use:

ApproachProcedureEffortSuitable for
Prompt engineeringMaking instructions and examples in the prompt more preciseLowQuickly improving recurring tasks
Retrieval-Augmented Generation (RAG)Relevant documents or data are supplied along with the queryMediumAnswers based on current company data
Tool connection (for example via MCP)The LLM retrieves data and functions via defined interfacesMediumAccess to BI systems with an authorization concept
Fine-tuningThe model is retrained with your own example dataHighTechnical terminology, fixed output formats
Quantization and distillationModels are reduced in size to lower computing effortHighOperation on your own hardware
APPROACHES

Which LLM solution fits which use case?

The right solution depends on which data the LLM is meant to process and how reliable the result has to be. For KPIs, the rule is: the higher the requirement for correctness, the more closely the LLM must be bound to a verified data model.

Use caseSuitable approachNote
Drafting texts, gathering ideasPublic AI assistantDo not enter confidential data
Questions about internal guidelines and documentsLLM with RAG on your own document baseRequire source references in the answers
Querying KPIs and explaining variancesAI integrated into BI software, such as AI analysis in DeltaMasterThe figures come from the BI model, the LLM explains
Commenting on reports automaticallyAI in reportingCheck comments before sending
Supplementing planning with explanationsAI in planningApproval remains with the human
Strict requirements on data sovereigntyOpen-weight model on-premises or controlled access via MCP serverFactor in operating effort
ERRORS

Which errors often occur when using LLMs and how do you avoid them?

The most common errors arise when companies give an LLM tasks it was not built for, or when the data basis is missing.

ErrorConsequenceHow you avoid the error
The LLM calculates KPIs itselfIncorrect totals and percentagesPerform calculations in the BI system, let the LLM only formulate
Adopting answers uncheckedHallucinations end up in management reportsPlan for a human-in-the-loop, have sources displayed
Confidential data in public chatbotsData protection and compliance risksUse approved tools with a clear authorization concept
No delimited use casePilot projects without measurable benefitStart with a concrete case, for example financial analysis
Inconsistent data basisContradictory answers depending on the sourceCreate a single source of truth and data governance
Lack of transparencyUsers do not trust the resultsExplainable analysis paths following the principle of explainable AI
PRACTICAL EXAMPLE

Practical example: contribution margin variance in sales controlling

An industrial company notices in the monthly report: the contribution margin of the South region is 8 percent below plan. Previously, the controller would have set filters, rearranged reports, and written a management summary by hand.

With DeltaMaster, the head of sales asks directly: “Why is the contribution margin in the South region below plan?” The AI analysis performs a drill-down across product groups and customers. This gives her the result: two major customers received higher discounts, sales volume is on plan.

The LLM supplements the figures with context from the connected sales call logs. There, a competitor offer is documented that explains the discounts. From this, the AI formulates an assessment and suggests measures, for example a review of the discount scale. After review by the controller, the DeltaMaster Publisher sends the summary to management.

The division of labor is decisive: the figures come from the BI data model, the LLM explains them. This way every statement remains traceable to a KPI.

EXAMPLES

Use cases: Where are large language models used?

LLMs make knowledge from data and documents available more quickly. In controlling and business intelligence, they primarily shorten the path from the figure to the explanation.

Sales controlling

Business users ask in natural language why a region is below plan. The LLM guides you through the drill-down to the root cause and adds context from connected sources.

Management reporting

From identified variances, the LLM formulates understandable executive summaries and comments. The metrics come from the verified BI data model.

Production

Production reports and logs are analyzed and linked with metrics. In this way, unstructured information flows into the analysis.

Customer service

Support tickets and call logs are made accessible and summarized. This adds qualitative insights to quantitative analyses.

Financial analysis

A well-defined use case such as financial analysis is suitable as a starting point. The LLM explains variances, while the calculation remains in the BI system.

Purchasing

Supplier contracts and order data are analyzed together. The LLM summarizes terms and links them to KPIs on price trends and delivery reliability.

Where would you like to use Large language model (LLM)?

Your input is sent to an AI service to answer it and is stored to improve the answers. Please do not enter any personal data. Privacy policy

How does Bissantz use large language models?

Bissantz uses LLMs in DeltaMaster and DeltaApp as a language layer above the BI data model.

The roles are clearly defined. DeltaMaster provides the KPIs from the verified data model and automatically identifies variances and anomalies. The LLM translates the results into executive summaries, answers follow-up questions via chat or voice control, and guides users to the underlying cause through drill-downs.

Through AI-powered data integration, the analysis also incorporates unstructured sources, such as sales meeting transcripts or production reports. Bissantz controls access through MCP servers. Companies determine themselves which systems are connected and which information is included in the AI analyses.

Business intelligence with AI capabilities Our software utilizes integrated AI capabilities for data integration, analysis, planning, and reporting. This turns your data into a clear basis for decision-making across the entire company. You can quickly identify what is most relevant and make business decisions more efficiently and securely. Business Intelligence with AI

FunctionBenefit
Executive summaries translates identified variances into understandable summaries
Chat and voice control answers follow-up questions about metrics in natural language
Root cause analysis via drill-down guides users from the variance to the root cause
AI-based data integration incorporates unstructured sources such as logs and reports
MCP server access controls which systems and information flow into the analysis
„The executive summaries from DeltaMaster save us from writing management comments manually. Every statement remains traceable to a key figure, and we review the results before sending them out.“
Head of Controlling
Food producer
FAQ

Frequently asked questions

What is a large language model in simple terms?

A large language model is a computer program that has learned how language works by reading enormous amounts of text. Similar to autocomplete on a smartphone, an LLM predicts which word is most likely to come next, but with much more context. In Bissantz BI software, an LLM makes business figures accessible through questions and answers.

What is the difference between an LLM and generative AI?

Generative AI is the umbrella term for all AI systems that generate new content, including text, images, music, or code. A large language model is a form of generative AI specialized in language. Bissantz uses LLMs in DeltaMaster to translate analytical results into understandable text.

What is the difference between an LLM and NLP?

Natural language processing (NLP) refers to the broader field of research concerned with machine-based language processing. Large language models are currently the most powerful approach within NLP. Older NLP methods typically solve a single task, whereas an LLM can handle many language tasks at once. Bissantz uses NLP and LLMs for natural-language data queries.

How secure is company data when using LLMs?

The security of company data when using LLMs depends on where the model runs and how data access is controlled. Public chatbots without a company agreement pose particular risks. Bissantz controls access to the AI features in DeltaMaster through MCP servers, allowing companies to define which data the AI is permitted to access.

Do companies need data scientists to use LLMs in controlling?

Integrated solutions do not require data scientists to use LLM features in controlling. In DeltaMaster from Bissantz, controllers and business users can use the AI features directly in their reports. Getting started typically involves a workshop and a clearly defined use case.

SUMMARY

Summary

A large language model is a language model that understands and generates text by calculating the most likely next word. In controlling, an LLM delivers value when it works on a verified data foundation and explains numbers rather than calculating them itself. Bissantz combines both in DeltaMaster: KPIs come from the BI model, while explanations and recommendations are generated by the LLM.

Questions about Large language model (LLM)?

Talk to us about how Bissantz can support you.

Get in touch