DE
/
EN

Discover the best large language models for digital products

The monthly TIMETOACT GROUP Language Model (LLM) Benchmarks help you choose the best AI models for digital product development.

Based on real benchmark data from our own software products, we re-evaluate each month the performance of different LLM models in addressing specific challenges. We examine specific categories such as document processing, CRM integration, external integration, marketing support, and code generation.

LLM Benchmarks | January 2025

    In the first issue of TIMETOACT GROUP LLM Benchmarks V2 we present our new benchmarks and talk about DeepSeek r1.

    Highlights:

    • Second Generation Benchmark - Early Preview
    • DeepSeek r1
    • Cost and price development of DeepSeek r1
    LLM Benchmarks | January 2025

    The benchmark categories in detail

    Here's exactly what we're looking at with the different categories of LLM Leaderboards

    How well can the model work with large documents and knowledge bases?

    How well does the model support work with product catalogs and marketplaces?

    Can the model easily interact with external APIs, services and plugins?

    How well can the model support marketing activities, e.g. brainstorming, idea generation and text generation?

    How well can the model reason and draw conclusions in a given context?

    Can the model generate code and help with programming?

    The estimated cost of running the workload. For cloud-based models, we calculate the cost according to the pricing. For on-premises models, we estimate the cost based on GPU requirements for each model, GPU rental cost, model speed, and operational overhead.

    The "Speed" column indicates the estimated speed of the model in requests per second (without batching). The higher the speed, the better.

    Archive

    Curious about how the scores have evolved? Here you can find all links to previously published leaderboards

    LLM Benchmarks | December 2024
    LLM Benchmarks | November 2024
    LLM Benchmarks | October 2024
    LLM Benchmarks | September 2024
    LLM Benchmarks | August 2024
    LLM Benchmarks | July 2024
    LLM Benchmarks | June 2024
    LLM Benchmarks | May 2024
    LLM Benchmarks | April 2024

    Discover our AI workshops for businesses


    Whether it's AI fundamentals, Prompt Engineering training, or potential analysis – we offer tailored solutions for every need.

    Explore our AI Workshops

    Transform your digital projects with the best AI language models!

    Discover the transformative power of the best Large Language Models and revolutionize your business with AI! Stay future-oriented, increase efficiency and secure a clear competitive advantage. We support you in taking your business value to the next level.

    * required

    We use the data you send us only for contacting you in connection with your request. You can find all further information in our privacy policy.

    Martin Warnung

    martin.warnung@timetoact.at

    Blog
    Blog

    ChatGPT & Co: LLM Benchmarks for January

    Find out which large language models outperformed in the January 2025 benchmarks. Stay informed on the latest AI developments and performance metrics.

    Blog
    Blog

    ChatGPT & Co: LLM Benchmarks for December

    Find out which large language models outperformed in the December 2024 benchmarks. Stay informed on the latest AI developments and performance metrics.

    Blog
    Blog

    ChatGPT & Co: LLM Benchmarks for November

    Find out which large language models outperformed in the November 2024 benchmarks. Stay informed on the latest AI developments and performance metrics.

    Blog
    Blog

    ChatGPT & Co: LLM Benchmarks for September

    Find out which large language models outperformed in the September 2024 benchmarks. Stay informed on the latest AI developments and performance metrics.

    Blog
    Blog

    ChatGPT & Co: LLM Benchmarks for October

    Find out which large language models outperformed in the October 2024 benchmarks. Stay informed on the latest AI developments and performance metrics.

    Martin WarnungMartin WarnungBlog
    Blog

    Common Mistakes in the Development of AI Assistants

    How fortunate that people make mistakes: because we can learn from them and improve. We have closely observed how companies around the world have implemented AI assistants in recent months and have, unfortunately, often seen them fail. We would like to share with you how these failures occurred and what can be learned from them for future projects: So that AI assistants can be implemented more successfully in the future!

    Jörg EgretzbergerJörg EgretzbergerBlog
    Blog

    8 tips for developing AI assistants

    AI assistants for businesses are hype, and many teams were already eagerly and enthusiastically working on their implementation. Unfortunately, however, we have seen that many teams we have observed in Europe and the US have failed at the task. Read about our 8 most valuable tips, so that you will succeed.

    Blog
    Blog

    AI Contest - Enterprise RAG Challenge

    TIMETOACT GROUP Austria demonstrates how RAG technologies can revolutionize processes with the Enterprise RAG Challenge.

    TIMETOACT GROUP
    Service
    Navigationsbild zu Data Science
    Service

    AI & Data Science

    The amount of data that companies produce and process every day is constantly growing. This data contains valuable information about customers, markets, business processes and much more. But how can companies use this data effectively to make better decisions, improve their products and services and tap into new business opportunities?

    Blog
    Blog

    Google Workspace: AI-supported work for every company

    The future of work with Google Workspace and Google AI

    Blog
    Blog

    Crisis management & building a sustainable future with AI

    Non-profit organizations develop AI models to tackle global challenges - and draw lessons for businesses worldwide

    Blog
    Blog

    Expanding Opportunities with Generative AI

    Discover how nonprofits use generative AI to boost career opportunities, enhance education, and bridge employment gaps for underserved communities.

    Blog
    Blog

    AI for social good

    Discover how leading companies are already profiting from Gen AI!

    Rinat AbdullinRinat AbdullinBlog
    Blog

    Let's build an Enterprise AI Assistant

    In the previous blog post we have talked about basic principles of building AI assistants. Let’s take them for a spin with a product case that we’ve worked on: using AI to support enterprise sales pipelines.

    Kompetenz
    Headerbild GenAI Consulting
    Kompetenz

    GenAI Consulting

    ChatGPT, Bard & Co. have shown at the latest: Generative AI has the potential to revolutionize the world of work. With GenAI Consulting, we support you in exploiting this potential for your company.

    Rinat AbdullinRinat AbdullinBlog
    Blog

    Strategic Impact of Large Language Models

    This blog discusses the rapid advancements in large language models, particularly highlighting the impact of OpenAI's GPT models.

    Rinat AbdullinRinat AbdullinBlog
    Blog

    Open-sourcing 4 solutions from the Enterprise RAG Challenge

    Our RAG competition is a friendly challenge different AI Assistants competed in answering questions based on the annual reports of public companies.

    TIMETOACT GROUP
    Branche
    Headerbild zur Logistik- und Transportbranche
    Branche

    AI & Digitization for the Transportation and Logistics Indus

    Digitalisierung und Transparenz der Prozesse sowie automatisierte Unterstützung bei der Optimierung können Logistikunternehmen helfen, den Spagat zwischen Kosten und Leistung besser zu bewältigen, um langfristig als wertvoller Partner der Wirtschaft zu agieren.

    Kompetenz
    Kompetenz

    Graph Technology

    We help you harness the power of graphs to transform your business. Our expertise spans from graph database modelling and graph data science to generative AI.

    Kompetenz
    Kompetenz

    AI - A technology is revolutionizing our everyday lives

    For ARS, AI is an increasingly natural and organic part of software engineering. This is particularly true in cases where it is an integral part of applications and functions.

    TIMETOACT
    Technologie
    Headerbild zu Cloud Pak for Data – Test-Drive
    Technologie

    IBM Cloud Pak for Data – Test-Drive

    By making our comprehensive demo and customer data platform available, we want to offer these customers a way to get a very quick and pragmatic impression of the technology with their data.

    TIMETOACT
    Martin LangeMartin LangeBlog
    Checkliste als Symbol für die verschiedenen To Dos im Bereich Lizenzmanagement
    Blog

    License Management – Everything you need to know

    License management is not only relevant in terms of compliance but can also minimize costs and risks. Read more in the article.

    TIMETOACT
    Referenz
    Referenz

    Standardized data management creates basis for reporting

    TIMETOACT implements a higher-level data model in a data warehouse for TRUMPF Photonic Components and provides the necessary data integration connection with Talend. With this standardized data management, TRUMPF will receive reports based on reliable data in the future and can also transfer the model to other departments.

    TIMETOACT
    Technologie
    Headerbild zu IBM Cloud Pak for Data Accelerator
    Technologie

    IBM Cloud Pak for Data Accelerator

    For a quick start in certain use cases, specifically for certain business areas or industries, IBM offers so-called accelerators based on the "Cloud Pak for Data" solution, which serve as a template for project development and can thus significantly accelerate the implementation of these use cases. The platform itself provides all the necessary functions for all types of analytics projects, and the accelerators provide the respective content.

    Branche
    Branche

    Artificial Intelligence in Treasury Management

    Optimize treasury processes with AI: automated reports, forecasts, and risk management.

    TIMETOACT GROUP
    Branche
    Branche

    Digital transformation in public administration

    The digital transformation will massively change the world of work, especially in public administration. We support federal, state and local authorities in the strategic and technical implementation of their administrative modernisation projects.

    TIMETOACT
    Technologie
    Headerbild zu IBM Watson Knowledge Studio
    Technologie

    IBM Watson Knowledge Studio

    In IBM Watson Knowledge Studio, you train an Artificial Intelligence (AI) on specialist terms of your company or specialist area ("domain knowledge"). In this way, you lay the foundation for automated text processing of extensive, subject-related documents.

    Service
    Mit Google Workspace den digitalen Arbeitsplatz ermöglichen Sales Freshsales
    Service

    Gemini

    Experience Gemini in Google Cloud and revamp the way you work. Discover innovative Generative AI functions for maximum efficiency.

    TIMETOACT
    Technologie
    Headerbild zu IBM Watson Discovery
    Technologie

    IBM Watson Discovery

    With Watson Discovery, company data is searched using modern AI to extract information. On the one hand, the AI uses already trained methods to understand texts; on the other hand, it is constantly developed through new training on the company data, its structure and content, thus constantly improving the search results.

    TIMETOACT
    Technologie
    Headerbild zu IBM Watson Assistant
    Technologie

    IBM Watson Assistant

    Watson Assistant identifies intention in requests that can be received via multiple channels. Watson Assistant is trained based on real-live requests and can understand the context and intent of the query based on the acting AI. Extensive search queries are routed to Watson Discovery and seamlessly embedded into the search result.

    Blog
    Blog

    Responsible AI: A Guide to Ethical AI Development

    Responsible AI is a key requirement in the development and use of AI technologies. You can find everything you need to know here!

    Workshop
    Workshop

    AI Workshops for Companies

    Whether it's the basics of AI, prompt engineering, or potential scouting: our diverse AI workshop offerings provide the right content for every need.

    Rinat AbdullinRinat AbdullinBlog
    Blog

    So You are Building an AI Assistant?

    So you are building an AI assistant for the business? This is a popular topic in the companies these days. Everybody seems to be doing that. While running AI Research in the last months, I have discovered that many companies in the USA and Europe are building some sort of AI assistant these days, mostly around enterprise workflow automation and knowledge bases. There are common patterns in how such projects work most of the time. So let me tell you a story...

    TIMETOACT GROUP
    Service
    Headerbild Data Insights
    Service

    Data Insights

    With Data Insights, we help you step by step with the appropriate architecture to use new technologies and develop a data-driven corporate culture: from the development of new data sources, to exploratory analysis to gain new insights, to predictive models.

    TIMETOACT GROUP
    Service
    Service

    Decision Automation

    Companies today are faced with the challenge of making increasingly complex decisions in a shorter time frame in order to remain competitive and act in a customer-oriented manner. At the same time, they have a wealth of data at their disposal that can potentially provide valuable insights, but is often difficult to analyze and use. Decision automation is an approach that aims to combine human intelligence with machine algorithms to support or automate better and faster decisions.

    TIMETOACT GROUP
    Leistung
    Headerbild zu Digitale Transformation bei Versicherern
    Leistung

    Mastering digital transformation in insurance

    Versicherer haben daher bereits die Chancen und Notwendigkeiten der Digitalisierung größtenteils erkannt. Trotzdem ist noch viel zu tun, denn Digitalisierung funktioniert nicht von einem Tag auf den anderen – besonders bei Versicherungen, bei denen es viele altmodische und langsame Prozesse gibt.

    TIMETOACT GROUP
    Branche
    Headerbild für lokale Entwicklerressourcen in Deutschland
    Branche

    On-site digitization partner for insurance companies

    As TIMETOACT GROUP, we are one of the leading digitization partners for IT solutions in Germany, Austria and Switzerland. As your partner, we are there for you at 17 locations and will find the right solution on the path to digitization - gladly together in a personal exchange on site.

    TIMETOACT GROUP
    Branche
    Schild als Symbol für innere und äußere Sicherheit
    Branche

    Internal and external security

    Defense forces and police must protect citizens and the state from ever new threats. Modern IT & software solutions support them in this task.

    TIMETOACT
    Referenz
    Referenz

    Interactive online portal identifies suitable employees

    TIMETOACT digitizes several test procedures for KI.TEST to determine professional intelligence and personality.

    TIMETOACT
    Referenz
    Referenz

    Managed service support for optimal license management

    To ensure software compliance, TIMETOACT supports FUNKE Mediengruppe with a SAM Managed Service for Microsoft, Adobe, Oracle and IBM.

    Blog
    Blog

    Google Threat Intelligence

    Threat intelligence at Google scale for you and your business!

    TIMETOACT
    Service
    Teaserbild zu Data Integration Service und Consulting
    Service

    Data Integration, ETL and Data Virtualization

    While the term "ETL" (Extract - Transform - Load / or ELT) usually described the classic batch-driven process, today the term "Data Integration" extends to all methods of integration: whether batch, real-time, inside or outside a database, or between any systems.

    Blog
    Blog

    The ROI of Gen AI

    Discover how leading companies are already profiting from Gen AI!

    TIMETOACT
    Service
    Headerbild zu Data Governance Consulting
    Service

    Data Governance

    Data Governance describes all processes that aim to ensure the traceability, quality and protection of data. The need for documentation and traceability increases exponentially as more and more data from different sources is used for decision-making and as a result of the technical possibilities of integration in Data Warehouses or Data Lakes.

    Workshop
    Workshop

    Gen AI Discovery Workshop

    Learn how to push your creative boundaries with Cloudpilots' innovative solution in the Discovery Workshop for Generative AI.

    Rinat AbdullinRinat AbdullinBlog
    Blog

    The Intersection of AI and Voice Manipulation

    The advent of Artificial Intelligence (AI) in text-to-speech (TTS) technologies has revolutionized the way we interact with written content. Natural Readers, standing at the forefront of this innovation, offers a comprehensive suite of features designed to cater to a broad spectrum of needs, from personal leisure to educational support and commercial use. As we delve into the capabilities of Natural Readers, it's crucial to explore both the advantages it brings to the table and the ethical considerations surrounding voice manipulation in TTS technologies.

    Aqeel AlazreeBlog
    Blog

    Database Analysis Report

    This report comprehensively analyzes the auto parts sales database. The primary focus is understanding sales trends, identifying high-performing products, Analyzing the most profitable products for the upcoming quarter, and evaluating inventory management efficiency.

    Aqeel AlazreeBlog
    Blog

    Part 4: Save Time and Analyze the Database File

    ChatGPT-4 enables you to analyze database contents with just two simple steps (copy and paste), facilitating well-informed decision-making.

    Aqeel AlazreeBlog
    Blog

    Part 3: How to Analyze a Database File with GPT-3.5

    In this blog, we'll explore the proper usage of data analysis with ChatGPT and how you can analyze and visualize data from a SQLite database to help you make the most of your data.

    Aqeel AlazreeBlog
    Blog

    Part 1: Data Analysis with ChatGPT

    In this new blog series we will give you an overview of how to analyze and visualize data, create code manually and how to make ChatGPT work effectively. Part 1 deals with the following: In the data-driven era, businesses and organizations are constantly seeking ways to extract meaningful insights from their data. One powerful tool that can facilitate this process is ChatGPT, a state-of-the-art natural language processing model developed by OpenAI. In Part 1 pf this blog, we'll explore the proper usage of data analysis with ChatGPT and how it can help you make the most of your data.

    Rinat AbdullinRinat AbdullinBlog
    Blog

    5 Inconvenient Questions when hiring an AI company

    This article discusses five questions you should ask when buying an AI. These questions are inconvenient for providers of AI products, but they are necessary to ensure that you are getting the best product for your needs. The article also discusses the importance of testing the AI system on your own data to see how it performs.

    Rinat AbdullinRinat AbdullinBlog
    Blog

    LLM Performance Series: Batching

    Beginning with the September Trustbit LLM Benchmarks, we are now giving particular focus to a range of enterprise workloads. These encompass the kinds of tasks associated with Large Language Models that are frequently encountered in the context of large-scale business digitalization.

    Felix KrauseBlog
    Blog

    License Plate Detection for Precise Car Distance Estimation

    When it comes to advanced driver-assistance systems or self-driving cars, one needs to find a way of estimating the distance to other vehicles on the road.

    Matus ZilinskyBlog
    Blog

    Creating a Social Media Posts Generator Website with ChatGPT

    Using the GPT-3-turbo and DALL-E models in Node.js to create a social post generator for a fictional product can be really helpful. The author uses ChatGPT to create an API that utilizes the openai library for Node.js., a Vue component with an input for the title and message of the post. This article provides step-by-step instructions for setting up the project and includes links to the code repository.

    Blog
    Blog

    SAM Wins First Prize at AIM Hackathon

    The winning team of the AIM Hackathon, nexus. Group AI, developed SAM, an AI-powered ESG reporting platform designed to help companies streamline their sustainability compliance.

    Blog
    Blog

    Second Place - AIM Hackathon 2024: Trustpilot for ESG

    The NightWalkers designed a scalable tool that assigns trustworthiness scores based on various types of greenwashing indicators, including unsupported claims and inaccurate data.

    Blog
    Blog

    Third Place - AIM Hackathon 2024: The Venturers

    ESG reports are often filled with vague statements, obscuring key facts investors need. This team created an AI prototype that analyzes these reports sentence-by-sentence, categorizing content to produce a "relevance map".

    Felix KrauseBlog
    Blog

    AIM Hackathon 2024: Sustainability Meets LLMs

    Focusing on impactful AI applications, participants addressed key issues like greenwashing detection, ESG report relevance mapping, and compliance with the European Green Deal.

    Nina DemuthBlog
    Blog

    From the idea to the product: The genesis of Skwill

    We strongly believe in the benefits of continuous learning at work; this has led us to developing products that we also enjoy using ourselves. Meet Skwill.

    TIMETOACT
    Service
    Navigationsbild zu Business Intelligence
    Service

    Business Intelligence

    Business Intelligence (BI) is a technology-driven process for analyzing data and presenting usable information. On this basis, sound decisions can be made.

    TIMETOACT
    Service
    Headerbild zu Dashboards und Reports
    Service

    Dashboards & Reports

    The discipline of Business Intelligence provides the necessary means for accessing data. In addition, various methods have developed that help to transport information to the end user through various technologies.

    TIMETOACT
    Referenz
    Referenz

    The digital customer file with IBM Content Manager

    The prefabricated house specialist SchwörerHaus KG has relied on IBM technology for many years to set up a digital customer file.

    TIMETOACT
    Technologie
    Headerbild zu IBM DataStage
    Technologie

    IBM InfoSphere Information Server

    IBM Information Server is a central platform for enterprise-wide information integration. With IBM Information Server, business information can be extracted, consolidated and merged from a wide variety of sources.

    TIMETOACT
    Service
    Headerbild zu Operationalisierung von Data Science (MLOps)
    Service

    Operationalization of Data Science (MLOps)

    Data and Artificial Intelligence (AI) can support almost any business process based on facts. Many companies are in the phase of professional assessment of the algorithms and technical testing of the respective technologies.

    Referenz
    Referenz

    Automated Planning of Transport Routes

    Efficient transport route planning through automation and seamless integration.

    TIMETOACT
    Referenz
    Referenz

    Flexibility in the data evaluation of a theme park

    With the support of TIMETOACT, an theme park in Germany has been using TM1 for many years in different areas of the company to carry out reporting, analysis and planning processes easily and flexibly.

    TIMETOACT GROUP
    Service
    Headerbild zur AI Factory for Insurance
    Service

    AI Factory for Insurance

    The AI Factory for Insurance is an innovative organisational model combined with a flexible, modular IT architecture. It is an innovation and implementation factory to systematically develop, train and deploy AI models in digital business processes.

    TIMETOACT
    Referenz
    Referenz

    Automation lays the foundation for smooth archive changeover

    For Rottendorf Pharma GmbH, the ECM experts of TIMETOACT GROUP have reattached all file attachments from the IBM archive to the corresponding e-mails in the mailing system. This was done automatically and with little manual effort using the specially developed Notes tool "ArchiveUsers".

    TIMETOACT GROUP
    Kompetenz
    Kompetenz

    Artificial Intelligence & Data Strategy

    Every company collects and manages vast amounts of data, e.g. from production processes or business transactions. However, only a fraction of this data is used effectively to support control and decision-making processes.

    TIMETOACT
    Service
    Headerbild zu Digitale Planung, Forecasting und Optimierung
    Service

    Demand Planning, Forecasting and Optimization

    After the data has been prepared and visualized via dashboards and reports, the task is now to use the data obtained accordingly. Digital planning, forecasting and optimization describes all the capabilities of an IT-supported solution in the company to support users in digital analysis and planning.

    TIMETOACT
    Service
    Navigationsbild zu Data Science
    Service

    Data Science, Artificial Intelligence and Machine Learning

    For some time, Data Science has been considered the supreme discipline in the recognition of valuable information in large amounts of data. It promises to extract hidden, valuable information from data of any structure.

    TIMETOACT GROUP
    Service
    Service

    Analytics, BI & Planning

    In today's business world, data has become a key competitive factor. Companies that are able to collect, analyze and use their data effectively can make better decisions, meet customer needs and identify new opportunities. To achieve this, you need powerful and flexible solutions for Analytics, Business Intelligence (BI) & Planning.

    TIMETOACT
    Technologie
    Headerbild zu Microsoft Azure
    Technologie

    Microsoft Azure

    Azure is the cloud offering from Microsoft. Numerous services are provided in Azure, not only for analytical requirements. Particularly worth mentioning from an analytical perspective are services for data storage (relational, NoSQL and in-memory / with Microsoft or OpenSource technology), Azure Data Factory for data integration, numerous services including AI and, of course, services for BI, such as Power BI or Analysis Services.

    Offering
    Offering

    Digital Maturity

    The Digital Maturity Assessment provides tailored strategies for your digital transformation.

    TIMETOACT GROUP
    Branche
    Branche

    Insurance

    Insurance companies live by making a promise to people - and that promise is security. Crucial to success is not only the mastery of new technologies and new forms of collaboration, but above all a change in corporate culture.

    TIMETOACT
    Technologie
    Headerbild zu IBM DB2
    Technologie

    IBM Db2

    The IBM Db2database has been established on the market for many years as the leading data warehouse database in addition to its classic use in operations.

    TIMETOACT
    Technologie
    Headerbild IBM Cloud Pak for Data
    Technologie

    IBM Cloud Pak for Data

    The Cloud Pak for Data acts as a central, modular platform for analytical use cases. It integrates functions for the physical and virtual integration of data into a central data pool - a data lake or a data warehouse, a comprehensive data catalogue and numerous possibilities for (AI) analysis up to the operational use of the same.

    TIMETOACT GROUP
    Service
    Articifial Intelligence & Data Science
    Service

    Artificial Intelligence & Data Science

    Data Science is all about extracting valuable information from structured and unstructured data. Together with Artificial Intelligence (AI) – the ability of a machine to imitate intelligent human behavior – you can make accurate decisions, based on high-quality information. Moreover, you can react quickly to recent developments.

    TIMETOACT
    Technologie
    Headerbild zu IBM Decision Optimization
    Technologie

    Decision Optimization

    Mathematical algorithms enable fast and efficient improvement of partially contradictory specifications. As an integral part of the IBM Data Science platform "Cloud Pak for Data" or "IBM Watson Studio", decision optimisation has been decisively expanded and embedded in the Data Science process.

    TIMETOACT
    Technologie
    Technologie

    Microsoft Azure Synapse Analytics

    With Synapse, Microsoft has provided a platform for all aspects of analytics in the Azure Cloud. Within the platform, Synapse includes services for data integration, data storage of any size and big data analytics. Together with existing architecture templates, a solution for every analytical use case is created in a short time.

    TIMETOACT GROUP
    Branche
    Headbilder zu innovativem Schadenmanagement für Versicherungen
    Branche

    Effective claims management for insurers

    Insurers have the challenge of helping people quickly and reliably in the event of a claim. At the same time, they have to keep the costs of claims and benefits management low so that insurance premiums remain affordable.