Open-sourcing 4 solutions from the Enterprise RAG Challenge

We’ve written earlier about the first round of our Enterprise RAG Challenge. In this friendly challenge different AI Assistants competed in answering questions based on the annual reports of public companies. Teams from the different countries competed in building such assistants. There were even a few commercial solutions in the mix.

We are open sourcing code of four solutions from this leaderboard, including the winning one.

You can find code for the solutions marked with “TTA” (TimeToAct) on Github. Solutions include description of the approach, code itself, sometimes even the log of failed experiments.

Code is real, without any cleanups and beautification.

In short:

  1. Daniel - winning and surprisingly simple solution that used checklist pattern with structured outputs. First place.
    → Check out Daniel's solution
     

  2. Felix - multi-agent solution with ChatGPT-4o. 12th place.
    → Check out Felix' solution
     

  3. Maria - solution using OpenAI Assistants API. 13th place.
    → Check out Maria's solution
     

  4. Pedro - locally-capable solution using openchat-3.5-0106. ninth place.
    → Check out Pedro's solution  
     

What's next?

Next round of Enterprise RAG Challenge will take place later this fall, with a bigger audience. The exact time depends on the organisation process within the TIMEOTACT GROUP. Perhaps, around November.

In the next round, question generator will be rebalanced, so that:

  1. There are less questions that don't have an answer (agents must respond N/A to these)

  2. There is more variability in the questions, so that “brute force” approach with checklists+structured outputs will not be able to win the competition so easily.

Questionnaires for the participants will also be reworked, so that we all together could learn more about approaches for Enterprise AI that work well in practice.

Blog 3/11/25

Answering Business Questions with LLMs

8th place in Enterprise RAG Challenge 2025: Answering Business Questions with LLMs

Blog

How I Won the Enterprise RAG Challenge

In this article, Ilia Ris describes the approach that helped him achieve first place in both prize categories and the overall SotA leaderboard.

Blog

Team-Leaderboard of the Enterprise RAG Challenge

The team-leaderboard includes all submitted entries – including those submitted after the Ground Truth was released. Therefore, we consider this ranking an unofficial overview.

Blog 1/21/25

AI Contest - Enterprise RAG Challenge

TIMETOACT GROUP Austria demonstrates how RAG technologies can revolutionize processes with the Enterprise RAG Challenge.

Insights

These are the proud winners of the Enterprise RAG Challenge

Discover the winners of the Enterprise RAG Challenge! Explore top RAG solutions, watch the official announcement, and see how AI-driven retrieval and LLMs shaped the best-performing models.

Blog 2/21/22

The Power of Event Sourcing

This is how we used Event Sourcing to maintain flexibility, handle changes, and ensure efficient error resolution in application development.

Blog 5/25/21

From the idea to the product: The genesis of Skwill

We strongly believe in the benefits of continuous learning at work; this has led us to developing products that we also enjoy using ourselves. Meet Skwill.

Referenz

smartOPTIMO migrates its Atlassian solutions to the cloud

smartOPTIMO advises on energy solutions and uses Jira for tickets and Confluence for collaboration. The cloud migration increases efficiency and ensures communication.

Blog

Your secure solution for the digital working world

Google Workspace: The secure alternative in today's threat landscape!

Blog 11/27/23

Part 4: Save Time and Analyze the Database File

ChatGPT-4 enables you to analyze database contents with just two simple steps (copy and paste), facilitating well-informed decision-making.

On-Premises in die Atlassian Cloud bei Oetiker nahtlos integriert
Referenz

Seamless migration from on-premises to the Atlassian cloud

Oetiker, a leading supplier of connecting solutions for the automotive industry, migrated to the cloud with catworkx Jira and Confluence in 2021.

Kollaboration mit dem modernen Helpdesk
Produkt 4/5/23

Backup and recovery solutions for the cloud - HYCU in focus

Experience the ultimate cloud experience with the strong partnership of CLOUDPILOTS and HYCU. Our pioneering solutions are designed to meet all your cloud needs.

Process Integration & Automation
Service

Process Integration & Automation

Digitizing and improving business processes and reacting to changes in an agile way – these are the challenges that more and more companies need to face.

Security, Identity & Access Management
Service

Security, Identity & Access Management

Time and again we hear about hacker attacks on companies that target sensitive company data. Therefore, security and access control of data must never be neglected.

Managed Services & Managed Support
Service

Managed Services & Managed Support

Our Managed Service Team of specialists will relieve your IT department. We ensure that you can work more efficiently, reliably and quickly

Digital Workplace & Employee Experience
Service

Digital Workplace & Employee Experience

The Digital Workplace gained in importance, especially in recent months, becoming indispensable for many companies. The Microsoft Office 365 platform provides an ideal basis for this development.

Unternehmen

ARS Computer und Consulting GmbH

ARS is one of the leading companies in Software Engineering. For them, Cognitive Solutions and Artificial Intelligence are the future.

News 5/7/21

Equistone acquires majority stake in TIMETOACT GROUP

TIMETOACT GROUP's already successful buy-&-build strategy will be boosted with both know-how and capital

Unternehmen

novacapta

Based on Microsoft SharePoint, Office 365, Azure, BizTalk and PowerBI novaCapta realizes intranets, collaboration portals, business intelligence solutions, individual applications and more.

Google Logo
Technologie 6/29/20

Google

Google is more than Google Search and Google Ads! We advise you on Google Analytics, Google Cloud Platform, G Suite, Google Cloud IoT and more!

Bleiben Sie mit dem TIMETOACT GROUP Newsletter auf dem Laufenden!