Theodor Hartmann in front of the Edinburgh skyline with the text "Beyond the WOW," highlighting his EuroSTAR keynote presentation.

EuroSTAR 2025: Beyond the Wow – Lessons of LLM-aided Test Case Generation

Objentis

We are excited that Objentis will be participating in EuroSTAR 2025!

Our colleague Theodor Hartmann will give a presentation titled “EuroSTAR 2025: Beyond the Wow – Insights from LLM-Assisted Test Case Generation,” in which he will share practical insights into the use of AI for test automation.

In his presentation, he will shed light on the realities of using Large Language Models (LLMs) to generate test cases—both their potential and their limitations. He will demonstrate how a tool that combines LLMs with a fundamental Retrieval-Augmented Generation (RAG) approach can generate test artifacts such as test cases and test data by linking general knowledge with customer-specific documentation, requirements, and user stories.

In addition to the technical aspects, the presentation will also address challenges that are often overlooked, such as redundancies in the generated content, inconsistencies in the results, and varying levels of effectiveness depending on the type of application. He will also discuss the conflicting experiences of testers—ranging from “writer’s block” to an overwhelming amount of AI-generated content that is, in some cases, nonsensical.

In an industry where many believe that automation can replace all aspects of testing, Theodor will present compelling arguments as to why human oversight remains essential. His presentation will highlight the importance of context-aware results, the limitations of large language models (LLMs), and why a cautious, balanced approach to using AI in testing is crucial.

You can find more information about his talk and a preview of the presentation on the EuroSTAR website.

21.02.2025