New AI Workshop at EuRuKo 2025

I started working on the workshop for EuRuKo 2025, "Don't Let Your AI Guess: Teach It to Test."

The goal of this workshop is to introduce techniques for prompting that reduce the hallucinations AI may experience when asked to write tests.

This is intended for individuals using AI to enhance their coding, allowing them to remain in control of which changes are applied. It's likely unsuitable for fully agentic coding (unsupervised) unless you plan to use these prompts as system instructions for your agent.

Let me start with my core belief: current LLMs are NOT ready to independently write tests that achieve the following goals:

1. Verify requirements
2. Ensure the software behaves predictably and consistently over time
3. Specify current behavior

They can generate unit tests that pass by examining the code, whether you or they wrote it. While this is useful, it seems like merely documenting the current code behavior. Without supervision, it's just creating more tests to confirm the code works as it is written. This resembles verifying requirements, but it is NOT! Verifying requirements involves writing tests based on expected behavior, not on the current business logic in the code. The surse of truth (called test oracle) for a test should be the product requirements, the users needs and the customer expectations and not the code.

If you care about correctness, consider using AI to generate tests, but maintain control:

• Select which tests the AI will write
• Review the test data
• Review the assertions

Otherwise, you might end up with tests that pass but don't effectively test what's important, leaving your users unprotected from potential bugs.

I plan to do a dry-run of this workshop before the conference and if you want to get invited at a discounted price join the GoodEnoughTesting newsletter.