Testing LLM-Based Applications: Strategies, Risks & Automated Evaluations

Location address:
Sainsburys Store Support Centre,
Draken Drive,
Ansty Park,
Coventry
CV7 9RD
**Free parking is available at the venue.**
(follow signs for 'Visitor Car Park' which is front of the main building)

About our speakers: Bill Matthews
• Owner & Consultant - Target Testing Ltd
• Technical Lead - Voy Finance
• Strategic Business Consultant

About the talk:
As Large Language Models (LLMs) become integral to modern applications, software testers must adapt their strategies to assess these AI-driven systems effectively. This talk explores the unique challenges of testing LLM-based applications, including their probabilistic nature, hallucinations, bias, and prompt sensitivity.

We will discuss key capabilities and risks that testers should focus on, methodologies for designing robust evaluation frameworks, and automation techniques to streamline testing. Attendees will also learn how to leverage LLMs as judges for qualitative assessments and explore tools that support scalable, systematic testing. Whether you're new to AI testing or looking to enhance your approach, this session will equip you with practical insights to ensure the reliability and fairness of LLM-based applications.

About our sponsors: Xpertise Recruitment
The food and drink for the attendees will be kindly provided by our fabulous sponsor Richard Bailey from Xpertise Recruitment
https://www.xpertise-recruitment.com/
*****************************************************************************

Please arrive from 6:00pm so that we can get you signed in with our Security Front Desk, and then escorted to our new Auditorium, where you can get settled and chat with everyone before the talk.

After the talk there is the opportunity for all attendees to take part in 99 Second Talks, where they can use the time to trial a presentation they plan to give, ask for help to the community, share something they are passionate about, virtually anything they can think of.

Finally, there will be complimentary food/drinks (provided by our fabulous sponsor Xpertise Recruitment) and networking until roughly 8:30pm (but you don't have to stay that late if you don't want to).

18:00 - 18:30 Guest arrival and networking
18:30 - 18:35 Intro & Welcome
18:35 - 19:15 Talk: Testing LLM-Based Applications
19:15 - 19:30 Q&A followed by 99 second talks
19:30 - 19:35 Thank You's and meeting wrapup
19:35 - 20:45 Drinks, networking and nibbles

------------------------------------------------------------------
Hosted by: Sainsbury's Tech
https://www.linkedin.com/company/sainsburysdtd/jobs/