Testing and Evaluation of Large Language Models & Gen AI Applications

This practical half-day workshop is designed to provide participants with a practical understanding of the process of testing and evaluating large language models and related generative AI applications for use in a business context. 

KEY INFORMATION

  • Face-to-Face Workshop
  • Half-Day
  • Workshop date: 10th of July, 12:30pm – 4:30pm
  • Price: $500 ex-GST

SESSION ONE:

⚡ Introduction to Large Language Models

Overview of LLMs and key characteristics of LLMs

⚡ Tesing Large Language Models

Testing in LLM development, types of tests and test case design

 ⚡ Evaluation Metrics and Techniques

Common metrics, qualitative evaluations and challenges

⚡ Practical Exercise and Group Discussion

SESSION TWO:

⚡ Advanced Testing Techniques

Uncovering biases & ensuring fairness, testing for robustness and senario-based testing

⚡ Optimising LLMs Through Iterative Testing

Iterative development, feedback loops and case studies

 ⚡ Best Practices and Future Directions

Emerging trends, ethical considerations and responsible AI

 ⚡ Interactive Session

Applying advanced testing techniques

⚡ Wrap Up

Whats included?

🔥Expert Workshops
Learn from leading industry experts in tech and business

🔥Interactive Sessions
Engage in interactive sessions that faciliate collaborative learning and discussion among participants

🔥Networking Opportunities
Connect with peers and industry who share a common interest in AI deployment and governance. Lunch will be provided at the beginning of the workshop

How to Register

⚙️ Apply Below

Secure your ticket today. Spaces are limited to 20 people for this workshop

Who is it for?

💡 This workshop is intended for technical practitioners  and any professionals looking to understand the process of testing and evaluating LLMs and related generative AI applications for use in a business context. 

Where is it delivered?

📍 The Precinct, Warrar Room, Lvl 2, 315 Brunswick St, Fortitude Valley QLD 4006

Participants have to join in-person to attend the program.

More questions?

📭 There are only 20 seats available for this cohort.

Reach out to our Community Manager at info@qldaihub.com if you have any questions.

This program is delivered by the Queensland AI Hub’s founding member, KJR

KJR is an Australian Software Quality Engineering Consultancy and a leading practitioner in Responsible AI implementation.

Founded on over 26 years of experience in quality assurance and verification, KJR has always understood the importance of managing IT risk and especially do so now with the steady maturation of various emerging technologies.

We recognise the potential of Artificial Intelligence and Machine Learning and see the specific challenges these technologies pose to traditional forms of quality assurance. We have harnessed our expertise to develop practical approaches to assuring compliant and successful deployments of AI solutions.

The QLD AI Hub brings business, government and research together through AI programs and events. Our aim is to accelerate AI adoption and capability development, improve productivity, and support job generation and economic growth.

The QLD AI Hub is building Australia’s AI industry to be innovative, sustainable, and globally competitive.