Back to Conference View
Login

Prilagajanje velikih jezikovnih modelov – praktičen pristop za poslovno in znanstveno rabo | Adapting and fine-tuning LLMs – a hands-on approach for business and science

Data controller
IJS Data Controller
dca@ijs.si
Privacy notice
→ Europe/Ljubljana
TBA (UL Fakulteta za računalništvo in informatiko)

TBA

UL Fakulteta za računalništvo in informatiko

Večna pot 113, 1000 Ljubljana
Matej Klemen (University of Ljubljana, Faculty of Computer and Information Science), Domen Vreš (UL FRI), Marko Robnik-Šikonja (UL FRI), Tjaša Arčon (UL FRI), Žagar Aleš (UL FRI), Živa Štebljaj (UL FRI)
Description

Izvajalec / Course provider: University of Ljubljana, Faculty of Computer and Information Science (UL FRI)

Predavatelji / Instructors: Marko Robnik-Šikonja, Matej Klemen, Aleš Žagar, Domen Vreš, Tjaša Arčon, Živa Štebljaj; (UL FRI)

Learning objectives: Get practical knowledge on how to use large language models (LLMs) via API calls, their fine-tuning for specific tasks, and efficient inference.

Course contents: To use large language models (LLMs) in a research or business setting, it is necessary to i) to access them on local computers or on GPU servers via API, ii) adapt them to specific needs by fine-tuning them.  The hands-on workshop will present theoretically and practically, step-by-step:

  1. How LLMs can be used via API on a local or remote server.
  2. How to fine-tune encoder-only models such as BERT.
  3. How to fine-tune generative models such as Llama, Gemma, and GaMS using compute-efficient techniques such as LoRA.
  4. How to implement efficient LLM inference.

 

The work will be based on practical datasets and problems from business and research environments. The use cases will cover popular tasks such as sentiment prediction, information retrieval, and question answering.

The independent work consists of an assignment using the dataset of your choice, preferably from your business or scientific domain (to be approved by the workshop team). The assignment shall fine-tune a suitable LLM on the prepared data, evaluate the results, and write a report, presenting the problem, methodology, evaluation, results, and conclusions.

Learning outcomes: Practical knowledge of LLM API use and fine-tuning. Practical problem-solving skills with LLMs. Ability to independently solve problems with LLMs.

Contact
Registration
General registration form for SLAIF
Register
    • 1
      (Predavanja) Prilagajanje velikih jezikovnih modelov – praktičen pristop za poslovno in znanstveno rabo | (Lectures) Adapting and fine-tuning LLMs – a hands-on approach for business and science
      Speakers: Matej Klemen (University of Ljubljana, Faculty of Computer and Information Science), Domen Vreš (UL FRI), Marko Robnik-Šikonja (UL FRI), Tjaša Arčon (UL FRI), Žagar Aleš (UL FRI), Živa Štebljaj (UL FRI)
    • 2
      (Praktično delo) Prilagajanje velikih jezikovnih modelov – praktičen pristop za poslovno in znanstveno rabo | (Practical work) Adapting and fine-tuning LLMs – a hands-on approach for business and science
      Speakers: Matej Klemen (University of Ljubljana, Faculty of Computer and Information Science), Domen Vreš (UL FRI), Marko Robnik-Šikonja (UL FRI), Tjaša Arčon (UL FRI), Žagar Aleš (UL FRI), Živa Štebljaj (UL FRI)