As part of the project, we conducted 33 pilot lectures at 12 members of the University of Ljubljana, in which we tested the Online Notes system in real time for lecturer speech recognition and machine translation into English. The purpose of the pilot lectures was to obtain feedback on the system’s performance, which will contribute to further development, and at the same time collect professional vocabulary, which will further improve speech recognition.

We conducted the pilot lectures as follows:

• We received lecture recordings from lecturer and agreed on a date for one or more pilot lectures.
• On the agreed date, 10-15 minutes before the lecture, we set up the Online Notes system, including the microphone, which is an important part of the system, .
• The lecturer/professor delivered the lecture as usual. During the lesson, the students were able to view the transcript of the speech and the English translation on their own laptops (or mobile phones). The lecture was also attended by a representative of the ON team.
• After the presentation was over, the lecturer was given access to the ON portal, where she could view the transcription with the translation of the lecture and edit and correct them.
• The lecturer completed a short questionnaire about satisfaction with the use of the Online Notes system.

The IT department of each member of UL participated in the implementation of the pilot lectures in the following way:

• Before the lecture, the technical department met with a representative of the Online Notes team for an informational meeting regarding the infrastructure review, presentation of the system operation and the procedure for conducting the lectures, and agreement on the rental of the necessary equipment.
• If necessary, the technical service had to provide a laptop/computer to connect to the Online Notes system (with a network powerful enough to allow for uninterrupted online audio transmission).
• Before the lecture, the technical service connected and checked the audio connection to the laptop (depending on the available equipment, this could be connecting a wireless microphone to the laptop, connecting a sound source via a sound card to the laptop, or selecting an already connected sound source (if the source is already connected to the laptop). The technical service helped the lecturer, if they faced any complications.
• During the lectures, the Online Notes team was always available to troubleshoot any problems with the system and provide advice. The technical department worked with them to resolve any problems.
• After the lecture, the IT department disconnected and stored the equipment, which was then picked up by the Online Notes team.

We have successfully tested the system at several different faculties and with different lecturers, for which we sincerely thank everyone. We are no longer conducting pilot lectures at this stage of the project.

• February 21, 2023, semester testing, Faculty of Civil and Geodetic Engineering, University of Ljubljana – Dr. Goran Turk: Fundamentals of Statics and Dynamics
• March 8, 2023, Faculty of Law, University of Ljubljana – Dr. Katarina Zajc: Economics
• March 6, 2023, Faculty of Chemistry and Chemical Technology, University of Ljubljana – Dr. Marko Novinec: Interactions of biological molecules
• March 23, 2023, Biotechnical Faculty, University of Ljubljana – Dr. Petra Grošelj: Quantitative methods
• March 28, 2023, Biotechnical Faculty, University of Ljubljana – Dr. Ajda Kermauner Kavčič: Nutrition of ruminants and non-ruminants
• April 3, 2023, Faculty of Education, University of Ljubljana – Dr. Slavko Kocijančič: Electronics
• April 6, 2023, Faculty of Arts, University of Ljubljana – Dr. Jana Rošker: Chinese Philosophy
• April 19, 2023, quarterly testing, Biotechnical Faculty, University of Ljubljana – Dr. Maks Merela: Wood Structure I
• April 24, 2023, Faculty of Arts, University of Ljubljana – Dr. Blaž Repe: Physical Geography
• April 25, 2023, Biotechnical Faculty, University of Ljubljana – Dr. Miha Humar: Wood protection
• May 5, 2023, Faculty of Physics and Mathematics, University of Ljubljana – Dr. Urban Jezernik: Elementary Number Theory
• May 8, 2023, Faculty of Physics and Mathematics, University of Ljubljana – Dr. Tomaž Zwitter: Astronomical observations
• May 10, 2023, Faculty of Physics and Mathematics, University of Ljubljana – Dr. Katarina Kosovelj: Astronomical observations
• May 11, 2023, Faculty of Mechanical Engineering, University of Ljubljana – Dr. Gregor Skok: Aviation Meteorology
• May 12, 2023, Biotechnical Faculty, University of Ljubljana – Dr. Petra Golja: Human Anatomy
• October 6, 2023, Faculty of Veterinary Medicine, University of Ljubljana – Dr. Alenka Seliškar: Anesthesiology

• April 13, 2022, Faculty of Social Sciences, University of Ljubljana – Dr. Barbara Rajgelj: Fundamentals of Law
• March 29, 2022, Faculty of Social Work, University of Ljubljana – Dr. Lea Šugman Bohinc: A dialogical approach to co-creating support and assistance
• March 15, 2022, Faculty of Social Sciences, University of Ljubljana – Dr. Samo Kropivnik: Media and Communication Research
• October 4, 2022 – January 16, 2023, Faculty of Civil Engineering and Geodesy, University of Ljubljana – Dr. Goran Turk: Spatial Statistics
• October 5, 2022, Faculty of Social Work, University of Ljubljana – Dr. Darja Zaviršek: People with Disabilities: Theories and Methods
• October 13, 2022, Faculty of Computer Science and Informatics, University of Ljubljana – Dr. Robert Rozman: Computer Architecture
• October 26, 2022, Faculty of Veterinary Medicine, University of Ljubljana – Dr. Modest Vengušt: Basics of clinical diagnostics
• November 2, 2022, Faculty of Social Work, University of Ljubljana – Dr. Aleksandra Kanjuo Mrčela: Economic Sociology
• November 9, 2022, Biotechnical Faculty, University of Ljubljana – Dr. Iztok Prislan: Chemistry
• November 15, 2022, UL Faculty of Law, University of Ljubljana – Dr. Katarina Zajc: Economics
• November 25, 2022, Faculty of Electrical Engineering, University of Ljubljana – Dr. Matevž Pogačnik and Klemen Pečnik: Introduction to multimedia systems
• 30. november 2022, Fakulteta za računalništvo in informatiko UL – dr. Patricio Bulić: Organizacija računalniških sistemov

• December 3, 2021, Faculty of Electrical Engineering, University of Ljubljana – Dr. Anton Rafael Sinigoj: Fundamentals of Electrical Engineering
• November 30, 2021, Faculty of Social Sciences, University of Ljubljana – Dr. Katja Lozar Manfreda: Statistics
• November 25, 2021, Faculty of Arts, University of Ljubljana – Dr. Roman Kuhar: (Introduction to Gay and Lesbian Studies
• November 18, 2021, Faculty of Computer Science and Informatics, University of Ljubljana – Dr. Marko Bajec: Database Fundamentals
• 18. november 2021, Fakulteta za računalništvo in informatiko, University of Ljubljana- Dr. Robert Rozman: Računalniška arhitektura