Tsinghua University's Department of Computer Science and Technology recently hosted the 2024 Summer School for Large Language Models. The event, aimed at showcasing the latest achievements in AI with young scholars worldwide and foster academic exchange and collaboration, saw a participation of nearly 40 students from over ten countries. Over the course of two weeks, participants engaged in rigorous coursework, hands-on experiments, and cultural activities, gaining a comprehensive understanding of large language models and their applications.
Advanced Curriculum
The summer school offered a meticulously designed curriculum on Large Language Models (LLMs). The course content covered an overview of LLM development, foundational knowledge, key technologies in learning and training algorithms, multimodal models, data preparation, distributive and parallel processing, applications in biopharmaceuticals and legal systems, and the latest research findings. The teaching team comprised professors from Tsinghua’s Department of Computer Science and the Institute for Al Industry Research with extensive research experience and well-prepared courses.
To reinforce classroom knowledge, the summer school included multiple hands-on experiments. These practical sessions enabled students to understand the working principles of LLMs and address real-world problems. Zhipu AI sponsored the test environment, which featured state-of-the-art graphics processing units (GPUs) and graduate teaching assistants to facilitate a suitable learning setting for students.
Expanding Horizons with Company Visits
To deepen students' understanding of LLM development and China’s IT industry, the summer school organized visits to leading companies such as Zhipu AI, Xiaomi, and Huawei. At Zhipu AI, students learned about the company’s vision of making machines think like humans and explored the technical details and industry applications of its foundation model, ChatGLM. At Xiaomi, discussions with LLM project leaders revealed future innovations in smart devices and homes, and students marveled at the latest autonomous vehicles, experiencing the integration of technology and everyday life. The Huawei visit impressed students with the company’s advanced strategies, diverse product range, and elegant exhibition hall.
Rich Cultural Activities
Beyond academic learning, the summer school offered cultural experiences such as Chinese calligraphy, paper cutting, tea ceremonies, and tours of iconic sites like the Great Wall, Temple of Heaven, Tian’anmen Square, and the National Centre for the Performing Arts. These activities left a profound impression on the students, showcasing China’s rich cultural heritage and history.
The closing ceremony was marked by joyous and heartfelt reflections. Professor Li Guoliang, Deputy Director of the Department of Computer Science, awarded certificates and accolades to outstanding students. Participants shared their experiences.
“This was my first time in Asia, Beijing, and Tsinghua. I came to learn about LLM technology and to understand China, both of which were very successful. The cutting-edge courses and visits to companies like Xiaomi were surprising and informative,” shared Pereira from the University of Porto.
Conrad from RWTH Aachen University noted, “The summer school gave me a deeper understanding of China. The experience was fantastic. Although the courses were intense, I learned a lot and made friends, creating precious memories.”
Xiao from the University of Warwick commented, “These courses are truly cutting-edge, and the passion of the teachers in their lectures was inspiring. Listening to their research provided great insights.”
Editor: Li Han
