The 14th Lisbon Machine Learning School
LxMLS 2024

11-17 July 2024

Place and registration

The summer school will be held at the Congress Center of Instituto Superior Técnico (IST).

 

The deadline for applications is April 26th, 2024.

Intended audience

Researchers and graduate students in the fields of NLP and computational linguistics, computer scientists interested in statistics and machine learning, and industry practitioners who desire a more in depth understanding of these subjects.

Organization

Days are divided into morning lectures and afternoon lab sessions and afternoon talks. A preliminary version of the guide for the labs can be found here. The lectures and afternoon talks are available at our Youtube Channel.

Requirements

No deep previous knowledge of ML or NLP is required, but the attendants are assumed to have some basic background on mathematics and programming. The first day is scheduled to review basic concepts and introduce the necessary tools for implementation exercises.

About the school

The Lisbon Machine Learning Summer School (LxMLS) takes place yearly at Instituto Superior Técnico (IST). LxMLS 2024 will be a 6-day event, scheduled to take place from July 11th to the 17th as an in-person event.

 

The school covers a range of machine learning topics, from theory to practice, that are important in solving natural language processing problems arising in different application areas. It is organized jointly by Instituto Superior Técnico (IST), a leading Engineering and Science school in Portugal, the Instituto de Telecomunicações, the Instituto de Engenharia de Sistemas e Computadores, Investigação e Desenvolvimento em Lisboa (INESC-ID), the Lisbon ELLIS Unit for Learning and Intelligent Systems (LUMLIS), Unbabel, Zendesk, and IBM Research.

 

Check online for information about past editions: LxMLS 2011, LxMLS 2012, LxMLS 2013, LxMLS 2014, LxMLS 2015, LxMLS 2016, LxMLS 2017, LxMLS 2018, LxMLS 2019, LxMLS 2020, LxMLS 2021, LxMLS 2022, LxMLS 2023 (you can also watch the videos of the lectures for 2016, 2017, 2018, 2020, 2021, 2022, and 2023).

Important dates

Application Deadline: April 26th

Notification of Admission: May 6th

Early registration: June 28th

Late registration: July 5th

Summer School: July 11th-17th

Frequently Asked Questions

WHEN DOES THE SCHOOL TAKE PLACE?

This year LxMLS will take place from July 11th to 17th.

WILL THE SCHOOL REALLY BE IN PERSON?

Yes. We are nonetheless planning to also broadcast the lectures on YouTube.

IS THERE A REGISTRATION FEE?

Upon acceptance, students will be asked to register for the summer school. A registration fee will support the full participation in the lectures and practical sessions, also covering lunches, coffee breaks, and the social event (banquet). The early and late (between parenthesis) fees are the following:
 
• 350 EUR - regular students (400 EUR);
• 400 EUR - university professors (500 EUR);
• 400 EUR - researchers at public institutes (500 EUR);
• 600 EUR - everyone else (700 EUR).

OOPS! I SUBMITTED MY APPLICATION TWICE. WILL THAT BE A PROBLEM?

It should be fine. If we find repeated entries we consider the most recent application.

ACCOMMODATION FOR STUDENTS

Our housing partner HouzeStudent has comfortable and affordable all-inclusive accommodation options available throughout the city of Lisbon with special prices for LxMLS students (from 26,50€/room/night). All apartments are fully equipped and furnished and are located in safe and central areas, close to public transportation. Each room includes two sets of bed linen and towels. More information will follow in the acceptance letter

IS IT EASY TO FIND ACCOMMODATION?

Some of the best reasonably-priced hostels in the World can be found in Lisbon, right in the middle of the historic and night life district. However, be sure to prepare your lodging in advance. You can check Booking.com, TripAdvisor or Airbnb.

I FORGOT/LOST MY FOOD TICKET AT THE SCHOOL! WHAT CAN I DO?

You’ll have to pay for your lunch. It may be the case that some monitor or organizer can give you spare tickets (meaning they will have to eat elsewhere), but we do not provide replacements for tickets in general. Try no to lose them!

I DON’T SPEAK PORTUGUESE, WILL THAT BE A PROBLEM?

It should not be a problem provided that you speak English. Many people in Lisbon speak fluent English, and Portugal is ranked as having a “High Proficiency” level on the English Proficiency Index. Furthermore, since Lisbon attracts a lot of tourists, you can also find fluent speakers in other languages, like Spanish, French or German.

CAN YOU PROVIDE AN INVITATION LETTER?

Yes, but invitation letters will be issued only to students after they have been accepted. Students that will need a visa are however advised to prepare the documents in advance to speed up the process. For the invitation letter, you will need to provide us your full name, the passport information (number, issue date and place, and expiration date), and the address to which you would like the invitation letter to be sent to.

DOES BEING REJECTED IN PREVIOUS YEARS INCREASE CHANCES OF ACCEPTANCE?

Yes. There is a specific field in the application form for this. Be sure to remind us that you did not get in last time. We check, so please don’t use this option if you did not apply before.

IS IT EASY TO GET ACCEPTED IN THE SCHOOL?

We get a lot of applications each year and the number has been increasing steadily. The number of students is usually slightly above 30% of the number of applications.

ARE THERE SCHOLARSHIPS AVAILABLE?

Yes. In partnership with our sponsoring companies, we provide a limited number of scholarships. We use these grants to fund students worldwide that show high potential but would normally not have the means to get to the school. There are various fields related to the scholarship application on the application form.

IF I GET A SCHOLARSHIP, HOW DOES IT WORK?

We will reimburse your registration, travel, and lodging expenses up to the quantity specified in the grant. Notice that you will still have to pay the school registration (but you may use grant money to pay for the registration). The amount of the scholarship has to do with a budget that you must specify in advance. You will have to send us copies of receipts, together with your full name, address, nationality, and passport number.

CAN ASKING FOR A SCHOLARSHIP REDUCE THE CHANCES OF ACCEPTANCE?

In principle, this should not be the case. However, during the selection process, there is always a number of doubtful cases. If you asked for a grant and you were not selected for it, with no further information, we may assume that you would not come to the school if being accepted, and this may affect your chances. Be sure to only apply to a scholarship if your institution cannot cover your expenses.

WHERE DOES THE SCHOOL TAKE PLACE?

The summer school takes place in Instituto Superior Técnico (IST), which is located in the heart of Lisbon. Registration and lectures take place at Centro de Congressos (floor -1). The morning coffee breaks are at the same place, but in floor -2. The afternoon lab sessions take place in Pavilhão de Informatica, and lunch is served at the Canteen. The school banquet takes place at Casa do Alentejo.

WHAT ARE THE APPLICATION AND REGISTRATION PERIODS?

Since our resources impose limitations on the number of accepted people, we have adopted a two-step approach: First, everyone interested in the summer school must apply. Then, the organisation committee analyses all the applications and sorts them according to their motivation, CV, and other relevant information. Finally, the first top applicants will be selected for participation and will need to perform the REGISTRATION in order to participate.

CAN I GET ECTS CREDITS FOR THE SCHOOL?

All attendees will receive a certificate of attendance during the event, but there is no equivalence in terms of the ECTS grading system.

HOW DO I GET TO THE SCHOOL FROM THE AIRPORT?

You can use the subway connection from the airport to the subway close to the IST. Take the subway on the airport (red line) until either the Alameda or Saldanha stops.

IS FOOD AFFORDABLE?

Very affordable, even by south European standards. Be sure to use the opportunity to taste local dishes such as Francesinha, Alheira, and of course Codfish. The school provides lunch tickets for the University canteen in any case.

HOW IS THE WEATHER? DO I NEED A RAINCOAT OR SOMETHING?

In July the weather is usually very pleasant, with sunny days and warm temperatures (30ºC – 86ºF). There are several beaches a few minutes away from the center. The public transportation system is far-reaching and reliable, and has the Metro (subway) as its main backbone.

IS LISBON SAFE?

Yes, Portugal is a very safe place, ranking sixth on the Global Peace Index in 2022, and Lisbon is no exception to this. Having said that, since the city is a touristic attraction, it also attracts pickpockets and non-violent theft. Take the usual precautions in touristic places.

ANYTHING ELSE I SHOULD KNOW ABOUT LISBON?

Lisbon is situated in the west coast of Portugal, where the Tagus river meets the Atlantic Ocean. It is the westernmost capital in mainland Europe. The light, the atmosphere, and the climate offer marvelous walks all over the city. Lisbon is also extremely lively, with a wealth of cultural events happening every day, and a vibrant nightlife. A huge selection of restaurants is available, featuring Portuguese and international cuisine. The following video provides some background on what to expect.
 

DO YOU THINK I CAN GET A VISA?

We are in no position to offer advice regarding visa issues. You’ll have to reach your embassy for this. Do this in advance as there are normally big delays regarding visa processing.

REIMBURSEMENT POLICY

• To be eligible for a registration reimbursement, participants must submit a written request to the LxMLS office at least 7 days before the start of the program.
• The only reasons for requesting a registration reimbursement are rejected VISA or documented medical emergencies. Participants must provide evidence of their VISA refusal or medical condition along with their request.
• The amount of reimbursement is 100% of the paid fee, regardless of the date of the request, as long as it is within the 7-day deadline.
• Participants who withdraw or cancel their enrollment after the 7-day deadline or for reasons other than VISA refusal or medical emergency will not receive any reimbursement.

I HAVE OTHER QUESTIONS!

You can contact us at lxmls-2024@googlegroups.com.

Summer School Schedule

[Updated: July, 17th]

Registration at Centro de Congressos

08:00 - 08:45

Presentation and Welcome

André Martins

08:45 - 09:00 [ slides , video ]

Learning with Linear Models (Part 1)

Mário Figueiredo

09:00 - 10:30 [ slides , video ]

Coffee Break and Networking Activity, 10:30 - 11:00

Learning with Linear Models (Part 2)

Mário Figueiredo

11:00 - 12:30 [ slides , video ]

Lunch Break, 12:30 - 14:00

Labs: Introduction to the Labs and Machine Learning Fundamentals

14:00 - 17:00 [ location , guide ]

Welcome Reception, 17:00 - ∞

Introduction to Neural Networks (Part 1)

Bhiksha Raj

09:00h - 10:30h [ slides , video ]

Coffee Break and Networking Activity, 10:30h - 11:00h

Introduction to Neural Networks (Part 2)

Bhiksha Raj

11:00h - 12:30h [ slides , video ]

Lunch Break, 12:30h - 14:00h

Labs: Introduction to Deep Learning and Pytorch

14:00h - 16:30h [ location , guide ]

Coffee Break and Networking Activity, 16:30h - 17:00h

Gemini: A Guided Tour Through Practical Examples

Slav Petrov

17:00h - 18:00h

Introduction to Sequence Models (Part 1)

Noah Smith

09:00h - 10:30h [ slides , video ]

Coffee Break and Networking Activity, 10:30h - 11:00h

Introduction to Sequence Models (Part 2)

Noah Smith

11:00h - 12:30h [ slides , video ]

Lunch Break, 12:30h - 14:00h

Labs: Sequence Models

14:00h - 16:30h [ location , guide ]

Coffee Break and Networking Activity, 16:30h - 17:00h

Musings on Direct Preference Optimization

Kyunghyun Cho

17:00h - 18:00h [ slides , video ]

Banquet Dinner at Casa do Alentejo, 20:00h - ∞h [ location , photos ]

Transformers and Large Pretrained Models (Part 1)

Danqi Chen

09:00h - 10:30h [ slides , video ]

Coffee Break and Networking Activity, 10:30h - 11:00h

Transformers and Large Pretrained Models (Part 2)

Danqi Chen

11:00h - 12:30h [ slides , video ]

Lunch Break, 12:30h - 14:00h

Labs: Transformers

14:00h - 16:30h [ location , guide ]

Coffee Break and Networking Activity, 16:30h - 17:00h

What do we Gain with Scale? Why we are Building a Ladder to the Moon?

Sara Hooker

17:00h - 18:00h [ slides , video ]

Vision and Language (Part 1)

Desmond Elliott

09:00h - 10:30h [ slides , video ]

Coffee Break and Networking Activity, 10:30h - 11:00h

Vision and Language (Part 2)

Desmond Elliott

11:00h - 12:30h [ slides , video ]

Lunch Break, 12:30h - 14:00h

Labs: Completion of Lab Exercises from Previous Days

14:00h - 16:30h [ location , guide ]

Coffee Break and Networking Activity, 16:30h - 17:00h

Multimodal Generative Models, Unification, Planning and Evaluation

Mohit Bansal

17:00h - 18:00h [ slides , video ]

Causality (Part 1)

Adèle Ribeiro

09:00h - 10:30h [ slides , video ]

Coffee Break and Networking Activity, 10:30h - 11:00h

Causality (Part 2)

Adèle Ribeiro

11:00h - 12:30h [ slides , video ]

Lunch Break, 12:30h - 14:00h

What is the future of foundation models?

Panel Discussion

Moderator: André Martins

Panelists: Adèle Ribeiro, Albert Gu, Mohit Bansal, Sara Hooker

14:00h - 15:00h

Coffee Break and Networking Activity, 15:00h - 17:00h

Structured State Space Models for Deep Sequence Modeling

Albert Gu

17:00h - 18:00h [ slides , video ]

Closing Session

Ramón Astudillo

18:00h - 18:30h [ slides , video ]

Instructors and Speakers

Adèle H. Ribeiro

Philipps-Universität Marburg

Albert Gu

Carnegie Mellon University

André Martins

University of Lisbon

Bhiksha Raj

Carnegie Mellon University
Mohammed bin Zayed University of AI

Danqi Chen

Princeton University

Desmond Elliott

University of Copenhagen

Kyunghyun Cho

New York University

Mário Figueiredo

University of Lisbon

Mohit Bansal

UNC Chapel Hill

Noah Smith

University of Washington

Sara Hooker

Cohere For AI

Slav Petrov

Google

    Organizers

    Mário Figueiredo

    University of Lisbon

    João Graça

    Unbabel

    Fernando Batista

    ISCTE-IUL & INESC-ID

    Mariana Almeida

    Zendesk

    Zita Marinho

    DeepMind

    André Martins

    University of Lisbon

    Ramón Astudillo

    IBM Research

    Bruno Martins

    University of Lisbon

    Pedro Balage

    PandaDoc

      Ana Ayash

      Instituto de Telecomunicações

        Steering Committee

        Mário Figueiredo

        University of Lisbon

        João Graça

        Unbabel

        Isabel Trancoso

        University of Lisbon

        André Martins

        University of Lisbon

        Luís Sarmento

        Inductiva Research Labs

        Other Staff

        Tereza Traquinas

        Secretary Support

        Sarah Almeida

        Visual Design

        Student Poster Sessions

        Posters Sessions take place at the morning coffee breaks (10:30). Schedule is shown below



        Friday, 12 July

        Adel Chehade - University of Genoa, Italy
        Alessio - La Sapienza University of Rome, Italy
        Diogo Araújo - Instituto Superior Técnico da Universidade de Lisboa, Portugal
        Tornike Tsereteli - University of Mannheim, Germany
        Nichal Narotamo - Zendesk, Portugal
        Can Yaras - University of Michigan, United States

        Saturday, 13 July

        Atsuki Yamaguchi - University of Sheffield, United Kingdom
        Luca Dini - University of Pisa - Computer Science, Italy
        Lucas Emanuel Resck Domingues - Fundação Getulio Vargas, Brazil
        Yiyi Chen - Aalborg University, Denmark

        Monday, 15 July

        Anna Lange - Humboldt Universität zu Berlin, Germany
        Joachim Baumann - University of Zurich, Switzerland
        Melody Sepahpour-Fard - University of Limerick, Ireland
        Natalia Evgrafova - Ghent University, Belgium
        Neha Sharma - University of Tartu, Estonia, Estonia

        Tuesday, 16 July

        Rositsa Ivanova - University of St. Gallen, Switzerland
        Yagmur Ozturk - Grenoble Alpes University, France
        Nakhlé - Université Grenoble Alpes;Lingua Custodia, France
        Quanqi Du - Ghent University, Belgium
        Anastasiia Vozniuk - Moscow Institute of Physics and Technology, Russian Federation

        Gold Sponsor

        Silver Sponsor

        Supporters