1st Summer School on Cognitive Robotics

Dates: June 12-16, 2017

A course on creating capable cognitive robots, by combining mobility and decision layers

The goal of this unique summer school is to help catalyze the next generation of planning researchers in AI and robotics, to work together to develop robots that are capable at both the task and motion levels. Our school will help students become equally conversant in the methods of cognitive systems and robotics, and will help them to build bridges between robotics and AI methods. The intended audience for this summer school includes top graduate students, postdocs and junior researchers, from both the cognitive AI and Robotics disciplines.

The summer school will center around a common robotic execution architecture that unifies the many methods presented, together with daily robotics labs and a grand challenge for the week. Advanced tutorials will be offered on those major elements of planning and perception that are required to develop capable autonomous systems, and will center around the daily themes of robust execution, motion planning, activity planning, perception and manipulation, and planning under uncertainty and risk. Tutorials alone, however are not enough to have lasting impact. Hence we complement them by a novel robotic architecture and suite of labs.

A feature of our summer school is that we offer students a comprehensive autonomy architecture, to use and take home. This architecture includes a decision layer architecture, which the cognitive AI community uses to combine decision-making components into a planning and execution system, coupled to a mobility layer architecture, which the robotics community uses to combine its manipulation and perception components. The architecture that we provide in this summer school uses Enterprise for the decision layer, and the Robotics Operating System - ROS for the mobility layer. The idea behind offering a decision layer architecture is to tie the cognitive systems community together, much in the way ROS and similar architectures have done for robotics, and to bring these two communities together, through the hybrid Enterprise/ROS architecture.

Leveraging this architecture, the summer school includes daily labs, centered around the daily themes and tutorials, and a grand challenge that helps the students apply the combined methods that they learn during the summer school. Students and researchers will then be able to take the hybrid architecture and a corresponding integrated tool set home, as a catalyst for future research, studies and collaboration.

Important Dates

May 17, 2017 (still open) Deadline for early application and grant requests
May 22, 2017 Start of notification of admission and grant allocations
May 30, 2017 Registration deadline
June 12-16, 2017 Summer school

Schedule Overview

Tentative summer school schedule. Speakers and links to material will be available here too.

Day 1 - June 12
Theme: Robust Execution: Estimation, Monitoring and Scheduling

8:30am - 10:00am Tutorial 1: Kick-off Talk - Architectures for Autonomy
10:00am - 10:30am Break1
10:30am - 12:00pm Tutorial 2: Monitoring and Diagnosis
Speaker: Brian Williams, Massachusetts Institute of Technology
12:00pm - 1:00pm Lunch
1:00pm - 2:30pm Tutorial 3: Dynamic Scheduling (TN/TNU)
Speaker: Luke Hunsberger, Vassar College
2:30pm - 3:00pm Break2
3:00pm - 6:00pm Supervised Lab
6:00pm - 7:00pm Open lab hours

Day 2 - June 13
Theme: Motion Planning

8:30am - 10:00am Tutorial 4: Sampling-based path planning
Speakers: Mark Moll and Lydia Kavraki, Rice University
10:00am - 10:30am Break1
10:30am - 12:00pm Tutorial 5: Incremental path planning
Speaker: Sven Koenig, University of Southern California
12:00pm - 1:00pm Lunch
1:00pm - 2:30pm Tutorial 6: Trajectory optimization for under-actuated robots
Speaker: Scott Kuindersma, Harvard University
2:30pm - 3:00pm Break2
3:00pm - 6:00pm Supervised Lab
6:00pm - 7:00pm Open lab hours

Day 3 - June 14
Theme: Activity Planning (AI)

8:30am - 10:00am Tutorial 7: Classical Planning@Robotics: Methods and Challenges
Speaker: Joerg Hoffmann, Saarland University
10:00am - 10:30am Break1
10:30am - 12:00pm Tutorial 8: Planning in Hybrid Domains
Speaker: Andrew Coles, King's College London
12:00pm - 1:00pm Lunch
1:00pm - 2:30pm Tutorial 9: Planning Concurrent Timelines
Speaker: David Wang, NuVu
2:30pm - 3:00pm Break2
3:00pm - 6:00pm Supervised Lab
6:00pm - 7:00pm Open lab hours

Day 4 - June 15
Theme: Perception and Manipulation

8:30am - 10:00am Tutorial 10: Multi-vehicle routing with time windows
Speaker: Phil Kilby, CSIRO Data61 / Australian National University
10:00am - 10:30am Break1
10:30am - 12:00pm Tutorial 11: Object recognition
12:00pm - 1:00pm Lunch
1:00pm - 2:30pm Tutorial 12: Grasp planning
Speaker: Alberto Rodriguez, Massachusetts Institute of Technology
2:30pm - 3:00pm Break2
3:00pm - 6:00pm Supervised Lab
6:00pm - 7:00pm Open lab hours

Day 5 - June 16
Theme: Planning with Uncertainty and Risk

8:30am - 10:00am Tutorial 13: Conditional (Probabilistic) Planning
Speaker: Shlomo Zilberstein, University of Massachusetts Amherst
10:00am - 10:30am Break1
10:30am - 12:00pm Tutorial 14: Localization and Mapping
Speaker: Nicholas Roy, Massachusetts Institute of Techonology
12:00pm - 1:00pm Lunch
1:00pm - 2:30pm Tutorial 15: Risk-bounded Planning and Scheduling
Speaker: Brian Williams, Massachusetts Institute of Techonology
2:30pm - 3:00pm Break2
3:00pm - 6:00pm Supervised Lab
6:00pm - 7:00pm Open lab hours


The Massachusetts Institute of Technology (MIT) Stata Center
Cambridge, MA

MIT is traditionally known for its advanced research and education in the physical sciences and engineering, biology, economics, linguistics, and management. It is often cited as among the world's top universities in the world. The Stata Center building in particular, where the school will be offered, is home to the Computer Science and Artificial Intelligence Laboratory (CSAIL), the Laboratory for Information and Decision Systems (LIDS), and the Department of Linguistics and Philosophy. Its striking design (featuring tilting towers, many-angled walls, glass ceilings and whimsical shapes) and its open-concept common areas provides a unique and exciting environment for students to collaborate and to be creative.

MIT stretches along the banks of the scenic Charles River, separating Cambridge from Boston. Cambridge and Boston are both vibrant areas, and include restaurants, theaters, museums, and shopping plazas, easily connected through a world-class public transportation system. Within a short distance are numerous other schools, including in or near Boston: Harvard, Boston College, Tufts, as well as the University of Connecticut (Storrs), Yale University (New Haven), and several campuses of the University of Massachusetts. There are also numerous high-tech firms in the area, most notably but not exclusively in the Boston area.


Boston has its own international airport, the Logan International Airport (BOS), which is located at a convenient two miles from the city center, with several public airport transportation options from and to downtown, suburban locations, and Cambridge area. There are approximately 40 airlines that serve Boston. Boston is also conveniently accessible by train and car from other popular international airports, such as John F. Kennedy International Airport (JFK) and LaGuardia Airport (LGA).

From the Logan International airport, MIT is conveniently accessible by a free subway ride, as well as by taxi or car. Taxi fare from the airport is about $35 – $40 and a ride will take between 15 minutes (during non-rush hour) to 30 minutes (during rush hour). The subway fare from any two points in the network is $2.25 (Charlie Card) or $2.75 (cash) and a ride from Logan to MIT will take, under normal conditions, about one-half hour.


Summer school students, including graduate students, postdoctoral researchers, junior researchers, will have the affordable option of staying at a well-located hostel in downtown Boston, the Hostelling International Boston.

As an alternative option for students, the Cambridge and Boston area has numerous hotel and Airbnb options at a range of prices. There are many hotels within 5 – 10 minutes walking distance ( ≤ 1 km) from the MIT Stata Center, such as Boston Marriott Cambridge, The Kendall Hotel, Le Meridien, and the Windsor Inn.


In a nutshell, the registration process for candidate attendees starts by filling out an online form and uploading a couple documents. The organizing committee will then evaluate the applications and select nominally 50 participants based on relevance. Those selected will receive a notification of acceptance starting May 22, including directions for finalizing the registration and for paying the registration fee. We will continue to accept applications until the participation is full. More details below.

How to Apply:

To apply to the summer school, fill out the online application form (see link below). Please include the following:

If you are requesting financial support for transportation to the venue, additional documentation is required in the online form. See the financial support section below.

To submit your application, please go to the Online Application Form, fill out the form and attach the required documents.

The registration will be restricted to roughly 50 participants, selected based on relevance.
Note: Preference will be given to graduate students, postdocs or junior scientists.

Registration Fee:

The registration fee is USD 150. It covers:

Payment information will be provided to selected participants in the notification email.

Financial Support for Transportation

We will provide financial support for transportation to/from the venue only for selected participants from US institutions. Acceptable means of transportation are airplanes, buses, and driving your own car. A limited number of grants for students will be available.

Request for such financial support should be indicated on the online application form. Grant applicants should provide:

Note: You are responsible for your own local transportation such as taxi, subway fees and parking.

Invited Speakers

Organizing Committee


Local organization:

The Summer School on Cognitive Robotics is being planned and run by
the Model-based Embedded and Robotic Systems (MERS) group at MIT.

Contact Us!

Send us questions and comments regarding the summer school at mers.cognitive.robotics at gmail dot com


National Science Foundation

MIT AeroAstro




Massachusetts Institute of Technology