Office hours
Jivko Sinapov (Instructor)
Time: Wednesdays 1:00-3:00 pm or by
appointment
Office: Halligan 213
Email:
jsinapov--AT--cs--DOT--tufts--DOT--edu
Srijith Rajeev (Teaching Assistant)
Time: Mondays 1:00-3:00 pm and Wednesdays 12:00-2:00 pm
Office: Halligan 228 A-B
Email:
srijith2311 -- AT -- gmail -- DOT -- com
Final Projects [top]
Important Dates:
Preliminary Project Proposal ''Presentations'': October 10th and 12th
Project Proposal Writeup due: October 26th
Final Project Presentations: December 5th and 7th
Final Project Report: December 13th
Final Project Presentation Schedule: [PDF]
Projects:
- Title: A Visual Attention Model with Human Gaze Feedback
Team: Raina Galbiati, Doo-yun Her, and Cassie Collins
Proposal: [PDF] - Title: CARoL: Coordinated, Automated Robots of Levity
Team: Azmina Karukappadath, Sam Weiss, and Yuelin Liu
Proposal: [PDF] - Title: Pathify Real-Time Path Planning and Optimization
Team: Timi Dayo-Kayode, Michael Edegware, and Jong Seo Yoon
Proposal: [PDF] - Title: Learning Workcell Affordances
Team: Matt Ryan
Proposal: [PDF] - Title: Object Permanence in Human Development and Robotics - A Survey
Team: Meghan O'Brien, Tooba Ahsen, and Elizabeth Lanzilla
Proposal: [PDF] - Title: Sound Classification using Deep Convolutional Neural Networks
Team: Ari Brown and Julie Jiang
Proposal: [PDF] - Title: Extending Instruction-Based One-Shot Learning in a CRA by generalizing from a few examples
Team: Brad Oosterveld and Tyler Frasca
Proposal: [PDF] - Title: Using Reinforcement Learning to Beat the Best Putter in the PGA
Team: Julia Novakoff, Teddy Laurita, George Pesmazoglou
Proposal: [PDF] - Title: Using Prosidy to Facilitate Learning
Team: Avi Block, Eric Chen, and Matt Shenton
Proposal: [PDF] - Title: Roombot
Team: Christopher Hylwa, Sonal Chatter, Brett Gurman
Proposal: [PDF]
Class Diary (including links to slides and readings) [top]
- 11/28 Language Grounding
Slides: [PDF]
Assigned Readings: WEEK 12-13
Assigned Homework: Homework 3 (Due Monday Dec 11th by midnight)
- 11/21 - 11/23 Multisensory Object Perception (II and III)
- 11/16 Multisensory Object Perception (I)
Slides: [PDF] [PDF]
Assigned Readings: WEEK 10-11 - 11/14 Guest Lecture
- 11/9 Auditory Perception
Slides: [PDF] - 11/2 Vision II
Slides: [PDF]
Assigned Readings: WEEK 9 - 10/31 Vision I
Slides: [PDF]
- 10/26 Tool Use II
Slides: [PDF] - 10/24 Tool Use I
Slides: [PDF]
Assigned Readings: WEEK 8 - 10/19 Overview of Reinforcement Learning
Slides: [PDF]
- 10/17 Overview of Machine Learning
Slides: [PDF]
- 10/12 Preliminary Project Proposal Presentations II
- 10/10 Preliminary Project Proposal Presentations I
Slides: [PDF]
Assigned Readings: WEEK 6-7 - 10/5 Affordances II
Slides: [PDF] - 10/3 Affordances
Slides: [PDF] - 9/28 Self-Recognition
Slides: [PDF]
Assigned Homework: Homework 2 (Due Thursday Oct 12th by midnight)
- 9/26 Embodiment
Slides: [PDF]
Assigned Readings: WEEK 4 - 9/21 Behavior-Based Robotics (II)
Slides: [PDF]
- 9/19 Behavior-Based Robotics (I)
Slides: [PDF]
Assigned Readings: WEEK 3 - 9/14 Overview of Robotics (III)
Slides: [PDF]
- 9/12 Overview of Robotics (II)
Slides: [PDF]
Assigned Homework: Homework 1 (Due Thursday Sep 21st by midnight)
Assigned Readings: WEEK 2 - 9/7 Syllabus and Overview of Robotics (I)
Slides: [PDF]
Announcment about Northeast Robotics Colloquium: [PDF] - 9/5 Class Introduction: What is Developmental Robotics?
Slides: [PDF]
Assigned Homework: Homework 0 (Due Thursday Sep 7 before class)
Assigned Readings: WEEK 1
Course Overview [top]
This class serves as an introduction to the interdisciplinary field of Developmental Robotics, which crosses the boundaries between robotics, artificial intelligence, and developmental psychology. The goal of the field is to create autonomous robots that are intelligent and adaptable in the real world rather than in very limited domains, situations and environments. The class will focus on representations and algorithms that enable a robot to continuously learn about its physical or social environment through its own interaction with it.
Topics include overview of robotics; robotics cognitive architectures; deep learning for visual and non-visual sensory data; unsupervised, self-supervised, and reinforcement learning in robotics; learning object affordances; and, theories of cognitive development and their applications to robotics. There will be several small homework assignments and one large class project, with the goal of producing work worthy of publication. You will use physics-based robot simulators as well as real robots as part of the final project. By the end of this class you will have an understanding of the current state of the art of the field and will be able to conduct original research within it.
Prerequisites [top]
A strong interest in the question, ``What is intelligence and how can it be implemented in a physical robot?''
For best results take two lectures weekly. Common side effects may include sleepless nights, broken robots, nervousness, and banging head on keyboard. Frequent visits to the instructor and the TA have been shown to alleviate some of those symptoms. Talk to your instructor if this class is right for you.
Text and Website [top]
There is no textbook for this course. Instead, relevant research papers will be initially assigned, and later chosen by the students following their interests.
Robotics and Machine Learning Resources [top]
Robot Operating System Framework: http://wiki.ros.org/
Installinng ROS in VirtualBox for Max OS X: https://wiki.epfl.ch/roscontrol/rosinstall
scikit-learn: Machine Learning in Python: http://scikit-learn.org/stable/
Computer Vision Libraries in C++: OpenCV and Point Cloud Library
Related Conferences and Journals [top]
Joint IEEE International Conference on Development and Learning: Proceedings
IEEE RAS International Conference on Humanoid Robots: Proceedings
IEEE/RSJ International Conference on Intelligent Robots and Systems: Proceedings
Conference on Robot Learning (CoRL 2017): Accepted Papers
IEEE Transactions on Autonomous Mental Development
Credits and Similar Courses [top]
This class is heavily inspired by a course on Developmental Robotics taught at Iowa State University by Alexander Stoytchev. Feel free to thank him if you enjoy it.
Academic Dishonesty Policy [top]
You are encouraged to form study groups and discuss the reading materials assigned for this class. You are allowed to discuss the the reading response assignments with your colleagues. However, each student will be expected to write his own response.
Collaboration is expected for the final projects -- as soon as you can, you will form teams of 2-3 members. If you absolutely insist on working alone, I won't stop you but you'll be facing a larger work load. For the final project, you're allowed to (and expected to) use various open-source libraries, published code, algorithms, datasets, etc. In fact, doing anything in robotics from scratch is next to impossible :) As long as you cite everything you use that was developed by someone else, you'll be fine.
IMPORTANT: Cheating, plagiarism, and other academic misconducts will not be tolerated and will be handled according to Tufts' policy on academic dishonesty. According to that policy, if I find any evidence of dishonesty, I am required to report it.
[Back to Department Homepage]