Course Information

Time and Location:

Instructor: Chandan Reddy

Teaching Assistant: Ping Wang

Course Email: cs5984vtfall17@gmail.com

Course Description:

Deep Learning has gained a lot of popularity due to its recent breakthrough results in many real-world applications such as speech recognition, machine translation, image understanding, and robotics. The primary idea of deep learning is to build high-level abstractions of the data through multi-layered architectures. This course introduces the fundamental principles, algorithms and applications of deep learning. It will provide an in-depth understanding of various concepts and popular techniques in deep learning. This course is mainly designed for graduate students who are interested in studying deep learning techniques and their practical applications. Basic knowledge and understanding of machine learning and data mining algorithms is required.

The course begins with a thorough treatment of deep feedforward networks along with various regularization and optimization techniques used for efficiently learning these models. Different forms of the network architectures such as convolutional networks, recurrent neural networks and autoencoders will be discussed in detail. Other advanced concepts such as deep generative models and deep reinforcement learning will also be covered. Finally, the course will conclude with a discussion on few real-world application domains where deep learning techniques have produced astonishing results.

Prerequisites:

Books: The material for this course will be adapted from a wide range of sources. While there is no single textbook that will be used in this course, the students might find the following books to be useful.

Homework Assignments:

There will be four written homework assignments. Homework problems will constitute some programming exercises that are designed to understand the working of deep learning algorithms. Students are encouraged to talk and discuss with other students to improve their conceptual understanding, but the final submission must be their own work. If any help is taken from others, please acknowledge the people from whom you received some help. Any homework turned in late will incur some penalty for each late day.

Quizzes:

There will be five in-class quizzes. The best four out of the five will be considered for the final grade in the course. Each quiz will be 15 minutes long and will contain some basic questions about the course topics. The questions can be in the form of fill-in the blanks, multiple choice or simple calculations. Detailed algorithms or coding questions will not be present in the quiz.

Paper Readings:

The students will need to write rigorous critiques for two research papers from the list provided under the "Readings" section on the course website. Each critique must be around 2 pages long (single-spaced) and should clearly highlight the problem motivation, background, the main intuition and algorithmic insights along with the main results. The critique should provide own thoughts as opposed to merely reproducing the paper's content. One paper should be selected from the methodologies section and the other one from the applications section. The papers related to the student's course project are strongly recommended.

Final Project:

One of the major components of this course is the final project. In this project, students will investigate some interesting aspect of deep learning and apply it to a real-world problem. The main purpose of this project is to enable the students to get some hands-on experience in the design and implementation of a practical deep learning system. In addition to the core algorithmic aspects, the performance of the system significantly depends on some specific domain-dependent expert knowledge in the application field (such as business intelligence, imaging, robotics, text analysis, e-commerce, etc.). More details about the project proposal and project submission will be provided at a later time.

Grading Policies:

Final grades are based on the performance in homeworks, final exam and the course project. Here is the distribution.

The final grades will be relative to others in the class.

Accommodations Statement:

Students are encouraged to discuss with the instructor about any special needs or special accommodations as soon as they become aware of such needs. Those seeking accommodations based on disabilities should obtain a Faculty Letter from the Services for Students with Disabilities office (540-231-0858) located in Lavery Hall, Suite 310 (http://www.ssd.vt.edu).

Honor Code Statement:

All students must adhere to the Honor Code Policies of Virginia Tech. The Honor Code will be strictly enforced in this course. All assignments shall be considered graded work, unless otherwise noted. All aspects of your coursework are covered by the honor system. Any suspected violations of the Honor Code will be promptly reported to the honor system. Honesty in your academic work will develop into professional integrity. The faculty and students of Virginia Tech will not tolerate any form of academic dishonesty. See http://www.honorsystem.vt.edu/?q=node/33