Afonso S. Bandeira's Homepage



	Syllabus > Grading and other important information > Homework >					DS-GA 1014: Optimization and Computational Linear Algebra for Data Science (Fall 2018, NYU CDS) Afonso S. Bandeira bandeira [at] cims [dot] nyu [dot] edu Lectures: Tue 11am-12.40pm at CDS(60 5th Av.) room 150 Afonso's Office Hours: Tue 1.45pm-2.45pm at CDS(60 5th Av.)603 (or by appointment) Afonso has sporadic extra office hours on Wednesdays at WWH1123, announced weekly Section Leader: Brett Bernstein (Section material). Sections: W 11am-11.50am at SILV 405 Brett's Office hours: W 1.30pm-2.30pm at CDS 650 (or by appointment) Graders (email address; add [at] nyu [dot] edu): Efe Onaran (eo766), Ruofan Wang (rw2268), Luca Venturi (lv800). Piazza page for this course here. Syllabus: This course will cover the basics of optimization and computational linear algebra used in Data Science. Contents: Vector spaces and linear transformations: rank, dimension, etc. Linear systems: conditioning, least squares. Singular-value decomposition/principal-component analysis, Rayleigh quotients. Applications: Spectral clustering, dimension reduction, Page Rank. Local optima and global optima. Constrained optimization. Optimality conditions and matrix calculus. Gradient descent and Stochastic Gradient Descent. Newton's method and Quasi-Newton methods (BFGS and L-BFGS). Linear Optimization, Duality, and Convex optimization. Conjugate Gradient. Some Applications: Lasso, compressed sensing. Problems on Graphs. Important: This course description is preliminary, and so it is subject to change. I am here to help: If you have any question, comment, feedback, want to brainstorm about any research idea, etc, just email me and we'll schedule a time to meet. Feedback: Also, if you have any comment or feedback on the class (it's going too fast, too slow, you want me to cover more of something, or less of something else, etc) please let me know (in person or through email) or submit a comment to this google form. Having direct feedback from you is the best way for me to try give lectures that you like! (keep in mind that I don't know who sent me the comment or feedback and there is no way for me to answer, for questions use email instead). Books: All three books are optional Strang: Introduction to Linear Algebra (there are very good lecture videos based on this book) Nocedal & Wright: Numerical Optimization (should be available online via NYU here) Boyd & Vandenberghe: Convex Optimization (available online here) Grading and other important information: Grading: 40% Homework, 20% Midterm (Nov 6th in class), 40% Final. Exams are open book/notes. Homework (typically weekly, due on Tuesday before class at the CDS front desk): Homework 1 (due on September 7 on NYU Classes). Homework 2 (due on September 14 on NYU Classes). Homework 3 (due on September 21 on NYU Classes). Homework 4 (due on September 28 on NYU Classes). Homework 5 (due on October 12 on NYU Classes). Homework 6 (due on October 19 on NYU Classes). Homework 7 (due on October 26 on NYU Classes). Homework 8 (due on November 16 on NYU Classes). Homework 9 (due on November 30 on NYU Classes). Homework 10 (due on December 11 on NYU Classes). Extended Syllabus: Lecture 1 (September 4, 2018). Lecture 2 (September 11, 2018). Lecture 3 (September 18, 2018). Lecture 4 (September 25, 2018). Lecture 5 (October 2-3, 2018). Lecture 6 (October 16, 2018). Lecture 7 (October 23, 2018). Lecture 8 (October 30, 2018). Lecture 9 (November 7-13-20, 2018). Lecture 10 (November 27 & December 4-11, 2018).