Administration • CSED441: Introduction to Computer Vision CSED441:Introduction to Computer Vision (2015S) Lecture1: Introduction to Computer Vision Instructor: Prof. Bohyung Han ([email protected], B4‐123) TA: TBD Time & Location: TuTh 15:30 ~ 16:45 AM, B2‐105 Office hour • Bohyung Han: Tue 17:00~18:00 or by appointment • TA: TBD Textbook (for reference) Bohyung Han CSE, POSTECH [email protected] • Computer Vision: Algorithms and Applications by R. Szeliski (Sep 2010 Ed.) • Computer Vision: A Modern Approach by D. Forsyth and J. Ponce • Multiple View Geometry by R. Hartly and A. Zisserman Prerequisite: probability theory & linear algebra Course webpage: http://cv.postech.ac.kr/~bhhan/class/cse441_2015s. html 2 (Tentative) Schedule • • • • • • • CSED441: Introduction to Computer Vision by Prof. Bohyung Han, Spring 2015 Grading Introduction and preliminaries (1.5 weeks) Visual features (2.5 weeks) Object detection and recognition (3.5 weeks) Image segmentation and clustering (2 weeks) Motion and tracking (2 weeks) Deep Learning (1.5 weeks) Image formation and geometric computer vision (2 weeks) • 5 assignments (30%) Problem solving Small programming project • Midterm exam (30%) • Final exam (40%) Comprehensive • Final project Programming/research project Final report Graduate student only • Note: Thresholds for letter grades may be higher for graduate students. Individual percentages are subject to change. 3 CSED441: Introduction to Computer Vision by Prof. Bohyung Han, Spring 2015 4 CSED441: Introduction to Computer Vision by Prof. Bohyung Han, Spring 2015 Final Project Course Policy • Team organization: individual project • Deliverables • Assignments submission Late assignments will not be accepted. But, you have one wildcard for 3‐day late submission. Use it smartly. Demo, source code, and presentation Intermediate reports Final report • Academic integrity • Guideline You decide the theme of your project. Final report should adhere to the standard quality and format of reputable conferences and journals. Top venues in computer vision: CVPR, ICCV, ECCV, TPAMI, IJCV If you do the fantastic job in your project in terms of both performance and presentation, you are eligible for ‘A’ regardless any other scores. 5 CSED441: Introduction to Computer Vision by Prof. Bohyung Han, Spring 2015 Make sure to acknowledge the POSTECH academic integrity. Violating t he academic integrity means the automatic failure (F) in this class with NO exception. • All written communication should be in English. Homeworks, reports, exams, etc. 6 CSED441: Introduction to Computer Vision by Prof. Bohyung Han, Spring 2015 Important Dates (Tentative) • Assignment Dues 3/17(Tue), 4/2 (Thu), 4/16 (Thu), 5/12 (Tue), 6/2 (Tue) All assignments should be handed in BEFORE class. • Midterm exam Date: 4/23 (Thu) What is Computer Vision? • Final exam Comprehensive Date: 6/18 (Thu) • Final project Intermediate reports due: 4/9 (Thu), 5/7 (Thu), 5/21 (Thu) Presentation: TBA Final Report due: 6/21 (Sun) 7 CSED441: Introduction to Computer Vision by Prof. Bohyung Han, Spring 2015 Understanding Images without Human Supervision amusement park laser Sensing camera The Wicked Twister sky Ferris wheel water 12E tree People sitting on the ride tree building deck camera merry‐go‐round bench radar radar umbrellas human People walking 9 10 CSED441: Introduction to Computer Vision by Prof. Bohyung Han, Spring 2015 CSED441: Introduction to Computer Vision by Prof. Bohyung Han, Spring 2015 Characteristics of Computer Vision Origin of Computer Vision Computer Vision Machine Learning Image Processing 11 CSED441: Introduction to Computer Vision by Prof. Bohyung Han, Spring 2015 Psychology Computer Graphics Statistics Artificial Intelligence • Convergence of various research disciplines Machine Vision • Automation • Machine inspection • Document processing Robot Vision • Visual SLAM Computer Vision • Visual recognition Human Vision • Cognitive science • Neural computation 12 CSED441: Introduction to Computer Vision by Prof. Bohyung Han, Spring 2015 Face Detection Interesting Computer Vision Problems Microsoft Kinect Automotive Vision Systems Autonomous Driving Object Detection Deformable part‐based modeling P. Felzenszwalb, R. Girshick, D. McAllester, D. Ramanan. Object Detection with Discriminatively Trained Part‐Based Models. TPAMI, 2009 Image Classification and Deep Learning Motion and Tracking • Challenges Non‐rigid shape Appearance changes Occlusions A. Krizhevsky, I. Sutskever, G. E. Hinton, ImageNet Classification with Deep Convolutional Neural Networks, NIPS 2012 C. Bibby, I.D. Reid. Robust Real‐Time Visual Tracking Using Pixel‐Wise Posterior. ECCV, 2008. M. Zeiler and R. Fergus, Visualizing and Understanding Convolutional Networks, ECCV 2014 19 Cropped target Appearance window model B. Han, L.S. Davis. Density‐Based On‐Line Appearance Modeling for Object Tracking. ICCV, 2005. Human Activity Recognition Event Detection S. Kwak, B. Han, J.H. Han, Scenario‐ Based Video Event Recognition by Constraint Flow. CVPR, 2011. V. Delaitre, I. Laptev, J. Sivic , Recognizing human actions in still images: a study of bag‐of‐features and part‐based representations, BMVC 2010 I. Laptive, M. Marszalek, C. Schmid , B. Rozenfeld, Learning Realistic Human Actions from Movies. CVPR 2008 3D Reconstruction: Building Rome in a Day Computational Photography Colosseum Image deblurring S. Cho, S. Lee, Fast Motion Deblurring. SIGGRAPH ASIA, 2009. Trevi Foundtain S. Agarwal, N. Snavely, I. Simon, S. M. Seitz and R. Szeliski, Building Rome in a Day, ICCV 2009 23 Image retargeting M. Rubinstein, A. Shamir, S. Avidan, Multi‐operator Media Retargeting, SIGGRAPH 2009. Image Stitching Other Research Directions • Non‐standard cameras Omni‐directional cameras Non‐visual sensors Camera array, many cameras • Large‐scale problems Using huge database Handling a large amount of computation http://www.ri.cmu.edu/events/sb35/tksuperbowl.html • Merge with cognitive science and human vision • Interactions with human Vision‐based interface Active learning http://cvlab.epfl.ch/~brown/autostitch/autostitch.html 25 26 CSED441: Introduction to Computer Vision by Prof. Bohyung Han, Spring 2015 Related Research Fields • • • • • • • • • • Machine learning Computer graphics Image processing Robotics Multimedia Optimization Algorithms Pattern recognition Human computer interactions … 27 CSED441: Introduction to Computer Vision by Prof. Bohyung Han, Spring 2015 28
© Copyright 2024