CSCI 435 Multimedia Information Systems (3 credits)
Fall 2022
Section: MW 3:00-4:15pm, at SL 051
Instructor: Jiang Yu Zheng, jzheng@cs.iupui.edu
Textbook: Slides provided.
Reference books:
Alan Watt, Fabio Policarpo, The Computer Image, ACM Press, Addison-wesley, ISBN 0-201-42298-0.
V. S. Subrahamanian, Principles of Multimedia Database Systems, Morgan Kaufmann Publishers, ISBN 1-55860-466-9.
Rolf
Stenmetz and Klara Nahrstedt,
Multimedia: Computing, Communications & Applications, Prentice Hall, ISBN
0-13-324435-0.
Jennifer Burg, The Science of Digital Media,
Prentice Hall, ISBN 13: 978-0-13-243580-2
Yue-ling Wong, Digital Media, Primer, Pearson ISBN13: 978-0-13-223944-8
Nigel Chapman and Jenny Chapman, Digital
Multimedia, Wiley, ISBN 978047051216-6
Office hour: 2:00-3pm, MW at SL280G, and after class by instructor. 1:30-2:30pm TR by TA at SL239.
Abstract:
This is an introductory course of multimedia. We discuss
various types of media, how they are created, edited, processed, indexed,
stored, transmitted, retrieved, and how to design an interface to access them.
Students will gain hands-on experiences in establishing a multimedia database
for Internet access. We will explore related underlying principles of
multimedia technologies such as Fourier Transform, Convolution and Filtering,
Entropy, Matching and Recognition.
Covered
topics:
1) Different types of media and Creating various media data: Sound and wave, frequency, sampling theory and aliasing, different formats of signal, Fourier Transform, convolution, filtering, MIDI, etc.
2) Image and Video: camera, image resolution, HDR, intensity and color, image Fourier transform, image stitching, panorama, Affine transform, non-linear transformation, image filtering, edge detection and region segmentation, video, view blending, surveillance, optical flow and motion, etc.
3) 3D and animation: basic graphics rendering, aliasing, image composition and synthesizing, image based rendering, flash animation, stereo, 3D display, depth measurements, 3D sensors, human animation by face, expression, action, etc.
4) Media compression and transmission: encoding and decoding, Entropy based coding, Hoffman coding, Frequency based compression, hybrid coding, JPG, MPEG compression, filtering, etc.
5) Internet application and interface: create website with images, video, and animation, frame, map. Interface on mobile devices, interaction with immersion, virtual reality elements, etc.
6) Multimedia database indexing and retrieval: data structure for indexing multi-dimensional data, video indexing and summarization, content based retrieval (object searching), scene classification, machine learning of large media data, etc.
Testing,
Grading, and Evaluation Policies and Procedures
The
goal of this course is to provide students basic knowledge of multimedia and
underlying concept. Through several projects and homework to process multimedia
materials and create multimedia dataset, students will gain skills of using
image, audio, video, animation, 3D model to establish a small multimedia
database, and touch advanced multimedia devices and software. A final test on
the concept and principle will also be given.
Projects and presentation: 20%. Final test on concept: 20%. Programming homework: 40%, and Quizzes: 20%. The grades will follow our school’s regulation.
System requirements:
Adobe software will be installed on your PC. C programming for Exercise and Python for Projects.