Special Courses 3 (Multimedia and Computer Graphics)

CSM231: MULTIMEDIA AND AUDIO SYSTEMS

Lecturers;

Aleksandr Yu. Pervitsky, Associate Prof. Ph.D., Vladimir V. Geppener, Associate Prof. Ph.D..

Course includes two parts. The first part is introduction to Multimedia computing as application of computer technologies. The second part is introduction in computer audio and speech technologies. Areas and issues on computer audio systems as element of Multimedia, hardware problems, basic audio signal processing, audio compression, file standards .programming of audio applications, speech recognition and synthesis, musical synthesis, speech mailing, audio in Internet.

1. Storage, Presentation, Communication and Multimedia Computing

2. Hardware for Presentation. Text, Images, Audio and Video in Personal Computers

3. Media Synchronization Problem and Real Time Protocols

4. Compression and Coding Problems

5. Introduction in Multimedia audio problems

6. Hardware for computer audio

7. Signal processing for audio application

8. Compression of audio information

9. Audio file standards

10. Programming of audio applications

11. Speech recognition

12. Speech synthesis

13. Musical synthesis

14. Audio in Internet

Course Text

1. Brian R Gaines, Mildrad L.G. Shaw. Open Architecture Multimedia Document. Proceedings ACM Multimedia 93, 1993.

2. CD ROM: Proceedings ACM Multimedia 93, 1993.

3. Digital speech processing: speech coding,, synthesis, and recognition. Ed, by A.Nejat, Kluwer Academic Publishers, Boston, 1992.

4. L. Rabiner, B.-H. Jaung, Fundamental of speech recognition. Englewood Cliffs NJ. : PTRPrinticeHall, 1993.

5. D.M. Huber. The MIDI manual, Publisher Carwel, Ind.,USA.

CSM232 GRAPHICAL.SYSTEMS ANPSTANDAl

Lecturers:

Aleksandr Yu. Pervitsky, Associate Prof. Ph.D., Tamara V. Gerasimova, Assistant Prof.

Course contains the basic concepts of standards for graphics files and standards for computer graphics systems. Demonstrates the more sophisticated and novel techniques possible using the OpenGL library, focuses on rendering high quality images, describing some of the more subtle OpenGL techniques, and providing a practical grounding in some of the central computer graphics concepts in use today.

1. Introduction

2. Standards for graphics files

3. Bitmaps (BMP, PNG, GIF, JPEG)

4. Videofiles (MPEG, AVI)

5. Animations files (FL1, FLX, AVI)

6. Vectors files (WMT, CGI, HPGL)

7. Metafiles (CGM, WMF)

8. Standards for computer graphics systems

10. GKS, PHTGS, PHIGS+

11. OpenGL

12. VRML

1. Gunter Born. Referenzhandbuch.Dateiformate.Addison-Wesley Publishing Company, 1993.

2. OpenGL Architecture Review Board, OpenGI Reference Manual: The official reference document for OpenGL, Release 1, Addison Wesley, 1993.

3. Mark Pesce. VRML-Browsing and Building Cyberspace. New Riders Publishing, Indianapolis, IN 462990 USA.

CSM233: ANIMATION AND VIDEOGRAPHICS

Lecturer Aleksandr Yu. Pervitsky, Associate Prof., Ph.D.

Animation has historically been produced in two ways. The first is creating a succession of cartoon frames, which are them combined into a film. A second method is by using physical models, which are positioned, the image recorded, then the model is moved, the next image is recorded, and this process is continued. Animation is used in Visualization to show the time dependent behaviour of complex systems. The major part of animation is motion control.

1. Introduction and overview. Background and History

2. Types of Animation Systems

3. Low Level Motion Control

4. Principles of Traditional Animation

5. Hardware and Recording Techniques

6. Aids to Motion Specification

7. Key Frame/Track Based Animation

8. Warping and Morfing

9. Motion Specification and Object Hierarchy

10. Hierarchical Modelling and Kinematics, Inverse Kinematics.

11. Rigid Body Motion and Dynamics

12. Flexible Body Animation

13. Particle Systems, Flocking

1- Rick Parent. Computer Animation: Algorithms and Techniques, 1995.

2. John Lasseter. Principles of Traditional Animation to 3D Computer Animation. SIGGRAPH '87, Computer Graphics, 21:4, July, 1987

3. John Lesseter. Animation Tricks. Course 1 at SIGGRAPH '94.

CSM234: MULTIMEDIA AND HYPERMEDIA AUTHORING

Lecturer Dmitrij L. Kretchman, Assistant Prof, PhD.

You will leam about multimedia authoring and leave with an understanding of multimedia application production. We will cover assembly of a development team, selection of appropriate multimedia production and delivery platforms, content tool selection and authoring tool selection and use. The focus of this course is on producing hypermedia/multimedia applications (CD ROM titles, WWW and other hyper-linked information spaces) based on a life cycle steps (from Idea to CD ROM Publishing). Other topics include review of hypermedia idea evaluation, visualizations of hypermedia, navigation, user interface for hypermedia databases, hypermedia functionality, hypermedia and multimedia data formats, human computer interaction, WWW. The course will be organized around a series of lectures, computer based training and independent producing of small prototype of multimedia title on CD ROM.

5. Hypermedia authoring tools.

6. Hypertext and hypermedia formal model. Navigation.

7. Programming and script writing.

10. Sound, voice, music, standards HTML, RTF, JavaScript. HTML

1. Neilsen. J., Hypertext and Hypermedia. San Diego, CA: Academic Press, 1990

2. Nelson, T., Literary machines. Mindful Press, 1990

3. Rosch, .L., Multimedia Bible. Indianapolis, IN; Sams Publishing, 1995

CSM235: HUMAN^COMPUTER INTERACTION________

Lecturers:

Tamara V. Gerasimova, Assistant Prof. Aleksandr Yu. Pervitsky, Associate Prof. PhD,

Human-computer interaction (HCI) is a discipline concerned with the design, evaluation, and implementation of interactive computing systems for human use, and with the study of major phenomena surrounding them. This course provides a broad overview of the field with an emphasis on interface development and evaluation. The course includes a laboratory component.

Topics

1. Introduction

2. High-level Theories

3. Knowledge and Mental Models

4. Interface metaphors and Conceptual Models

5. Menu Selection and Form Fill-in

6. Command Languages

7. Direct Manipulation

8. Interaction Devices

9. Response Time and Display Rate Issues

10. System Messages, Screen Design, and Colour

11. Multiple Window Strategies

12. User-Interface Development Environments

1. B. Shneiderman. Designing the User Interface, 3rd Edition. Addison Wesley Longman Publishing. 1998.

2. D. Mayhew. Principles and Guidelines in Software User Interface Design. Prentice Hall. 1992.

3. R. Eberts. User Interface Design. Prentice Hall. 1994.

4. S. Treu. User Interface Evaluation. Plenum Publishing. 1994.

5. Human-Machine Interactive Systems. A. Kinger (ed.). Plenum Publishing. 1991.

CSM236: IMAGE PROCESSING

Lecturer Alexander H. Mursaev, Prof, DSc.

Areas and issues in image processing, including image representation, image features, image transformations. Theoretical basis of image processing; spectral and spatial approaches in image processing, Fourier theory in two dimensions . Image processing techniques; image analysis, restoration (e.g.; smoothing, sharpening), compression, recognition.

1. Introduction and overview

2. Signals and Images

3. Mathematical Preliminaries

4. Visual Systems and Their Characterization

5. The Two-dimensional Fourier Transform

6. Discrete Spatial Sampling and Reconstruction

7. FFT Algorithm, Other Transforms

8. Level Operations

9. Noise. Filtering

10. Restoration

11. Enchancement

12. Colour

13. Geometric and Spatial Operations

14. Coding. Compression

15. Basics of Pattern Recognition

16. Image-Processing tools

17. Material chosen by instructor

1. AnilK. Jain: Fundamentals of Digital Image Processing, Prentice-Hall, 1989.

2. Pratt W. Digital Image processing. Academic Press, New York, 1979