CS 530: Geometric and Probabilistic Methods in Computer Science *

Instructor: Lance Williams <williams@cs.unm.edu>
Time: MWF 2:00-2:50
Location: Woodward 149
Office Hours: Mon. 3:00-5:00, Tues. 3:00-5:00
Office: FEC 349C

Teaching Assistant

Name: Zhu Li <zhuli@unm.edu>
Office: FEC 301A
Office Hours: Tues. 9:20-10:50, Thurs. 1:45-3:15

Description

This is a course in applied mathematics for computer scientists, with an emphasis on information theory and linear systems theory. The goal of this course is to introduce computer science graduate students to the practical kind of mathematics useful for computer simulation and mathematical modeling and by researchers in scientific computation, computer vision and graphics, image processing, robotics, machine learning, and neural networks.

Course Syllabus **

Week 1
- Introduction
- Discrete Random Variables
- Continuous Random Variables
Week 2
Week 3
- Labor Day
- Shannon Information Measure
- Mutual Information (Ex. 4.1)
Week 4
- Source Encoding and Efficiency
- (contd.)
- Spectral Theorem (Ex. 5.1)
Week 5
- Markov Chains (Ex. 5.2) (Ex. 5.3)
- (contd.)
- (contd.)
Week 6
- Information Sources with Memory
- Markov Random Fields (Ex. 6.1)
- Review for Midterm I
Week 7
- Midterm I
- Complex Numbers
- Fall Break
Week 8
Week 9
Week 10
- Fourier Transform Theorems
- Shannon Sampling Theorem
- (contd.)
Week 11
Week 12
- Review for Midterm II
- Midterm II
- Numerical Solution of PDE's
Week 13
- Principal Component Analysis
- JPEG
- Thanksgiving
Week 14
- Linear Algebra and Color (Ex. 14.1)
- Frames vs. Bases
- (contd.)
Week 15
- Intro. to Wavelet Transforms (Ex. 15.1)
- (contd.)
- Fast Wavelet Transform
Week 16
- (contd.)
- Orthonormal Wavelet Series
- (contd.)

Prerequisites

This is not a linear algebra course. Knowledge of basic linear algebra is a prerequisite! Concepts you should understand are: vector sum and difference, inner product, matrix product, matrix transpose, matrix inverse, linear independence, span, basis, rank, orthogonality, change of basis, eigenvectors, and eigenvalues. Students unfamiliar with any of these concepts should take Math 321.

Homeworks

There will be approximately six homework assignments. Many of the homework problems will be similar to those you will find on the midterms and final exams. Other problems will require experimentation in MATLAB. All are designed to increase your understanding of the fundamental ideas. Homeworks are to be turned in during class on the day they are due. They should not be emailed to the professor.

Practice Final

Additional Resources

Schaum's Outline of Probability, Random Variables, and Random Processes (Hsu).
Schaum's Outline of Linear Algebra (Lipschutz-Lipson).
ven der Lubbe, J.C., Information Theory, Cambridge Univ. Press, Cambridge, UK, 1997.
Reza, F.M., Introduction to Information Theory, Dover Publications, New York, NY, 1994.
Lay, D.C., Linear Algebra and Its Applications (2nd Ed.), Addison-Wesley, 2000.
Strang, G., Linear Algebra and Its Applications (3rd Ed.), Harcourt Brace Jovanovich, San Diego, CA, 1988.
Roberts, M.J., Signals and Systems, McGraw Hill, New York, NY, 2004.
Schaum's Outline of Signals and Systems (Hsu).
Hubbard, B.B., The World According to Wavelets (2nd Ed.), A.K. Peters, Wellesley, MA, 1998.

Grading

Homeworks (approx. 6): 25%
Exam I: 25%
Exam II: 25%
Exam III: 25%

Class Mailing List

Miscellany

MATLAB

Most programming will be done in MATLAB or GNU Octave. Both have excellent online documentation. Here are some useful routines:

Images

Calculators

Although experience shows them to be of little actual value, on all exams, you are welcome to use a basic scientific calculator, e.g., a TI-30. You will not be allowed to use graphing calculators, programmable calculators, PDA's, or laptops. A good rule of thumb is that if it cost you more than $20, you probably cannot use it. If you have doubts, see me.

Final Exam

The final exam will be held during final exam week on the date indicated in the university's final exam schedule.

* This page can be found at http://www.cs.unm.edu/~williams/cs530f15.html
** Subject to change.