Introduction to Probability

Multivariable Calculus

Algorithms: Part II

Algorithms: Part I

Introduction to Software Design and Architecture

Calculus Two: Sequences and Series

LAFF Linear Algebra

Stanford Machine Learning

Calculus One

Computational Thinking

Effective Thinking Through Mathematics

CS50 Introduction to Computer Science


Week 3 - Matrix-Vector Operations

Special Matrices

  • Special Vectors:

    • Unit Vector: Any vector of length one (unit length). For example, the vector (2222)\begin{pmatrix}\frac{\sqrt{2}}{2} \\ \frac{\sqrt{2}}{2}\end{pmatrix} has length one.
    • Standard Unit Vector:

Triangular Matrices

Transpose Matrix

Symmetric Matrix

Scaling a Matrix

Adding Matrices

Matrix-vector Multiplication

Cost of Matrix-Vector Multiplication

  • Consider y:=Ax+y , where ARm×ny := Ax+y\ \text{, where } A \in R^{m \times n} :
    • Notice that there is a multiply and an add for every element of A.
    • Since A has m×n=mnm \times n = mn elements, y:=Ax+yy := Ax+y, requires mn multiplies and mn adds, for a total of 2mn floating point operations (flops).