Matrices are sets of numbers or expressions arranged in rows and columns. A matrix is defined by its order, or the number of rows and columns it contains. There are several types of matrices including square, zero, identity, and triangular matrices. Operations on matrices include finding the transpose, determinant, and reducing a matrix to row echelon form. Determinants are values that can be calculated for square matrices and have various properties when operating on matrices.