Factor analysis is a statistical technique used to reduce a large set of variables into a smaller set of underlying factors or dimensions. It examines the interrelationships among variables to define common dimensions called factors that can help explain correlations. Factor analysis is used to identify the underlying structure in a data set and reduce many variables into a smaller number of factors for subsequent analysis like regression or discriminant analysis.