Linear regression is a simple supervised machine learning algorithm that finds the linear relationship between variables. It fits a linear equation to the data to predict the output value based on one or more predictor variables. The goal is to find the best fit line that minimizes the distance between the actual data points and the line. In Python, the scikit-learn library can be used to implement linear regression and evaluate the model accuracy using the R-squared metric.