Classical linear regression is inappropriate when the predictors are correlated (multicollinearity). Learn the principe of PCR and PLS regression designed to deal with multicollinearity and when it is relevant to use them.
One of the oldest multivariate techniques, factor analysis is closely related to PCA and even confused by many for PCA. However, it serves a totally different purpose. Uncover hidden dimensions in your data.