Linear Regression

Published

August 27, 2025

Linear Regression

Introduction

Linear regression is a simple and powerful statistical method used to model the relationship between a dependent variable and one or more independent variables. It is a fundamental tool in machine learning and statistics, widely used in various fields including economics, finance, and social sciences.

Mathematical Formulation

Gradient Descent

The Normal Equation

Regularization

L1 Regularization

L2 Regularization

Elastic Net Regularization

L1 vs L2 Regularization