Python Tutorial: Simple Linear Regressions

Key Takeaways

in this video you'll learn about simple linear regressions of time series a simple linear regression finds the slope beta and the intercept alpha of a line that's the best fit between a dependent variable Y and an independent variable X the X's and Y's can be to time series a linear regression is also known as ordinary least squares or OLS because it minimizes the sum of the squared distances between the data points and the regression line regression techniques are very common and therefore there are many packages in Python that can be used in stats models there is OLS in numpy there is polyfit and if you said degree equal 1 it fits the data to a line which is a linear regression panthis has an OLS method and scifi has a linear regression function beware that the order of x and y is not consistent across packages all these packages are very similar and in this course you will use the stats models OLS now you'll regress the returns of the small cap stocks on returns of large cap stocks compute returns from prices using the percent change method in pandas you need to add a column of ones as a dependent right-hand-side variable the reason you have to do this is because the regression function assumes that if there is no constant column then you want to run the regression without an intercept by adding a column of one's stats models will compute the regression coefficient of that column as well which can be interpreted as the intercept of the line the stats models method ad constant is a simple way to add a constant notice that the first row of the return series is n a n each return is computed from two prices so there was one less return than price to delete the first row of n use the pandas method drop na you're finally ready to run the regression the first argument of the stats models regression is the series that represents the dependent variable Y and the next argument contains the independent variable or variables in this case the dependent variable is the r2000 returns and the independent variables are the constant and SPX returns the method fit runs the regression and results are saved in a class instance called results the summary method of results shows the entire regression output we will only focus on a few items of the regression results in the red box the coefficient 1 point 1 4 1 2 is the slope of the regression which is also referred to as beta the coefficient above that is the intercept which is very close to 0 you can also pull out individual items from results like the intercept in results dot params 0 and the slope in results dot params 1 another statistic to take note of is the r-squared of 0.75 3 that will be discussed next from the scatter diagrams you saw that the correlation measure is how closely the data are clustered along a line the r-squared also measures how well the linear regression line fits the data so as you would expect there is a relationship between correlation and r-squared the magnitude of the correlation is the square root of the r-squared and the sign of the correlation is the sign of the slope of the regression line if the regression line is positively sloped the correlation is positive and if the regression line is negatively sloped the correlation is negative in the example you just analyzed of large cap and small cap stocks the r-squared was 0.75 3 the slope of the regression was positive so the correlation is then positive the square root of 0.75 3 or point eight six eight which can be verified by computing the correlation directly now it's your turn