Covariance and Pearson Correlation — Statistics & Probability for Data Science

So far every measure has described a single variable in isolation, but the questions that drive data science are usually about relationships: does practice time relate to performance, does temperature relate to sales, does one stock move with another? Covariance and correlation exist to quantify how two variables move together — whether they rise and fall in tandem, move in opposite directions, or vary independently. Without them, analysts could only inspect variables one at a time and would miss the connections that make prediction possible. Correlation in particular, by standardising covariance onto a fixed scale from minus one to plus one, gives a universally comparable strength-of-relationship number that underpins feature selection, regression, and the very notion of which inputs are worth modelling.

Analogy🏏Cricket

🏏 Think of it like cricket: Imagine Virat Kohli has scored 45, 52, 38, 61, and 49 across five innings in a series, and a commentator wants to describe his form in one phrase. The commentator cannot read out all five scores every time, so they compress them into a single representative figure. Just as the commentator picks one number to stand in for the whole sequence of innings, a measure of central tendency picks one value to represent an entire dataset. Just as a misleading summary ('he averages 200') would distort how selectors judge Kohli, a wrongly chosen centre distorts how analysts judge data. And just as different summaries (best score versus typical score) tell different stories, the mean, median, and mode each emphasise a different aspect of the same innings. This reveals why central tendency is never one fixed number — it is a deliberate choice about which story the data should tell.