What type of correlation will exist if there is an increase in one variable and decrease in another?

A correlation is a measure or degree of relationship between two variables. A set of data can be positively correlated, negatively correlated or not correlated at all. As one set of values increases the other set tends to increase then it is called a positive correlation.

As one set of values increases the other set tends to decrease then it is called a negative correlation.

If the change in values of one set doesn't affect the values of the other, then the variables are said to have "no correlation" or "zero correlation."

A causal relation between two events exists if the occurrence of the first causes the other. The first event is called the cause and the second event is called the effect. A correlation between two variables does not imply causation. On the other hand, if there is a causal relationship between two variables, they must be correlated.

Example:

A study shows that there is a negative correlation between a student's anxiety before a test and the student's score on the test. But we cannot say that the anxiety causes a lower score on the test; there could be other reasons—the student may not have studied well, for example. So the correlation here does not imply causation.

However, consider the positive correlation between the number of hours you spend studying for a test and the grade you get on the test. Here, there is causation as well; if you spend more time studying, it results in a higher grade.

One of the most commonly used measures of correlation is Pearson Product Moment Correlation or Pearson's correlation coefficient. It is measured using the formula,

r x y = n ∑ x y − ∑ x ∑ y ( n ∑ x 2 − ( ∑ x ) 2 ) ( n ∑ y 2 − ( ∑ y ) 2 )

The value of Pearson's correlation coefficient vary from − 1 to + 1 where –1 indicates a strong negative correlation and + 1 indicates a strong positive correlation.

November 2016

(Note: all the previous publications in the basic statistics category are listed on the right-hand side.  Select "Return to Categories" to go to the page with all publications sorted by category.  Select this link for information on the SPC for Excel software.)

There are all sorts of correlations we can look at.  Sometimes variables increase or decrease over time.  For example, the earth’s temperature is increasing over time.  So are the levels of greenhouse gases.  If you run a correlation analysis on these two variables, you will find that global temperature correlates strongly to the level of greenhouse gases.  But does this mean that one is the cause of the other?  Not necessarily.  When two variables are trending up or down, a correlation analysis will often show there is a significant relationship – simply because of the trend – not necessarily because there is a cause and effect relationship between the two variables.

Some correlations with trending data make sense; others do not.  This month’s publication takes a look at method you can use to help determine if the correlation between two trending variables could be real.  It involves “de-trending” the results, i.e., removing the trend to see if there is still a correlation between the two variables.

In this issue:

• Review of Correlation
• Confusing Correlation with Causation Example
• Nonsensical Correlations
• Removing the Trend to See if the Correlation Still Exists
• Summary
• Quick Links

You may also download a pdf copy of this publication at this link.  Please feel free to leave a comment at the end of the publication.

Review of Correlation

There are two straightforward ways to determine if there is a correlation between two variables, X and Y.  One is simply to construct a scatter diagram.  In a scatter diagram, paired values of X and Y are plotted.  The scatter diagram will show a picture of the correlation.  You can see if the correlation is positive, negative or non-existent. 

It is important to remember that simply because there is a significant correlation between two variables, it does not mean that one is the cause of the other. Suppose we find a significant correlation between X and Y.  There is still a lot we don’t know.  For example:

• We don’t know if the correlation is real.
• And if it is real, we don’t know the direction of the correlation – does a change in X cause a change in Y or does a change in Y cause a change in X.
• And we don’t know if there are a third variable at play that is actually causing the changes in both X and Y.

The key point is that is impossible just from a correlation analysis to determine what causes what. You don't know the cause and effect relationship between two variables simply because a correlation exists between them. You will need to do more analysis to define the cause and effect relationship. 

Confusing Correlation with Causation Example

The classical example of confusing correlation with causation involves the population in Oldenburg, Germany and the number of storks observed during the years from 1930 to 1936.  The original data is given in Ornithologische Monatsberichte, 44, No.2, Jahrgang, 1936, Berlin, and 48, No.1, Jahrgang, 1940, Berlin.  The data are given in Table 1.

Table 1: Population vs Number of Storks Observed Data

The scatter diagram is show in Figure 1.  It includes the best-fit line.  The R2 value for these data is 0.886 – which means 88.6% of the variation in population is explained by the number of storks observed.  The p-value for R is less than 0.01 – so it confirms that there is a statistically significant correlation.

Figure 1: Population versus Number of Storks Scatter Diagram

But remember, correlation does not equal causation.  In this example, both the number of storks and the population both increased with time over these seven years.  Whenever you have two variables increasing (or decreasing) over time, the odds are that there will be a correlation when the two are examined as a scatter diagram.  That doesn’t mean that one is the cause of the other.

Nonsensical Correlations

There are many “significant” correlations that are absolutely nonsense – like the example above.  The internet has many more examples of these.  Tyler Vigen has a website where he lists thousands of “spurious correlations.”  These are available at this link.    One of the examples show the correlation between per capita consumption of mozzarella cheese (US) and civil engineering doctorates awarded (US) from 2000 to 2009.  The data are shown in Table 2.  The scatter diagram is shown in Figure 2, along with the best fit line.

Table 2: Civil Engineering PhD’s Awarded versus Per Capita Consumption of Mozzarella Cheese

Figure 2: Civil Engineering PhD’s vs Mozzarella Cheese Consumption Scatter Diagram

The R2 value for this dataset if 0.919.   So, almost 92% of the variation in civil engineering PhD’s awarded is explained by the variation in per capita consumption of mozzarella cheese.  The p-value for R is less than 0.01 – again confirming a statistically significant correlation between the two.

Once again though, this correlation is simply nonsense in terms of causation.  So, what can we do – fairly quickly - to determine if a correlation is simply nonsense?

Removing the Trend to See if the Correlation Still Exists

Many correlations exist because two variables are trending up at the same time or trending down at the same time.  Suppose there is a real correlation between X and Y.  And further suppose that a change in X causes a real change in Y.  This means that we would expect to see evidence of this as each point is added to the correlation.  This means that the change in X from time 1 to time 2 impacts the change in Y from time 1 to time 2.   To explore this, we simply compare the changes from time period to time period to see if the correlation may be possible.  You do this by subtracting each point from the point that came before it:

X’(t) = X(t) – X(t-1)

Y’(t)=Y(t) – Y(t–1)

The primed X and Y values represent the change in each variable per time period. You then determine if there is a correlation between X’ and Y’.  This approach essentially “de-trends” the data.

Let’s return to the stork data.  Table 3 shows the original data plus columns that compare time period to time period.  The first value in the X’ column is the change in stork observations from 1930 to 1931: 148 – 140 = 8.  There was no change in population so the first value in the Y’ column is 0.

Table 3: Population/Stork Data Revisited

Figure 3 is a scatter diagram of X’ versus Y’ and contains the best-fit line.  The data displayed in Figure 3 are not correlated.  The R2 value is less than 1%.  And the p-value for R is 0.853.  

Figure 3: X’ versus Y’ Scatter Diagram for Population/Stork Data

Figure 3 shows a different story than Figure 1.  What does this mean?  It means that there is probably not a causal relationship between population and storks.  The change from period to period for the two variables is not correlated.   So much for one being the cause of the other.  You will find the same thing if you analyze the data from Table 2 the same way.

What happens if there really is a cause and effect relationship between two variables that are increasing?  The correlation will still exist when you remove the trend as shown above.  Consider the data shown in Table 4.  The X and Y column are the raw data.  The X’ and Y’ columns represent the difference between consecutive points.

Table 4: X and Y Data

Figure 4 is the scatter diagram for X and Y.  You can see there is very significant correlation. The R² value is 0.998.  The p-value associated with R is less than 0.01.  

Figure 4: Scatter Diagram for X and Y

Figure 5 is the scatter plot for X’ and Y’ – after the trend has been removed.  Note that the correlation still exists.  The R² value is 0.75 and the p-value for R is less than 0.01.

Figure 5: Scatter Diagram for X’ and Y’

Does this mean there is a causal relationship between X and Y?  Not necessarily.  You still need to do more work to confirm this (e.g., experimental designs).  It is still possible that there is a third variable impacting the results.  And even if there is a causal relationship, you still don’t know if X causes the change in Y or Y causes the change in X.

But, if de-trending the data shows there is no longer correlation between X and Y, you can pretty sure that there is no correlation.  For two variables that are trending over time, it is a good idea to de-trend the data before deciding if there may be a correlation present.

Summary

The publication showed how to handle examining the correlation between two variables that are trending up or trending down.  Two variables might be increasing over time and a correlation analysis shows that the two are correlated.  But there might not really be a cause and effect relationship.   You might just be seeing the impact of the trend.  To determine if two trending variables may actually have a causal relationship, you need to remove the trend from the analysis.  A simple way to do that is to examine the difference between consecutive points for the two variables.  If these differences are correlated, then there may just be a real correlation between the two variables.  If these differences are not correlated, then there is not a relationship between the two variables.

What is the correlation if one increases and the other decreases?

What type of correlation exists when one variable decreases the other decreases?

What type of correlation which the increase in one variable will result in an increase in the other?

Is a relationship between two variables where if one variable increases the other one decreases?