Correlation analysis
How are my variables related?

Overview

Before you start to create risk models, it is a good idea to analyze how the variables are related to one another. Examples of questions that arise in risk analysis:

  • Process safety engineer: “To what extent does increased process temperature and pressure increase the level of corrosion of my equipment?”

  • Medical researcher: “What is the mortality impact of smoking 2 packets of cigarettes per day?”

  • Safety regulator: “Do more frequent site inspections lead to a lower accident rate?”

  • Life insurer: “What is the conditional probability when one spouse dies, that the other will die shortly afterwards?”

The simplest statistical technique for analyzing causal effects is correlation analysis. It measures the extent to which two variables vary together, including the strength and direction of their relationship. Exploring correlation between variables is an important part of exploratory data analysis.

Learn how to measure the degree of linear dependency between two random variables using Python and the SciPy library. The lecture slides include a number of warnings related to dependency, causality and correlation in risk analysis.

This submodule is a part of the risk analysis module.

Course material

Modelling correlations with Python

Lecture slides (PDF)

Python notebook on correlation

View Python notebook online

Download Python notebook

Run notebook in MyBinder mybinder

Run notebook in Google Colab

In these course materials, applications are presented using the NumPy, SciPy and statsmodels libraries for the Python programming language. We have some material on getting started with Python that explains how to install Python on your computer or try out our computational notebooks using free online services.

Other resources

We recommend the following sources of further information on this topic:

Published: