Programmatic access to the GESIS Data Catalogue (DBK)

Eric Persson

2017-01-30

The GESIS Data Catalogue offers a repository of approximately 5,000 datasets.

library(gesis)

We start by listing all available groups of studies:

groups <- get_study_groups()
head(groups, 10)

## # A tibble: 10 × 2
##    Groupnumber                                `Group Title`
##          <chr>                                        <chr>
## 1       GN0001 International Social Survey Programme (ISSP)
## 2       GN0002                     EB - Flash Eurobarometer
## 3       GN0003                               Travel Surveys
## 4       GN0004                            Time Budget Study
## 5       GN0005       EB - Central and Eastern Eurobarometer
## 6       GN0006       EB - Candidate Countries Eurobarometer
## 7       GN0007                                       ALLBUS
## 8       GN0008      EB - Standard and Special Eurobarometer
## 9       GN0009                  European Values Study (EVS)
## 10      GN0010                               Politbarometer

We see that the Eurobarometer has study group number 0008. Let’s looks at all available Eurobarometer waves:

eurobars <- get_datasets("0008")
head(eurobars)

## # A tibble: 6 × 2
##     doi                           title
##   <chr>                           <chr>
## 1  0078 Attitudes towards Europe (1962)
## 2  0626 European Communities Study 1970
## 3  0627 European Communities Study 1971
## 4  0628 European Communities Study 1973
## 5  0986  Eurobarometer 2 (Oct-Nov 1974)
## 6  0987      Eurobarometer 3 (May 1975)

We would now like to download the first three studies. We first need to log in to the Gesis website and then pass the DOIs (unique data set identifiers) to download_dataset:

# username and password stored as environment 
# variables "GESIS_USER" and "GESIS_PASS"
gesis_session <- login()

if(!dir.exists("downloads")) dir.create("downloads")

download_dataset(s = gesis_session, doi = eurobars$doi[1:3], 
                 path = "downloads", filetype = ".dta")

files <- list.files("downloads", full.names = TRUE)

We can also download the codebooks for the same studies:

download_codebook(eurobars$doi[1:3], path = "downloads")

## Downloading codebook for DOI: 0078

## Downloading codebook for DOI: 0626

## Downloading codebook for DOI: 0627

Using the haven package we can now read the data sets:

# library(haven)
df <- read_dta(files[1])
dim(df)

Disclaimer: the gesis package is neither affiliated with, nor endorsed by, the Leibniz Institute for the Social Sciences. I have been unable to find any indication that programmatic access to the website is disallowed under its terms of use (indeed, its guidelines appear to encourage it). That said, I would discourage users from using the gesis package to put undue pressure on their servers by initiating unnecessary (or unnecessarily large) batch downloads.