The GovLab Index: Open Data – 2018 Edition

By Alexandra Shaw, Michelle Winowatan, Andrew Young, and Stefaan Verhulst

Please find below the latest installment in The GovLab Index series, inspired by Harper’s Index. “The GovLab Index: Open Data 2018” provides an update to our previous Open Data installments: The GovLab Index: Open Data, (Updated and Expanded of 2013, The GovLab Index: Open Data (Updated) of 2015, and The GovLab Index: Open Data – 2016 Edition.

To share additional, illustrative statistics on open data, or other issues at the nexus of technology and governance, please reach out to Andrew Young (andrew@thegovlab.org) 

Value and Impact

  • Direct market value of open data in EU from 2016 to 2020: estimated EUR 325 billion
  • Predicted number of Open Data jobs in Europe by 2020: 100,000 (35% increase)
  • The projected year at which all 28+ EU member countries will have a fully operating open data portal: 2020
  • Between 2016 and 2020, the market size of open data in Europe is expected to increase by 36.9%, and reach this value by 2020: EUR 75.7 billion
  • Estimated cost savings for public administration in the EU by 2020: EUR 1.7 billion
  • 2013 estimates of potential value of global open data, as estimated by McKinsey: $3 trillion annually
  • Potential yearly value of open data in Australia: AUD 25 billion
  • Value of Transport for London open data projects: £115 million per year
  • Value that open data can help unlock in economic value annually across seven sectors in the United States: $3-5 trillion

Public Views on and Use of Open Government Data

  • Number of Americans who do not trust the federal government or social media sites to protect their data: Approximately 50%
  • Key findings from The Economist Intelligence Unit report on Open Government Data Demand:
    • Percentage of respondent who say the key reason why governments open up their data is to create greater trust between the government and citizens: 70%
    • Percentage of respondent who say OGD plays an important role in improving lives of citizens: 78%
    • Percentage of respondent who say OGD helps with daily decision making especially for transportation, education, environment: 53%
    • Percentage of respondent who cite lack of awareness about OGD and its potential use and benefits as the greatest barrier to usage: 50%
    • Percentage of respondent who say they lack access to usable and relevant data: 31%
    • Percentage of respondent who think they don’t have sufficient technical skills to use open government data: 25%
    • Percentage of respondent who feel the number of OGD apps available is insufficient, indicating an opportunity for app developers: 20%
    • Percentage of respondent who say OGD has the potential to generate economic value and new business opportunity: 61%
    • Percentage of respondent who say they don’t trust governments to keep data safe, protected, and anonymized: 19%

Efforts and Involvement

  • Time that’s passed since open government advocates convened to create a set of principles for open government data – the instance that started the open data government movement: 10 years
  • Countries participating in the Open Government Partnership today: 79 OGP participating countries and 20 subnational governments
  • Percentage of “open data readiness” in Europe according to European Data Portal: 72%
    • Open data readiness consists of four indicators which are presence of policy, national coordination, licensing norms, and use of data.
  • Number of U.S. cities with Open Data portals: 27
  • Number of governments who have adopted the International Open Data Charter: 62
  • Number of non-state organizations endorsing the International Open Data Charter: 57
  • Number of countries analyzed by the Open Data Index: 94
  • Number of Latin American countries that do not have open data portals as of 2017: 4 total – Belize, Guatemala, Honduras and Nicaragua
  • Number of cities participating in the Open Data Census: 39

Demand for Open Data

  • Open data demand measured by frequency of open government data use according to The Economist Intelligence Unit report:
    • Australia
      • Monthly: 15% of respondents
      • Quarterly: 22% of respondents
      • Annually: 10% of respondents
    • Finland
      • Monthly: 28% of respondents
      • Quarterly: 18% of respondents
      • Annually: 20% of respondents
    • France
      • Monthly: 27% of respondents
      • Quarterly: 17% of respondents
      • Annually: 19% of respondents
    • India
      • Monthly: 29% of respondents
      • Quarterly: 20% of respondents
      • Annually: 10% of respondents
    • Singapore
      • Monthly: 28% of respondents
      • Quarterly: 15% of respondents
      • Annually: 17% of respondents
    • UK
      • Monthly: 23% of respondents
      • Quarterly: 21% of respondents
      • Annually: 15% of respondents
    • US
      • Monthly: 16% of respondents
      • Quarterly: 15% of respondents
      • Annually: 20% of respondents
  • Number of FOIA requests received in the US for fiscal year 2017: 818,271
  • Number of FOIA request processed in the US for fiscal year 2017: 823,222
  • Distribution of FOIA requests in 2017 among top 5 agencies with highest number of request:
    • DHS: 45%
    • DOJ: 10%
    • NARA: 7%
    • DOD: 7%
    • HHS: 4%

Examining Datasets

  • Country with highest index score according to ODB Leaders Edition: Canada (76 out of 100)
  • Country with lowest index score according to ODB Leaders Edition: Sierra Leone (22 out of 100)
  • Number of datasets open in the top 30 governments according to ODB Leaders Edition: Fewer than 1 in 5
  • Average percentage of datasets that are open in the top 30 open data governments according to ODB Leaders Edition: 19%
  • Average percentage of datasets that are open in the top 30 open data governments according to ODB Leaders Edition by sector/subject:
    • Budget: 30%
    • Companies: 13%
    • Contracts: 27%
    • Crime: 17%
    • Education: 13%
    • Elections: 17%
    • Environment: 20%
    • Health: 17%
    • Land: 7%
    • Legislation: 13%
    • Maps: 20%
    • Spending: 13%
    • Statistics: 27%
    • Trade: 23%
    • Transport: 30%
  • Percentage of countries that release data on government spending according to ODB Leaders Edition: 13%
  • Percentage of government data that is updated at regular intervals according to ODB Leaders Edition: 74%
  • Number of datasets available through:
  • Number of datasets classed as “open” in 94 places worldwide analyzed by the Open Data Index: 11%
  • Percentage of open datasets in the Caribbean, according to Open Data Census: 7%
    • Number of companies whose data is available through OpenCorporates: 158,589,950

City Open Data

  • New York City
  • Singapore
    • Number of datasets published in Singapore: 1,480
    • Percentage of datasets with standardized format: 35%
    • Percentage of datasets made as raw as possible: 25%
  • Barcelona
    • Number of datasets published in Barcelona: 443
    • Open data demand in Barcelona measured by:
      • Number of unique sessions in the month of September 2018: 5,401
    • Quality of datasets published in Barcelona according to Tim Berners Lee 5-star Open Data: 3 stars
  • London
    • Number of datasets published in London: 762
    • Number of data requests since October 2014: 325
  • Bandung
    • Number of datasets published in Bandung: 1,417
  • Buenos Aires
    • Number of datasets published in Buenos Aires: 216
  • Dubai
    • Number of datasets published in Dubai: 267
  • Melbourne
    • Number of datasets published in Melbourne: 199

Sources