The GovLab Index: Open Data – 2018 Edition

26 September 2018

By Alexandra Shaw, Michelle Winowatan, Andrew Young, and Stefaan Verhulst
Please find below the latest installment in The GovLab Index series, inspired by Harper’s Index. “The GovLab Index: Open Data 2018” provides an update to our previous Open Data installments: The GovLab Index: Open Data, (Updated and Expanded of 2013, The GovLab Index: Open Data (Updated) of 2015, and The GovLab Index: Open Data – 2016 Edition.
To share additional, illustrative statistics on open data, or other issues at the nexus of technology and governance, please reach out to Andrew Young ([email protected]

Value and Impact

  • Direct market value of open data in EU from 2016 to 2020: estimated EUR 325 billion
  • Predicted number of Open Data jobs in Europe by 2020: 100,000 (35% increase)
  • The projected year at which all 28+ EU member countries will have a fully operating open data portal: 2020
  • Between 2016 and 2020, the market size of open data in Europe is expected to increase by 36.9%, and reach this value by 2020: EUR 75.7 billion
  • Estimated cost savings for public administration in the EU by 2020: EUR 1.7 billion
  • 2013 estimates of potential value of global open data, as estimated by McKinsey: $3 trillion annually
  • Potential yearly value of open data in Australia: AUD 25 billion
  • Value of Transport for London open data projects: £115 million per year
  • Value that open data can help unlock in economic value annually across seven sectors in the United States: $3-5 trillion

Public Views on and Use of Open Government Data

  • Number of Americans who do not trust the federal government or social media sites to protect their data: Approximately 50%
  • Key findings from The Economist Intelligence Unit report on Open Government Data Demand:
    • Percentage of respondent who say the key reason why governments open up their data is to create greater trust between the government and citizens: 70%
    • Percentage of respondent who say OGD plays an important role in improving lives of citizens: 78%
    • Percentage of respondent who say OGD helps with daily decision making especially for transportation, education, environment: 53%
    • Percentage of respondent who cite lack of awareness about OGD and its potential use and benefits as the greatest barrier to usage: 50%
    • Percentage of respondent who say they lack access to usable and relevant data: 31%
    • Percentage of respondent who think they don’t have sufficient technical skills to use open government data: 25%
    • Percentage of respondent who feel the number of OGD apps available is insufficient, indicating an opportunity for app developers: 20%
    • Percentage of respondent who say OGD has the potential to generate economic value and new business opportunity: 61%
    • Percentage of respondent who say they don’t trust governments to keep data safe, protected, and anonymized: 19%

Efforts and Involvement

  • Time that’s passed since open government advocates convened to create a set of principles for open government data – the instance that started the open data government movement: 10 years
  • Countries participating in the Open Government Partnership today: 79 OGP participating countries and 20 subnational governments
  • Percentage of “open data readiness” in Europe according to European Data Portal: 72%
    • Open data readiness consists of four indicators which are presence of policy, national coordination, licensing norms, and use of data.
  • Number of U.S. cities with Open Data portals: 27
  • Number of governments who have adopted the International Open Data Charter: 62
  • Number of non-state organizations endorsing the International Open Data Charter: 57
  • Number of countries analyzed by the Open Data Index: 94
  • Number of Latin American countries that do not have open data portals as of 2017: 4 total – Belize, Guatemala, Honduras and Nicaragua
  • Number of cities participating in the Open Data Census: 39

Demand for Open Data

  • Open data demand measured by frequency of open government data use according to The Economist Intelligence Unit report:
    • Australia
      • Monthly: 15% of respondents
      • Quarterly: 22% of respondents
      • Annually: 10% of respondents
    • Finland
      • Monthly: 28% of respondents
      • Quarterly: 18% of respondents
      • Annually: 20% of respondents
    • France
      • Monthly: 27% of respondents
      • Quarterly: 17% of respondents
      • Annually: 19% of respondents
    • India
      • Monthly: 29% of respondents
      • Quarterly: 20% of respondents
      • Annually: 10% of respondents
    • Singapore
      • Monthly: 28% of respondents
      • Quarterly: 15% of respondents
      • Annually: 17% of respondents
    • UK
      • Monthly: 23% of respondents
      • Quarterly: 21% of respondents
      • Annually: 15% of respondents
    • US
      • Monthly: 16% of respondents
      • Quarterly: 15% of respondents
      • Annually: 20% of respondents
  • Number of FOIA requests received in the US for fiscal year 2017: 818,271
  • Number of FOIA request processed in the US for fiscal year 2017: 823,222
  • Distribution of FOIA requests in 2017 among top 5 agencies with highest number of request:
    • DHS: 45%
    • DOJ: 10%
    • NARA: 7%
    • DOD: 7%
    • HHS: 4%

Examining Datasets

  • Country with highest index score according to ODB Leaders Edition: Canada (76 out of 100)
  • Country with lowest index score according to ODB Leaders Edition: Sierra Leone (22 out of 100)
  • Number of datasets open in the top 30 governments according to ODB Leaders Edition: Fewer than 1 in 5
  • Average percentage of datasets that are open in the top 30 open data governments according to ODB Leaders Edition: 19%
  • Average percentage of datasets that are open in the top 30 open data governments according to ODB Leaders Edition by sector/subject:
    • Budget: 30%
    • Companies: 13%
    • Contracts: 27%
    • Crime: 17%
    • Education: 13%
    • Elections: 17%
    • Environment: 20%
    • Health: 17%
    • Land: 7%
    • Legislation: 13%
    • Maps: 20%
    • Spending: 13%
    • Statistics: 27%
    • Trade: 23%
    • Transport: 30%
  • Percentage of countries that release data on government spending according to ODB Leaders Edition: 13%
  • Percentage of government data that is updated at regular intervals according to ODB Leaders Edition: 74%
  • Number of datasets available through:
  • Number of datasets classed as “open” in 94 places worldwide analyzed by the Open Data Index: 11%
  • Percentage of open datasets in the Caribbean, according to Open Data Census: 7%
    • Number of companies whose data is available through OpenCorporates: 158,589,950

City Open Data

  • New York City
  • Singapore
    • Number of datasets published in Singapore: 1,480
    • Percentage of datasets with standardized format: 35%
    • Percentage of datasets made as raw as possible: 25%
  • Barcelona
    • Number of datasets published in Barcelona: 443
    • Open data demand in Barcelona measured by:
      • Number of unique sessions in the month of September 2018: 5,401
    • Quality of datasets published in Barcelona according to Tim Berners Lee 5-star Open Data: 3 stars
  • London
    • Number of datasets published in London: 762
    • Number of data requests since October 2014: 325
  • Bandung
    • Number of datasets published in Bandung: 1,417
  • Buenos Aires
    • Number of datasets published in Buenos Aires: 216
  • Dubai
    • Number of datasets published in Dubai: 267
  • Melbourne
    • Number of datasets published in Melbourne: 199

Sources