By Alexandra Shaw, Michelle Winowatan, Andrew Young, and Stefaan Verhulst
Please find below the latest installment in The GovLab Index series, inspired by Harper’s Index. “The GovLab Index: Open Data 2018” provides an update to our previous Open Data installments: The GovLab Index: Open Data, (Updated and Expanded of 2013, The GovLab Index: Open Data (Updated) of 2015, and The GovLab Index: Open Data – 2016 Edition.
To share additional, illustrative statistics on open data, or other issues at the nexus of technology and governance, please reach out to Andrew Young ([email protected])
Value and Impact
- Direct market value of open data in EU from 2016 to 2020: estimated EUR 325 billion
- Predicted number of Open Data jobs in Europe by 2020: 100,000 (35% increase)
- The projected year at which all 28+ EU member countries will have a fully operating open data portal: 2020
- Between 2016 and 2020, the market size of open data in Europe is expected to increase by 36.9%, and reach this value by 2020: EUR 75.7 billion
- Estimated cost savings for public administration in the EU by 2020: EUR 1.7 billion
- 2013 estimates of potential value of global open data, as estimated by McKinsey: $3 trillion annually
- Potential yearly value of open data in Australia: AUD 25 billion
- Value of Transport for London open data projects: £115 million per year
- Value that open data can help unlock in economic value annually across seven sectors in the United States: $3-5 trillion
Public Views on and Use of Open Government Data
- Number of Americans who do not trust the federal government or social media sites to protect their data: Approximately 50%
- Key findings from The Economist Intelligence Unit report on Open Government Data Demand:
- Percentage of respondent who say the key reason why governments open up their data is to create greater trust between the government and citizens: 70%
- Percentage of respondent who say OGD plays an important role in improving lives of citizens: 78%
- Percentage of respondent who say OGD helps with daily decision making especially for transportation, education, environment: 53%
- Percentage of respondent who cite lack of awareness about OGD and its potential use and benefits as the greatest barrier to usage: 50%
- Percentage of respondent who say they lack access to usable and relevant data: 31%
- Percentage of respondent who think they don’t have sufficient technical skills to use open government data: 25%
- Percentage of respondent who feel the number of OGD apps available is insufficient, indicating an opportunity for app developers: 20%
- Percentage of respondent who say OGD has the potential to generate economic value and new business opportunity: 61%
- Percentage of respondent who say they don’t trust governments to keep data safe, protected, and anonymized: 19%
Efforts and Involvement
- Time that’s passed since open government advocates convened to create a set of principles for open government data – the instance that started the open data government movement: 10 years
- Countries participating in the Open Government Partnership today: 79 OGP participating countries and 20 subnational governments
- Percentage of “open data readiness” in Europe according to European Data Portal: 72%
- Open data readiness consists of four indicators which are presence of policy, national coordination, licensing norms, and use of data.
- Number of U.S. cities with Open Data portals: 27
- Number of governments who have adopted the International Open Data Charter: 62
- Number of non-state organizations endorsing the International Open Data Charter: 57
- Number of countries analyzed by the Open Data Index: 94
- Number of Latin American countries that do not have open data portals as of 2017: 4 total – Belize, Guatemala, Honduras and Nicaragua
- Number of cities participating in the Open Data Census: 39
Demand for Open Data
- Open data demand measured by frequency of open government data use according to The Economist Intelligence Unit report:
- Australia
- Monthly: 15% of respondents
- Quarterly: 22% of respondents
- Annually: 10% of respondents
- Finland
- Monthly: 28% of respondents
- Quarterly: 18% of respondents
- Annually: 20% of respondents
- France
- Monthly: 27% of respondents
- Quarterly: 17% of respondents
- Annually: 19% of respondents
- India
- Monthly: 29% of respondents
- Quarterly: 20% of respondents
- Annually: 10% of respondents
- Singapore
- Monthly: 28% of respondents
- Quarterly: 15% of respondents
- Annually: 17% of respondents
- UK
- Monthly: 23% of respondents
- Quarterly: 21% of respondents
- Annually: 15% of respondents
- US
- Monthly: 16% of respondents
- Quarterly: 15% of respondents
- Annually: 20% of respondents
- Number of FOIA requests received in the US for fiscal year 2017: 818,271
- Number of FOIA request processed in the US for fiscal year 2017: 823,222
- Distribution of FOIA requests in 2017 among top 5 agencies with highest number of request:
- DHS: 45%
- DOJ: 10%
- NARA: 7%
- DOD: 7%
- HHS: 4%
Examining Datasets
- Country with highest index score according to ODB Leaders Edition: Canada (76 out of 100)
- Country with lowest index score according to ODB Leaders Edition: Sierra Leone (22 out of 100)
- Number of datasets open in the top 30 governments according to ODB Leaders Edition: Fewer than 1 in 5
- Average percentage of datasets that are open in the top 30 open data governments according to ODB Leaders Edition: 19%
- Average percentage of datasets that are open in the top 30 open data governments according to ODB Leaders Edition by sector/subject:
- Budget: 30%
- Companies: 13%
- Contracts: 27%
- Crime: 17%
- Education: 13%
- Elections: 17%
- Environment: 20%
- Health: 17%
- Land: 7%
- Legislation: 13%
- Maps: 20%
- Spending: 13%
- Statistics: 27%
- Trade: 23%
- Transport: 30%
- Percentage of countries that release data on government spending according to ODB Leaders Edition: 13%
- Percentage of government data that is updated at regular intervals according to ODB Leaders Edition: 74%
- Number of datasets available through:
- Number of datasets classed as “open” in 94 places worldwide analyzed by the Open Data Index: 11%
- Percentage of open datasets in the Caribbean, according to Open Data Census: 7%
- Number of companies whose data is available through OpenCorporates: 158,589,950
City Open Data
- New York City
- Number of datasets available through NYC Open Data: 2170
- New datasets published in New York City for fiscal year 2018: 629 (2,000+ in total)
- Number of automated datasets in New York City for fiscal year 2018: 246 (38 new datasets added)
- Open data demand in New York City in fiscal year 2018 measured by:
- Singapore
- Number of datasets published in Singapore: 1,480
- Percentage of datasets with standardized format: 35%
- Percentage of datasets made as raw as possible: 25%
- Barcelona
- Number of datasets published in Barcelona: 443
- Open data demand in Barcelona measured by:
- Number of unique sessions in the month of September 2018: 5,401
- Quality of datasets published in Barcelona according to Tim Berners Lee 5-star Open Data: 3 stars
- London
- Number of datasets published in London: 762
- Number of data requests since October 2014: 325
- Bandung
- Number of datasets published in Bandung: 1,417
- Buenos Aires
- Number of datasets published in Buenos Aires: 216
- Dubai
- Number of datasets published in Dubai: 267
- Melbourne
- Number of datasets published in Melbourne: 199
Sources
- About OGP, Open Government Partnership. 2018.
- Analytical Report no. 9: The Economic Benefits of Open Data, European Data Portal, 2017.
- Creating Value through Open Data: Study on the Impact of Re-use of Public Data Resources, European Data Portal. 2015.
- European Data Portal Datasets, European Data Portal.
- Find Open Data, UK Government Data.
- Global Open Data Index: Dataset Overview, Open Knowledge International.
- Global Open Data Index: Place Overview, Open Knowledge International.
- Local Data Catalog, DATA.GOV.
- Many Americans do not trust modern institutions to protect their personal data – even as they frequently neglect cybersecurity best practices in their own personal lives, Pew Research Center – Internet and Technology. 2017.
- NYC Open Data, City of New York, 2018.
- Open Data Barometer, World Wide Web Foundation. 2017.
- Open Data Barometer 4th Edition, World Wide Web Foundation, 2017.
- Open Data Barometer Leaders Edition: From Promise to Progress, World Wide Web Foundation. 2018.
- Open Data Charter.
- Open Data for All Report, NYC DoITT, 2018.
- Open data service of the Barcelona City Council, City of Barcelona.
- Open Data in Europe, European Data Portal. 2018.
- Open Government Data: Assessing demand around the world, The Economist Intelligence Unit. 2017.
- “Policy in the Data Age: Data Enablement for the Common Good.” Karim Tadjeddine and Martin Lundqvist. McKinsey and Company. August 2016.
- Search Data, Australian Government.
- Singapore Open Data Portal, Singaporean Government.
- Starting an Open Data Initiative, The World Bank.
- Summary of Annual FOIA Reports for Fiscal Year 2017, US Department of Justice. 2017.
- The home of the U.S. Government’s Open Data, DATA.GOV, 2018.
- The Open Database of the Corporate World, Opencorporates. 2018.
- The State of Open Data Portals in Latin America. Center for Data Innovation, 2017.
- Tracking the State of Open Government Data, Open Knowledge International.
- U.S. ranks 4th in open data, with leadership by cities and states helping support the numbers, Statescoop. 2017.
- What is the Open Data Survey? Open Data Census.