Catalyzing innovation and adding more transparency to government through the release of open data is an issue that should rise about partisan politics. At least, that was the message that Nigel Shadbolt, an advisor to the United Kingdom, delivered at a conference in Bilbao, Spain yesterday.
Opendata : les leçons à tirer de data.gov.uk, par Nigel Shadbolt from RSLNmag on Vimeo.
Shadbolt’s presentation on how they did data.gov.uk, the British open government data website will offer some fuel to the arguments of advocates in other countries or states working to justify standing up similar repositories – or defend one that are already online. In his presentation, below, Shadbolt offers up a range of arguments, including more accountability, citizen engagement, improvement to public services, government efficiency, benefits to economic and social value, and that “government as a platform” idea that continues to maintain traction around the globe.
It was only last month, after all, that the United States Congress weighed deep cuts to funding for federal open government data platforms, with the final budget slashing the White House Office of Management and Budget’s e-government fund by some 75%. As data.gov relaunches as a cloud-based platform, the arguments for open data that Shadbolt advances will need to be born out with favorable outcomes in at least a few areas over the coming year to shore up bipartisan its continued operations. The brightest hope for those outcomes is likely to come from health.data.gov, a subdomain of the main open government data repository, where the U.S. Department of Health and Services has been working to making health data as weather data.
For more on the United Kingdom’s open government initiative and the open data movement, watch Shadbolt’s talk from February 2011 of this year, embedded below:
[Hat tip to the Australia E-Government Research Center]
Data.gov relaunches as a cloud-based open data platform
There’s a new version of data.gov going online. For those keeping track, Data.gov is the open data website that the United States federal government launched two years ago. The most recent iteration integrates the services of Socrata, a Seattle-based startup that has quietly been helping cities and states around the country to get their data online. For more on the new version of Data.gov, check out explore.data.gov or watch Socrata’s introductory video about the changes.
One caveat: It was only a few weeks ago that Congress cut funding to open government data platforms by 75% – which includes data.gov. Federal CIO Vivek Kundra has not made any public statements about how the remaining $8 million dollars of the Office of Management and Budget’s e-government funds will be allocated, but given the ongoing revamp of data.gov, the smart money, so to speak, looks to be that the premier federal open government website will not only stay online but gain more functionality.
For a more personal look, here’s a video interview I recorded with Allen Vander Wallie, a program manager for Data.gov at the U.S. General Services Administration, where he talks about the potential for open data.
With a new road map, New York City aims to be the nation’s premier digital city
Today, New York City released its strategy to use technology to improve productivity, save money, attract startups and upgrade the services it provides to citizens. That’s a tall order, but then New Yorkers have rarely been know to think small or dream moderately.
“We want New York City to be the nation’s premier digital city – in how local government interacts with New Yorkers, in how New Yorkers have access to and capitalize on new technologies, and in how our tech and digital media sectors evolve, grow businesses and create jobs,” Mayor Michael Bloomberg said in a statement. His office released an official statement digital roadmap at MikeBloomberg.com. “NYC’s #digitalroadmap has 4 goals: access, open government, citizen engagement & expanding NYC’s digital job growth,” tweeted Bloomberg after the announcement.
Nick Judd secured an advance copy of NYC’s road map to the digital city over at techPresident, which I’ve embedded below, and has this analysis of some of the important bytes.
There are no explicit plans in the report for increasing the number of available datasets — such as more detailed city budget data — but do include an “apps wishlist” to streamline the process of requesting more data.
Implementing the recommendations in the report will in large part be the responsibility of city Department of Information Technology and Telecommunications Commissioner Carole Post, who is already in the process of pushing internally for updated city IT.
Archived video of today’s announcement by Mayor Bloomberg and NYC chief digital officer Rachel Sterne (which was, appropriately, livestreamed online) is embedded below.
While some media outlets will focus on NYC embracing Twitter, Facebook and Foursquare as digital partners, a notable aspect of today’s news that may fly under the radar may be that NYC.gov will be adding APIs for Open311, its open data mine and other Web efforts. Those are the open government pillars that will support New York City’s effort to architect a city as a platform. For more on how New York City is citizensourcing smarter government, head on over to Radar.
Social media will play a role in the months ahead. When Adam Sharp, Twitter’s government guy, tweeted out the Wall Street Journal above, he highlighted a feature that melds social media with old school mobile technology: the use of “Fast Follow,” a function that goes back to Twitter’s earliest days.
“New Yorkers who want to follow @nycgov by SMS can text “follow nycgov” to 40404. No @Twitter acct or computer needed,” tweeted Sharp.
That means that every resident with a phone call can receive updates from the city’s official account. It will be interesting to see if city government advertises that to its residents over the coming months, particularly in areas where Internet penetration rates are lower.
Anil Dash, native New Yorker, blogger and entrepreneur, highlighted something important in the plan that transcended any particular initiative, technology or policy: it captures New York City government thinking about the Web as a public space.
It’s an extraordinary document, and as someone who loves the web, civic engagement, public infrastructure and New York City, it feels like a momentous accomplishment, even though it marks the beginning of a years-long process, not just the end of a months-long one.
But the single biggest lesson I got from the 65-page, 11.8mb PDF is a simple one: The greatest city in the world can take shared public spaces online as seriously as it takes its public spaces in the physical world.
As you’d expect, there’s a press release about the Digital Road Map, but more reassuringly, the document demonstrates the idea of the web as public space throughout, making the idea explicit on page 43:
Maintaining digital ‘public spaces’ such as nyc.gov or 311 Online is equally important as maintaining physical public spaces like Prospect Park or the New York Public Library. Both digital and physical should be welcoming, accessible, cared for, and easy to navigate. Both must provide value to New Yorkers. And for both, regular stewardship and improvements are a necessity.
New York City’s road map for a digital city plan is embedded below. You also can download the digital city roadmap as a PDF.
NYC ODC 90day Report 5-15C(function() { var scribd = document.createElement(“script”); scribd.type = “text/javascript”; scribd.async = true; scribd.src = “http://www.scribd.com/javascripts/embed_code/inject.js”; var s = document.getElementsByTagName(“script”)[0]; s.parentNode.insertBefore(scribd, s); })();
UPDATE: There are some concerns about what happens next out there in the community. New York City resident and director of the CUNY Mapping Service at the Graduate Center of the City University of New York (CUNY) Steven Romalewski also listened in on the announcement and blogged his concerns about ‘open data fatigue“:
I always worry when I see the city touting its technology efforts without also including local Community Boards, neighborhood groups, business advocates, urban planners, other elected officials, etc. who rely on access to public data so they can hold government accountable and do their jobs better. In my view, these groups need the data moreso than app developers. That is why open data efforts and policies are so important.
But the city seems more focused on apps than on community. I understand the economic development appeal of fostering startups. But the open data movement long predated apps. I highlighted this in my post last year (see the “Misplaced Priorities” section).
Apps are great (I use them constantly, and I’ve even developed one myself). And kudos to the city and its agencies for responding to app developers and making data more open so the developers can do great things with the data (things even the city might not do).
I just hope the latest announcements by the city will result in more real and lasting efforts to make data easier to access than the latest check-in craze. The Mayor already expressed some hesitation to making data accessible when a reporter asked him about CrashStat. CrashStat is a great example of my point — it wasn’t created to be an “app” per se; it’s an effort by a local nonprofit group to use public data to educate the public and hold government agencies more accountable about traffic injuries and fatalities. But the Mayor said he didn’t even know what CrashStat was, while making excuses about not making data available if it’s not in electronic format, or needs to be vetted, or is “sensitive”. Blah blah blah – we’ve heard all that before and it undermines my confidence in the city’s pronouncements that more data will really be made open.
What is open government data? What is it good for? [FILM]
Open government data broadly refers to public sector records that have been made available to citizens. For a canonical resource on what makes such releases truly “open,” consult the 8 principles of open government data. Today, the Open Knowledge Foundation has released a terrific new short film entitled “#opendata” that offers expert perspectives on what open government data is and how it can be useful to society.
#opendata from Open Knowledge Foundation on Vimeo.
For more information, visit OpenGovernmentData.org. The film has already been translated into Czech, Spanish, Hungarian and Chinese. If you’d like to volunteer to translate it into another language, the makers of the film are actively seeking help.
In the broader context, The Economist‘s support for open government data remains salient today: “Public access to government figures is certain to release economic value and encourage entrepreneurship. That has already happened with weather data and with America’s GPS satellite-navigation system that was opened for full commercial use a decade ago. And many firms make a good living out of searching for or repackaging patent filings.”
In the United States, the open data story in healthcare is particularly compelling, from new mobile apps that spur better health decisions to data spurring changes in care at the Veterans Administration.
As Clive Thompson reported at Wired this month, public sector data can help fuel jobs, “shoving more public data into the commons could kick-start billions in economic activity.” In the transportation sector, for instance, transit data is open government fuel for economic growth.
Thompson focused on the story of Brightscope, where government data drives the innovation economy. “That’s because all that information becomes incredibly valuable in the hands of clever entrepreneurs,” wrote Thompson. “Pick any area of public life and you can imagine dozens of startups fueled by public data. I bet millions of parents would shell out a few bucks for an app that cleverly parsed school ratings, teacher news, test results, and the like.”
Google Public Data Explorer adds Census Bureau data, state government statistics
Last month, the Google Public Data Explorer went public. Today, Google added U.S. Census Bureau and state government finance statistics to the database, allowing everyone to gain new insight into our present.
The numbers may be beautifully displayed but they tell a grim tale when it comes to state budgets. The crisis in state budgets across the country will be the primary driver for the adoption of new approaches to governance and service delivery in 2011. If Gov 2.0 goes local, citizensourcing smarter government couldn’t come at a more timely moment.
Building a revolution in relevance in an age of information abundance
“We’ve had a decade’s worth of news in less than two months,” Mike Allen, chief White House correspondent for Politico. In the Saturday edition of Politico’s Playbook, Allen looked back at the Arab Spring and Japanese ongoing challenges:
It was Feb. 11 – seven weeks ago — that Mubarak fled the Arab spring, a rolling reordering of Middle East power that could wind up affecting global security as profoundly as 9/11.
It was March 11 – 15 days ago – that we woke to the news of the Japanese earthquake and tsunami, which will have ripple effects on the fragile global economy for months to come.
And, oh, we’re in three hot conflicts at once, for the first time since World War II.”
Related, in the NEW YORK TIMES: “Inundated With News, Many Find It Difficult to Keep Up on Libya”
“People interviewed across four states said that at a time when the world seems to stagger from one breathtaking news event to another — rolling turmoil across the Middle East, economic troubles at home, disaster upon disaster in Japan — the airstrikes on military targets in Libya can feel like one crisis too many.”
Through it all, I’ve been following Andy Carvin (@acarvin), whose Twitter feed has been a groundbreaking curation of the virtual community and conversation about the Middle East, including images, video, breaking news and unverified reports.
To wax metaphorical, his account has become a stream of crisis data drawn from from the data exhaust created by the fog of war across the Middle East, dutifully curated by a veteran digital journalist for up to 17 hours a day.
Carvin has linked to reports, to video and images from the front lines that are amongst the most graphic images of war I have ever seen. While such imagery is categorically horrific to view, they can help to bear witness to what is happening on the ground in countries where state media would never broadcast their like.
The vast majority of the United States, however, is not tracking what’s happening on the ground in the region so closely. NEW YORK TIMES:
“A survey by the Pew Research Center — conducted partly before and partly after the bombing raids on Libya began on March 19 — found that only 5 percent of respondents were following the events ‘very closely.’ Fifty-seven percent said they were closely following the news about Japan.”
Understanding the immensity of the challenges that face Japan, Egypt and Libya is pushing everyone’s capacity to stay informed with day to day updates, much less the larger questions of what the larger implications of these events all are for citizens, industry or government. In the context of the raw information available to the news consumer in 2011, that reality is both exciting and alarming. The tools for newsgathering and dissemination are more powerful and democratized than ever before. The open question now is how technologists and journalists will work together to improve them to provide that context that everyone needs.
Finally, an editor’s note: My deepest thanks to all of the brave and committed journalists working long hours, traveling far from their families and risking their lives under hostile regimes for the reporting that helps us make it so.
Beth Noveck on connecting the academy to open government R&D
Earlier this week, the White House convened an open government research and development summit at the National Archives. Columbia statistics professor Victoria Stodden captures some key themes from it at her blog, including smart disclosure of government data and open government at the VA. Stodden also documented the framing questions that federal CTO Aneesh Chopra asked for help answered from the academic community:
1. big data: how strengthen capacity to understand massive data?
2. new products: what constitutes high value data?
3. open platforms: what are the policy implications of enabling 3rd party apps?
4. international collaboration: what models translate to strengthen democracy internationally?
5. digital norms: what works and what doesn’t work in public engagement?
In the video below, former White House deputy CTO for open government, Beth Noveck, reflected on what the outcomes and results from the open government R&D summit at the end of the second day. If you’re interested in a report from one of the organizers, you’d be hard pressed to do any better.
The end of the beginning for open government?
The open government R&D summit has since come under criticism from one of its attendees, Expert Labs’ director of engagement Clay Johnson, for being formulaic, “self congratulatory” and not tackling the hard problems that face the country. He challenged the community to do better:
These events need to solicit public feedback from communities and organizations and we need to start telling the stories of Citizen X asked for Y to happen, we thought about it, produced it and the outcome was Z. This isn’t to say that these events aren’t helpful. It’s good to get the open government crowd together in the same room every once and awhile. But knowing the talents and brilliant minds in the room, and the energy that’s been put behind the Open Government Directive, I know we’re not tackling the problems that we could.
Noveck responded to his critique in a comment where she observed that “Hackathons don’t substitute for inviting researchers — who have never been addressed — to start studying what’s working and what’s not in order to free up people like you (and I hope me, too) to innovate and try great new experiments and to inform our work. But it’s not enough to have just the academics without the practitioners and vice versa.”
Justin Grimes, a Ph.D student who has been engaged in research in this space, was reflective after reading Johnson’s critique. “In the past few years, I’ve seen far more open gov events geared towards citizens, [developers], & industry than toward academics,” he tweeted. “Open gov is a new topic in academia; few people even know it’s out there; lot of potential there but we need more outreach. [The] purpose was to get more academics involved in conversation. Basically, government saying ‘Hey, look at our problems. Do research. Help us.'”
Johnson spoke with me earlier this year about what else he sees as the key trends of Gov 2.0 and open government, including transparency as infrastructure, smarter citizenship and better platforms. Given the focus he has put on doing, vs researching or, say, “blogging about it,” it will be interesting to see what comes out of Johnson and Expert Labs next.
Making open government data visualizations that matter
Every month, more open government data is available online. Local governments are becoming data suppliers. Open healthcare data is spurring better decisions. There’s a tremendous amount of activity in open data – but there’s a long road ahead for open government. At the SXSW Interactive Festival in Austin, Texas, Jeremiah Akin and Michael Castellon made a case for “why visualizing government data makes taxpayers happy.”
The expectation of transparency is creating demand for government agencies to develop new ways to communicate complex data and trends to the public in easy-to-access and easy-to-understand formats.
Some agencies are turning to Google Maps and KML data to visualize raw information online and on mobile devices. Delivering data in more easily understandable formats not only boosts trust and confidence between government agencies and their publics, but also streamlines workloads among Data, Web, Editorial, and Customer Service teams.
The two men talked about how the Texas Comptroller is using public-facing maps to communicate with the public, including to the rapidly increasing numbers of citizens accessing government websites from mobile devices.
The utility of open government data can be quite concrete, as when live tsunami data is used to help save lives. It can also help people to understand more about the virtual lines in their towns and cities. In Texas, ClaimItTexas.org shows unclaimed property in Lone Star State.
Mobile transparency
The Texas Transparency Map is also available for touchscreen mobile devices and for tablets. That’s no accident: Akin said that mobile traffic to the site up four-fold since lat year.
“We’re seeing a lot more mobile access,” he said. “If we want to make it available on multiple devices, we need to create in a way that can be displayed.” That insight is a crucial one, and reverberates far beyond the government sphere. By choosing to develop non-native Web applications written in HTML5, Javascript and JSON, this cohort of Texas government avoided “Shiny App Syndrome.” Next steps include support for street level detail, Google Fusion tables, and geolocation.
Putting open government data to work
“Open government data has been used for a long time,” said Akin, citing the use of census data in newspapers. A new class of new media journalism is putting data to use in innovative ways, pointed out Castellon. “The Texas Tribune is one of the leaders in data visualization,” he said, which helps citizens to make sense of government data.
The key here, emphasized Akin, is that is not just enough to simply dump data. You need ways to visualize it and make it meaningful as information. “There’s a lot of resistance – people have been there, and that’s not how they’ve done things,” he said. “If you make a visualization that makes someone’s job easier pretty soon they start coming back to you.
With better data visualizations and more information, Castellon posited that more problem solving can take place. “When you release data, especiallly with science, education or research, there are stories embedded in that data,” he said.
In this narrative, it’s up to governments to release better, clean data in consumable formats and the evolving art of data journalism to make stories from it that give citizens, businesses and elected officials insight into the complexities of modern life.
Visualizing the future of programmable cities
Technology is fueling new visions for the future of cities. Today at the South by Southwest Interactive festival, a panel considered “Web Mashup Platforms and Future Programmable Cities“. NYC chief digital officer Rachel Sterne (@RachelSterne) joined Christine Outram (@cityinnovation), Vlad Trifa (@vladounet) and Dominique Guinard (@domguinard) in exploring how open data, mobile platforms and citizen engagement will shape what comes next in urban life.
Below, visual notes by OgilvyNotes and ImageThink capture the conversation.
For more on how cities are embracing new platforms and technologies, learn about citizensourcing smarter government in New York City.
[Hat Tip: Rachel Sterne]
USA.gov adds 1.USA.gov URL shortener for civilian use
Last year, the United States General Services Administration (GSA) launched the Go.USA.gov URL shortener at the Gov 2.0 Expo in Washington, D.C. Today, USA.gov soft-launched a way for citizens to create shortened USA.gov URLs as well. Whenever someone uses Bit.ly (or any service that uses Bit.ly, like Tweetdeck or the Twitter app for iPhone) to shorten a .gov or .mil URL, the link will be converted to a short 1.USA.gov.
For those feeling a bit dizzied by acronyms, URL stands for “uniform resource locator.” A URL is the Web address, like, say, govfresh.com, that a citizen types into a Web browser to go to a site. Many URLs are long, which makes sharing them on Twitter or other mobile platforms awkward. As a result, many people share shortened versions. One of the challenges that face users is that, unless a citizen uses one of several tools to view what the actual hyperlink is below the link, he or she might be led astray or exposed to malicious code that was included in the original link.
This new service will make it easier for people to know when a short URL will direct them to a trustworthy official U.S. government site. “The whole idea is to improve people’s experience when dealing with government information online,” said Jed Sundwall, a contractor for USA.gov and GobiernoUSA.gov. “We keep USA.gov in the domain for usability reasons. It’s crystal clear, worldwide, that 1.USA.gov URLs point to trustworthy governmentt information.” Adriel Hampton talked with Jed Sundwall about Go.USA.gov on Gov 2.0 Radio last year. For more on how Go.USA.gov URLs work, watch Michele Chronister’s presentation from the last year’s Gov 2.0 Expo, below:
The new shortener began appearing online this Friday. According to Sundwall, ABC senior White House correspondent Jake Tapper was the first to use it when he linked to a PDF containing new unemployment information at the Bureau of Labor and Statistics: “For those asking follow-ups on unemployment, here’s the BLS link http://1.usa.gov/XUtpL”
Tapper is not alone, as many others have used the 1.USA.gov URL shortener simply by using the tools there already knew. “The beauty is that Jake used it without knowing he was using it,” said Sundwall. “We’re trying making it easy for anyone to identify .gov information as it’s being shared online,” said Sundwall.
<
1.USA.gov FAQ
Following are the GSA’s answers to frequently asked questions about 1.USA.gov.
Why did we use 1.USA.gov when go.gov or 1.us.gov would be shorter?
Including USA.gov in the shortened URLs makes them more intuitive and meaningful to users worldwide. Many Internet users may not realize that .gov is the exclusive top-level domain of the U.S. government, and USA.gov adds valuable context to the short URLs.
What if I don’t want a 1.USA.gov URL?
You can replace 1.USA.gov with bit.ly or j.mp. For example 1.USA.gov/12345 will go to the same place as j.mp/12345 or bit.ly/12345.
Is Bit.ly owned by the Libyan government?
No. Bit.ly (@bitly is an American-owned company based in New York City. While .ly is the top level Internet domain assigned to Libya, this does not mean that Libya has any stake at all in Bit.ly, the ability to access Bit.ly’s data, or the ability to control Bit.ly’s servers. On the Quora website, Bit.ly’s CEO has addressed what would happen to Bit.ly if Libya were to shut off Internet access in Libya. Regardless, we use .gov URLs, and none of the servers that power this service (or any of Bit.ly’s servers) are located in Libya.
Who uses a similar service with Bit.ly?
C-SPAN: http://cs.pn
NY Times: http://nyti.ms
NPR: http://n.pr
Facebook: http://fb.me
Pepsi: http://pep.si
Economist: http://econ.st
What does this mean for Go.USA.gov?
We will still maintain Go.USA.gov as an option for government employees to use as a URL shortener, and Go.USA.gov URLs will continue to work.
Correction: an earlier version of this story referred to the new shortener as 1.GO.USA.gov, as opposed to the shorter version. We regret the error.
E Pluribus Unum 