What’s the value proposition for open government data?

This weekend, I asked the Govloop community to tell me about the value proposition of open government data. Today at the International Open Government Data Conference in Washington, I’ll deliver a presentation that incorporates much of that feedback. I’ve embedded it below:

The audio livestream for my presentation and those of my fellow panelists will be available below:

http://www.ustream.tv/flash/live/1/18959?v3=1

The active backchannel on Twitter is embeddded below:

http://widgets.twimg.com/j/2/widget.js

new TWTR.Widget({
version: 2,
type: ‘search’,
search: ‘#IOGDC’,
interval: 6000,
title: ‘#IOGDC in Twitter’,
subject: ‘International Open Government Data Conference’,
width: ‘auto’,
height: 300,
theme: {
shell: {
background: ‘#004d70’,
color: ‘#ffffff’
},
tweets: {
background: ‘#ffffff’,
color: ‘#444444’,
links: ‘#1985b5’
}
},
features: {
scrollbar: false,
loop: true,
live: true,
hashtags: true,
timestamp: true,
avatars: true,
toptweets: true,
behavior: ‘default’
}
}).render().start();

Geeks hacking smarter government: Kickstarter’s Andy Baio joins Expert Labs

As Anil Dash blogged earlier today, Andy Baio has joined Expert Labs as a project director for ThinkUp App. According to Dash, Baio will be working as a “Director of Hacks,” focusing on making better use of the data collected by apps like ThinkUp.

Andy’s new role marks the beginning of a whole new phase for Expert Labs; We’re now very tightly focused on working with agencies that want to get crowdsourced feedback, and the biggest request those agencies make is to better understand the ideas that people submit. We’re answering those requests with smart tools for presenting, visualizing, sorting and filtering ideas and suggestions that come in through Facebook and Twitter.

In short, we’ve already got the ability to collect responses to policy questions through a social network, and now we’ll be able to turn those responses into real insights.

In his own blog post about on joining Expert Labs, Baio elaborated further on the mission he’s taking on:

Our goal’s to help government make better decisions about policy by listening to citizens in the places they already are: social networks like Twitter and Facebook.

Our first project is ThinkUp, an open-source tool for archiving and visualizing conversations on social networks. It started with Gina scratching a personal itch, a way to parse and filter @replies. But it’s grown to be something more: a tool for policy makers to harness the collective intelligence of experts.

There’s tons to do, but I’m particularly excited to tackle ThinkUp’s ability to separate signal from noise, making it easier to derive meaning from hundreds or thousands of responses, using visualization, clustering, sentiment analysis, and robotic hamsters. I’m planning on building some fun hacks on top of ThinkUp, as well as keeping an eye open for other vectors to tackle our core mission.

And his motivations for going to work in open government:

So, why would I go to a Gov 2.0 non-profit? For three main reasons:

It’s important. To tackle our most serious national issues, we need better communication between government and citizens. I want my son to grow up in a world where he doesn’t feel disconnected and disillusioned by government, and I want government to meet the needs of the people, rather than favoring those with the most money or the loudest voices.

It’s exciting. Technology is quite possibly our best hope of breaking down that divide, using social tools to disrupt the way that governments are run and policy is made. I love designing and building tools that use social connections to tackle difficult problems, and it feels like government is an area ripe for disruption.

I love the team. I’ve known Anil and Gina for years and have long admired their work. They’re both extraordinarily talented and creative people, and I feel lucky to call them both friends. The opportunity to work with them was too hard to pass up.

Welcome to the Gov 2.0 community, Andy. I saw him hard at work at the first FCC Open Developer Day in Washington this week, where we talked more about what it means to have members of the technology community work on technology to make government function more effectively.

When high profile members of the Web 2.0 community pitch in, their networks will learn more about what’s going on. Call it “digital diffusion.” That attention, scrutiny and tinkering is likely to be a good outcome for everyone.

For more on that count, I interviewed Expert Labs’ Gina Trapani at the FCC about ThinkUp app, the apps that came out of the developer day and this issue: what does it mean when geeks try to help government work better. It was a great conversation and I encourage readers of this blog to embed it elsewhere.

San Francisco passes municipal open data law

Yesterday, the San Francisco Board of Overseers voted unanimously to approve the first municipal an open data law* in the United States. November 9, 2010 is a milestone for open government.

That said, the moment comes with major caveats on open data appetite vs reality, as John Wonderlich points out at the Sunlight Foundation.

Here are the changes that came out of the committee, though:

AMENDED on Page 2, Lines 2-6 by adding ‘make reasonable efforts to’ after ‘shall’; deleting ‘all’ after ‘available’; adding ‘and with applicable law, including laws related to privacy’ after ‘(“COIT”)’; Page 3, Line 2 by deleting ‘all’ after ‘accounting of’; and on Page 3, Line 5 by replacing ‘would’ with ‘could’.
Those changes are comical. The ordinance now mandates that agencies have to try to follow the standards set by an IT oversight body, to release some information based on an audit of some subset of public data.

This is the language of the low-hanging fruit — the kind of aspirational mandate that isn’t really a mandate at all, but more of a statement of goals and principles, lofty rhetoric with a roadmap made up of other road maps, and plans for other plans.

Again, this declaration, and the others like it, aren’t inappropriate. Their effects probably vary based on the context, based on the actual commitment of everyone involved, from government officials to citizens.
If all these declarations do is to win some of the easy fights, then they’re well worth the effort, because those obvious decisions (like open local transit data) have been gotten wrong far too often in the past, and can have significant positive effects when they’re gotten right.
We need to avoid, however, thinking that these top-level political declarations are something they aren’t. Governments have a vast stores of information, and most of it won’t be reached by these pronouncements. There’s a whole world between the initial urge for government to “put all its data online” and the “please try to put some data online better when you remember to” that that urge decays into. At the first sign of trouble, “all” disappears, “must” becomes “should,” and a mandate becomes a suggestion. The San Francisco ordinance demonstrates just how far a vision for transparency can be from the kind of nuance and structure that makes it possible.

Wonderlich is onto something here. Read the whole thing.

*CORRECTION: As Philip Ashlock pointed out, “Portland’s open data & open source legislation passed a year ago in Oregon, though it wasn’t as explicit as San Francisco’s. See open data policy [at CivicCommons].” In his comment to FreeGovInfo’s story, he notes that Portland’s “law was largely influenced by the legislation passed in Vancouver about six months before that. The major difference (and a very important one) with San Francisco’s new legislation is that it is more explicit about using open licenses with the open data.”

I regret the error; the tweet from the White House @OpenGov account (“San Francisco passes first municipal open data law”) led me astray.

The text of the law is embedded below, courtesy of Chris Dorobek at Federal News Radio.

San Francisco open data law (11.09.2010) http://d1.scribdassets.com/ScribdViewer.swf

HHS CTO Todd Park on HealthData.gov, Text4Baby and open health data

The first chief technology officer of the Department of Health and Human Services (HHS), Todd Park, has been working hard to make community health data as useful as weather data. If that vision for open government at HHS matures, the innovation released in the private sector could meet or exceed the billions of dollars unlocked by GPS or NOAA data. To see the first steps in that direction, look no further than the healthcare apps that have already gone online, like the integration of community health data into Bing search results.

Park shared the next step in opening up health data last month out in California, when he announced HealthData.gov at the San Francisco Healthcamp. When interviewed yesterday at the mHealth Summit in Washington, Park shared more details about HealthData.gov, which he says will launch in December. He also shared a new goal for text4baby yesterday, which has now grown to be the biggest mobile health platform in the United States: 1 million moms by 2012.

HealthData.gov will be a new part of Data.gov with a health data catalog, including a roster of new public and private applications using the data, said Park. The site will launch with a new tool, a “Health Indicator Warehouse” with over 2000 metrics for United States, state and county health. HealthData.gov will also host an online community dedicated to health data, which should allow practitioners, technologists and entrepreneurs to learn from one another. The site is the next step in the framework HHS has created for government to act as a platform through the Community Health Data Initiative. The next question will be whether these applications lead to better outcomes for citizens and businesses that expand, bringing on new workers. Measuring that meaningful outcome will require more time.

Curry and Co-Creation: A new US-Indian Partnership on Open Government

What will a new US-India partnership on open government mean to the two countries? Shared resources, shared technologies, and maybe, a culture that trends towards a more open, accountable and participatory government.

No one who has watched the progress of open government in the United States would posit that it’s been an easy path. In India, the challenges are, if anything, even greater, given the immensity of the issues posed to the country’s population by poverty or literacy, a legacy of bureaucratic intransigence or outright corruption. There’s a reality behind Ipaidabribe.com Indian website that speaks volumes about that culture.

That said, there are many reasons to be hopeful about this open government partnership, particularly around the growth of mobile technology as a means of reporting issues.

President Barack Obama and Prime Minister Manmohan Singh of India walk down the Cross Hall

Image Source: White House Flickr Account

As Nancy Scola points out at techPresident, learning Indian-style open government offers many opportunities to adopt the rapidly evolving platforms for mobile citizen participation from India.

For a sense of how such platforms can grow, look no further than Ushahidi, which was originally created to be an election reporting platform in Kenya.

Now we’ve got a joint statement from Obama and Singh, striking in how it frames the United States as a junior partner in the open government partnership. It noticeably credits the progress India has made in using technology to empower democratic engagement while striking a decidely more aspirational tone when it comes to the Obama adminstration’s work in the open government field: “This will build on India’s impressive achievements in this area in recent years and the commitments [link] that the President made to advance an open government agenda at the United Nations General Assembly.”

That statement is embedded below:

Us-India Open Government Partnership http://d1.scribdassets.com/ScribdViewer.swf

In his remarks to a joint session of the Indian parliament in New Delhi, President Obama elaborated further on his vision for an Indian-US partnership on open government:

In the United States, my administration has worked to make government more open and transparent and accountable to people. Here in India, you’re harnessing technologies to do the same, as I saw yesterday at an expo in Mumbai. Your landmark Right to Information Act is empowering citizens with the ability to get the services to which they’re entitled — (applause) — and to hold officials accountable. Voters can get information about candidates by text message. And you’re delivering education and health care services to rural communities, as I saw yesterday when I joined an e-panchayat with villagers in Rajasthan.

Now, in a new collaboration on open government, our two countries are going to share our experience, identify what works, and develop the next generation of tools to empower citizens. And in another example of how American and Indian partnership can address global challenges, we’re going to share these innovations with civil society groups and countries around the world. We’re going to show that democracy, more than any other form of government, delivers for the common man —- and woman.

The question, as ever, is what this will practically mean when the glow induced by lofty rhetoric fades and the hard work of open government moves forward. The US-Indian open government dialog might mean more open source collaboration. As Information Week reported, a US-India partnership on open government practically includes $1 million dollars “toward public efforts to share best practices in working toward improved services and democratic accountability.” In the United States, that might not go very far. In the Indian subcontinent, it might be enough to seed funding for a number of mobile platforms to grow.

As Steve Ressler pointed out at Govloop, the mobile aspect of open government mainstream deserves special note. Why? Tom Friedman’s recent New York Times op-ed on the growth of mobile technology in India highlighted the same thing that Scola did: the potential to leapfrog a generation in wireless tech and see the creation of many new businesses:

India today is this unusual combination of a country with millions of people making $2 and $3 a day, but with a growing economy, an increasing amount of cheap connectivity and a rising number of skilled technologists looking to make their fortune by inventing low-cost solutions to every problem you can imagine. In the next decade, I predict, we will see some really disruptive business models coming out of here — to a neighborhood near you. If you thought the rate of change was fast thanks to the garage innovators of Silicon Valley, wait until the garages of Delhi, Mumbai and Bangalore get fully up to speed. I sure hope we’re ready.

If just a few of those mobile entrepreneurs focus on creating platforms for open government, the civic surplus of hundreds of millions of citizens in India and abroad could be harnessed to co-create government on a scale never witnessed before in history. There are reasons to be be skeptical, naturally, but the opportunity is there.

Data BBQ features District tech entrepreneurs, passion and tasty open data.

Get off your index and build your Rolodex,” read the invite to last night’s Data BBQ in Washington, D.C.

And last night, that’s exactly what over a hundred people from around D.C.’s growing tech scene did, spilling out of the revamped officers of Insomniac Design in Bladgen Alley, near Mount Vernon Square.

The crowd was leavened with many attendees from the ongoing mHealth Summit 2010, manyof DC’s open data geeks and supporters and. Expert Labs’ Gina Trapani and Waxy.org’s Andy Baio came by from the FCC’s Open Developer Day to mix and mingle too. The highlight of the Data BBQ was the lightning talks, where attendees pitched projects, ideas, jobs or even spare rooms to the crowd. The talks are embedded below:

Many of the mHealth conferees no doubt know about the Health 2.0 Developer Challenge from the Department of Health and Human Services, where health data is being mashed up into new applications.

And, judging by the show of hands, many of the Data BBQ’ers had also heard about the World Bank’s Global Apps for Development Competition, which is looking to the development and practitioner communities to create innovative apps using World Bank data.

What might have been new to a few, at least, was the upcoming Apps for Army competition for the public, where the successful apps competition that Peter Corbett and iStrategy Labs helped the Army run will be rebooted for wider participation.

FCC hosts developer day focused on open government innovation

Will a rebooted FCC.gov become a platform for an ecosystem of applications driven by open government data? If that vision is going to come to fruition, the nation’s pre-eminent communication regulator will have to do more than just publish open data sets in machine readable formats online: it will have to develop a community of software developers that benefits to creating such applications.

Monday’s FCC developer day is a first step towards that future. Whether it’s a successful one will be in part predicated upon whether the applications created by the “civic hackers” present help citizens, businesses or other organizations do something new or ease a given process.

UPDATE: One key member of the open government community is the founder of Development Seed, Eric Gunderson. Gunderson has been involved in some of the most innovative mapping projects in open government over the past few years, along with the development of the platform for the new data.worldbank.org. If you’re looking for an unvarnished assessment of the meaning of the FCC’s effort and developer outreach, look no further:

Does it make sense to experiment? “In an online world, the best ideas can and do come from anyone, anywhere,” said FCC chairman Genachowski in a prepared statement. “Tapping into the innovation happening at the edge and in the cloud is a no brainer. The FCC’s first-ever Open Developer Day imports a best practice from the tech industry to help improve accessibility. It is part of our ongoing effort to harness technology to transform the FCC into a model of excellence in government.”

As the statement hints, addressing the requirements of the 21st Century Communications and Video Accessibility Act that President Obama signed into law last month.

In order to meet that goal, the FCC is taking an open government tack, asking the civic development community to contribute to that effort. The agency’s first data officer, Greg Elin, explained more about the constituents for today’s dev day on the Blogband blog:

Programmers from the Yahoo! Developer Network will be on hand to demo their tools and provide guidance. They will give an overview of YQL, their query language which allows developers to “access and shape data across the Internet through one simple language, eliminating the need to learn how to call different APIs.” We will also see a demonstration of their YUI Library, a set of “utilities and controls … for building richly interactive web applications.”

An undertone, pervading a significant strand of the discussion, will be the 21st Century Communications and Video Accessibility Act. In signing the act last month, President Obama said the act “will make it easier for people who are deaf, blind or live with a visual impairment to do what many of us take for granted…  It sets new standards so that Americans with disabilities can take advantage of the technology our economy depends on.”

The full day event will start at 9:00am and take place in Washington, DC at FCC headquarters. All developers are welcome free of charge. Bring a laptop and RSVP soon. If you’re not in the DC area and are unable to make it down here, we will be live streaming portions of the day. You can also join the discussion on Twitter using the hashtag #fccdevday. To email questions write to livequestions [at] fcc [dot] gov. You can participate by visiting Accessible Event, and entering the event code 00520237

For more context on what the FCC is trying to accomplish with FCC.gov/developer, watch a speech from the chairman and managing director Steve Van Roeckel at the 2010 Gov 2.0 Summit, below:

Linking up WhiteHouse.gov and a new US-India Partnership on Open Government

After an election that saw open government make gains in statehouses across the United States, a new transcontinental partnership offers new opportunities for international collaboration. This afternoon, Samantha Power, special assistant to the President for multilateral affairs and human rights, blogged about a new US-India partnership on open government at WhiteHouse.gov. Her post describes President Obama’s visit to an “Expo on Democracy and Open Government” at St. Xavier’s College in Mumbai and the technologies and organizations he encountered there. According to Power:

“India’s dynamism in the technology sector is well known, as is Gandhi’s legacy in India of civic action and bottom-up change, but today’s expo highlighted something very fresh: Indian civil society’s harnessing of innovation and technology to strengthen India’s democracy — by fighting corruption, holding government officials accountable, and empowering citizens to be the change they seek.”

Power’s post is thorough, descriptive and contextualizes the president’s trip and the growing use of technology to fight corruption and improve accountability in India. It also contains only one link that’s relevant to the organizations that were at said “Expo on Democracy and Open Government.” Ipaidabribe.com was created by Janagraaha to enable “Indians upload videos of their experiences in paying a bribe, in refusing to pay a bribe, and in ‘not having to pay a bribe.'”

The expo itself does not appear to have a website, or at least one that could be discovered after a few minutes of searching online.

The closest thing to an online FAQ is the White House press release on “Indian Innovations in Expo for Democracy and Open Government posted at America.gov, where the participating organizations are listed and described. Neither the WhiteHouse.gov blog post nor the release contains that most elemental of online elements: hyperlinks to the relevant person, place or thing being described. For some readers, used to the limitations of print, that may not be a huge issue. For digital natives or immigrants, the absence of links is a big missed opportunity.

The reason that critique is particularly fresh this afternoon is that one of the archetypal bloggers on the Web, David Winer, made the argument at Scripting News today that WhiteHouse.gov should be a hyperlocal blog. Specifically:

The sitting President can’t run campaign ads as an aspiring President does. But he has the ability to communicate more effectively than anyone else on the planet, if that power is developed. If you send people away to places that involve them. The White House blog should be a daily link list of ideas and perspectives on what’s happening in the world.

For instance, Power could have linked to the press briefing at USAID.gov where she, Secretary of Agriculture Tom Vilsack, USAID Administrator Raj Shah and Chief Technology Officer Aneesh Chopra talk about yesterday’s agricultural exposition, including her comments on this open government partnership. For example:

one of the things that we’ve been doing is really learning as a government just how rich the innovations are in a lot of emerging democracies, and indeed, in a lot of new democracies and transitional democracies. No one country has a monopoly on innovation in this space. And it’s indeed quite inspiring to see how even with very few resources you can see how creative nongovernmental actors are, or indeed champions within government who are stepping forward and taking advantage of new technologies and so forth to try to enhance partnership or transparency.

So having said that, I still think India has a huge number of comparative advantages. I mean, for starters it has one of the most noble traditions in human history of bottom-up change and bottom-up activism. I mean, the whole history of modern India is rooted in what you might call the original “Yes, we can” with Mr. Gandhi and the movement that he created and the billions of people that he inspired around the world, one of whom, as the President said today, was Martin Luther King, without whom, arguably, we wouldn’t be where we are in my own country.

So this tradition of bottom-up change, of citizen demand the quality of demand that one encounters out in the most rural areas and some of the most impoverished areas here, even among people who haven’t yet acquired literacy in their communities.

For an administration that’s embraced the idea and practice of Gov 2.0 in many notable ways, failing to link in even a Web 1.0 way is surprising. And to be fair, this post was an exception. The White House blog has frequently made good use of links, video and images, as shown by this week’s WhiteHouse.gov weekly wrapup.

For the sake of the broader open government community who may be interested, here’s the list of participants in that Expo from the press release, this time with links to the relevant organizations or news coverage, where such websites are not available:

An Illustrative List of Exhibitors and Roundtable Participants:

· Mazdoor Kisan Shakti Sangathana (Workers and Peasants Strength Union – MKSS) is an organization that fights against government corruption and creates channels for citizens to oversee their local governments. Its leader, Aruna Roy, is best known as a prominent leader of the Right to Information movement in India which led to Parliament’s passage of the Right to Information Act in 2005, which has empowered millions of ordinary Indians.

· Satark Nagrik Sangathan (SNS) is a New Delhi based citizen’s group with a mandate to promote accountability and transparency in government functioning. SNS’s key activities have been to promote the use of the Right to Information Act (RTI) by training citizens, particularly women in slum areas, to use the RTI and on the functioning of the government in areas such as rations, civic works, education and social welfare schemes. More recently, SNS has used the RTI to collect information on the performance of elected representatives and develop report cards.

· Janaagraha is a Bangalore-based NGO that works with citizens and government to change the quality of life in India’s cities and towns, focusing on urban infrastructure and citizen engagement with public institutions, including volunteerism. They also recently launched an exciting initiative called IPAIDABRIBE.com, a web platform for where people who have been asked for or ever had to pay a bribe are encouraged to share their experiences (after only 2 months, it gets 30,000 hits per day).

· The Hunger Project (THP) is a global organization committed to ending hunger. In India, it is committed to ignite and sustain the leadership spirit of women elected to local village councils (panchayats). THP works in 13 states of India, including Maharashtra (where Mumbai is located). By partnering with more than 90 civil society organizations, THP has worked with and supported the leadership of more than 60,000 elected women representatives.

· ASER uses simple tools to empower people nationwide to test their children’s math and reading abilities, and then hold local government accountable to outcomes. With this data, ASER creates the Annual Status of Education Report, which surveys literacy in 570 districts and 700,000 children of India with citizen participation. Each year 25,000 volunteers donate 4 days of their time to gather the data for this report.

· PRS Legislative Research (PRS) works with Members of Parliament (MPs) across party lines to provide research support on legislative and policy issues. Its aim is to complement the base of knowledge and expertise that already exists in government, citizens groups, businesses, and other research institutions. PRS also enables citizens to track the progress of legislative and policy reforms through an on-line portal.

· The Association for Democratic Reforms (ADR) works on building fair and transparent electoral and political processes in India. ADR has organized Citizen Election Watch for all major elections and discloses candidate background information in a timely manner, including through SMS technology, to the media and the public, helping them to make informed voting choices.

The takeaway for government – or any organization, for that matter – is that blogs and the Web offer new opportunities to share information, create more surface area to expose ideas to citizens and create conversations. If official accounts of new partnerships or events consist of plaintext press releases, lack a website or a post on the most prominent government blog in the world fails to include images, video or relevant links, that opportunity is being neglected.

Google Maps Mashup: World Map of Open Government Data Initiatives

Pretty cool. According to the page, it’s from Semantic-Web.at. It’s a good bet that the growth of open data and open government initiatives around the world will be a topic of conversation for the community the International Data Summit this month in Washington, D.C.

Exploring Civil Society 2.0 at the State Department

The Tech@State conference on Civil Society 2.0 offered insight into the future of technology and civics around the world from digital diplomats, nonprofit leaders and technologists. Tim O’Reilly delivered one of the most thoughtful lectures I’ve seen to date, exploring the factors that led to the success of the Web, Google, Microsoft, Amazon and the platforms that undergird our digital world.

“As you think about civil society 2.0, think about open ended platforms that you can build on, not just applications,” he said.

While his comments and those of the other presenters deserve more analysis and reporting, the four excerpts from O’Reilly’s talk below offer immediate access to the insight he shared. I’ll write more at Radar soon.

For more perspective on what civil society might mean in 2010 – or 2050 – read Nancy Scola at techPresident.

http://www.ustream.tv/flash/video/10632532?v3=1

http://www.ustream.tv/flash/video/10632190?v3=1

http://www.ustream.tv/flash/video/10632341?v3=1

http://www.ustream.tv/flash/video/10632304?v3=1