The International Open Data Hackathon in DC will be held at the Martin Luther King Jr. Memorial Library. The organizers encourage attendees to “bring ideas, your laptop, and help create solutions to make data more open and make better use of open data.” The list of attendees is already filling up with interesting people, including members of Washington’s open government and technology communities. The DC open data hackathon is hosted by Wikimedia DC and sponsored by civic startup PopVox.
Update: In the context of fauxpen data, beware “openwashing:” Simply opening up data is not a replacement for a Constitution that enforces a rule of law, free and fair elections, an effective judiciary, decent schools, basic regulatory bodies or civil society — particularly if the data does not relate to meaningful aspects of society. Adopting open data and digital government reforms is not quite the same thing as good government, although they certainly can be and are related, in some cases.
If a country launches an open data platform but deprecates freedom of the press or assembly, questions freedom of information laws or restricts the ability of government scientists to speak to the public, is it adopting “open government” — or doing something else?
What began as an idea just over two years ago is now a reality: a citizen corps of designers and programmers who committed to a year-long fellowship to Code for America. Today in San Francisco, the inaugural Code for America Summit will highlight the year past, look to the year ahead and convene a conversation around four core topics that will be familiar to people who have been following the story of Gov 2.0: citizen participation, data-driven decision making, co-Creation and co-stewardship, government as a platform. The SPUR Center is packed with civic innovators from all around the country and buzzing with energy. My liveblog is below.
This Web app takes 311 reports about vacant and abandoned buildings from the Chicago and visualizes them onto a searchable map. “It’s specifically set up to pull data from Chicago’s data portal,” said Eder, linking to the 311 service requests of vacant and abandoned buildings dataset.
Eder shared more about how mapping Chicago’s vacant buildings in a blog post earlier this week. The results are unsurprising: there are many more vacant buildings in areas with high poverty rates.
Eder said that the app could be used by other cities, depending on how they store or format their data. The code for Chicago Buildings is on Github. On that front, he says that Chicago “isn’t using Open 311 yet, so this site isn’t either. That being said, it wouldn’t be too hard to hook up the same interface to a different data source.” Code for America will help Chicago to implement Open311 in 2012. Eder shared that he wrote a script that converts Socrata to Google Fusion Tables that could be modified for this purpose.
In the video below, Elizabeth Park, the creator of IFindit Chicago, talks about how she was inspired to build the team that created an Android app to help homeless and lower income citizens find resources like as shelters, medical clinics,and food pantries.
Voting for the winners ends this Friday, October 14th, so check out the community round entries and weigh in.
As a reminder: If you have open government news to share, you can always find me at @digiphile on Twitter, where I share my email address, alex@oreilly.com.
Two weeks ago at the Strata Conference in NYC, I donned a headset, grabbed a tablet worth of questions and headed to the podium to talk with the chairman of the U.S. House Committee on Oversight and Government Reform about data and open government.
Congressman Darrell Issa (R-CA) joined me via remote webcast from chambers in Washington, D.C. Our crack video team is working on an improved version of this video in which you’ll see my side of the broadcast, along with a boost in audio. Until then, the video that the House Oversight digital team uploaded to YouTube will suffice — and I don’t want to wait to share this story any longer in the meantime, particularly as interest builds behind the principle subject of our conversation, a proposed bill to standardize financial reporting data standards in the federal government and create single database for financial spending.
Daniel Schuman listened in and summarized our conversation on open government data over at the Sunlight Foundation’s blog:
The Chairman focused his remarks on the DATA Act, the bipartisan legislation he introduced that would transform how government tracks federal spending and identifies waste, fraud, and abuse.
He emphasized the importance of making government data available online in real time so that innovative minds can immediately make use the information to build their own businesses. Business, in turn, would help the government identify program mismanagement and data quality problems. The Chairman specifically singled out Vice President Biden as a supporter of efforts to find a common solution to make data available in a systematic way.
…Chairman Issa explained that the private sector must step up as advocates for greater openness because they will benefit from building and using the tools made possible by greater transparency. He added when government drives down the cost of obtaining information, private individuals will derive value from the analysis of data, not its ownership.
“In a cost estimate dated Sept. 16, the CBO attributes $325 million of the estimated total to requirements in the bill regarding the collecting and reporting of financial information. The DATA Act would require federal agencies, and most government contractors and grant award winners to adopt XBRL as a financial data reporting mechanism.”
Left unsaid in the CBO estimate is what the impact of this kind of transparency on the federal government’s finances might be, in terms of savings. House Oversight staff have estimated annual savings from standards and centralized spending database that would more than offset that outlay, including:
$41 million in funds recovered from questionable recipients
$63 million in funds withheld from questionable recipients
$5 billion in savings recommended by inspectors general
unknown savings resulting from better internal spending control and better oversight by Congressional appropriators.
The DATA Act, which would expand the role of the Recovery Accountability and Transparency Board to track all federal spending and make all of the information available to the public, has bipartisan support in the Senate from Senator Mark Warner (D-VA), who has introduced a companion bill there.
Given the White House’s embrace of the mantle of open government on President’s first day in office, the executive branch has gathered a lot of the press, attention, praise, scrutiny and criticism in this area.
That looks to be changing, and for the better. As Clay Johnson pointed out at the beginning of 2011, any competition between the White House and Congress on open government is likely to be a win for the American people.
Jim Harper, director of information policy studies at the Cato Foundation and webmaster of WashingtonWatch.com, wrote then that the GOP can eclipse Obama on transparency. “House Republicans can quickly outshine Obama and the Democratic Senate,” he opined. “It all depends on how they implement the watch phrase of their amendment package: “publicly available in electronic form.”
The GOP House leadership must make sure that this translates into real-time posting of bills, amendments and steps in the legislative process, in formats the Internet can work with. It’s not about documents anymore. It’s about data. Today’s Internet needs the data in these documents.
There are no technical impediments to a fully transparent Congress. Computers can handle this. The challenges, however, are institutional and practical.”
Johnson identified the moment in history as an important inflection point, and one that, if the White House rose to the challenge, could legitimately be seen as an open government win for the American people and a smarter, more accountable government.
The White House may hold the considerable advantages of the bully pulpit and the largest followings of any federal entity or politician on Twitter, for now, but that has to be balanced against the considerable new media prowess that the GOP has built up over their Democratic counterparts in Congress, where Republicans hold an edge on social media.
While some projects or choices continue to cast questions on commitment in the rank and file to open government principles, with the GOP bending new House rules, there’s progress to report. The leadership of the House of Representatives has supported the creation of open, online video archives, like House.Resource.org. The House revamped its floor feed recently, adding live XML. And House leadership has recently venerated the role of technology in making Congress more transparent, engaged and accountable.
Rep. Issa, in particularly, appears to have taken on open government as a cause and, for the moment, its rhetoric. He even tweets using the #opengov hashtag. When it comes to the legislature, “the American people have a right to all the data from Congress. They have a right,” he said at a recent forum on Congressional transparency, as reported by Diana Lopez.
Government secrecy and transparency are, in theory, non-partisan issues. In practice, they are often used a political bludgeons against an opposing party, particularly by a partisan minority, and then discarded once power is gained. For government transparency to outlast a given White House or Congress, laws and regulatory changes have to happen.
Open government has to be “baked in” to culture, practices, regulations, technology, business practices and public expectations. Needless to say, that’s going to take a while, but it looks like both the administration and some members of Congress are willing to keep trying.
As these efforts go forward, it will be up to the media, businesses, nonprofits, watchdogs and, of course, citizens to hold them accountable for actions taken, not just rhetoric.
What’s the future of the DATA Act?
I’m writing a feature article about the bill, this conversation, context for government performance data and whether open government and transparency will have any legs in the upcoming presidential campaign.
If you have any questions that are unanswered after watching the conversation, comments about the use of XBRL or perspective on the proposed law’s future in Congress, please ring in in the comments or find me at alex[at]oreilly.com.
After a false report that made its way online in the absence of any fact checking, a call to the White House Office of Management and Budget (OMB) or an email to the General Services Administration, I felt the need to shine a little sunlight where I think it’s needed.
First, I contacted Aneesh Chopra, the first federal CTO of the United States, who confirmed that the reports above were simply “untrue” and reported that out. According to Chopra, Data.gov will stay up and be an important part of the U.S. National Plan for Open Government. In the short run, tweeted Chopra, citizens should expect “agency support for data.gov communities. In the long run, Data.gov will become an open source open data platform. (More on that later.)
Second, consider this an “open letter” directed to Steven O’Keefe, founder of Meritalk, author of the latest article declaring that open government “is dead” because of reduced funding for OMB’s e-government fund in Congress.
Yes, people really care. Mr. Okeefe, if you aren’t against the concept of open government, why did you write an inflammatory headline about its “death,” particularly on the same week that a historic global Open Government Partnership launched?
I can think of at least 46 reasons open government is not dead. Last year, in your testimony before the United States Senate on government transparency, you said:
…We are very encouraged by the OMB and Recovery Board response to feedback from the Ogov study. President Obama’s open government initiative is analogous to President Kennedy’s commitment to go to the moon. It is a journey, and key stakeholders in government seem very receptive to building a better open government rocket
ship. The effort will doubtless yield many useful innovations along the way.
Mr. Chairman, it is our sincere hope that open government continues to build momentum in the Federal government. Much room exists for improvement. Our recommendations and observations are but a start toward establishing open government as a mainstream standard operating procedure in the Federal government.
A year later, that tune has changed. As I’ve said elsewhere to the editors of the site, I do not believe that this post was worthy of getting more exposure on on OpenSource.com. The flippancy of “pass the beer nuts” is simply not in-line with the gravity of the subject.
For one, it resulted in an error-filled post by Alberto Cottica that misreported that Data.gov was going to be taken down, a mistake that he failed to apologize for nor fully corrected until directly confronted.
For another, it’s just the next in a series of FUD-filled posts that seem designed to stir up controversy with the “is dead” trope that’s sadly endemic to lazy technology journalism as opposed to sober analysis of the issues. I’ll continue to read the Sunlight Foundation’s blog and will again try to unsubscribe from Meritalk’s “cup of IT,” an email newsletter that I somehow was forced to receive after speaking at the recent GOSCON summit.
There are indeed data quality issues on Data.gov, on the IT Dashboard and on USAspending.gov, as the Sunlight Foundation and other journalists have highlighted. The data problems are evident because of open government, not the opposite. A dashboard is only as good as the data put into it. There will be bad data in any large data set. By making data about the business or performance of government public, however, government officials can and do receive feedback upon the issues with it. And as the recently released GAO report on e-government emphasized, the open government platforms need better performance metrics aligned with their goals and improved data quality.
That said, there are larger considerations.
This moment occurs within a far broader historic context, however, than the posts referenced suggest. If you consider the larger sweep of the open government movement at the state, local and international level, any analysis of open government that declares it “alive” or dead based upon funding for the OMB’s eGov fund is limited by its premise, diminished by a myopic inside-the-Beltway perspective that does little to encourage the open source community to care and much more to cause the broader online audience and a global populace stressed by war, unemployment and corruption to be more cynical.
For those looking for a serious, well-reported assessment of federal open government policies, as seen through the prism of the media, read this CJR feature on government transparency. While the assessment of the Obama administration’s promises is not kind, the author does cede that there has been marginal improvement in the past three years.
For those who want an even deep analysis by an organization dedicated to open government, read OMB Watch’s assessment of progress of open goverment. Short version: again, improvement but a long road ahead.
Open government is not simply about open data nor OMB’s initiatives, although both are important at the federal level in the United States. Open government is a mindset, a cultural change, and an ongoing process that touches upon every citizen and government official, often indirectly. The conversations about it are supported by technology, its operations are enhanced by technology, and new possibilities are catalyzed by technology. That said, technology is a tool, not an end. Defunding some programs does not mean that “open government is dead” any more than it means representative democracy has expired.
Looking back, this isn’t the first time this issue has come up. Jenn Gustetic dug into similar issues last October when there was a smattering of posts wondering if open government was dead. Luke Fretwell, of Govfresh, responded to Vivek Wadhwa’s well meaning but poorly informaed post on open government earlier this year, after Wadhwa’s Washington Post blog ran a similar headline.
As Nick Judd pointed out in his reporting on open government at the time, there are other reasons to believe that open government data may become more than an executive order soon. Stay tuned on that count.
In the meantime, we can and should do better by our communities.
Earlier today, Vivek Kundra, the first CIO of the United States, visited the Online News Association. Here’s a Storify of the tweetstream from his talk by Cristina F. Pereda.
The school year may have just begun but Congress has already received an early report card on the transparency of its legislative data. The verdict? A 2.47 GPA, on average, if you don’t include the 4 Incompletes. That’s on average a bit better than a C+, for those who’ve long since forgotten how grade point averages are computer. It also means that while Congress “passed this term,” any teacher’s note would likely include a stern warn that when it comes to legislative transparency, the student needs to show improvement before graduation.
If you’re interested in opening up the United States federal legislative system, you can tune into a livestream of special DC forum this morning where Harper and other open government stakeholders “rates Congress. Brandon Arnold, director of government affairs at the Cato Institute, will moderate a discussion between Harper, Rep. Darrell Issa, chairman of the House Committee on Oversight and Government Reform, and John Wonderlich, policy director at the Sunlight Foundation.
The Cato paper analyzes Congressional achievement through the lens of four basic concepts in data publication: authoritative sourcing, availability, machine-discoverability, and machine-readability. “Together, these practices will allow computers to automatically generate the myriad stories that the data Congress produces has to tell,” writes Harper in a blog post today. “Following these practices will allow many different users to put the data to hundreds of new uses in government oversight.
That data model used to produce this analysis should be of interest to the broader open government data community, in terms of a good matrix for rating a given legislature. “Data modeling is pretty arcane stuff, but in this model we reduced everything to ‘entities,’ each having various ‘properties,’ explained Harper. “The entities and their properties describe the logical relationships of things in the real world, like members of Congress, votes, bills, and so on. We also loosely defined several ‘markup types’ guiding how documents that come out of the legislative process should be structured and published. Then we compared the publication practices in the briefing paper to the ‘entities’ in the model.”
While the obvious takeaway is that Congress could do better, Harper gives the Senate and House due credit and time to improve. “This stuff is tough sledding,” he allowed. “The data model isn’ the last word, and there are things happening varied places on and around Capitol Hill to improve things. Several pieces of the legislative process nobody has ever talked about publishing as data before, so we forgive the fact that this isn’t already being done. If things haven’t improved in another year, then you might start to see a little more piquant commentary.”
Today at the Social Good Summit, Dr. Raj Shah, the administrator of the United States Agency for International Development (USAID) will launch a new public engagement effort to raise awareness about the devastating famine in the Horn of Africa. USAID is calling it the “FWD campaign” and it includes some interesting uses of open data, mapping and citizen engagement. USAID launched USAID.gov/FWD today and a text to donate initiative up and running in time to be amplified by the reach of Mashable’s Social Good Summit. You can txt “GIVE’ to 777444 to donate $10.
FWD stands for “Famine, War, Drought,” the unfortunate combination that lies behind the crisis in the Horn of Africa. “It also stands for our call to action,” writes in Haley Van Dyck, director of digital strategy at USAID, with an eye to getting people involved in raising awareness and “forwarding” the campaign on to friends, family and colleagues. Each of the components of the page includes the options to share on Twitter, Facebook or “FWD” on to people using email.
“Frankly, it’s the first foray the agency is taking into open government, open data, and citizen engagement online,” said Van Dyck. “We recognize there is a lot more to do on this front, but are happy to start moving the ball forward. This campaign is different than anything USAID has done in the past. It is based on informing, engaging, and connecting with the American people to partner with us on these dire but solvable problems. We want to change not only the way USAID communicates with the American public, but also the way we share information.”
Van Dyck was particularly excited about the interactive maps that USAID has built and embedded on the FWD site. The agency built the maps with open source mapping tools and published the data sets they used to make these maps on data.gov.
The combination of publishing maps and the open data that drives them simultaneously online is significantly evolved for any government agency and will serve as a worthy bar for other efforts in the future to meet. They’ve done that by migrating their data to an open, machine-readable format. In the past, we released our data in inaccessible formats – mostly PDFs — that are often unable to be used effectively, wrote Van Dyck.
“USAID is one of the premiere data collectors in the international development space,” wrote Van Dyck. “We want to start making that data open, making that data sharable, and using that data to tell stories about the crisis and the work we are doing on the ground in an interactive way.”
If, like me, your German isn’t so good, try reading it using Google Translate.
Key points:
Ulrich Freise, Berlin’s Secretary of State for Home Affairs, described Berlin’s open data site as base for administrative action that citizens could use to make decisions, find facts and involve themselves in decision-making processes.
Domscheit-Berg, a member of the Berlin Open Data Platform for Action, praised the launch as an important milestone on the way to a more transparent government in Germany.
An “Open Data Day” in Berlin this May helped introduce more government staff to the idea and resulted in a agenda that subsequently helped shape the release.
Much of the data is not machine-readable, at present, nor released under a Creative Commons license that would free to be used commercially or otherwise adapted for further civic use, as German civic developer Stefan Wehr Meyer pointed out to Heise.
While Open Data Berlin launches with just 18 data sets, there’s plenty of room to grow. Data.gov, in the US, went online with 49 data sets in 2009. Now there are over 400,000 listed there. If Berlin can similarly expand and open up more meaningful data in a manner that’s usable to Germany’s civic developers, there will be more Deutchland data stories to tell this year.
What began as an idea just over 
E Pluribus Unum 