Fauxpen data, open data and bridging the data divide

My Ignite talk from the Strata Conference in NYC is online.

Comments welcome, as ever.

Update: In the context of fauxpen data, beware “openwashing:” Simply opening up data is not a replacement for a Constitution that enforces a rule of law, free and fair elections, an effective judiciary, decent schools, basic regulatory bodies or civil society — particularly if the data does not relate to meaningful aspects of society. Adopting open data and digital government reforms is not quite the same thing as good government, although they certainly can be and are related, in some cases.

If a country launches an open data platform but deprecates freedom of the press or assembly, questions freedom of information laws or restricts the ability of government scientists to speak to the public, is it adopting “open government” — or doing something else?

This is the ambiguity of open government and open data that Harlan Yu and David Robinson wrote about in 2012. Expect it to be the subject of more “takedowns” in the 2013.

Jack Dangermond on mapping, government transparency and accountability

Writing over at the ESRI blog today, founder and president Jack Dangermond shared his thoughts on how maps and GIS information can contribute to improving government transparency and accountability:

Born out of the Gov 2.0 movement, the terms transparency and accountability have become part of the daily vernacular of governments and the citizens they serve. One might even suggest these words have become a new expectation of governing. Transparency and accountability began with a simple concept of openly communicating public policy to the taxpayer. Today, these concepts are thriving within a growing emphasis on developing an interactive dialog between governments and the people.

Maps can be a very valuable part of transparency in government. Maps give people a greater understanding of the world around them. They can help tell stories and many times be more valuable than the data itself. They provide a context for taxpayers to better understand how spending or decisions are being made in a circumstance of where they work and live. Maps help us describe conditions and situations, and help tell stories, often related to one’s own understanding of content.

I spoke with Dangermond about precisely this subject last year at the Gov 2.0 Summit in Washington. I believe the interview holds up and remains relevant to the conversation around open government today.

Code for America Summit showcases civic innovation [LIVEBLOG]

What began as an idea just over two years ago is now a reality: a citizen corps of designers and programmers who committed to a year-long fellowship to Code for America. Today in San Francisco, the inaugural Code for America Summit will highlight the year past, look to the year ahead and convene a conversation around four core topics that will be familiar to people who have been following the story of Gov 2.0: citizen participation, data-driven decision making, co-Creation and co-stewardship, government as a platform. The SPUR Center is packed with civic innovators from all around the country and buzzing with energy. My liveblog is below.

Day 2

Code for America Summit (Day 2)

Day 1

Code for America Summit

Chicagobuildings.org maps vacant and abandoned buildings using open government data

One of the minds behind the Look at Cook open government data visualization app is at it again. Derek Eder wrote in this week to share another Web app he just launched (ChicagoBuildings.org) and a reminder about what’s happening in Chicago in this space.

This Web app takes 311 reports about vacant and abandoned buildings from the Chicago and visualizes them onto a searchable map. “It’s specifically set up to pull data from Chicago’s data portal,” said Eder, linking to the 311 service requests of vacant and abandoned buildings dataset.

Eder shared more about how mapping Chicago’s vacant buildings in a blog post earlier this week. The results are unsurprising: there are many more vacant buildings in areas with high poverty rates.

Eder said that the app could be used by other cities, depending on how they store or format their data. The code for
Chicago Buildings is on Github. On that front, he says that Chicago “isn’t using Open 311 yet, so this site isn’t either. That being said, it wouldn’t be too hard to hook up the same interface to a different data source.” Code for America will help Chicago to implement Open311 in 2012. Eder shared that he wrote a script that converts Socrata to Google Fusion Tables that could be modified for this purpose.

ChicagoBuildings.org is one of a growing number of civic applications that have come out of Chicago’s open government initiative. As Eder made sure to point out, his app is a finalist in the Apps for Metro Chicago contest, along with 9 other apps, including iFindItChicago and Techno Finder.

In the video below, Elizabeth Park, the creator of IFindit Chicago, talks about how she was inspired to build the team that created an Android app to help homeless and lower income citizens find resources like as shelters, medical clinics,and food pantries.

Voting for the winners ends this Friday, October 14th, so check out the community round entries and weigh in.

As a reminder: If you have open government news to share, you can always find me at @digiphile on Twitter, where I share my email address, alex@oreilly.com.

HouseLive.gov embraces open format to bring live video to mobile devices

Congress may be one of the most unpopular institutions in the land but some of its staffers are continuing to work towards bringing its communications infrastructure into the 21st century.

The United States House of Representatives has begun beta testing streaming video from the House floor directly to mobile devices via HouseLive.gov — and they’re doing it using an open format that will work on iPads, iPhones Android devices or whatever else a citizen is using.

“Streaming the House floor to mobile devices through HouseLive.gov is just one more way the House is innovating and keeping its pledge to make Congress more open and accessible to the American people,” wrote Don Seymour in a blog post on Speaker.gov.

“The Office of the Clerk began beta testing this new H.264 live streaming feed for mobile devices last week,” wrote Seymour.

At present, supported video resolution is 480×360 and the bit rate is 650 kbps, so you’ll need to have a fast mobile connection to tune in. The bottom line, however, is that the video stream should work across ALL platforms now, desktop or mobile.

Seymour explained a bit more via email “The site now works like this: 1) when someone visits HouseLive.gov, the site first defaults to Silverlight. If Silverlight is not installed, then, 2) it defaults to Flash. If Flash is not installed/available, then, 3) it defaults to HTML5.”

He also used a key term that’s familiar to the Web world: “beta,” referring to a feature that’s still not finalized. Given that open government is in beta, and looks set to remain in that phase for a long time to come, it feels apt. Seymour asks in his blog post that citizens send feedback to the Clerk’s office: “…since this feature is still in beta, please leave a comment below if you experience any difficulties. Be sure to note your device (iPhone? Blackberry?), operating system (iOS? Android?), and connection speed (Wi-fi? 3G?); we’ll pass your note along to the Clerk’s office.”

Radhika Marya covered the news about mobile video over at Mashable, adding a few bytes of context for the addition.

While we’re moving closer to House 2.0, there’s still a long way to go. Nick Judd suggests on direction at techPresident, this move puts the floor of the U.S. House in your hand:

The House Republicans have their share of tech-savvy staffers who have brought their side of the Hill out of the Stone Age when it comes to things like what a member’s website can do, for instance, encouraging lawmakers to adopt Drupal, a popular open-source content management system. They’ve also come up with new ways to interact with voters, such as YouCut and a project to solicit tales of regulatory woe from business owners. That said, in August, after Congress squeaked a debt-ceiling deal through both houses, Politifact reported that House Republicans have had trouble making good on another 21st-century promise: to post all legislation online 72 hours in advance of a vote.

Live video from the House floor on a mobile device isn’t likely to stimulate movement on the issues that matter to many citizens, including jobs, education, energy costs or healthcare, to name the hot buttons that will be discussed at tonight’s Republican primary debate. It will, however, give citizens a direct window to watch debates from wherever they are, however, and that’s a step forward. Speaking as someone who has suffered through abysmal streamed video of committee meetings many times — or not seen them online at all — here’s hoping that the next step for Congressional staff is to bring those proceedings into the 21st century soon too.

Update: Commenting on my post about this news on Google Plus, software architect David Bucci questions just how “open” the format in question is: “This gets an “interesting use of the word ‘open'” alert – first it tries SilverLight, then falls back to Flash, and then HTML5 using the patent-encumbered H.264. Umm … I’m looking for the “open” in there … ubiquitous != open. Instead of “open format”, it must mean “open access” (which I applaud).”

NASA to launch inexpensive Android ‘phonesats’ into space

Android….in….space! This morning, Will Marshall of NASA showed the Android Open Conference plans for a sub-$10,000 Nexus One “phonesat.” Given that the cost of satellites usually measure in the tens or hundreds of millions or so, that’s a rather spectacular cost savings.

Marshall says that this will be the fastest processor to govern a satellite. For reference, Mars Explorer used a 33MHz processor. It sends signals back via amateur radio packet system, rather than ground tracking. The launch video is embedded below:

Great anecdote: when a launch failed, the entire payload fell without parachute into desert. The data was left intact.

William launching 3 Android phonesats in December, in space for 3 weeks. As O’Reilly Media’s Gina Blaber pointed out, they’re “iterating Silicon Valley-style.”

For more, check out the short documentary below about the PhoneSat suborbital test launch in the Black Rock desert:

PhoneSat Rocket Launch Documentary from Ben Howard on Vimeo.

You can follow @NASA_Phonesat on Twitter — there’s no official website yet – and, according to Marshall, eventually check out code on Github, where NASA is open sourcing some software behind it. (And yes, that’s a big deal.)

Open government data gathers bipartisan support in Washington

Two weeks ago at the Strata Conference in NYC, I donned a headset, grabbed a tablet worth of questions and headed to the podium to talk with the chairman of the U.S. House Committee on Oversight and Government Reform about data and open government.

Congressman Darrell Issa (R-CA) joined me via remote webcast from chambers in Washington, D.C. Our crack video team is working on an improved version of this video in which you’ll see my side of the broadcast, along with a boost in audio. Until then, the video that the House Oversight digital team uploaded to YouTube will suffice — and I don’t want to wait to share this story any longer in the meantime, particularly as interest builds behind the principle subject of our conversation, a proposed bill to standardize financial reporting data standards in the federal government and create single database for financial spending.

Daniel Schuman listened in and summarized our conversation on open government data over at the Sunlight Foundation’s blog:

The Chairman focused his remarks on the DATA Act, the bipartisan legislation he introduced that would transform how government tracks federal spending and identifies waste, fraud, and abuse.

He emphasized the importance of making government data available online in real time so that innovative minds can immediately make use the information to build their own businesses. Business, in turn, would help the government identify program mismanagement and data quality problems. The Chairman specifically singled out Vice President Biden as a supporter of efforts to find a common solution to make data available in a systematic way.

…Chairman Issa explained that the private sector must step up as advocates for greater openness because they will benefit from building and using the tools made possible by greater transparency. He added when government drives down the cost of obtaining information, private individuals will derive value from the analysis of data, not its ownership.

The cost of good data

Since our conversation, the Congressional Budget Office has estimated that the DATA Act would cost the government $575 million to implement over 5 years, as reported by FierceGovernmentIT:

“In a cost estimate dated Sept. 16, the CBO attributes $325 million of the estimated total to requirements in the bill regarding the collecting and reporting of financial information. The DATA Act would require federal agencies, and most government contractors and grant award winners to adopt XBRL as a financial data reporting mechanism.”

Left unsaid in the CBO estimate is what the impact of this kind of transparency on the federal government’s finances might be, in terms of savings. House Oversight staff have estimated annual savings from standards and centralized spending database that would more than offset that outlay, including:

  • $41 million in funds recovered from questionable recipients
  • $63 million in funds withheld from questionable recipients
  • $5 billion in savings recommended by inspectors general
  • unknown savings resulting from better internal spending control and better oversight by Congressional appropriators.

The DATA Act, which would expand the role of the Recovery Accountability and Transparency Board to track all federal spending and make all of the information available to the public, has bipartisan support in the Senate from Senator Mark Warner (D-VA), who has introduced a companion bill there.

As NextGov reported yesterday, efforts to require government-wide spending reports have advanced on the Hill, while President Obama has begun the process of establishing a similar board by executive order.

You can read more letters of support that extend from well beyond an Open Government Coalition online over at Scribd, including:

Open government as a bipartisan issue

Given the White House’s embrace of the mantle of open government on President’s first day in office, the executive branch has gathered a lot of the press, attention, praise, scrutiny and criticism in this area.

That looks to be changing, and for the better. As Clay Johnson pointed out at the beginning of 2011, any competition between the White House and Congress on open government is likely to be a win for the American people.

Jim Harper, director of information policy studies at the Cato Foundation and webmaster of WashingtonWatch.com, wrote then that the GOP can eclipse Obama on transparency. “House Republicans can quickly outshine Obama and the Democratic Senate,” he opined. “It all depends on how they implement the watch phrase of their amendment package: “publicly available in electronic form.”

The GOP House leadership must make sure that this translates into real-time posting of bills, amendments and steps in the legislative process, in formats the Internet can work with. It’s not about documents anymore. It’s about data. Today’s Internet needs the data in these documents.

There are no technical impediments to a fully transparent Congress. Computers can handle this. The challenges, however, are institutional and practical.”

Johnson identified the moment in history as an important inflection point, and one that, if the White House rose to the challenge, could legitimately be seen as an open government win for the American people and a smarter, more accountable government.

The White House may hold the considerable advantages of the bully pulpit and the largest followings of any federal entity or politician on Twitter, for now, but that has to be balanced against the considerable new media prowess that the GOP has built up over their Democratic counterparts in Congress, where Republicans hold an edge on social media.

While some projects or choices continue to cast questions on commitment in the rank and file to open government principles, with the GOP bending new House rules, there’s progress to report. The leadership of the House of Representatives has supported the creation of open, online video archives, like House.Resource.org. The House revamped its floor feed recently, adding live XML. And House leadership has recently venerated the role of technology in making Congress more transparent, engaged and accountable.

Rep. Issa, in particularly, appears to have taken on open government as a cause and, for the moment, its rhetoric. He even tweets using the #opengov hashtag. When it comes to the legislature, “the American people have a right to all the data from Congress. They have a right,” he said at a recent forum on Congressional transparency, as reported by Diana Lopez.

Government secrecy and transparency are, in theory, non-partisan issues. In practice, they are often used a political bludgeons against an opposing party, particularly by a partisan minority, and then discarded once power is gained. For government transparency to outlast a given White House or Congress, laws and regulatory changes have to happen.

Open government has to be “baked in” to culture, practices, regulations, technology, business practices and public expectations. Needless to say, that’s going to take a while, but it looks like both the administration and some members of Congress are willing to keep trying.

As these efforts go forward, it will be up to the media, businesses, nonprofits, watchdogs and, of course, citizens to hold them accountable for actions taken, not just rhetoric.

What’s the future of the DATA Act?

I’m writing a feature article about the bill, this conversation, context for government performance data and whether open government and transparency will have any legs in the upcoming presidential campaign.

If you have any questions that are unanswered after watching the conversation, comments about the use of XBRL or perspective on the proposed law’s future in Congress, please ring in in the comments or find me at alex[at]oreilly.com.

How should Regulations.gov be using social media?

The Internet offers new opportunities to involve the public in regulatory rulemaking, including industry, media, nonprofits and citizens. A new social layer for the Web has shifted what’s possible in open government forward again, both hosting and enabling conversations. Below, one of those conversations is captured using the social media curation tool, Storify.

http://storify.com/digiphile/how-should-regulationsgov-be-using-social-media.js[View the story “How should Regulations.gov be using social media?” on Storify]