White House hosts online webchat on anniversary of Open Government Directive

Tomorrow, December 8, is the one year anniversary of the White House Open Government Directive, which which required federal agencies to take steps to achieve key milestones in transparency, participation, and collaboration. At 2:00 PM EST, the first United States chief technology officer, Aneesh Chopra, will join OMB chief information officer Vivek Kundra and Cass Sunstein, administrator of the Office of Information and Regulatory Affairs, in a live web chat at WhiteHouse.gov/live. Video of the webcast is embedded below:

The @OpenGov account and White House solicited questions through an online form tool at WhiteHouse.gov and through the White House Facebook page. The chat itself will be hosted using the White House Live Facebook app and streamed live online through WhiteHouse.gov/live or, presumably, the White House iPhone app. Watch for whether any three of the White House officials answer questions on Wikileaks and open government. (UPDATE: They didn’t.) President Obama’s press conference on a tax deal with the GOP superseded the original chat on Tuesday, which the @WhiteHouseOSTP account confirmed.

I’ll be liveblogging the chat here using CoverItLive, embedded below:

White House Open Government Live Chat

The Sunlight Foundation released the following statement on the one year anniversary of the open government directive:

“In its first year, the Open Government Directive made government transparency a priority and encouraged federal agencies to put important information online. While more government information is now available online, the Directive’s limitations have also become clearer. Simply put, the president’s commitment to transparency is not yet living up to its full potential. The Open Government Directive is a great starting point, but the hard work that is needed to create a truly open government is still ahead of us.

“Agencies such as the Department of Labor, Health and Human Services and NASA have led the way in releasing data, and the working groups created among key staff have brought about real cultural change within agencies. But all of these initiatives need a steady hand and a clear commitment from the White House to mature into permanent, reliable, effective policies that result in meaningful data online.

“More concentrated work is needed to move beyond the easy wins. The administration has to give stronger direction and urge the agencies to move forward if the promise of an open government is to be realized.”

Sunlight’s recommendations for a more open government are available online at http://sunlightfoundation.com/policy/documents/agenda/.

John Wonderlich of the Sunlight Foundation is also liveblogging.

For more context on White House open government innovation, review the following pieces:

The open government community will likely be discussing the chat on Twitter.  Embedded below is a curated list of open government accounts:

//

A Day in the Life of Twitter: Jakarta glows as brightly as New York and San Francisco

.bbpBox10716694204911616 {background:url(http://s.twimg.com/a/1290538325/images/themes/theme2/bg.gif) #C6E2EE;padding:20px;} p.bbpTweet{background:#fff;padding:10px 12px 10px 12px;margin:0;min-height:48px;color:#000;font-size:18px !important;line-height:22px;-moz-border-radius:5px;-webkit-border-radius:5px} p.bbpTweet span.metadata{display:block;width:100%;clear:both;margin-top:8px;padding-top:12px;height:40px;border-top:1px solid #fff;border-top:1px solid #e6e6e6} p.bbpTweet span.metadata span.author{line-height:19px} p.bbpTweet span.metadata span.author img{float:left;margin:0 7px 0 0px;width:38px;height:38px} p.bbpTweet a:hover{text-decoration:underline}p.bbpTweet span.timestamp{font-size:12px;display:block}

#Indonesia has the highest percentage of web users on #Twitter. Blogging/micro-blogging has been adopted and adapted in powerful ways here.less than a minute ago via txt

You can see that activity flare brightly in this extraordinary visualization of mapping a day in the life of Twitter by Chris McDowall.

From the video description of “Mapping a Day in the Life of Twitter” by Chris McDowall on Vimeo.

Last week I hooked a computer up to the Twitter data streaming API and, over the course of a day, grabbed every tweet that had geographic coordinates. I wrote a Python script to parse the 2GB of JSON files and used Matplotlib with the Basemap extension to animate 25 hours of data on a world map. The resulting animation plots almost 530,000 tweets — and remember these are just tweets with geo-coordinates enabled.

I recommend you full-screen this video, turn scaling off and high definition on.

The animation begins at 5am on November 18, Greenwich Mean Time (United Kingdom). This corresponds to midnight Eastern Standard Time, 9pm Pacific Time (Nov 17) and 6pm in New Zealand (Nov 18).

There are some interesting things to note:
– It is possible to infer the passage of the sun across the map as data begins to stream out of mobile phones and desktops and previously dark patches of the map begin to glow white.
– At 8:00, 9:00 and 10:00 GMT waves of tweets pass across the United States from East to West. This is an automated Twitter service that tweets local news for specific ZIP codes.
Turn your attention to Indonesia. Jakarta glows as brightly as New York and San Francisco.
– Note the black spots. With the exception of a few cities, such as Lagos and Johannesburg, Africa remains the dark continent.

Food for thought and a feast for the eyes as the weekend draws near.

What was the story of the first FTC online privacy chat? 17 questions and answers.

http://storify.com/digiphile/the-federal-trade-commissions-first-twitter-chat.js

FTC online privacy report endorses “Do-Not-Track” mechanism for Web browsers

The Federal Trade Commission released an online privacy report today that will reshape how companies, consumers and businesses interact on the Internet. The agency will take questions from reporters at 1 PM EST and from the public on Twitter in its first Twitter chat at 3 PM EST. The recommendation that “companies should adopt a ‘privacy by design’ approach by building privacy protections into their everyday business practices” is a key direction to every startup or Global 1000 corporation that comes under the FTC’s purview as the nation’s top consumer protection regulator.

The new FTC privacy report proposes a framework that would “balance the privacy interests of consumers with innovation that relies on consumer information to develop beneficial new products and services,” according to the agency’s statement, and recommends the implementation of a “Do Not Track” mechanism, which the agency describes as “a persistent setting on consumers’ browsers – so consumers can choose whether to allow the collection of data regarding their online searching and browsing activities.”

“Technological and business ingenuity have spawned a whole new online culture and vocabulary – email, IMs, apps and blogs – that consumers have come to expect and enjoy. The FTC wants to help ensure that the growing, changing, thriving information marketplace is built on a framework that promotes privacy, transparency, business innovation and consumer choice. We believe that’s what most Americans want as well,” said FTC Chairman Jon Leibowitz.

The report states that industry efforts to address privacy through self-regulation “have been too slow, and up to now have failed to provide adequate and meaningful protection.” The framework outlined in the report is designed to reduce the burdens on consumers and businesses.

“This proposal is intended to inform policymakers, including Congress, as they develop solutions, policies, and potential laws governing privacy, and guide and motivate industry as it develops more robust and effective best practices and self-regulatory guidelines,” according to the report, which is titled, “Protecting Consumer Privacy in an Era of Rapid Change: A Proposed Framework for Businesses and Policymakers.”

“Self-regulation has not kept pace with technology,” said David Vladeck, director of the FTC’s Consumer Protection Bureau, speaking this morning about the proposed online privacy rules. “We have to simplify consumer choice and ‘do not track’ will achieve that goal,” he said. “I don’t think that under the FTC authority we could unilaterally mandate ‘do not track.'”

One of the nation’s top technology policy advocates approved. “The FTC report hits all the right notes. It sets out a modern and forward looking framework for privacy protection that moves beyond a narrow focus on notice and choice toward a full set of fair information practices and accountability measures,” said Center for Democracy and Technology president Leslie Harris. “The FTC has provided the blueprint. Now it is time for Congress and industry to follow suit.”

“We are very pleased to see the FTC exerting strong leadership on privacy,” said CDT Privacy Project Director Justin Brookman. “This report should bolster efforts to enact a privacy bill next Congress. Its recommendations are consistent with what is being discussed on the Hill.”

In a novel move, the FTC tweeted out “key points” from the report, embedded below, using @FTCGov.

“FTC proposes new framework 2 guide policymakers & industry as they develop legislation & other solutions. Self-regulation on privacy has been too slow. Important privacy choices should be presented in relevant context, not buried in privacy policy. Baseline protections of FTC’s proposed framework include reasonable security & accuracy, confidence that data collected or kept only 4 legitimate needs & privacy considered at every stage of product development. Privacy notices should be clearer, shorter & more standardized to better understand privacy practices & promote accountability. Consumers should have reasonable access to data upon request. Commission supports a more uniform mechanism for behavioral advertising: a so-called “Do Not Track”. Do Not Track could signal consumer’s choices about being tracked & receiving targeted ads.”

Below are the prepared remarks of the FTC chairman, followed by a liveblog of the press call. Audio of the FTC online privacy press call is available as an MP3.

FTC Chairman Privacy Report Remarks

FTC Online Privacy Press Conference

FTC Online Privacy Report

FTC to release online privacy report, host first Twitter chat at #FTCpriv

This fall, online privacy debates have been heating up in Washington. Tomorrow, the Federal Trade Commission will finally deliver its long awaited online privacy report. Chairman. Over the past year FTC has explored new online privacy frameworks and examined the strength of cloud computing privacy in a series of privacy roundtables.

The FTC has issued a privacy advisory for tomorrow, stating that FTC chairman Jon Leibowitz, Jessica Rich, deputy director of the Bureau of Consumer Protection, and Edward W. Felten, the FTC’s new chief technologist, will answer reporters’ questions “about a new FTC report on privacy that outlines a framework for consumers, businesses and policymakers.”

This FTC online privacy report will be one of the most important government assessments this year. Look for widespread reaction to its contents across industry and technology media. Particular attention likely be paid to two events here in Washington:

First, David Vladeck, the FTC’s director of the Bureau of Consumer Protection Protection, will speak tomorrow at Consumer Watchdog’s policy conference on the future of online consumer protections. You can watch live here (if you can stream Windows Media files.)

Second, House of Representatives will hold a hearing on “Do-Not-Track legislation, which would consider whether citizens should be able to opting of from Web tracking

Will online privacy look different by the end of the day? As Jamie Court, Author, President of Consumer Watchdog, wrote in the Huffington Post:

There are few issues 9 out of 10 Americans agree on. A Consumer Watchdog poll shows that 90% of Americans agree it is important to protect their privacy online. 86% want a “make me anonymous” button and 80% want the creation of a “do not track me” list online that would be administered by the Federal Trade Commission.

The release of the FTC online privacy report also comes with a new media twist: According to @FTCGov, the agency’s Twitter account, the nation’s top regulator will also host its first Twitter chat at 3 PM. It remains to be seen how civil citizens are in the famously snarky medium. The agency has suggested the #FTCpriv hashtag to aggregate tweets. UPDATE: Although the White House OpenGov account and FTC tweeted on Wednesday that the chat would be at #FTCpriv hashtag, not #FTCpriv, the chat ended up being at the original hashtag.

Breaking News! Tomorrow we will release our #privacy report & host our 1st Twitter Chat to answer Qs. More details to come. #FTCprivless than a minute ago via web

http://widgets.twimg.com/j/2/widget.js // <![CDATA[
new TWTR.Widget({
version: 2,
type: 'search',
search: '#FTCpriv',
interval: 6000,
title: 'FTC Privacy',
subject: 'What are people saying about the FTC Privacy report?',
width: 'auto',
height: 300,
theme: {
shell: {
background: '#094561',
color: '#ffffff'
},
tweets: {
background: '#ffffff',
color: '#444444',
links: '#1985b5'
}
},
features: {
scrollbar: false,
loop: true,
live: true,
hashtags: true,
timestamp: true,
avatars: true,
toptweets: true,
behavior: 'default'
}
}).render().start();

http://widgets.twimg.com/j/2/widget.js //

Is Wikileaks open government?

Aeschylus wrote nearly 2,500 years ago that in war, “truth is the first casualty.” His words are no doubt known to another wise man, whose strategic “maneuvers within a changing information environment” would not be an utterly foreign concept to the Greeks in the Peloponnesian War. Aeschylus and Thucydides would no doubt wonder at the capacity of the Information Age to spread truth and disinformation alike. In November 2010, it’s clear that legitimate concerns about national security must be balanced with the spirit of open government expressed by the Obama administration.

The issues created between Wikileaks and open government policies are substantial. As Samantha Power made clear in her interview on open government and transparency: “There are two factors that are always brought to bear in discussions in open government, as President Obama has made clear from the day he issued his memorandum. One is privacy, one is security.”

As the State Department made clear in its open letter to Wikileaks, the position of the United States government is that the planned release of thousands of diplomatic cables by that organization today will place military operations, diplomatic relationships and the lives of many individuals at risk.

As this post went live, the Wikileaks website is undergoing a massive distributed denial of service (DDoS) attack, though the organization’s Twitter account is far from silenced. A tweet earlier on Sunday morning noted that “El Pais, Le Monde, Speigel, Guardian & NYT will publish many US embassy cables tonight, even if WikiLeaks goes down.”

In fact, Wikileaks’ newest leak, through the early release of Der Spiegel, had long since leaked onto Twitter by midday. Adrien Chen’s assessment at Gawker? “At least from the German point of view there are no earth-shattering revelations, just a lot of candid talk about world leaders.”

The New York Times offered a similar assessment in its own report on Wikileaks, Cables Shine Light Into Secret Diplomatic Channels: “an unprecedented look at backroom bargaining by embassies around the world, brutally candid views of foreign leaders and frank assessments of nuclear and terrorist threats.”

The Lede is liveblogged reaction to Wikileaks at NYTimes.com, including the statement to Fareed Zakaria by the chairman of the Joint Chiefs of Staff, Admiral Mullen, that “the leak would put the lives of some people at risk.”

http://i.cdn.turner.com/cnn/.element/apps/cvp/3.0/swf/cnn_416x234_embed.swf?context=embed&videoId=world/2010/11/26/gps.zakaria.mullen.wikileaks.cnn

The Lede added some context for that statement:

Despite that dire warning, Robert Gates, the defense secretary, told Congress in October that a Pentagon review “to date has not revealed any sensitive intelligence sources and methods compromised by the disclosure,” of the war logs by WikiLeaks.

The Guardian put today’s release into context, reporting that the embassy cable leaks sparks a global diplomatic crisis. Among other disclosures, the Guardian reported that the cables showed “Arab leaders are privately urging an air strike on Iran and that US officials have been instructed to spy on the UN’s leadership … a major shift in relations between China and North Korea, Pakistan’s growing instability and details of clandestine US efforts to combat al-Qaida in Yemen.” The Guardian’s new interactive of diplomatic cables is one of the best places online to browse the documents.

Is the “radical transparency” that Wikileaks both advocates for – and effectively forces – by posting classified government information “open government?” The war logs from Afghanistan are likely the biggest military intelligence leak ever. At this point in 2010, it’s clear that Wikileaks represents a watershed in the difficult challenge to information control that the Internet represents for every government.

On the one hand, Open Government Directive issued by the Obama administration on December 8, 2009 explicitly rejects releasing information that would threaten national security. Open government expert Steven Aftergood was crystal clear in June on that count: Wikileaks fails the due diligence review.

On the other hand, Wikileaks is making the diplomatic and military record of the U.S. government more open to its citizens and world, albeit using a methodology on its own site that does not appear to allow for the redaction of information that could be damaging to the national security interests of the United States or its allies. “For me Wikileaks is open govt,” tweeted Dominic Campbell. “True [open government] is not determined and controlled by govts, but redistributes power to the people to decide.”

The New York Times editorial board explored some of these tensions in a note to readers on its decision to publish Wikileaks.

The Times believes that the documents serve an important public interest, illuminating the goals, successes, compromises and frustrations of American diplomacy in a way that other accounts cannot match… The Times has taken care to exclude, in its articles and in supplementary material, in print and online, information that would endanger confidential informants or compromise national security. The Times’s redactions were shared with other news organizations and communicated to WikiLeaks, in the hope that they would similarly edit the documents they planned to post online.

…the more important reason to publish these articles is that the cables tell the unvarnished story of how the government makes its biggest decisions, the decisions that cost the country most heavily in lives and money. They shed light on the motivations — and, in some cases, duplicity — of allies on the receiving end of American courtship and foreign aid. They illuminate the diplomacy surrounding two current wars and several countries, like Pakistan and Yemen, where American military involvement is growing. As daunting as it is to publish such material over official objections, it would be presumptuous to conclude that Americans have no right to know what is being done in their name.

It seems that the Times and Guardian decided to make redactions from the diplomatic cables before publication. It’s not clear how that will compare to what will be posted on Wikileaks.org alongside the War Logs and Afghan Diaries.

Open government, radical transparency and the Internet

More transparency from the military, Congress and the White House regarding the progress of wars is important, desirable and perhaps inevitable. Accountability to civilian leadership and the electorate is a bedrock principle in a representative democracy, not least because of the vast amounts of spending that has been outlaid since 9/11 in the shadow government that Dana Priest reported out in Top Secret America in the Washington Post.

Wikileaks and the Internet together add the concept of asymmetric journalism to the modern media lexicon. File asymmetric journalism next to the more traditional accountability journalism that Priest practices or the database journalism of the new media crew online at the Sunlight Foundation and similar organizations are pioneering.

As Tim O’Reilly tweeted, “wikileaks *challenges* [open government government 2.0] philosophy. Challenges are good if we rise to them.” No question about the former point. Governments that invest in the capacity to maneuver in new media environment might well fare better in the information warfare the 21st century battlefield includes.

Open government is a mindset, but goes beyond new media literacy or harnessing new technologies. The fundamental elements of open government, as least as proposed by the architects of that policy in Washington now, do not include releasing diplomatic cables regarding espionage or private assessments of of world leaders. Those priorities or guidelines will not always be followed by the governed, as Wikileaks amply demonstrates.

Increasingly, citizens are turning to the Internet for data, policy and services. Alongside the efforts of government webmasters at .gov websites, citizens will find the rich stew of social media, media conglomerates or mashups that use government and private data. That mix includes sites like Wikileaks, its chosen media partners, the recently launched WLCentral.org or new models for accountability like IPaidABribe.com.

That reality reinforces that fact that information literacy is a paramount concern for citizens in the digital age. As danah boyd has eloquently pointed out, transparency is not enough. The new media environment makes such literacy more essential than ever, particularly in the context of the “first stateless news organization” Jay Rosen has described. There’s a new kind of alliance behind the War Logs, as David Carr wrote in the New York Times.

There’s also a critical reality: in a time of war, some information can and will have to remain classified for years if those fighting them are to have any realistic chances of winning. Asymmetries of information between combatants are, after all, essential to winning maneuvers on the battlefields of the 21st century. Governments appear to be playing catchup given the changed media environment, supercharged by the power of the Internet, broadband and smartphones. This year, we’ve seen a tipping point in the relationship of government, media and techology.

Comparing the Wikileaks War Logs to the Pentagon Papers is inevitable — and not exactly valid, as ProPublica reported. It would be difficult for the military to win battles, much less wars, without control over situational awareness, operational information or effective counterintelligence.

Given the importance of the ENIGMA machine or intercepts of Japanese intel in WWII, or damage caused by subsequent counterintelligence leaks from the FBI and elsewhere, working to limit intelligence leaks that damage ongoing ops will continue to be vitally important to the military for as long as we have one. Rethinking the definitions for secrecy by default will also require hard work. As the disclosures from the most recent release continue to reverberate around the globe, the only certainty is that thousands of State Department and Defense Department workers are going to have an extra headache this winter.

A short story about Derek Willis, open data and database journalism at the New York Times

http://storify.com/digiphile/a-short-story-about-derek-willis-the-new-york-time.js

Dan Melton and Derek Willis presentations from IOGDC http://d1.scribdassets.com/ScribdViewer.swf?document_id=43042947&access_key=key-1hkrm7di0y2z92bt92iw&page=1&viewMode=slideshow

For more on how Code for America is inspiring a new generation of civic coders, tune into the webinar in the linked piece or read techPresident on how developers pledge to connect citizens.

Geeks hacking smarter government: Kickstarter’s Andy Baio joins Expert Labs

As Anil Dash blogged earlier today, Andy Baio has joined Expert Labs as a project director for ThinkUp App. According to Dash, Baio will be working as a “Director of Hacks,” focusing on making better use of the data collected by apps like ThinkUp.

Andy’s new role marks the beginning of a whole new phase for Expert Labs; We’re now very tightly focused on working with agencies that want to get crowdsourced feedback, and the biggest request those agencies make is to better understand the ideas that people submit. We’re answering those requests with smart tools for presenting, visualizing, sorting and filtering ideas and suggestions that come in through Facebook and Twitter.

In short, we’ve already got the ability to collect responses to policy questions through a social network, and now we’ll be able to turn those responses into real insights.

In his own blog post about on joining Expert Labs, Baio elaborated further on the mission he’s taking on:

Our goal’s to help government make better decisions about policy by listening to citizens in the places they already are: social networks like Twitter and Facebook.

Our first project is ThinkUp, an open-source tool for archiving and visualizing conversations on social networks. It started with Gina scratching a personal itch, a way to parse and filter @replies. But it’s grown to be something more: a tool for policy makers to harness the collective intelligence of experts.

There’s tons to do, but I’m particularly excited to tackle ThinkUp’s ability to separate signal from noise, making it easier to derive meaning from hundreds or thousands of responses, using visualization, clustering, sentiment analysis, and robotic hamsters. I’m planning on building some fun hacks on top of ThinkUp, as well as keeping an eye open for other vectors to tackle our core mission.

And his motivations for going to work in open government:

So, why would I go to a Gov 2.0 non-profit? For three main reasons:

It’s important. To tackle our most serious national issues, we need better communication between government and citizens. I want my son to grow up in a world where he doesn’t feel disconnected and disillusioned by government, and I want government to meet the needs of the people, rather than favoring those with the most money or the loudest voices.

It’s exciting. Technology is quite possibly our best hope of breaking down that divide, using social tools to disrupt the way that governments are run and policy is made. I love designing and building tools that use social connections to tackle difficult problems, and it feels like government is an area ripe for disruption.

I love the team. I’ve known Anil and Gina for years and have long admired their work. They’re both extraordinarily talented and creative people, and I feel lucky to call them both friends. The opportunity to work with them was too hard to pass up.

Welcome to the Gov 2.0 community, Andy. I saw him hard at work at the first FCC Open Developer Day in Washington this week, where we talked more about what it means to have members of the technology community work on technology to make government function more effectively.

When high profile members of the Web 2.0 community pitch in, their networks will learn more about what’s going on. Call it “digital diffusion.” That attention, scrutiny and tinkering is likely to be a good outcome for everyone.

For more on that count, I interviewed Expert Labs’ Gina Trapani at the FCC about ThinkUp app, the apps that came out of the developer day and this issue: what does it mean when geeks try to help government work better. It was a great conversation and I encourage readers of this blog to embed it elsewhere.

The NewsHour interviews Alec J. Ross on digital diplomacy and 21st Century Statecraft

What do State Department officials mean when they talk about ” 21st Century Statecraft?” The PBS Newshour’s digital correspondent, Hari Sreenivasan, sat down with Alec J. Ross, senior adviser for innovation at the State Department, to learn how technology is being leveraged to accomplish foreign policy goals. Sreenivasan subsequently published an excellent post on diplomacy and 21st Century statecraft at the Rundown, the Newshour blog, that includes the video below:

As Sreenivasan notes, the State Department has been rapidly moving forward in its use of technology, as reported in Radar on applying technology for Internet freedom. The question of whether the US should support Internet freedom through technology is a complex one, and deserves serious scrutiny as it moves forward, as evidenced by the Haystack fiasco.

What does 21st Century Statecraft mean? Sreenivasan takes a swing at reporting on Ross’s take:

In light of the seismic shifts taking place in how information and people interact and engage with one another, Ross says a broadening of the practice of statecraft is necessary. Going forward, that means using a balance of soft and hard power to enable and support relationships between non-state actors, and between representatives of governments.The prescription calls for far more than giving diplomats Twitter training, or simply using social media to push “the message” out. It is also about connecting people to resources efficiently and effectively, from NGOs to governments to people in need of aid.

In addition to spending money on new forms of digital diplomacy, the State Department has more often used its clout to convene bright minds from the private sector and the NGO world in a series of Tech@State conferences. They have included gatherings to share ideas on leveraging mobile technology, finding and empowering technology assistance in Haiti’s recovery and, more recently, rethinking Civil Society.

Sreenivasan included a host of excellent links to learn more about 21st Century statecraft, including:

  • An essay in Foreign Affairs entitled “America’s Edge” (requires one-time free registration) by Anne-Marie Slaughter. It was published around the same time that the former Dean of the Woodrow Wilson school at Princeton University was appointed as the new Director of Policy Planning at the State Department.
  • A essay by Eric Shmidt and Jared Cohen of Google titled The Digital Disruption, also in Foreign Affairs, which discusses the challenges facing diplomacy. As Sreenivasan notes, Cohen recently moved to Google from the State Department, where he had been working with Ross on 21st Century Statecraft. The New York Times Magazine covered their digital diplomacy efforts this this past summer.
  • Sam Dupont of NDN has gathered a list of 21st Century statecraft initiatives.

The Newshour has been extending its coverage into Gov 2.0 since Sreenivasan reported on the Gov 2.0 Expo and Summit earlier this year. For more of its past coverage, check out their conversation with Todd Park, the Chief Technology Officer of HHS, and excerpts from their conversation with White House Chief Technology Officer Aneesh Chopra and federak CIO Vivek Kundra. It’s a significant evolution to see Gov 2.0 be discussed on the Newshour, CBS or Dan Rather reports. Whether it’s enough to raise national awareness of open government challenges, success or failure is itself an open question.

Leveraging technology to stand up the Consumer Financial Protection Bureau

Can technology be used to create a “21st Century regulator?” Keep an eye on Elizabeth Warren as she works to stand up the new Bureau of Consumer Financial Protection over the next months. As Bill Swindell reported for NextGov, the new consumer protection agency plans to use crowdsourcing to detect issues in the market earlier. In a world where studios can use tweets to estimate movie profits or researchers can use Twitter to predict the stock market, it makes sense for government to seriously examine data mining blogs and social networks to pick up the weak signals that predate real problems. Choosing to use such a methodology is applying a lesson from Web 2.0 for Gov 2.0.

This isn’t the first time the federal government has tried to use crowdsourcing for collaborative innovation in open government, certainly, but detecting consumer fraud in a networked world is such a massive challenge that the effort deserves special attention and scrutiny. What’s the thinking here? As Warren told Swindell:

“It’s also about how we will receive information about how the world works,” she said. “It’s about how people will tell us about what is happening. I want you to think about this more like ‘heat maps’ for targeted zip codes where problems are emerging, or among certain demographic groups, or among certain issuers,” Warren said in her still-not-decorated office.

How will crowdsourcing be focused? Swindell’s article provides more insight:

“The power of enforcement will be partly about the agency. But it will be partly, in the future, be about how people crowdsource around identified problems,” Warren said. “The idea that people can talk to each other, whether it’s through the agency or from other platforms. In a sense, the whole notion of how markets work will change.”

“In the old world, it would be up for the agency to come in, and you look very slowly through a sample of the banks to see what products they mailed out. And did they add a lot of fine print, nonsense by regulation that was not supposed to be there?[Now] all of the sudden you got information, and you got it much faster, and you have it more pinpointed and that becomes relevant for purposes of where you spend enforcement resources.”

Warren elaborated further this morning on her thinking about how technology can be used to stand up the Consumer Financial Protection Bureau at the White House blog:

I think the tools that can be at the new agency’s disposal will have at least three kinds of implications. First, information technology can help ensure that the new agency remains a steady and reliable voice for American families. The kinds of monitoring and transparency that technology make possible can help this agency ward off industry capture.

Second, technology can be used to help the agency become an effective, high-performance institution that is able to update information, spot trends, and deliver government services twenty-four hours a day, seven days a week. If we set it up right from the beginning, the agency can collect and analyze data faster and get on top of problems as they occur, not years later. Think about how much sooner attention could have turned to foreclosure documentation (robo-signers and fake notaries) if, back in 2007 and 2008, the consumer agency had been in place to gather information and to act before the problem became a national scandal.

And third, technology can be used to expand publicly available data so that more people can analyze information, spot problems, and craft solutions. When these data are made available – while also, of course, protecting consumer privacy, shielding personal information and protecting proprietary business information – a shared opportunity arises between the agency and people outside government to have a hand in shaping the consumer credit world.

When Elizabeth Warren meets with Silicon Valley executives, certain technologies are likely to be of particular interest. As reported, she’ll be talking with Hal Varian, Google’s chief economist. Varian is behind a “Google price index” created through online shopping data that measures inflation. For some perspective on his thinking and why leveraging big data is one of the most important trends in IT, watch the video from last year’s Gov 2.0 Summit below:

For more perspective on how big data is being put to work across government, academia and big business, check out the excellent Strata Week series at O’Reilly Radar. Data science is shaping up to be one of the key disciplines of the 21st Century. Whether it can be put to good use by government regulators is a question that will be fascinating to see answered.

UPDATE: Warren delivered a speech to the University of California at Berkeley during her trip where she elaborated further on her vision for the new consumer protection agency. Full text of the speech is embedded below. Selected quotes on data follow.

Technology may provide new tools for the media and government to determine what’s happening – but they can and are used against consumers. As is so often the case, technology is agnostic to the purpose it is bent towards.

Today,  information  is  king—but  information  is  not  evenly  accessed  by  all.  Repeat  players  can  understand   a  complicated  financial  product  that  the  rest  of  us  have  difficulty  parsing  in  full.  Lenders  can  hire  teams   of  lawyers  to  work  out  every  detail  of  a  contract,  then  replicate  it  millions  of  times;  a  consumer  doesn’t   have  the  same  option.  And  with  technology  to  keep  track  of  every  purchase,  to  watch  every  payment   choice,  to  observe  and  record  the  rhythms  of  our  lives,  a  sophisticated  seller  can  harvest  that   information—sometimes  in  ways  that  provide  value,  but  sometimes  in  ways  that  manipulate  customers   who  will  never  see  what  happened  to  them.

Warren also talked about how technology can be used to connect the new regulator with consumers, with respect to a “virtual shingle.” We’ll all see how big those ears can be.

When  an  agency  loses  sight  of  the  public  it  is  designed  to  serve,  academics  say  it  has  been  captured.     The  new  consumer  agency  can  develop  tools  to  help  level  the  playing  field  and  discourage    capture.  The   American  people  can  have  not  just  one,  but  thousands  of  seats  at  the  table.  Even  before  the  agency   officially  opens  its  doors,  it  can  solicit  information  from  the  American  people  about  the  challenges  and   frustrations  that  they  face  with  consumer  financial  products  day  in  and  day  out—and  it  can  organize   that  information  and  put  it  to  good  use.  Data  from  the  public  can  inform  priorities,  and  it  can  signal   problems  both  to  consumers  and  businesses.         Information  technology  can  allow  us  to  hang  out  a  virtual  shingle  in  front  the  Agency  and  to  declare  our   intent  to  the  world.  It’s  a  lot  harder  to  let  yourself  fail  –  and  a  lot  easier  for  the  public  to  hold  you   accountable  –  when  you’ve  transparently  declared  your  mission  and  shared  information  the  public  can   use  to  measure  your  success  in  meeting  it.  Technology  can  force  this  agency  to  remain  true  to  its  goals.

Warren also articulated her thoughts on a “data-driven agency” and empowering citizens  “to help  expose,  early  on,  consumer  financial  tricks,” acting as a kind of collective digital neighborhood watch. It’s an interesting vision.

In  a  world  of  experts,  it’s  the  experts  that  frame  the  questions  to  be  asked,  isolate  the  problems,  sort   through  the  data  (if  there  are  any),  and  try  to  design  solutions—always  with  the  industry  looking  on  and   chiming  in.  But  we  can  do  this  differently.    

A  data  driven  agency  won’t  be  about  conventional  wisdom.  It  will  be  about  data.  And  those  data  should   come  from  many  sources—from  financial  institutions,  from  academic  studies  and  from  our  own   independent  research.  We  can  reinforce  that  approach  by  making  sure  that  our  analysts  come  from  a   diversity  of  backgrounds—finance,  law,  economics,  sociology,  housing.      

But  we  can  also  gather  data  directly  from  the  American  people  by  asking  them  to  volunteer  to  share   with  us  the  experiences  they  have  with  consumer  credit  products.  We  can  open  up  our  platform  to   families  across  the  country  who  want  to  tell  us  what  has  happened  to  them  as  they  have  used  credit   cards,  tried  to  pay  off  student  loans,  or  worked  to  correct  errors  in  a  credit  report.  We  can  learn  more   about  the  loan  application  process,  about  what  people  see  on  the  front  end  and  what  happens  on  the   back  end.  We  can  learn  about  good  practices,  bad  practices  and  downright  dangerous  practices,  and  we   can  report  on  the  good,  the  bad  and  the  ugly  to  increase  transparency  and  to  push  markets  in  the  right   direction.      

Normally,  agencies  use  supervision  and  lawsuits  to  enforce  the  law.  This  agency  will  do  that  as  the  cop   on  the  beat  watching  huge  credit  card  companies,  local  payday  lenders,  and  others  in  between.   Technology  can  help  us  do  that  better,  by  making  sure  our  enforcement  priorities  are  tightly  connected   to  the  financial  market  realities  as  experienced  by  customers  every  day.      

New  technology  can  help  us  supplement  the  cop  on  the  beat  by  building  a  neighborhood  watch.  The   agency  can  empower  a  well-­‐informed  population  to  help  expose,  early  on,  consumer  financial  tricks.  If   rules  are  being  broken,  we  don’t  need  to  wait  for  an  expert  in  Washington  to  wake  up.  If  we  set  it  up   right  from  the  beginning,  the  agency  can  collect  and  analyze  data  faster  and  get  on  top  of  problems  as   they  occur,  not  years  later.    Think  about  how  much  sooner  attention  could  have  turned  to  foreclosure   documentation  (robo-­‐signers  and  fake  notaries)  if,  back  in  2007  and  2008,  the  consumer  agency  had   been  in  place  to  blow  the  whistle  before  the  problem  became  a  national  scandal.        
The  agency  may  also  be  able  to  demonstrate  how  incentives  can  change  when  people  are  connected  not   only  to  the  government,  but  also  to  each  other.  Through  crowd-­‐sourcing  technology,  consumers  can   deal  collectively  with  those  who  would  take  advantage  of  them—and  can  reward  those  who  provide   excellent  products  and  services.  Imagine  scanning  a  credit  agreement  and  uploading  to  a  website  where   software  can  analyze  the  text  of  the  agreement.  A  consumer  could  help  the  agency  spot  new   agreements  on  the  market  and  customers  could  get  more  information  as  they  make  decisions.    The  new   CARD  Act  requires  credit  card  issuers  to  submit  their  agreements  to  the  Federal  Reserve  for  posting.     That’s  a  model  we  can  build  on.     Information  –  fast,  accurate  information  from  a  variety  of  sources  –  has  the  power  to  transform  the  old   measures  of  agency  effectiveness.    

Warren was also thoughtful about the risks and opportunities of using government data. She also alluded to the potential for entrepreneurs to develop apps to create something of value, an aspect of Gov 2.0 that has been widely articulated through the Obama administration’s IT officials.

As  a  researcher,  I  understand  that  data  must  always  be  handled  carefully,  and  protection  of  personal   data  and  proprietary  models  is  paramount.  But  I  also  believe  that  better  data,  made  available  to  the   media,  private  investors,  scholars  and  others,  will,  over  time,  produce  better  results.  When  data  are   widely  shared,  others  can  use  those  data  to  uncover  new  problems,  to  frame  those  problems  in   different  ways,  to  propose  their  own  public  policy  solutions,  and,  for  the  entrepreneurs  in  the  group,  to   develop  their  own  private  apps  to  create  something  of  value.  I’ve  seen  some  good  ideas  in  my  time,  and   I’ve  learned  that  those  ideas  can  come  from  unlikely  places.  I’m  hopeful  that,  as  we  drive  consumer   credit  markets  toward  working  better  for  families,  the  new  consumer  agency  will  be  smart  enough  to   encourage  –  and  then  to  build  upon  –  good  ideas  that  come  from  far  outside  the  government  sphere.

The entire speech is below.

Elizabeth Warren’s lecture at Berkeley [10/28/2010] http://d1.scribdassets.com/ScribdViewer.swf?document_id=40414149&access_key=key-244936q6dsprxbkibw61&page=1&viewMode=list