FCC hosts developer day focused on open government innovation

Will a rebooted FCC.gov become a platform for an ecosystem of applications driven by open government data? If that vision is going to come to fruition, the nation’s pre-eminent communication regulator will have to do more than just publish open data sets in machine readable formats online: it will have to develop a community of software developers that benefits to creating such applications.

Monday’s FCC developer day is a first step towards that future. Whether it’s a successful one will be in part predicated upon whether the applications created by the “civic hackers” present help citizens, businesses or other organizations do something new or ease a given process.

UPDATE: One key member of the open government community is the founder of Development Seed, Eric Gunderson. Gunderson has been involved in some of the most innovative mapping projects in open government over the past few years, along with the development of the platform for the new data.worldbank.org. If you’re looking for an unvarnished assessment of the meaning of the FCC’s effort and developer outreach, look no further:

Does it make sense to experiment? “In an online world, the best ideas can and do come from anyone, anywhere,” said FCC chairman Genachowski in a prepared statement. “Tapping into the innovation happening at the edge and in the cloud is a no brainer. The FCC’s first-ever Open Developer Day imports a best practice from the tech industry to help improve accessibility. It is part of our ongoing effort to harness technology to transform the FCC into a model of excellence in government.”

As the statement hints, addressing the requirements of the 21st Century Communications and Video Accessibility Act that President Obama signed into law last month.

In order to meet that goal, the FCC is taking an open government tack, asking the civic development community to contribute to that effort. The agency’s first data officer, Greg Elin, explained more about the constituents for today’s dev day on the Blogband blog:

Programmers from the Yahoo! Developer Network will be on hand to demo their tools and provide guidance. They will give an overview of YQL, their query language which allows developers to “access and shape data across the Internet through one simple language, eliminating the need to learn how to call different APIs.” We will also see a demonstration of their YUI Library, a set of “utilities and controls … for building richly interactive web applications.”

An undertone, pervading a significant strand of the discussion, will be the 21st Century Communications and Video Accessibility Act. In signing the act last month, President Obama said the act “will make it easier for people who are deaf, blind or live with a visual impairment to do what many of us take for granted…  It sets new standards so that Americans with disabilities can take advantage of the technology our economy depends on.”

The full day event will start at 9:00am and take place in Washington, DC at FCC headquarters. All developers are welcome free of charge. Bring a laptop and RSVP soon. If you’re not in the DC area and are unable to make it down here, we will be live streaming portions of the day. You can also join the discussion on Twitter using the hashtag #fccdevday. To email questions write to livequestions [at] fcc [dot] gov. You can participate by visiting Accessible Event, and entering the event code 00520237

For more context on what the FCC is trying to accomplish with FCC.gov/developer, watch a speech from the chairman and managing director Steve Van Roeckel at the 2010 Gov 2.0 Summit, below:

Linking up WhiteHouse.gov and a new US-India Partnership on Open Government

After an election that saw open government make gains in statehouses across the United States, a new transcontinental partnership offers new opportunities for international collaboration. This afternoon, Samantha Power, special assistant to the President for multilateral affairs and human rights, blogged about a new US-India partnership on open government at WhiteHouse.gov. Her post describes President Obama’s visit to an “Expo on Democracy and Open Government” at St. Xavier’s College in Mumbai and the technologies and organizations he encountered there. According to Power:

“India’s dynamism in the technology sector is well known, as is Gandhi’s legacy in India of civic action and bottom-up change, but today’s expo highlighted something very fresh: Indian civil society’s harnessing of innovation and technology to strengthen India’s democracy — by fighting corruption, holding government officials accountable, and empowering citizens to be the change they seek.”

Power’s post is thorough, descriptive and contextualizes the president’s trip and the growing use of technology to fight corruption and improve accountability in India. It also contains only one link that’s relevant to the organizations that were at said “Expo on Democracy and Open Government.” Ipaidabribe.com was created by Janagraaha to enable “Indians upload videos of their experiences in paying a bribe, in refusing to pay a bribe, and in ‘not having to pay a bribe.'”

The expo itself does not appear to have a website, or at least one that could be discovered after a few minutes of searching online.

The closest thing to an online FAQ is the White House press release on “Indian Innovations in Expo for Democracy and Open Government posted at America.gov, where the participating organizations are listed and described. Neither the WhiteHouse.gov blog post nor the release contains that most elemental of online elements: hyperlinks to the relevant person, place or thing being described. For some readers, used to the limitations of print, that may not be a huge issue. For digital natives or immigrants, the absence of links is a big missed opportunity.

The reason that critique is particularly fresh this afternoon is that one of the archetypal bloggers on the Web, David Winer, made the argument at Scripting News today that WhiteHouse.gov should be a hyperlocal blog. Specifically:

The sitting President can’t run campaign ads as an aspiring President does. But he has the ability to communicate more effectively than anyone else on the planet, if that power is developed. If you send people away to places that involve them. The White House blog should be a daily link list of ideas and perspectives on what’s happening in the world.

For instance, Power could have linked to the press briefing at USAID.gov where she, Secretary of Agriculture Tom Vilsack, USAID Administrator Raj Shah and Chief Technology Officer Aneesh Chopra talk about yesterday’s agricultural exposition, including her comments on this open government partnership. For example:

one of the things that we’ve been doing is really learning as a government just how rich the innovations are in a lot of emerging democracies, and indeed, in a lot of new democracies and transitional democracies. No one country has a monopoly on innovation in this space. And it’s indeed quite inspiring to see how even with very few resources you can see how creative nongovernmental actors are, or indeed champions within government who are stepping forward and taking advantage of new technologies and so forth to try to enhance partnership or transparency.

So having said that, I still think India has a huge number of comparative advantages. I mean, for starters it has one of the most noble traditions in human history of bottom-up change and bottom-up activism. I mean, the whole history of modern India is rooted in what you might call the original “Yes, we can” with Mr. Gandhi and the movement that he created and the billions of people that he inspired around the world, one of whom, as the President said today, was Martin Luther King, without whom, arguably, we wouldn’t be where we are in my own country.

So this tradition of bottom-up change, of citizen demand the quality of demand that one encounters out in the most rural areas and some of the most impoverished areas here, even among people who haven’t yet acquired literacy in their communities.

For an administration that’s embraced the idea and practice of Gov 2.0 in many notable ways, failing to link in even a Web 1.0 way is surprising. And to be fair, this post was an exception. The White House blog has frequently made good use of links, video and images, as shown by this week’s WhiteHouse.gov weekly wrapup.

For the sake of the broader open government community who may be interested, here’s the list of participants in that Expo from the press release, this time with links to the relevant organizations or news coverage, where such websites are not available:

An Illustrative List of Exhibitors and Roundtable Participants:

· Mazdoor Kisan Shakti Sangathana (Workers and Peasants Strength Union – MKSS) is an organization that fights against government corruption and creates channels for citizens to oversee their local governments. Its leader, Aruna Roy, is best known as a prominent leader of the Right to Information movement in India which led to Parliament’s passage of the Right to Information Act in 2005, which has empowered millions of ordinary Indians.

· Satark Nagrik Sangathan (SNS) is a New Delhi based citizen’s group with a mandate to promote accountability and transparency in government functioning. SNS’s key activities have been to promote the use of the Right to Information Act (RTI) by training citizens, particularly women in slum areas, to use the RTI and on the functioning of the government in areas such as rations, civic works, education and social welfare schemes. More recently, SNS has used the RTI to collect information on the performance of elected representatives and develop report cards.

· Janaagraha is a Bangalore-based NGO that works with citizens and government to change the quality of life in India’s cities and towns, focusing on urban infrastructure and citizen engagement with public institutions, including volunteerism. They also recently launched an exciting initiative called IPAIDABRIBE.com, a web platform for where people who have been asked for or ever had to pay a bribe are encouraged to share their experiences (after only 2 months, it gets 30,000 hits per day).

· The Hunger Project (THP) is a global organization committed to ending hunger. In India, it is committed to ignite and sustain the leadership spirit of women elected to local village councils (panchayats). THP works in 13 states of India, including Maharashtra (where Mumbai is located). By partnering with more than 90 civil society organizations, THP has worked with and supported the leadership of more than 60,000 elected women representatives.

· ASER uses simple tools to empower people nationwide to test their children’s math and reading abilities, and then hold local government accountable to outcomes. With this data, ASER creates the Annual Status of Education Report, which surveys literacy in 570 districts and 700,000 children of India with citizen participation. Each year 25,000 volunteers donate 4 days of their time to gather the data for this report.

· PRS Legislative Research (PRS) works with Members of Parliament (MPs) across party lines to provide research support on legislative and policy issues. Its aim is to complement the base of knowledge and expertise that already exists in government, citizens groups, businesses, and other research institutions. PRS also enables citizens to track the progress of legislative and policy reforms through an on-line portal.

· The Association for Democratic Reforms (ADR) works on building fair and transparent electoral and political processes in India. ADR has organized Citizen Election Watch for all major elections and discloses candidate background information in a timely manner, including through SMS technology, to the media and the public, helping them to make informed voting choices.

The takeaway for government – or any organization, for that matter – is that blogs and the Web offer new opportunities to share information, create more surface area to expose ideas to citizens and create conversations. If official accounts of new partnerships or events consist of plaintext press releases, lack a website or a post on the most prominent government blog in the world fails to include images, video or relevant links, that opportunity is being neglected.

Google Maps Mashup: World Map of Open Government Data Initiatives

Pretty cool. According to the page, it’s from Semantic-Web.at. It’s a good bet that the growth of open data and open government initiatives around the world will be a topic of conversation for the community the International Data Summit this month in Washington, D.C.

Exploring Civil Society 2.0 at the State Department

The Tech@State conference on Civil Society 2.0 offered insight into the future of technology and civics around the world from digital diplomats, nonprofit leaders and technologists. Tim O’Reilly delivered one of the most thoughtful lectures I’ve seen to date, exploring the factors that led to the success of the Web, Google, Microsoft, Amazon and the platforms that undergird our digital world.

“As you think about civil society 2.0, think about open ended platforms that you can build on, not just applications,” he said.

While his comments and those of the other presenters deserve more analysis and reporting, the four excerpts from O’Reilly’s talk below offer immediate access to the insight he shared. I’ll write more at Radar soon.

For more perspective on what civil society might mean in 2010 – or 2050 – read Nancy Scola at techPresident.

http://www.ustream.tv/flash/video/10632532?v3=1

http://www.ustream.tv/flash/video/10632190?v3=1

http://www.ustream.tv/flash/video/10632341?v3=1

http://www.ustream.tv/flash/video/10632304?v3=1

Automotive X-Prize Winners: “Give us problems that mean something to us”

http://storify.com/dan_munz/jenn-gustetic-interviews-the-automotive-xprize-tea.js

The Future is Mobile at Ignite NYC: Open Data, Open Government and Augmented Reality

“The future is already here – it’s just not evenly distributed.” —William Gibson.

http://blip.tv/play/AYKJtSgC

“An exploration of cyberpunk fiction, technology, where we’re headed, the challenges we face, and the solutions we need”-Ignite NYC. I gave a (very) similar talk called Pattern Recognition and Spimewatch at Ignite D.C. later that week. For whatever reason, this version seems to have come off much better. Rack it up to the first time on a big stage; there were close to a thousand people present in NYC.

The creative graphic recording at Ignite NYC at Web 2.0 Expo was created during the talk by Nora Herting of ImageThink.

For a great Ignite talk with a related theme, check out In Coders We Trust, by Laurel Ruma.

Dan Rather interviews Tim O’Reilly on Gov 2.0

How did Tim O’Reilly describe the potential of Gov 2.0 to Dan Rather?

“Government 2.0 is the attempt to harness the latest technology to make our government more effective, transparent and participatory,” he said.

What do the alpha geeks want to do, with respect to improving government? “They started saying, first of all, we want to open up government, we want more access to all this government data. We want to create new capabilities for citizen involvement.”

From HDNet YouTube Channel excerpt’s description:

Barack Obama’s presidential campaign was recognized for its innovative use of technology to rally voter support. But there are people out there who say that technology has the power to not only revolutionize campaigns, but the very way we view government. It’s a movement called Government 2.0 and Tim O’Reilly is one of its most vocal prophets. He has been called “the Oracle of Silicon Valley” because he saw the potential of the world wide web years before most of us had even heard of it. He’s a highly respected big thinker in the tech community. And he believes that we are at the vanguard of a radical re-think of how government works in the Internet age.

The full episode of Dan Rather Reports on “Tim O’Reilly and Government 2.0” is available as a direct download from iTunes.

IBM initiative adds Big Blue to government cloud computing market

What will a government cloud computing look like coming from “Big Blue?” Today, IBM announced a community cloud for federal government customers and a municipal cloud for state and local government agencies. With the move, IBM joins a marketplace for providing government cloud computing services that has quickly grown to include Google, Amazon, Salesforce.com and Microsoft.

[Image Credit: Envis-Precisely.com]

“We’re building our federal cloud offering out of intellectual bricks and mortar developed over decades,” said Dave McQueeney, IBM’s CTO of US Federal, in an interview. The value proposition for government cloud computing that IBM offers, he said, is founded in its integrated offering, long history of government work and experience with handling some of the largest transactional websites in the world.

The technology giant whose early success was predicated upon a government contract (providing Social Security records keeping systems in the 1920s) will be relying on that history to secure business. As McQueeney pointed out, IBM has been handling hosting for federal agencies for years and, unlike any other of the cloud computing players, has already secured FISMA High certification for that work. IBM will have to secure FISMA certification for its cloud computing, which McQueeney said is underway. “Our understanding is that you have to follow the FedRAMP process,” he said, referring to the the Federal Risk and Authorization Management Program (FedRAMP initiative that’s aimed at making such authorization easier for cloud providers. “We have made requests for an audit,” he said.

As the drive for governments to move to the cloud gathers steam, IBM appears to have made a move to remain relevant as a technology provider. There’s still plenty of room in the marketplace, after all, and a federal CIO in Vivek Kundra that has been emphasizing the potential of government cloud computing since he joined the Office of Management and Budget. Adopting government cloud computing services are not, however, an easy transition for federal or state CIOs, given complex security, privacy and other compliance issues. That’s one reason that IBM is pitching an integrated model that allows government entities to consumer cloud services to the degree to which CIOs are comfortable.

Or, to put it another way, software quality and assurance testing is the gateway drug to the cloud. That’s because putting certain kinds of workloads and public data in the cloud doesn’t pose the same headaches as others. That’s why the White House moved Recovery.gov to Amazon’s cloud, which CIO Kundra estimated will save some $750,000 to the operational budget to run the government spending tracking website. “We don’t have data that’s sensitive in nature or vital to national security here,” said Kundra in May.

“Cloud isn’t so much a thing as a place you are on a journey,” said McQueeney. “To begin, it’s about making basic basic information provisioning as easy and as flexible as possible. Then you start adding virtualization of storage, processing, networks, auto provisioning or self service for users. Those things tend to be the nexus of what’s available by subscription in a SaaS [Software-as-a-Service] model.”

The path most enterprises and government agencies are following is to start with private clouds, said McQueeney. In a phrase that might gain some traction in government cloud computing, he noted that “there’s an appliance for that,” a “cloud in a box” from IBM that they’re calling CloudBurst. From that perspective, enterprises have long since moved to a private cloud where poorly utilized machines are virtualized, realizing huge efficiencies for data center administrators.

“We think most will government agencies will continue to start with private cloud,” said McQueeney, which means CIOs “won’t have to answer hard questions about data flowing out of the enterprise.”

Agencies that need on demand resources for spikes in computing demands also stand to benefit from government cloud computing services: just ask NASA, which has already begun sending certain processing needs to Amazon’s cloud. IBM is making a play for that business, though it’s unclear yet how well it will compete. The federal community cloud that IBM is offering includes multiple levels of the software stacks including Infrastructure as a Service (IaaS) and Platform as a Service (PaaS), depending upon agency interest. At the state and local level, IBM is making a play to offer SaaS to those customers based upon its experience in the space.

We know from dealing with municipal governments that processes are very similar between cities and states,” said McQueeney. “There’s probably a great leverage to be gained economically for them to do municipal tasks using SaaS that don’t differ from one another.” For those watching the development of such municipal software, the Civic Commons code-sharing initiative is also bidding to reduce government IT costs by avoiding redundancies between open source applications.

The interesting question, as McQueeney posed it, is what are government cloud computing clients are really going to find when they start using cloud services. “Is the provider ready? Do they have capacity? Is reliability really there?” he asked. Offering a premium services model seems to be where IBM is placing its bet, given its history of government contracts. Whether that value proposition makes dollars (and sense) in the context of the other players remains to be sense, along with the potential growth of Open Stack, the open source cloud computing offering from Rackspace and other players.

Regardless of loud computing will be one more tool that enables government to deliver e-services to citizens in a way that was simply not possible before. If you measure Gov 2.0 by how technology is used to arrive at better outcomes, the cloud is part of the conversation.

Whether state and city governments move to open source applications or cloud computing – like Los Angeles, Minnesota or now New York City – will be one of the most important government IT stories to watch in the next year. Today, IBM has added itself to that conversation.

UPDATE: CNET posted additional coverage of IBM’s government cloud initiative, including the video from IBM Labs below:

Open Government and Civic Innovation on Display at Portland’s CivicApps Awards

What does the innovation on display at the Civic Apps contest by developers in Portland, Oregon mean to the city’s mayor?

“It’s bringing to the world knowledge of what exists in the real world but is so often unknown,” said Mayor Sam Adams in an interview at the awards ceremony for the winners of the contest.

“In Portland, like I think most cities, when people are armed with knowledge, they make wiser choices,” he said, pointing to applications like PDX Bus as examples of innovation that actually help citizens to navigate the city better.

Does open data lead to more economic value creation in the private sector and metropolitan areas alike?

“We are seeing folks that are sole proprietorships hire folks to help them build their business, their app business, their online business with our data sets.” he said. “For us, data has always been there, in some cases for decades. Putting it to use for the public and help people make money while they do it – we intend to be the open source capitol of the nation – and this is one contribution we can make, with our data sets.”

What’s next? “What CivicApps is about in part, providing the data, is sparking relationships, relationships which lead to economic opportunities,” he said. “Webtrends, Microsoft meets the local hacker or coder tonight at this event, who knows what will happen. Our job is to provide the data, provide the opportunity for relationships to occur, provide what in comparison is a tiny litte bit of money, a little incentive for people to keep going. And it’s also fun. It make the city more fun to live in, because you know what’s there.”

That incentive, incidentally, amounted to $1000 for each of the winners of the second round of Civic Apps awards, with another $3000 going to the Best of Show winner, Loqi.me. This afternoon, Skip Newberry, economic development policy advisor to Mayor Adams, congratulated the winners of CivicApps on Twitter.

.bbpBox29117818058 {background:url(http://a3.twimg.com/profile_background_images/26879991/Downtown_Portland_-_Twitter_image.png) #9AE4E8;padding:20px;} p.bbpTweet{background:#fff;padding:10px 12px 10px 12px;margin:0;min-height:48px;color:#000;font-size:18px !important;line-height:22px;-moz-border-radius:5px;-webkit-border-radius:5px} p.bbpTweet span.metadata{display:block;width:100%;clear:both;margin-top:8px;padding-top:12px;height:40px;border-top:1px solid #fff;border-top:1px solid #e6e6e6} p.bbpTweet span.metadata span.author{line-height:19px} p.bbpTweet span.metadata span.author img{float:left;margin:0 7px 0 0px;width:38px;height:38px} p.bbpTweet a:hover{text-decoration:underline}p.bbpTweet span.timestamp{font-size:12px;display:block}

Congrats to @caseorganic @elsewisemedia @pdxmele @maxogden & John Mosser for their award-winning @civicapps! #opensource #gov20 #teamadamsless than a minute ago via TweetDeck

Most Useful App and Best of Show

Amber Case for Loqi.me

As Mayor Adams mentioned later in the program, this Web app could be useful in a snowstorm in Oregon or, if adapted more broadly, for crisis response around the country or world.

App description: “This application is a resource for citizens, medical teams and governments before, during and after disasters. Loqi.me allows mobile users to send an emergency GPS beacon to a real-time map. Crises responders can view all of the help requests on the webpage, along with hospitals and fire stations, real-time 911 calls related to natural disasters. Ground teams can easily use Loqi.me on their mobile phones to send notices of supplies and terrain reports in real time. Remote helpers can easily see the whole picture on the website’s real-time map, handle help and information requests, and send messages to the network. Loqi.me supports subscription to group messages via SMS, AIM, Jabber and Twitter. No application installation is required. Location beacons can be sent simply by going to http://loqi.me on a mobile phone.”

Most Appealing

Matt Blair for PDX Trees.

App description: “PDX Trees is an app for iPhone and iPod Touch devices that makes it easy to find and and enjoy them. With this app, you can:

  • Search for nearby trees and see them on a map.
  • Tap a pin to see the name and view details for that particular tree.
  • Take and upload a photo of a Heritage Tree you’re visiting.
  • View photos of the tree taken by other tree enthusiasts.
  • Email a friend about the tree (includes tree name and location where available)
  • Read more about a type of tree from Wikipedia, without leaving the app.”

Most Original

Melelani Sax-Barnett for Portland Bike to Transit.

App Description: “This is a simple, handy web map that helps you figure out how to ride your bike to transit. It lets you choose from a variety of base layers, and toggle transit stops, routes, and current bike routes. You can also query transit stops and routes for basic information. I made this for a Web GIS class at PSU and I’m a total beginner (with some code thanks to Professor Percy and OpenLayers).”

Best Use of Data

Max Ogden for Civic Apps Data Previewer

“This helped make our data useful to a lot of other developers and the general public,” said Mayor Adams. “Why take it on?”

“I saw all of this great data at the core when civic apps launched,” said Ogden. “When you get data into the Web format, you get Web developers who are really used to making human interfaces for things make them.”

App Description: “A web application to preview any of the public geo data on CivicApps from your web browser. You can choose a dataset and view that data on a map. Individual objects are clickable and can provide details (metadata).”

Civic Choice

Joseph Mosser for PDXTrian

App Description: “Pdxtrian is a simple utility for riders of Portland’s excellent mass transit system, TriMet.

  • Uses GPS to find nearby transit stops
  • Displays a map of the stop location
  • Displays a list upcoming arrivals
  • Allows you to save stops and look them up anytime”

The livestream of the awards ceremony is embedded below:

http://www.ustream.tv/flash/video/10487185?v3=1

Leveraging technology to stand up the Consumer Financial Protection Bureau

Can technology be used to create a “21st Century regulator?” Keep an eye on Elizabeth Warren as she works to stand up the new Bureau of Consumer Financial Protection over the next months. As Bill Swindell reported for NextGov, the new consumer protection agency plans to use crowdsourcing to detect issues in the market earlier. In a world where studios can use tweets to estimate movie profits or researchers can use Twitter to predict the stock market, it makes sense for government to seriously examine data mining blogs and social networks to pick up the weak signals that predate real problems. Choosing to use such a methodology is applying a lesson from Web 2.0 for Gov 2.0.

This isn’t the first time the federal government has tried to use crowdsourcing for collaborative innovation in open government, certainly, but detecting consumer fraud in a networked world is such a massive challenge that the effort deserves special attention and scrutiny. What’s the thinking here? As Warren told Swindell:

“It’s also about how we will receive information about how the world works,” she said. “It’s about how people will tell us about what is happening. I want you to think about this more like ‘heat maps’ for targeted zip codes where problems are emerging, or among certain demographic groups, or among certain issuers,” Warren said in her still-not-decorated office.

How will crowdsourcing be focused? Swindell’s article provides more insight:

“The power of enforcement will be partly about the agency. But it will be partly, in the future, be about how people crowdsource around identified problems,” Warren said. “The idea that people can talk to each other, whether it’s through the agency or from other platforms. In a sense, the whole notion of how markets work will change.”

“In the old world, it would be up for the agency to come in, and you look very slowly through a sample of the banks to see what products they mailed out. And did they add a lot of fine print, nonsense by regulation that was not supposed to be there?[Now] all of the sudden you got information, and you got it much faster, and you have it more pinpointed and that becomes relevant for purposes of where you spend enforcement resources.”

Warren elaborated further this morning on her thinking about how technology can be used to stand up the Consumer Financial Protection Bureau at the White House blog:

I think the tools that can be at the new agency’s disposal will have at least three kinds of implications. First, information technology can help ensure that the new agency remains a steady and reliable voice for American families. The kinds of monitoring and transparency that technology make possible can help this agency ward off industry capture.

Second, technology can be used to help the agency become an effective, high-performance institution that is able to update information, spot trends, and deliver government services twenty-four hours a day, seven days a week. If we set it up right from the beginning, the agency can collect and analyze data faster and get on top of problems as they occur, not years later. Think about how much sooner attention could have turned to foreclosure documentation (robo-signers and fake notaries) if, back in 2007 and 2008, the consumer agency had been in place to gather information and to act before the problem became a national scandal.

And third, technology can be used to expand publicly available data so that more people can analyze information, spot problems, and craft solutions. When these data are made available – while also, of course, protecting consumer privacy, shielding personal information and protecting proprietary business information – a shared opportunity arises between the agency and people outside government to have a hand in shaping the consumer credit world.

When Elizabeth Warren meets with Silicon Valley executives, certain technologies are likely to be of particular interest. As reported, she’ll be talking with Hal Varian, Google’s chief economist. Varian is behind a “Google price index” created through online shopping data that measures inflation. For some perspective on his thinking and why leveraging big data is one of the most important trends in IT, watch the video from last year’s Gov 2.0 Summit below:

For more perspective on how big data is being put to work across government, academia and big business, check out the excellent Strata Week series at O’Reilly Radar. Data science is shaping up to be one of the key disciplines of the 21st Century. Whether it can be put to good use by government regulators is a question that will be fascinating to see answered.

UPDATE: Warren delivered a speech to the University of California at Berkeley during her trip where she elaborated further on her vision for the new consumer protection agency. Full text of the speech is embedded below. Selected quotes on data follow.

Technology may provide new tools for the media and government to determine what’s happening – but they can and are used against consumers. As is so often the case, technology is agnostic to the purpose it is bent towards.

Today,  information  is  king—but  information  is  not  evenly  accessed  by  all.  Repeat  players  can  understand   a  complicated  financial  product  that  the  rest  of  us  have  difficulty  parsing  in  full.  Lenders  can  hire  teams   of  lawyers  to  work  out  every  detail  of  a  contract,  then  replicate  it  millions  of  times;  a  consumer  doesn’t   have  the  same  option.  And  with  technology  to  keep  track  of  every  purchase,  to  watch  every  payment   choice,  to  observe  and  record  the  rhythms  of  our  lives,  a  sophisticated  seller  can  harvest  that   information—sometimes  in  ways  that  provide  value,  but  sometimes  in  ways  that  manipulate  customers   who  will  never  see  what  happened  to  them.

Warren also talked about how technology can be used to connect the new regulator with consumers, with respect to a “virtual shingle.” We’ll all see how big those ears can be.

When  an  agency  loses  sight  of  the  public  it  is  designed  to  serve,  academics  say  it  has  been  captured.     The  new  consumer  agency  can  develop  tools  to  help  level  the  playing  field  and  discourage    capture.  The   American  people  can  have  not  just  one,  but  thousands  of  seats  at  the  table.  Even  before  the  agency   officially  opens  its  doors,  it  can  solicit  information  from  the  American  people  about  the  challenges  and   frustrations  that  they  face  with  consumer  financial  products  day  in  and  day  out—and  it  can  organize   that  information  and  put  it  to  good  use.  Data  from  the  public  can  inform  priorities,  and  it  can  signal   problems  both  to  consumers  and  businesses.         Information  technology  can  allow  us  to  hang  out  a  virtual  shingle  in  front  the  Agency  and  to  declare  our   intent  to  the  world.  It’s  a  lot  harder  to  let  yourself  fail  –  and  a  lot  easier  for  the  public  to  hold  you   accountable  –  when  you’ve  transparently  declared  your  mission  and  shared  information  the  public  can   use  to  measure  your  success  in  meeting  it.  Technology  can  force  this  agency  to  remain  true  to  its  goals.

Warren also articulated her thoughts on a “data-driven agency” and empowering citizens  “to help  expose,  early  on,  consumer  financial  tricks,” acting as a kind of collective digital neighborhood watch. It’s an interesting vision.

In  a  world  of  experts,  it’s  the  experts  that  frame  the  questions  to  be  asked,  isolate  the  problems,  sort   through  the  data  (if  there  are  any),  and  try  to  design  solutions—always  with  the  industry  looking  on  and   chiming  in.  But  we  can  do  this  differently.    

A  data  driven  agency  won’t  be  about  conventional  wisdom.  It  will  be  about  data.  And  those  data  should   come  from  many  sources—from  financial  institutions,  from  academic  studies  and  from  our  own   independent  research.  We  can  reinforce  that  approach  by  making  sure  that  our  analysts  come  from  a   diversity  of  backgrounds—finance,  law,  economics,  sociology,  housing.      

But  we  can  also  gather  data  directly  from  the  American  people  by  asking  them  to  volunteer  to  share   with  us  the  experiences  they  have  with  consumer  credit  products.  We  can  open  up  our  platform  to   families  across  the  country  who  want  to  tell  us  what  has  happened  to  them  as  they  have  used  credit   cards,  tried  to  pay  off  student  loans,  or  worked  to  correct  errors  in  a  credit  report.  We  can  learn  more   about  the  loan  application  process,  about  what  people  see  on  the  front  end  and  what  happens  on  the   back  end.  We  can  learn  about  good  practices,  bad  practices  and  downright  dangerous  practices,  and  we   can  report  on  the  good,  the  bad  and  the  ugly  to  increase  transparency  and  to  push  markets  in  the  right   direction.      

Normally,  agencies  use  supervision  and  lawsuits  to  enforce  the  law.  This  agency  will  do  that  as  the  cop   on  the  beat  watching  huge  credit  card  companies,  local  payday  lenders,  and  others  in  between.   Technology  can  help  us  do  that  better,  by  making  sure  our  enforcement  priorities  are  tightly  connected   to  the  financial  market  realities  as  experienced  by  customers  every  day.      

New  technology  can  help  us  supplement  the  cop  on  the  beat  by  building  a  neighborhood  watch.  The   agency  can  empower  a  well-­‐informed  population  to  help  expose,  early  on,  consumer  financial  tricks.  If   rules  are  being  broken,  we  don’t  need  to  wait  for  an  expert  in  Washington  to  wake  up.  If  we  set  it  up   right  from  the  beginning,  the  agency  can  collect  and  analyze  data  faster  and  get  on  top  of  problems  as   they  occur,  not  years  later.    Think  about  how  much  sooner  attention  could  have  turned  to  foreclosure   documentation  (robo-­‐signers  and  fake  notaries)  if,  back  in  2007  and  2008,  the  consumer  agency  had   been  in  place  to  blow  the  whistle  before  the  problem  became  a  national  scandal.        
The  agency  may  also  be  able  to  demonstrate  how  incentives  can  change  when  people  are  connected  not   only  to  the  government,  but  also  to  each  other.  Through  crowd-­‐sourcing  technology,  consumers  can   deal  collectively  with  those  who  would  take  advantage  of  them—and  can  reward  those  who  provide   excellent  products  and  services.  Imagine  scanning  a  credit  agreement  and  uploading  to  a  website  where   software  can  analyze  the  text  of  the  agreement.  A  consumer  could  help  the  agency  spot  new   agreements  on  the  market  and  customers  could  get  more  information  as  they  make  decisions.    The  new   CARD  Act  requires  credit  card  issuers  to  submit  their  agreements  to  the  Federal  Reserve  for  posting.     That’s  a  model  we  can  build  on.     Information  –  fast,  accurate  information  from  a  variety  of  sources  –  has  the  power  to  transform  the  old   measures  of  agency  effectiveness.    

Warren was also thoughtful about the risks and opportunities of using government data. She also alluded to the potential for entrepreneurs to develop apps to create something of value, an aspect of Gov 2.0 that has been widely articulated through the Obama administration’s IT officials.

As  a  researcher,  I  understand  that  data  must  always  be  handled  carefully,  and  protection  of  personal   data  and  proprietary  models  is  paramount.  But  I  also  believe  that  better  data,  made  available  to  the   media,  private  investors,  scholars  and  others,  will,  over  time,  produce  better  results.  When  data  are   widely  shared,  others  can  use  those  data  to  uncover  new  problems,  to  frame  those  problems  in   different  ways,  to  propose  their  own  public  policy  solutions,  and,  for  the  entrepreneurs  in  the  group,  to   develop  their  own  private  apps  to  create  something  of  value.  I’ve  seen  some  good  ideas  in  my  time,  and   I’ve  learned  that  those  ideas  can  come  from  unlikely  places.  I’m  hopeful  that,  as  we  drive  consumer   credit  markets  toward  working  better  for  families,  the  new  consumer  agency  will  be  smart  enough  to   encourage  –  and  then  to  build  upon  –  good  ideas  that  come  from  far  outside  the  government  sphere.

The entire speech is below.

Elizabeth Warren’s lecture at Berkeley [10/28/2010] http://d1.scribdassets.com/ScribdViewer.swf?document_id=40414149&access_key=key-244936q6dsprxbkibw61&page=1&viewMode=list