Mayor Bloomberg, Deputy Mayor for Operations Goldsmith and Buildings Commissioner LiMandri announced the use of Quick Response (QR) codes on all Department of Buildings permits, providing New Yorkers with instant access to information related to buildings and construction sites throughout New York City.
As people who follow this blog know well, there’s a new movement afoot to make government work better through technology. This week, Samantha Gross covered the trend for the Associated Press, publishing a widely syndicated piece on how cities are using tech to cull ideas from citizens. In the private sector, leveraging collective intelligence is often called crowdsourcing. In open government, it’s citizensourcing — and in cities around the country, the approach is gaining traction:
Government officials tout such projects as money-savers that increase efficiency and improve transparency. Citizen advocates for the programs argue they offer something deeper — an opportunity to reignite civic responsibility and community participation.
In some ways, the new approach is simply a high-tech version of an old concept, says Ben Berkowitz, the CEO of SeeClickFix, which helps citizens post pothole-type complaints and track whether they’ve been addressed.
“It’s participatory democracy,” he says. “Open government … is something that was laid out by Thomas Jefferson pretty early on. This is just a way to realize that vision.”
Efforts towards open government in the United States remain in beta. It’s early days yet for all of these trends. On this day, however, it’s good news for the community that the AP reported a “Gov 2.0” approach took off in Manor, Texas because of financial concerns.
As Gross reported, city officials in Manor “decided they wanted to engage residents and beef up services beyond the means of their modest budget.” The approaches they chose to tap into the local civic surplus, including ideation platforms, QR codes and open source publishing, have been widely documented. Over the past month, QR codes and citizensourcing have been adopted in New York City.
Below, one of the officials – former Manor CIO Dustin Haisler – talks about what Manor did to implement Gov 2.0, speaking from a business perspective:
There’s a long road ahead for citizens, government and technology. This story in the Associated Press, however, will means that a few more citizens will be aware that change is afoot.
Designing digital democracy is hard. The structures and conventions that have evolved for deliberative democracy, as messy as it can be offline, don’t transfer perfectly into machine code. Many different companies, civic entrepreneurs, nonprofits and public servants are working to create better online forums for discussion that make better use of technology. This morning, New York City’s new chief digital officer, Rachel Sterne, asked how NYC could use technology to serve citizens. In 2011, the White House is using an unprecedented mix of Web 2.0 platforms at its new State of the Union page for tonight’s speech, integrating graphs and other elements to the WhiteHouse.gov livestream.
Tonight, a new alpha feature in Google Moderator is adding some social signals to help identify the questions that citizens want President Obama to answer in his YouTube interview on Thursday night. Every tweet with an #askObama hashtag will be added to the Google Moderator instance at YouTube.com/AskObama. And every retweet of an #AskObama tweet will count as vote in the Moderator instance. (For the uninitiated, a retweet on Twitter is when a user reshares another user’s tweet. To count as a vote on Moderator, the retweet has to be a “native RT,” not the older manual version where text is copied.)
It’s a simple tweak but it’s one that could make the tool more useful for people who wish to crowdsource questions. “There’s a lot of experimentation going on with Gov 2.0,” said Ginny Hunt, product manager for Google Moderator. “There’s a lot of people on all sides trying to figure out how to involve people in a more useful, participatory, exciting way.”
Hunt looks at Moderator as a way to aggregate and rank answers from many different places across the Web. “We don’t see Moderator as a Q&A platform in quite the same way that you might look at Yahoo Answers or Quora,” she said. “We see it as a way to have an ongoing conversation with constituents in a way that’s efficiently organized. That’s why it fits so naturally with YouTube, because there’s a very clear connection with engaging content.”
Hunt emphasized that what people will see on Moderator tonight “is really alpha” and isn’t available on the standard module on YouTube. “It’s a small step in the evolution of social engagement,” she said. “The more we can simplify the process for government and partners, the better. What you’ll see with Twitter tonight is just the first step. Tweets will get integrated into Moderator with your Twitter identity. It’s just a tiptoe into how we can aggregate ideas in a smarter way and is highly experimental, which is why it’s in Google Labs.”
Part of that process is in making the Google Moderator API available to developers. For instance, Google Moderator powers 10 Questions, which the Personal Democracy Forum relaunched in an effort to reboot citizen to candidate engagement.
“We’ve now used the API to kick of something called YouTube World View, which will be a monthly interview with a world leader,” said Hunt. “You can use the API to plug into anything you want to socialize to allow ranking. We made it open because we expect people to be more innovative than we can anticipate in terms of easily crowdsourcing within a community.”
The content from a Moderator series can also be exported as comma-separated values (CSV) files, which allows developers and designers to take the information and do analysis with the raw data.
There are many challenges in creating platforms for civic discourse, including building in incentives for participation, mitigating identity or privacy issues, addressing vocal minorities overwhelming the system, or ensuring systems scale under heavy traffic. (On that last count, Google’s servers have had little trouble keeping up the load: the Google Moderator instance for last year’s YouTube interview on the CitizenTube channel received over 11,600 questions and over 660,000 votes.)
Even as the role of the Internet as a platform for collective action is growing, however, the technical challenges of getting this right include numerous design, community and cultural challenges. The ways that connection technologies can be turned to governance, versus campaigning, will become increasingly critical as more people go online. Many of the social platforms that are in current use give their users substantial ability to personalize what information or conversations they receive.
Clay Shirky, speaking at this year’s State of the Internet Conference, said that government and technologists have systematically undersigned social spaces where hard choices are addressed. “We have, thanks to James Madison, lots of well designed systems to do that [offline]” he said. “We don’t have as many online. The tendency to rant or opt out prevents the kind of bargaining or horsetrading that’s important.”
The Google Moderator team has made an effort to address some of those issues. “We’ve tried to address that by giving everyone a way to let their voices be heard and to weigh in on the process. Ideally, a small, loud, organized group wouldn’t block the virtual room for others,” said Hunt. “The online systems haven’t caught up to the checks and balances that exist in an in-person town hall. Sometimes, they can be more disruptive. We’re still figuring that out. We do care that people have fair space to have their voice heard.”
Hunt posits that when you ask community about not just what they want to say but what they care about, you’ll get more useful results. “We’re not just inviting people here to post something. We’re asking them to contribute and then vote on something they care about. Freedom of speech in a representative democracy can be messy but that’s part of the process that makes it what it is. The challenge is getting closer to giving people who are busy, with a lot on their minds, a way to get involved.”
The real time Web needs to become the right time Web for most of those citizens to find it relevant in their everyday lives, as it did today when a new geolocation app launched that connected trained citizens with heart attack victims. People need actionable intelligence. Geeks hacking smarter government to make asking questions and gathering feedback simpler can and will make a difference. “If we can make it simpler for folks to plug in, that’s a good thing for everyone,” said Hunt. For those that want to #askObama a question about his plans for 2011, that Moderator instance closes at midnight on Wednesday.
Can technology be used to create a “21st Century regulator?” Keep an eye on Elizabeth Warren as she works to stand up the new Bureau of Consumer Financial Protection over the next months. As Bill Swindell reported for NextGov, the new consumer protection agency plans to use crowdsourcing to detect issues in the market earlier. In a world where studios can use tweets to estimate movie profits or researchers can use Twitter to predict the stock market, it makes sense for government to seriously examine data mining blogs and social networks to pick up the weak signals that predate real problems. Choosing to use such a methodology is applying a lesson from Web 2.0 for Gov 2.0.
This isn’t the first time the federal government has tried to use crowdsourcing for collaborative innovation in open government, certainly, but detecting consumer fraud in a networked world is such a massive challenge that the effort deserves special attention and scrutiny. What’s the thinking here? As Warren told Swindell:
“It’s also about how we will receive information about how the world works,” she said. “It’s about how people will tell us about what is happening. I want you to think about this more like ‘heat maps’ for targeted zip codes where problems are emerging, or among certain demographic groups, or among certain issuers,” Warren said in her still-not-decorated office.
How will crowdsourcing be focused? Swindell’s article provides more insight:
“The power of enforcement will be partly about the agency. But it will be partly, in the future, be about how people crowdsource around identified problems,” Warren said. “The idea that people can talk to each other, whether it’s through the agency or from other platforms. In a sense, the whole notion of how markets work will change.”
“In the old world, it would be up for the agency to come in, and you look very slowly through a sample of the banks to see what products they mailed out. And did they add a lot of fine print, nonsense by regulation that was not supposed to be there?[Now] all of the sudden you got information, and you got it much faster, and you have it more pinpointed and that becomes relevant for purposes of where you spend enforcement resources.”
I think the tools that can be at the new agency’s disposal will have at least three kinds of implications. First, information technology can help ensure that the new agency remains a steady and reliable voice for American families. The kinds of monitoring and transparency that technology make possible can help this agency ward off industry capture.
Second, technology can be used to help the agency become an effective, high-performance institution that is able to update information, spot trends, and deliver government services twenty-four hours a day, seven days a week. If we set it up right from the beginning, the agency can collect and analyze data faster and get on top of problems as they occur, not years later. Think about how much sooner attention could have turned to foreclosure documentation (robo-signers and fake notaries) if, back in 2007 and 2008, the consumer agency had been in place to gather information and to act before the problem became a national scandal.
And third, technology can be used to expand publicly available data so that more people can analyze information, spot problems, and craft solutions. When these data are made available – while also, of course, protecting consumer privacy, shielding personal information and protecting proprietary business information – a shared opportunity arises between the agency and people outside government to have a hand in shaping the consumer credit world.
When Elizabeth Warren meets with Silicon Valley executives, certain technologies are likely to be of particular interest. As reported, she’ll be talking with Hal Varian, Google’s chief economist. Varian is behind a “Google price index” created through online shopping data that measures inflation. For some perspective on his thinking and why leveraging big data is one of the most important trends in IT, watch the video from last year’s Gov 2.0 Summit below:
For more perspective on how big data is being put to work across government, academia and big business, check out the excellent Strata Week series at O’Reilly Radar. Data science is shaping up to be one of the key disciplines of the 21st Century. Whether it can be put to good use by government regulators is a question that will be fascinating to see answered.
UPDATE: Warren delivered a speech to the University of California at Berkeley during her trip where she elaborated further on her vision for the new consumer protection agency. Full text of the speech is embedded below. Selected quotes on data follow.
Technology may provide new tools for the media and government to determine what’s happening – but they can and are used against consumers. As is so often the case, technology is agnostic to the purpose it is bent towards.
Today, information is king—but information is not evenly accessed by all. Repeat players can understand a complicated financial product that the rest of us have difficulty parsing in full. Lenders can hire teams of lawyers to work out every detail of a contract, then replicate it millions of times; a consumer doesn’t have the same option. And with technology to keep track of every purchase, to watch every payment choice, to observe and record the rhythms of our lives, a sophisticated seller can harvest that information—sometimes in ways that provide value, but sometimes in ways that manipulate customers who will never see what happened to them.
Warren also talked about how technology can be used to connect the new regulator with consumers, with respect to a “virtual shingle.” We’ll all see how big those ears can be.
When an agency loses sight of the public it is designed to serve, academics say it has been captured. The new consumer agency can develop tools to help level the playing field and discourage capture. The American people can have not just one, but thousands of seats at the table. Even before the agency officially opens its doors, it can solicit information from the American people about the challenges and frustrations that they face with consumer financial products day in and day out—and it can organize that information and put it to good use. Data from the public can inform priorities, and it can signal problems both to consumers and businesses. Information technology can allow us to hang out a virtual shingle in front the Agency and to declare our intent to the world. It’s a lot harder to let yourself fail – and a lot easier for the public to hold you accountable – when you’ve transparently declared your mission and shared information the public can use to measure your success in meeting it. Technology can force this agency to remain true to its goals.
Warren also articulated her thoughts on a “data-driven agency” and empowering citizens “to help expose, early on, consumer financial tricks,” acting as a kind of collective digital neighborhood watch. It’s an interesting vision.
In a world of experts, it’s the experts that frame the questions to be asked, isolate the problems, sort through the data (if there are any), and try to design solutions—always with the industry looking on and chiming in. But we can do this differently.
A data driven agency won’t be about conventional wisdom. It will be about data. And those data should come from many sources—from financial institutions, from academic studies and from our own independent research. We can reinforce that approach by making sure that our analysts come from a diversity of backgrounds—finance, law, economics, sociology, housing.
But we can also gather data directly from the American people by asking them to volunteer to share with us the experiences they have with consumer credit products. We can open up our platform to families across the country who want to tell us what has happened to them as they have used credit cards, tried to pay off student loans, or worked to correct errors in a credit report. We can learn more about the loan application process, about what people see on the front end and what happens on the back end. We can learn about good practices, bad practices and downright dangerous practices, and we can report on the good, the bad and the ugly to increase transparency and to push markets in the right direction.
Normally, agencies use supervision and lawsuits to enforce the law. This agency will do that as the cop on the beat watching huge credit card companies, local payday lenders, and others in between. Technology can help us do that better, by making sure our enforcement priorities are tightly connected to the financial market realities as experienced by customers every day.
New technology can help us supplement the cop on the beat by building a neighborhood watch. The agency can empower a well-‐informed population to help expose, early on, consumer financial tricks. If rules are being broken, we don’t need to wait for an expert in Washington to wake up. If we set it up right from the beginning, the agency can collect and analyze data faster and get on top of problems as they occur, not years later. Think about how much sooner attention could have turned to foreclosure documentation (robo-‐signers and fake notaries) if, back in 2007 and 2008, the consumer agency had been in place to blow the whistle before the problem became a national scandal.
The agency may also be able to demonstrate how incentives can change when people are connected not only to the government, but also to each other. Through crowd-‐sourcing technology, consumers can deal collectively with those who would take advantage of them—and can reward those who provide excellent products and services. Imagine scanning a credit agreement and uploading to a website where software can analyze the text of the agreement. A consumer could help the agency spot new agreements on the market and customers could get more information as they make decisions. The new CARD Act requires credit card issuers to submit their agreements to the Federal Reserve for posting. That’s a model we can build on. Information – fast, accurate information from a variety of sources – has the power to transform the old measures of agency effectiveness.
Warren was also thoughtful about the risks and opportunities of using government data. She also alluded to the potential for entrepreneurs to develop apps to create something of value, an aspect of Gov 2.0 that has been widely articulated through the Obama administration’s IT officials.
As a researcher, I understand that data must always be handled carefully, and protection of personal data and proprietary models is paramount. But I also believe that better data, made available to the media, private investors, scholars and others, will, over time, produce better results. When data are widely shared, others can use those data to uncover new problems, to frame those problems in different ways, to propose their own public policy solutions, and, for the entrepreneurs in the group, to develop their own private apps to create something of value. I’ve seen some good ideas in my time, and I’ve learned that those ideas can come from unlikely places. I’m hopeful that, as we drive consumer credit markets toward working better for families, the new consumer agency will be smart enough to encourage – and then to build upon – good ideas that come from far outside the government sphere.
Should the approach succeed, challenges and contests have the potential to leverage the collective expertise of citizens, just as apps contests have been used to drive innovation in D.C. and beyond.
In the interview below, Bev Godwin and Brandon Kessler explain what Challenge.gov is and what it might do. Kessler is the founder of ChallengePost, the platform that Challenge.gov is built upon.
I interviewed Godwin and Kessler in August, when senior government officials and private sector enjoyed a preview of Challenge.gov at the Newseum at the second annual Fedscoop forum on reducing the cost of government. The following excerpts from their panels offer more insight into how challenges work, how they’ve been used in the private sector and what results citizens might anticipate as this approach to open government moves forward.
What is a Challenge?
Kessler defines a challenge.
The Value of Challenges to the Government
Bev Godwin discusses the importance and value of challenges to the government.
Results from Challenges
Brandon Kessler discusses the results he has seen from challenges.
Different Classifications of Challenges
Michael Donovan, Chief Technologist, Strategic Capabilities, HP, explains how he would classify different types of challenges.
Dean Halstead, collaboration architect at Microsoft, discusses how he would classify different types of challenges.
ROI from Challenges at NASA
Dr. Jeffrey Davis, director of space life sciences at NASA, talks about the return on investment shown by some of the challenges he has run or been involved with.
What Makes a Good Challenge?
Dr. Jeffrey Davis explores the characteristics of a good challenge.
Challenges in the Private Sector
Dean Halstead explains how Microsoft leverages challenges.
Michael Donovan explains how HP leverages challenges.
Will Crowdsourcing and Challenges Enable More Open Government?
Challenge.gov “is the next form of citizen engagement, beyond participation to co-creation,” said Godwin at the Newseum. Many questions remain about how the effort will be received. Will citizens show up? Will challenges see participation from industry leaders and the innovators in the private sector? Will intellectual property rights be clearly and fairly addressed up front and afterwards, in a sustainable way? Will Congress pass legislation enshrining this approach to open government?
The answers to most of those questions, in other words, will often not be driven by legal or technological challenges. Instead, the results will have to be used to drive acquisition, civic empowerment or even more data-driven policy. Opening the doors of government to innovation will not be easy. Whether these efforts can spur the evolution of a more efficient, innovative government in the 21st Century may be the most difficult challenge to win of all.
Could contests help us realize the vision of participatory democracy outlined by Thomas Jefferson, where citizens collaborate with government to solve the nation’s most difficult problems? The White House hopes so. As the Federal Times reported this morning, agencies are trying to crowdsource their way out of problems.
“Government does not have a monopoly on the best ideas,” as Vivek Kundra, the nation’s first federal chief information officer, has emphasized repeatedly. To deliver on the promise of innovation for “government as a platform,” as Tim O’Reilly has framed the concept of “government 2.0,” the White House will have to find ways to empower citizens to contribute to the formation and delivery of effective and efficient policy and services.
The idea of a contest to inspire technological innovation, however, is not a novel concept reliant on Web services, born from the fertile mind of a Silicon Valley entrepreneur. One of the most famous scientific achievements in nautical history was spurred by a grand challenge issued in the 18th Century. The issue of safe, long distance sea travel in the Age of Sail was of such great importance that the British government offered a cash award of £20,000 pounds to anyone who could invent a way of precisely determining a ship’s longitude. The Longitude Prize, enacted by the British Parliament in 1714, would be worth some £30 million pounds today, but even by that measure the value of the marine chronometer invented by British clockmaker John Harrison might be a deal.
What has inspired the use of the contests? “There are a number of sources,” said Thomas Kalil, deputy director for policy at OSTP. “The organization that gets the most credit for the renaissance in the use of prizes is the X Prize Foundation. The Ansari X Prize and its success was one of the things that got me excited about the potential of these challenges.” Kalil joined Tim O’Reilly and Lesa Mitchell from the Kauffman Foundation next week at the Gov 2.0 Summit to talk about turbocharging American innovation. Their conversation is embedded below:
The Applications of App Contests
“We created Apps for Democracy with Vivek Kundra and Office of the Chief Technology Officer back in 2008,” said Peter Corbett, CEO of Washington, D.C.-based iStrategy Labs. “[Kundra] said ‘Peter, we have all this open data–it’s probably the most comprehensive municipal open data catalog in the world–but it’s not really useful to anybody because it’s just raw data.”
What Corbett suggested to Kundra was to encourage citizen technologists to build Web applications and mobile services on top of that data. “Build on top of that catalog for fame — and a little bit of fortune.” Within two months, they had 47 Web, mobile and iPhone applications developed. Since then, that method and concept has spread throughout the world, said Corbett. The Department of Defense recently announced the winners of the Apps for Army contest, which could shape the future of defense acquisition.
Apps contests are not just a phenomenon in the United States, either: in Canada, an Apps for Climate Change contest just wrapped up. And in Africa, Apps for Africa is focused on leveraging the talent of local developers in Kenya, Uganda, Rwanda and Tanzania.
“There are ‘Apps for Democracy’ contests in Finland, in Australia and ones on the city level like Portland, New York and London,” said Corbett, highlighting the spread of the paradigm globally. Later this year, an Apps for Development contest will leverage an even bigger open data store soon too, explained Corbett, based upon the World Bank’s open data catalog.
A recent McKinsey article on the promise of innovation held by prize contests offered further instruction, noting that “most successful prize competitions place an equal emphasis on other elements, such as the broader change strategy, the competition itself, and post-award activities designed to enhance the impact of the prize.”
Kalil agreed with that assessment, observing that a strategy that specifies victory conditions is useful. “That’s why a clear goal, like ‘build a spaceship that can go up 200km, and then repeat that within two weeks,’ is helpful,” he said.
Will hardwiring prizes that leverage public sector investments provide a good return on the commitment of time, prize money and other resources?
“We’re finding that to be the case with the NASA Centennial Challenges Program,” said Kalil. “If NASA had had to pay for all of the capabilities created by the Lunar Lander Challenge, they would have had to put in far more money.”
Corbett said that for D.C., the city estimated the value of the first Apps for Democracy program was in excess of $2.3 million dollars, when compared to the traditional costs associated with procurement and development.
Other early results are also promising. “The government is still in early days with respect to its use of prizes,” said Kalil. “The agencies most involved have been NASA and its prizes. DARPA, particularly the DARPA Grand Challenge, have played an important role in advanced unmanned ground vehicles and robotics. The DARPA Network Challenge showed the power of social networks to gather information in a distributed way.”
Riley Crane, a MIT post-doctoral fellow, shares insights on crowdsourcing from his team’s success in the DARPA Network Challenge below. The interview came after his testimony at a recent Senate hearing on technological innovation and government.
The success or failure of these challenges and contests may ultimately rest upon the ability of the White House to draw the attention of innovators to the questions posed. Should we expect a live American Idol panel to judge the potential of ideas?
Kalil laughed: “That will depend on the competition.”
There are already dozens of challenges online at the new Challenge.gov today. Below, Bev Godwin from the General Services Administration talks about the new site:
Crowdsourcing innovation through social media
Contests aren’t the only platform that government entities are looking to in order to spur collaborative innovation. Another platform for communication will come from Expert Labs, a non-profit independent lab that is affiliated with the American Association for the Advancement of Science. The open source ThinkUp App being developed by award-winning author Gina Trapani will be used by the White House as a crowdsourcing platform for collecting feedback on grand challenges that are submitted on Twitter.
“This first attempt is about whether we can get people to push the button,” said Anil Dash, director of Expert Labs. “The next attempt will be about seeing if we can get them to contribute to something larger, like a collaborative document.”
Dash said that to be successful, people developing these tools need know what they want to achieve at the outset. “You have to have a purpose-built tool,” he said. “You have to tap into as large of a network as possible, and you need to clearly define the outcome you want.”
Will it be possible to draw attention to huge, difficult problems using social media and the Internet? “Look at the number of people that have watched Bill Gates’ TED talk on zero carbon,” said Dash. “You don’t need to get everyone in the world to agree. It’s a matter of activating the people who want to contribute. It’s about getting the doers to do.”
In the video below, you can learn more about Think Up App from Dash and Trapani’s talk at the recent Supernova Hub conference.