I generally agree with the assessment of Washington Post, with respect to how well Maryland Governor Martin O’Malley’s “Ask Me Anything” on Reddit went for him, though I give him far more credit for venturing onto the unruly social news platform than the reporter did. The Post’s report that he only answered 5 questions was just plain incorrect.
O’Malley answered 19 questions this morning, not 5, a fact that could be easily and quickly ascertained by clicking on GovMartinOMalley, the username he used for the AMA, including a (short) answer to a question on mental health that the Post said went unanswered. (An editor made multiple corrections and updates to the Post’s story after I pointed that out.)
He subsequently logged back on in the afternoon to answer more questions, rebutting the Post’s assessment and that of a user: “I don’t know, I’m having fun! This is my first AMA. I had to step away to sign a bunch of bills, and I’m glad to be back,” he commented.
He answered at least one tough question (from a questioner who appears to have joined Reddit today) after doing so, although the answer hasn’t been highly rated:
@bmoreprogressive91: Thanks for doing an AMA. Just one question: How does the Maryland healthcare exchange, which cost taxpayers $90 million to implement before your administration found that it would be cheaper (at an additional $40-50 million) to just replace it than to fix it, show that your Administration has been effectively using taxpayer dollars to better the lives of individual citizens?
O’Malley: No one was more frustrated than I was about the fact that our health exchange website didn’t work properly when we launched. But our health exchange is more than a web site, and we worked hard to overcome the technical problems. We have enrolled about 329,000 people thus far, exceeding the goal we set of 260,000. I often say that we haven’t always succeeded at first, but we have never given up. We learn from both success and failure.
By the end of the day, Maryland’s governor answered 36 questions in total. (You can read a cleanly formatted version of O’Malley’s AMA at Interview.ly). Reddit users rated the quality of some answers much higher than others, with the most popular answer, “Yes,” coming in response to whether he would support a constitutional amendment to reverse the Citizens United decision by the Supreme Court.
To be fair — and reasonable observers should be — Reddit’s utility for extracting answers from a politician isn’t so great, as Alexis Madrigal pointed out after President Barack Obama did an AMA, back in 2012. That said, I’m generally supportive of elected leaders engaging directly with constituents online using the tools and platforms that citizens are active upon themselves.
Popular questions that go unanswered can be instructive and offer some insight into what issues a given politician would rather not talk about in public. As such, they’re fine fodder for media to report upon. The record online, however, also means that when a reporter botches the job or misrepresents an interaction, question or answer, we can all see that, too.
Postscript: Andrew MacRae was critical of the governor and his team’s approach to Reddit and offered a tip for other politicians that venture onto the social news platform for an AMA. More on that in the embedded tweets, below:
As White House special advisor John Podesta noted in January, the PCAST has been conducting a study “to explore in-depth the technological dimensions of the intersection of big data and privacy.” Earlier this week, the Associated Press interviewed Podesta about the results of the review, reporting that the White House had learned of the potential for discrimination through the use of data aggregation and analysis. These are precisely the privacy concerns that stem from data collection that I wrote about earlier this spring. Here’s the PCAST’s list of “things happening today or very soon” that provide examples of technologies that can have benefits but pose privacy risks:
Pioneered more than a decade ago, devices mounted on utility poles are able to sense the radio stations
being listened to by passing drivers, with the results sold to advertisers.26
In 2011, automatic license‐plate readers were in use by three quarters of local police departments
surveyed. Within 5 years, 25% of departments expect to have them installed on all patrol cars, alerting
police when a vehicle associated with an outstanding warrant is in view.27 Meanwhile, civilian uses of
license‐plate readers are emerging, leveraging cloud platforms and promising multiple ways of using the
information collected.28
Experts at the Massachusetts Institute of Technology and the Cambridge Police Department have used a
machine‐learning algorithm to identify which burglaries likely were committed by the same offender,
thus aiding police investigators.29
Differential pricing (offering different prices to different customers for essentially the same goods) has
become familiar in domains such as airline tickets and college costs. Big data may increase the power
and prevalence of this practice and may also decrease even further its transparency.30
reSpace offers machine‐learning algorithms to the gaming industry that may detect
early signs of gambling addiction or other aberrant behavior among online players.31
Retailers like CVS and AutoZone analyze their customers’ shopping patterns to improve the layout of
their stores and stock the products their customers want in a particular location.32 By tracking cell
phones, RetailNext offers bricks‐and‐mortar retailers the chance to recognize returning customers, just
as cookies allow them to be recognized by on‐line merchants.33 Similar WiFi tracking technology could
detect how many people are in a closed room (and in some cases their identities).
The retailer Target inferred that a teenage customer was pregnant and, by mailing her coupons
intended to be useful, unintentionally disclosed this fact to her father.34
The author of an anonymous book, magazine article, or web posting is frequently “outed” by informal
crowd sourcing, fueled by the natural curiosity of many unrelated individuals.35
Social media and public sources of records make it easy for anyone to infer the network of friends and
associates of most people who are active on the web, and many who are not.36
Marist College in Poughkeepsie, New York, uses predictive modeling to identify college students who are
at risk of dropping out, allowing it to target additional support to those in need.37
The Durkheim Project, funded by the U.S. Department of Defense, analyzes social‐media behavior to
detect early signs of suicidal thoughts among veterans.38
LendUp, a California‐based startup, sought to use nontraditional data sources such as social media to
provide credit to underserved individuals. Because of the challenges in ensuring accuracy and fairness,
however, they have been unable to proceed.
The PCAST meeting was open to the public through a teleconference line. I called in and took rough notes on the discussion of the forthcoming report as it progressed. My notes on the comments of professors Susan Graham and Bill Press offer sufficient insight and into the forthcoming report, however, that I thought the public value of publishing them was warranted today, given the ongoing national debate regarding data collection, analysis, privacy and surveillance. The following should not be considered verbatim or an official transcript. The emphases below are mine, as are the words of [brackets]. For that, look for the PCAST to make a recording and transcript available online in the future, at its archive of past meetings.
Susan Graham: Our charge was to look at confluence of big data and privacy, to summarize current tech and the way technology is moving in foreseeable future, including its influence the way we think about privacy.
The first thing that’s very very obvious is that personal data in electronic form is pervasive. Traditional data that was in health and financial [paper] records is now electronic and online. Users provide info about themselves in exchange for various services. They use Web browsers and share their interests. They provide information via social media, Facebook, LinkedIn, Twitter. There is [also] data collected that is invisible, from public cameras, microphones, and sensors.
What is unusual about this environment and big data is the ability to do analysis in huge corpuses of that data. We can learn things from the data that allow us to provide a lot of societal benefits. There is an enormous amount of patient data, data about about disease, and data about genetics. By putting it together, we can learn about treatment. With enough data, we can look at rare diseases, and learn what has been effective. We could not have done this otherwise.
We can analyze more online information about education and learning, not only MOOCs but lots of learning environments. [Analysis] can tell teachers how to present material effectively, to do comparisons about whether one presentation of information works better than another, or analyze how well assessments work with learning styles.
Certain visual information is comprehensible, certain verbal information is hard to understand. Understanding different learning styles [can enable] develop customized teaching.
The reason this all works is the profound nature of analysis. This is the idea of data fusion, where you take multiple sources of information, combine them, which provides much richer picture of some phenomenon. If you look at patterns of human movements on public transport, or pollution measures, or weather, maybe we can predict dynamics caused by human context.
We can use statistics to do statistics-based pattern recognition on large amounts of data. One of the things that we understand about this statistics-based approach is that it might not be 100% accurate if map down to the individual providing data in these patterns. We have to very careful not to make mistakes about individuals because we make [an inference] about a population.
How do we think about privacy? We looked at it from the point of view of harms. There are a variety of ways in which results of big data can create harm, including inappropriate disclosures [of personal information], potential discrimination against groups, classes, or individuals, and embarrassment to individuals or groups.
We turned to what tech has to offer in helping to reduce harms. We looked at a number of technologies in use now. We looked at a bunch coming down the pike. We looked at several tech in use, some of which become less effective because of pervasivesness [of data] and depth of analytics.
We traditionally have controlled [data] collection. We have seen some data collection from cameras and sensors that people don’t know about. If you don’t know, it’s hard to control.
Tech creates many concerns. We have looked at methods coming down the pike. Some are more robust and responsive. We have a number of draft recommendations that we are still working out.
Part of privacy is protecting the data using security methods. That needs to continue. It needs to be used routinely. Security is not the same as privacy, though security helps to protect privacy. There are a number of approaches that are now used by hand that with sufficient research could be automated could be used more reliably, so they scale.
There needs to be more research and education about education about privacy. Professionals need to understand how to treat privacy concerns anytime they deal with personal data. We need to create a large group of professionals who understand privacy, and privacy concerns, in tech.
Technology alone cannot reduce privacy risks. There has to be a policy as well. It was not our role to say what that policy should be. We need to lead by example by using good privacy protecting practices in what the government does and increasingly what the private sector does.
Bill Press: We tried throughout to think of scenarios and examples. There’s a whole chapter [in the report] devoted explicitly to that.
They range from things being done today, present technology, even though they are not all known to people, to our extrapolations to the outer limits, of what might well happen in next ten years. We tried to balance examples by showing both benefits, they’re great, and they raise challenges, they raise the possibility of new privacy issues.
In another aspect, in Chapter 3, we tried to survey technologies from both sides, with both tech going to bring benefits, those that will protect [people], and also those that will raise concerns.
In our technology survey, we were very much helped by the team at the National Science Foundation. They provided a very clear, detailed outline of where they thought that technology was going.
This was part of our outreach to a large number of experts and members of the public. That doesn’t mean that they agree with our conclusions.
Eric Lander: Can you take everybody through analysis of encryption? Are people using much more? What are the limits?
Graham: The idea behind classical encryption is that when data is stored, when it’s sitting around in a database, let’s say, encryption entangles the representation of the data so that it can’t be read without using a mathematical algorithm and a key to convert a seemingly set of meaningless set of bits into something reasonable.
The same technology, where you convert and change meaningless bits, is used when you send data from one place to another. So, if someone is scanning traffic on internet, you can’t read it. Over the years, we’ve developed pretty robust ways of doing encryption.
The weak link is that to use data, you have to read it, and it becomes unencrypted. Security technologists worry about it being read in the short time.
Encryption technology is vulnerable. The key that unlocks the data is itself vulnerable to theft or getting the wrong user to decrypt.
Both problems of encryption are active topics of research on how to use data without being able to read it. There research on increasingly robustness of encryption, so if a key is disclosed, you haven’t lost everything and you can protect some of data or future encryption of new data. This reduces risk a great deal and is important to use. Encryption alone doesn’t protect.
Unknown Speaker: People read of breaches derived from security. I see a different set of issues of privacy from big data vs those in security. Can you distinguish them?
Bill Press: Privacy and security are different issues. Security is necessary to have good privacy in the technological sense if communications are insecure, they clearly can’t be private. This goes beyond, to where parties that are authorized, in a security sense, to see the information. Privacy is much closer to values. security is much closer to protocols.
Interesting thing is that this is less about purely tech elements — everyone can agree on right protocol, eventually. These things that go beyond and have to do with values.
This afternoon, the United States House of Representatives passed the Digital Accountability and Transparency Act (DATA) of 2013, voting to send S.994, the bill that enjoyed unanimous support in the U.S. Senate earlier this month, on to the president’s desk.
The DATA Act is the most significant open government legislation enacted by Congress in generations, going back to the Freedom of Information Act in 1966. An administration official at the White House Office of Management and Budget confirmed that President Barack Obama will sign the bill into law.
The DATA Act establishes financial open data standards for agencies in the federal government, requires compliance with those standards, and that the data will then be published online. The bipartisan bill was sponsored in the Senate by Senator Rob Portman (R-OH) and Senator Mark Warner (D-VA), and in the House by Representative Darrell Issa (R-CA) and Representative Elijah Cummings (D-MD).
Representative Issa, who first introduced the transparency legislation in 2011, spoke about the bill on the House floor this afternoon and tweeted out a long list of beneficial outcomes his office expects to result from its passage.
#DATAact will give lawmakers & public watchdogs powerful tools to identify and root out waste, fraud & abuse in gov. pic.twitter.com/Y8YvP9ofJU
The Senators who drafted and co-sponsored the version of the bill that the House passed today quickly hailed its passage.
“In the digital age, we should be able to search online to see how every grant, contract and disbursement is spent in a more connected and transparent way through the federal government,” said Senator Warner, in a statement. “Independent watchdogs and transparency advocates have endorsed the DATA Act’s move toward greater transparency and open data. Our taxpayers deserve to see clear, accessible information about government spending, and this accountability will highlight and help us eliminate waste and fraud.”
“During a time of record $17 trillion debt, our bipartisan bill will help identify and eliminate waste by better tracking federal spending,” said Senator Portman, in a statement. “I’m pleased that our bill to empower taxpayers to see how their money is spent and improve federal financial transparency has unanimously passed both chambers of Congress and is now headed to the President’s desk for signature.”
Pleased the House just passed my bipartisan #DataAct.Great news for govt transparency & taxpayers. Now to President for signature. #opengov
“The DATA Act is a transformational piece of legislation that has the potential to permanently transform how the Federal government operates,” said House Majority Leader Eric Cantor, in a statement. “For the first time ever, the American people will have open, standardized access to how the federal government spends their money. Washington has an abundance of information that is often bogged down by federal bureaucracy and is inaccessible to our nation’s innovators, developers and citizens. The standardization and publication of federal spending information in an open format will empower innovative citizens to tackle many of our nation’s challenges on their own. Government of the people, by the people, and for the people should be open to the people.”
The DATA Act earned support from a broad coalition of open government advocates and industry groups. Its passage in Congress was hailed today by open government advocates and trade groups alike.
“The central idea behind the Digital Accountability and Transparency Act is simple: disclose to the public what the federal government spends,” “>said Daniel Schuman, policy council for the Citizens for Responsibility and Ethics in Washington.
“The means necessary to accomplish this purpose—increased agency reporting, the use of modern technology, implementation of government-wide standards, regular quality assurance on the data—will require government to systematically address how it stovepipes federal spending information. This is no small task, and one that is long overdue. The effort to reform transparency around federal spending arose in large part because members of both political parties concluded that their ability to govern effectively depends on making sure federal spending data is comprehensive, accessible, reliable, and timely. Currently, it is not. The leaders of the reform efforts in the Senate are Senators Mark Warner (D-VA), Rob Portman (R-OH), Tom Carper (D-DE), and Tom Coburn (R-OK), and the leaders in the House are Representatives Darrell Issa (R-CA) and Elijah Cummings (D-MD), although they are joined by many others. We welcome and applaud the House of Representative’s passage of the DATA Act. It is a remarkable bill that, if properly implemented, will empower elected officials and everyday citizens alike to follow how the federal government spends money.”
“Sunlight has been advocating for the DATA Act for some time, and are thrilled to see it emerge from Congress,” said Matt Rumsey, a policy analyst at the Sunlight Foundation. “As I wrote while describing the history of the bill after it passed through the Senate, ‘Congress has taken a big step by passing the DATA Act. The challenge now will be ensuring that it is implemented effectively.’ We hope that the President swiftly signs the bill and we look forward to working with his administration to shed more light on federal spending.
“With this legislation, big data is finally coming of age in the federal government,” said Daniel Castro, Director of the Center for Data Innovation, in a statement. “The DATA Act promises to usher in a new era of data-driven transparency, accountability, and innovation in federal financial information. This is a big win for taxpayers, innovators, and journalists.”
“After three years of debate and negotiation over the DATA Act, Congress has issued a clear and unified mandate for open, reliable federal spending data,” said Hudson Hollister, the Executive Director of the Data Transparency Coalition. Hollister helped to draft the first version of the DATA Act in 2011, when he was on Representative Issa’s staff. “Our Coalition now calls on President Obama to put his open data policies into action by signing the DATA Act and committing his Office of Management and Budget to pursue robust data standards throughout federal financial, budget, grant, and contract reporting.”
“The Administration shares Senator Warner’s commitment to government transparency and accountability, and appreciates his leadership in Congress on this issue,” said Steve Posner, spokesman for the White House Office of Management and Budget. “The Administration supports the objectives of the DATA Act and looks forward to working with Congress on implementing the new data standards and reporting requirements within the realities of the current constrained budget environment and agency financial systems.”
Update: Speaker of the House John Boehner (R-OH) signed the DATA Act on April 30, before sending it on to President Obama’s desk.
“From publishing legislative data in XML to live-streaming hearings and floor debates, our majority has introduced a number of innovations to make the legislative process more open and accessible,” he said, in a statement touting open government progress in the House. “With the DATA Act, which I signed today, we’re bringing this spirit of transparency to the rest of the federal government. For years, we’ve been able to track the status of our packages, but to this day there is no one website where you can see how all of your tax dollars are being spent. Once the president signs this bill, that will start to change. There is always more to be done when it comes to opening government and putting power back in the hands of the people, and the House will be there to lead the way.”
UPDATE: On May 9th, 2014, President Barack Obama signed The DATA Act into law.
Statement by Press Secretary Jay Carney:
On Friday, May 9, 2014, the President signed into law:
S. 994, the “Digital Accountability and Transparency Act of 2014” or the “DATA Act,” which amends the Federal Funding Accountability and Transparency Act of 2006 to make publicly available specific classes of Federal agency spending data, with more specificity and at a deeper level than is currently reported; require agencies to report this data on USASpending.gov; create Government-wide standards for financial data; apply to all agencies various accounting approaches developed by the Recovery Act’s Recovery Accountability and Transparency Board; and streamline agency reporting requirements.
Rep. Darrell Issa issued the following statement in response:
“The enactment of the DATA Act marks a transformation in government transparency by shedding light on runaway federal spending,” said Chairman Issa. “The reforms of this bipartisan legislation not only move the federal bureaucracy into the digital era, but they improve accountability to taxpayers and provide tools to allow lawmakers and citizen watchdogs to root out waste and abuse. Government-wide structured data requirements may sound like technical jargon, but the real impact of this legislation on our lives will be more open, more effective government.”
Back in February, I reported that Esri would enable governments to open their data to the public.Today, the geographic information systems (GIS) software giant pushed ArcGIS Open Data live, instantly enabling thousands of its local, state and federal government users to open up the public data in their systems to the public, in just a few minutes.
“Starting today any ArcGIS Online organization can enable open data, specify open data groups and create and publicize their open data through a simple, hosted and best practices web application,” wrote Andrew Turner, chief technology officer of Esri’s Research and Development Center in D.C., in a blog post about the public beta of Open Data ArcGIS. “Originally previewed at FedGIS ArcGIS Open Data is now public beta where we will be working with the community on feedback, ideas, improvements and integrations to ensure that it exemplifies the opportunity of true open sharing of data.”
Turner highlighted what this would mean for both sides of the open data equation: supply and demand.
Data providers can create open data groups within their organizations, designating data to be open for download and re-use, hosting the data on the ArcGIS site. They can also create public microsites for the public to explore. (Example below.) Turner also highlighted the code for Esri’s open-source GeoPortal Server on Github as a means to add metadata to data sets.
Data users, from media to developers to nonprofits to schools to businesses to other government entities, will be able to download data in common open formats, including KML, Spreadsheet (CSV), Shapefile, GeoJSON and GeoServices.
“As the US Open Data Institute recently noted, [imagine] the impact to opening government data if software had ‘Export as JSON’ by default,” wrote Turner.
“That’s what you now have. Users can also subscribe to the RSS feed of updates and comments about any dataset in order to keep up with new releases or relevant supporting information. As many of you are likely aware, the reality of these two perspectives are not far apart. It is often easiest for organizations to collaborate with one another by sharing data to the public. In government, making data openly available means departments within the organization can also easily find and access this data just as much as public users can.”
Turner highlighted what an open data site would look like in the wild:
“Data Driven Detroit a great example of organizations sharing data. They were able to leverage their existing data to quickly publish open data such as census, education or housing. As someone who lived near Detroit, I can attest to the particular local love and passion the people have for their city and state – and how open data empowers citizens and businesses to be part of the solution to local issues.
In sum, this feature could, as I noted in February, could mean a lot more data is suddenly available for re-use. When considered in concert with Esri’s involvement in the White House’s Climate Data initiative, 2014 looks set to be a historic year for the mapping giant.
It also could be a banner year for open data in general, if governments follow through on their promises to release more of it in reusable forms. By making it easy to upload data, hosting it for free and publishing it in the open formats developers commonly use in 2014, Esri is removing three major roadblocks governments face after a mandate to “open up” come from a legislature, city council, or executive order from the governor or mayor’s office.
“The processes in use to publish open data are unreasonably complicated,” said Waldo Jacquith, director of the U.S. Open Data Institute, in an email.
“As technologist Dave Guarino recently wrote, basically inherent to the process of opening data is ETL: “extract-transform-load” operations. This means creating a lot of fragile, custom code, and the prospect of doing that for every dataset housed by every federal agency, 50 states, and 90,000 local governments is wildly impractical.
Esri is blazing the trail to the sustainable way to open data, which is to open it up where it’s already housed as closed data. When opening data is as simple as toggling an “open/closed” selector, there’s going to be a lot more of it. (To be fair, there are many types of data that contain personally identifiable information, sensitive information, etc. The mere flipping of a switch doesn’t address those problems.)
Esri is a gold mine of geodata, and the prospect of even a small percentage of that being released as open data is very exciting.”
According to Code for DC, their team will published all responses collected, after the street addresses are excluded, on OpenDataDC, “a public catalog of civic data built by and for the people of Washington.” The group will continue to collect responses until mid-May 2014, sharing them with the Boundary Review Advisory Committee, the relevant government entity entrusted with working on the proposals. You can find more a bit more context about the app and the issues at WAMU.org.
Our DC Schools builds upon the data behind the Washington Post’s interactive news app, which also enables people to perform a similar geographic search, and then goes one step further than the newspaper, giving people tools to rate proposed changes and send it on to local government.
According to Code for DC, the idea for the civic app came from Chris Given, when he saw how much data was available regarding the issue
“I attended a public working group meeting at Dunbar High School and while I was impressed by the dedication of the Deputy Mayor for Education and DC Public Schools staff, I was just bowled over by the scale of the challenge of getting meaningful feedback from everyone these policies affect,” said Given, in a statement. “I wanted to create an on-ramp for engaging with a really complex issue.”
In personalizing and visualizing the school district changes, unpacking these proposals for assignment and connecting feedback concerned citizens affected by the proposals to policy makers at local government, these volunteers are demonstrating how open government data and the World Wide Web can inform residents and stimulate citizen engagement in matters of great public interest.
Notably, the civic app came to life through a collaboration between Code for DC and the office of the district’s Deputy Mayor for Education (DME). It’s an effort to use modern technology to better engage the people of DC in their government.
“The Our Schools DC app is an example of what can be achieved when government collaborates with citizens to find solutions to common problems. In addition to providing valuable information, it’s a means of public engagement that will help city leaders better meet the educational needs of communities throughout the district,” said Traci L. Hughes, Director of the District of Columbia Office of Open Government, in a statement.
Given the considerable attention that the economic outcomes of open data releases has received over the past year, with trillions of dollars in potential value flowing across headlines, it’s worth reminding everyone of the impacts of open data beyond the bottom line. Thankfully, Emily Shaw, the national policy manager at the Sunlight Foundation, did exactly that in a blog post today, including a handy briefing document that I have embedded below. She credited her colleagues for the brief:
“Democratic governance improves when people have data that helps them see how officials are doing relative to past or promised performance,” she wrote.
As Shaw highlighted in her post, open data can increase the transparency of governments, corporations, journalism or academia. Its release and analysis can and does hold those same entities accountable. Open data can enable efficiencies in information search, access and retrieval, supporting the case of those looking for the return on investment in these kinds of open government initiatives. And open data can support and enhance civic engagement and participation between the people and their government.
“Persuadés que la transparence, l’intégrité et la participation des citoyens aux décisions qui les concernent sont les piliers de la démocratie, le Mexique et la France ont décidé d’adhérer à l’Initiative pour un Gouvernement ouvert, dont le Mexique assumera la présidence en 2015 et sera siège du Sommet l’an prochain. Forts de leur expérience en matière d’ouverture et de partage des données publiques, la France et le Mexique entendent encourager pleinement cette initiative.»
Roughly translated to English, that is:
“Convinced that transparency, integrity and participation of citizens in decisions that concern them are the pillars of democracy, Mexico and France have decided to join the Open Government Partnership, of which Mexico assumes the presidency in 2015 and will be the seat of the Summit next year. With their experience of the opening of materials and sharing of public data, France and Mexico agree to fully encourage this initiative.”
“France is joining the Open Government Partnership with great determination,” Marylise Lebranchu, Ministre de de la Décentralisation, de la Réforme de l’Etat et de la Fonction Publique, France, said, in a statement. “France is willing to contribute to its dynamism with full commitment and by engaging in a fruitful dialogue with its partners. What’s at stake is innovation and building the public action of tomorrow. It’s not only about being accountable, it is also about deeply renewing the way we design, drive and assess public action.”
Commenting on France joining, the civil-society co-chair of OGP, Rakesh Rajani, said that “opening up government to citizen ideas and oversight is not easy and not always popular. France has shown … that it is willing to take the extra step of joining the Open Government Partnership, and putting citizens at the heart of government reform efforts.”
Minister Kuntoro, the government co-chair of OGP, in a statement, said that “OGP is stronger today with France as a participant, and I look forward to working with them to advance reform efforts in France and globally. The demand from citizens for open, innovative and accountable governments is common across the world. France can help strengthen OGP and inspire other countries to join this vibrant movement.”
Official adoption of gouvernment ouvert and open data by France means that “données publiques” (public data) and “données ouvert” (open data) will become part of the lingua franca of Francophone countries around the world. (Canada started that the ball rolling a few years ago.) Tranparence, collaboration and participation, the three pillars of open government proposed by the White House open government initiative five years ago, need far less in the way of translation, differing only in one letter.
Whether there is much of a discussion of how “libéralisme” — meaning economic liberalism and the market system — relates to données ouvert remains to be seen, particularly given that the Socialist party is currently in power in France. As the relationship between of open data and economic activity has become better established and the potential value of its release valued in the trillions of dollars (or euros), governments around the world have become interested in tapping their own national reserves.
One challenge for France, as it is everywhere the 21st century version of technology-driven open government is being embraced, will be to come to grips with the privacy rights of citizens, from surveillance to public data release, nor put critical infrastructure at risk through open data releases.
Another will be to pay equal or greater attention to the release of “données publiques” that is not only “ouvert” in the sense of format, license and reuse, but also in the sense of making the government more transparent and accountable to the citizens of the representative democratic republic, or to the oversight of their elected representatives, where public disclosures might affect national security, privacy or the trade secrets of companies under regulation.
The most uncomfortable challenge, however, may be reconciling this newfound, public commitment to more “openness” with closed or secret systems of government in France, from intelligence to criminal justice, just as it has true in other participating countries, from the United States to the Philippines.
As the Fifth French Republic submits a letter of intent and joins the Open Government Partnership, the Hollande administration is committing itself to creating a National Open Government Action Plan, following through on a public consultation and collaboration with civil society, and then to working towards milestones and goals in it.
Whether France makes meaningful commitments in its consultation, from publicizing it to giving citizens a real say in the future direction of the country, or follows through on them, will be, as is true everywhere, an open question.
Twitter’s best practices for tweeting don’t appear to mix well with its rules for tweeting, as I found out last month when the social networking company briefly suspended the Twitter account for this blog. While I was able to quickly get the account back online, the episode raises somr issues regarding how Twitter’s algorithm flags media accounts and some contradictions in the company’s guidance for new users.
When I found that I couldn’t file a help request to Twitter Support to appeal the suspension of @e_pluribusunum_ through that account, I used my main account (@digiphile).
Can’t file a help request to @twitter to appeal the suspension of @e_pluribusunum_. Not clear what caused it; I used it as I do this account
As I found out days later, however, the suspension was for “sending multiple unsolicited @replies or mentions,” per the statement I have from Twitter Support on @e_pluribusunum_:
“This account was suspended for sending multiple unsolicited @replies or mentions. Twitter monitors the use of these features to make sure they’re not abused. Using either feature to post messages to other users in an unsolicited or egregious manner is considered an abuse of its use, which results in account suspension. You can find more information about @replies and mentions here:https://support.twitter.com/articles/14023-what-are-replies-and-mentions
I have now unsuspended your account. Please note that it may take an hour or so for your follower and following numbers to return to normal. Be sure to review the Twitter Rules, as repeat violations may result in permanent suspension: http://twitter.com/rules”
The tweets in question, however, are extremely similar to the way I’ve been using Twitter for years, advise others to use Twitter, and that Twitter itself recommends to new users.
Here are the tweets sent the day before the suspension and the three that morning, which I have to assume triggered the suspension.
The seventh tweet, embedded above, had six different @names in it, but it was appropriate: I was attributing the source of the information, referring to an NPR program (The Kojo Nnamdi Show) and naming the 4 guests who were on it. The eighth tweet had three @mentions in it, as I had retweeted a media account that referred to a reporter and added the subject of the story for context.
So: Were there a lot of @mentions? Yep. Were they “unsolicited?” Yep. That accurately describes tens of thousands of tweets that I’ve sent over the past seven years. In this case, they were far from “abuse.”
That led me to wonder how many people, journalists, government or media companies or nonprofit organizations a Twitter account is allowed to @mention before it’s suspended. Should any of the categories of users I listed now have to actively ask followers for feedback or allow others to talk about them? That doesn’t seem practical nor scalable. Are there different rules for different users, Verified or not? (I’ve asked Twitter for comment on these general questions but have received no answers after two weeks. I will update the post if I do.)
In the meantime, I’ve tried to think them through myself. The “newness” of this account likely tripped Twitter’s automated filter, leading to the suspension. That means that other new users have to think about whether they’re sending “unsolicited replies or mentions” to keep clear.
I found that deeply jarring. I used the @E_Pluribus Unum_ account exactly as I have @digiphile, for over 7 years now, resharing tweets with attributed context and quotes, tweeting about public figures and government officials, tagging mastheads, retweeting select tweets.
That’s more or less how I define being “social” and engaging on the platform. That’s how I thought Twitter defined it, too. Twitter’s own best practices for engaging followers recommends it:
“Mention high-profile users
@HillaryClinton included Secretary of State Madeleine Albright username@madeleine in a Tweet welcoming the former Secretary to Twitter. In turn, Albright replied to @HillaryClinton and also mentioned the Kennedy Center (@kencen), where she had recently performed. Including so many mentions of other users makes it more likely that people will find the conversation and join in. ”
If Twitter is suspending new accounts that @mention too many high profile users or reply to them in an “unsolicited” fashion, I can’t help but have serious concerns about Twitter’s future and commitment to being a platform for free expression, government accountability, or hosting civic dialogue.
I do see potential issues with “egregious” @mentions — “@reply spam” has been an issue on Twitter for years — but isn’t that exactly what the block button has been used for, or the new abuse reporting button should be used for? People have been tweeting “#FollowFriday” recommendations for years with many unsolicited @mentions. Are they risking suspension?
Honestly, knocking new accounts offline for being “too social” suggests a tone-deaf algorithm. Ignoring my questions regarding general standards suggests something else. (The company generally refuses to comment on individual accounts.)
Given reports of retention issues and low activity by most users, an overly aggressive approach to filtering new users that are engaging in activity that Twitter itself recommends, particularly media accounts, strikes me as actively self-defeating.
Only 13% of Twitter accounts have written at least 100 tweets. 30% have sent 1-10 tweets, and 44% haven’t sent any. http://t.co/Qyj24vIr8n
Twitter and its investors should care about the people who never tweet. This experience reminded me that those same parties should care about the people who do tweet and are caught up on algorithmic censorship, followed by vague missives not to talk about other accounts too much.
As I’ve written before, Twitter is not a public utility. It’s a private company with a Terms of Service and Rules it itself sets. If Twitter’s users don’t like them or lose trust, their option is to stop using the service or complain loudly on other platforms.
In general, Twitter’s record on censorship, Internet freedom and privacy is the best of the big tech companies, as an analysis by the Electronic Frontier Foundation last year highlighted. They’ve gone to bat for their users, from Turkey to Washington. Today, however, I just wish they’d clarify how social those users are allowed to be.
Editor’s Note: The headline of this post has been amended, with “After a false positive” added.
The City of Boston has joined the growing list of cities around the world that have adopted open data. The executive order issued yesterday by Mayor Marty Walsh has been hailed by open government advocates around the country. The move to open up Boston’s data has been followed by action, with 411 data sets listed on data.cityofboston.gov as of this morning. The EO authorizes and requires Boston’s chief information officer to issue a City of Boston Open Data Policy and “include standards for the format and publishing of such data and guidance on accessibility, re-use and minimum documentation for such data.”
The element on re-use is critical: the success of such initiatives should be judged based upon the network effects of open data releases, not the raw amount of data published online, and improvements to productivity, efficiency, city services, accountability and transparency.
Notably, Boston City Councilor-at-Large Michelle Wu also filed a proposal yesterday morning to create an open data ordinance that would require city agencies and departments to make open data available, codifying the executive order into statue as San Francisco, New York City and Philadelphia have done.
“Government today should center on making data-driven decisions and inviting in the public to collaborate around new ideas and solutions,” said Wu, in a statement. “The goal of this ordinance is greater transparency, access, and innovation. We need a proactive, not a reactive, approach to information accessibility and open government.”
Notably, she posted the text of her proposed open data ordinance online on Monday, unlike the city government, and tweeted a link to it. (It took until today for the city of Boston to post the order; city officials have yet to share it on social media. )
“Boston is a world-class city full of energy and talent,” said Wu. “In addition to promoting open government, making information available to the fullest extent possible will help leverage Boston’s energy and talent for civic innovation. From public hackathons to breaking down silos between city departments, putting more data online can help us govern smarter for residents in every neighborhood.”
As long-time readers know, I lived in Boston for a decade. It’s good to see the city government move forward to making the people’s data available to them for use and reuse. I look forward to seeing what the dynamic tech, financial, health care, educational and research communities in the greater Boston area do with it.
EXECUTIVE ORDER OF MAYOR MARTIN J. WALSH
An Order Relative to Open Data and Protected Data Sharing
Whereas, it is the policy of the City of Boston to practice Open Government, favoring participation, transparency, collaboration and engagement with the people of the City and its stakeholders; and
Whereas, information technologies, including web-based and other Internet applications and services, are an essential means for Open Government, and good government generally; and
Whereas, the City of Boston should continue, expand and deepen the City’s innovative use of information technology toward the end of Open Government, including development and use of mobile computing and applications, provision of online data, services and transactions; and
Whereas, the City of Boston also has an obligation to protect some data based upon privacy, confidentiality and other requirements and must ensure that protected data not be released in violation of applicable constraints; and
Whereas, clarification and definition of open data, privacy, security requirements, interoperability and interaction flows is necessary for the City’s Open Government agenda;
NOW THEREFORE, pursuant to the authority vested in me as Chief Executive Officer of the City of Boston by St. 1948, c. 452 Section 11, as appearing in St. 1951, c. 376, Section 1, and every other power hereto enabling, I hereby order and direct as follows:
1. The City of Boston recognizes Open Government as a key means for enabling public participation, transparency, collaboration and effective government, including by ensuring the availability and use of Open Data, appropriate security and sharing of Protected Data, effective use of Identity and Access Management and engagement of stakeholders and experts toward the achievement of Open Government.
2. The City of Boston Chief Information Officer (“CIO”), in consultation with City departments, is authorized and directed to issue a City of Boston Open Data Policy.
a) The Open Data Policy shall include standards for the format and publishing of such data and guidance on accessibility, re-use and minimum documentation for such data;
b) The Open Data Policy shall include guidance for departments on the classification of their data sets as public or protected and a method to report such classification to the CIO. All departments shall publish their public record data sets on the City of Boston open data portal to the extent such data sets are determined to be appropriate for public disclosure, and/or if appropriate, may publish their public record data set through other methods, in accordance with API, format, accessibility and other guidance of the Open Data Policy.
3. The City of Boston CIO, in consultation with City departments, is authorized and directed to issue a City of Boston Protected Data Policy applicable to non-public data, such as health data, educational records and other protected data;
a) The policy shall provide guidance on the management of Protected Data, including guidance on security and other controls to safeguard Protected Data, including appropriate Identity and Access Management and good practice guidelines for compliance with legal or other rules requiring the sharing of Protected Data with authorized parties upon the grant of consent, by operation of law or when otherwise so required;
b) The policy shall provide a method to ensure approval by the Corporation Counsel of the City of Boston to confirm Protected Data is only disclosed in accordance with the Policy.
4. This Executive Order is not intended to diminish or alter the rights or obligations afforded under the Massachusetts Public Records Law, Chapter 66, Section 10 of the Massachusetts General Laws and the exemptions under Chapter 4, Section 7(26). Additionally, this Executive Order is intended to be interpreted consistent with Federal, Commonwealth, and local laws and regulations regarding the privacy, confidentiality, and security of data. Nothing herein shall authorize the disclosure of data that is confidential, private, exempt or otherwise legally protected unless such disclosure is authorized by law and approved by the Corporation Counsel of the City of Boston.
5. This Executive Order is not intended to, and does not, create any right or benefit, substantive or procedural, enforceable at law or in equity by any party against the City of Boston, its departments, agencies, or entities, its officers, employees, or agents, or any other person.
6. The City of Boston CIO is authorized and directed to regularly consult with experts, thought leaders and key stakeholders for the purpose of exploring options for the implementation of policies and practices arising under or related to this Executive Order.
“The federal government can now unlock the collaborative “genius” of citizens and communities to make public services easier to access and understand with a new free social media platform launched by GSA today at the Federal #SocialGov Summit on Entrepreneurship and Small Business,” writes Justin Herman, federal social media manager.
“News Genius, an annotation wiki based on Rap Genius now featuring federal-friendly Terms of Service, allows users to enhance policies, regulations and other documents with in-depth explanations, background information and paths to more resources. In the hands of government managers it will improve public services through citizen feedback and plain language, and will reduce costs by delivering these benefits on a free platform that doesn’t require a contract.”
This could be a significant improvement in making complicated policy documents and regulations understandable to the governed. While plain writing is indispensable for open government and mandated by law and regulation, the practice isn’t exactly uniformly practiced in Washington.
If people can understand more about what a given policy, proposed rule or regulation actually says, they may well be more likely to participate in the process of revising it. We’ll see if people adopt the tool, but on balance, that sounds like a step ahead.
Another recent example comes from DOBTCO founder and CEO Clay Johnson, who memorably put RapGenius to good use last year decoding testimony on Healthcare.gov.
E Pluribus Unum 