Tag Archives: GIS

Esri’s new ArcGIS feature is live. Will terabytes of new open data follow?

Posted on by

0

esri-open-data

Back in February, I reported that Esri would enable governments to open their data to the public.Today, the geographic information systems (GIS) software giant pushed ArcGIS Open Data live, instantly enabling thousands of its local, state and federal government users to open up the public data in their systems to the public, in just a few minutes.

open-data-esri

“Starting today any ArcGIS Online organization can enable open data, specify open data groups and create and publicize their open data through a simple, hosted and best practices web application,” wrote Andrew Turner, chief technology officer of Esri’s Research and Development Center in D.C., in a blog post about the public beta of Open Data ArcGIS. “Originally previewed at FedGIS ArcGIS Open Data is now public beta where we will be working with the community on feedback, ideas, improvements and integrations to ensure that it exemplifies the opportunity of true open sharing of data.”

Turner highlighted what this would mean for both sides of the open data equation: supply and demand.

Data providers can create open data groups within their organizations, designating data to be open for download and re-use, hosting the data on the ArcGIS site. They can also create public microsites for the public to explore. (Example below.) Turner also highlighted the code for Esri’s open-source GeoPortal Server on Github as a means to add metadata to data sets.

Data users, from media to developers to nonprofits to schools to businesses to other government entities, will be able to download data in common open formats, including KML, Spreadsheet (CSV), Shapefile, GeoJSON and GeoServices.

“As the US Open Data Institute recently noted, [imagine] the impact to opening government data if software had ‘Export as JSON’ by default,” wrote Turner.

“That’s what you now have. Users can also subscribe to the RSS feed of updates and comments about any dataset in order to keep up with new releases or relevant supporting information. As many of you are likely aware, the reality of these two perspectives are not far apart. It is often easiest for organizations to collaborate with one another by sharing data to the public. In government, making data openly available means departments within the organization can also easily find and access this data just as much as public users can.”

EmploymentLaborForces_B230251

Turner highlighted what an open data site would look like in the wild:

“Data Driven Detroit a great example of organizations sharing data. They were able to leverage their existing data to quickly publish open data such as census, education or housing. As someone who lived near Detroit, I can attest to the particular local love and passion the people have for their city and state – and how open data empowers citizens and businesses to be part of the solution to local issues.

In sum, this feature could, as I noted in February, could mean a lot more data is suddenly available for re-use. When considered in concert with Esri’s involvement in the White House’s Climate Data initiative, 2014 looks set to be a historic year for the mapping giant.

It also could be a banner year for open data in general, if governments follow through on their promises to release more of it in reusable forms. By making it easy to upload data, hosting it for free and publishing it in the open formats developers commonly use in 2014, Esri is removing three major roadblocks governments face after a mandate to “open up” come from a legislature, city council, or executive order from the governor or mayor’s office.

“The processes in use to publish open data are unreasonably complicated,” said Waldo Jacquith, director of the U.S. Open Data Institute, in an email. 

“As technologist Dave Guarino recently wrote, basically inherent to the process of opening data is ETL: “extract-transform-load” operations. This means creating a lot of fragile, custom code, and the prospect of doing that for every dataset housed by every federal agency, 50 states, and 90,000 local governments is wildly impractical.

Esri is blazing the trail to the sustainable way to open data, which is to open it up where it’s already housed as closed data. When opening data is as simple as toggling an “open/closed” selector, there’s going to be a lot more of it. (To be fair, there are many types of data that contain personally identifiable information, sensitive information, etc. The mere flipping of a switch doesn’t address those problems.)

Esri is a gold mine of geodata, and the prospect of even a small percentage of that being released as open data is very exciting.”

Will ESRI allow public GIS data to be fully open government data?

Posted on by

1

As has been true for years, there’s a robust debate in municipal information technology world around the use of proprietary software or open source. An important element of that conversation centers on open data, specifically whether the formats used by companies are interoperable and “open,” in the sense of being usable by more than one kind of software. When the license required to use a given software application is expensive, that requirement can put budget-strapped cities and towns in a difficult position. Last week, former New York State Senate CIO Andrew Hoppin weighed in on the debate, writing about proprietary software lions and bears in the Civic Commons marketplace, a new online directory of civic software.

http://storify.com/nickgrossman/proprietary-lions-and-bears-in-the-civic-commons-m.js I believe the Civic Commons Marketplace will ultimately save US taxpayers billions of dollars in government IT spending, while accelerating the propagation of technology-driven civic innovation in the bargain.  I’ve believed this for a while.   Thus, it’s a debate worth having; the Marketplace deserves attention, and critique.

In order to realize its potential, from my perspective as a recovering government CIO, I believe that the Civic Commons Marketplace must give equal billing to all software used in government, regardless of the software license associated with it.

Nick Grossman, the executive director of Civic Commons, chronicled the debate that Hoppin described in a Storify:

http://storify.com/nickgrossman/proprietary-lions-and-bears-in-the-civic-commons-m.js[View the story “Proprietary Lions and Bears in the Civic Commons Marketplace” on Storify]

I talked with ESRI founder Jack Dangermond in September 2010 about how he was opening up ESRI and the role he saw for mapping in open government. My sense then, as now, is that this is an issue that’s deeply important to him.

There are clearly strong feelings in the civic development community about the company’s willingness to open up its data, along with what that means for how public data is coded and released. If you’re a GIS developer and have an opinion on this issue, please let us know in the comments.

Jack Dangermond on mapping, government transparency and accountability

Posted on by

1

Writing over at the ESRI blog today, founder and president Jack Dangermond shared his thoughts on how maps and GIS information can contribute to improving government transparency and accountability:

Born out of the Gov 2.0 movement, the terms transparency and accountability have become part of the daily vernacular of governments and the citizens they serve. One might even suggest these words have become a new expectation of governing. Transparency and accountability began with a simple concept of openly communicating public policy to the taxpayer. Today, these concepts are thriving within a growing emphasis on developing an interactive dialog between governments and the people.

Maps can be a very valuable part of transparency in government. Maps give people a greater understanding of the world around them. They can help tell stories and many times be more valuable than the data itself. They provide a context for taxpayers to better understand how spending or decisions are being made in a circumstance of where they work and live. Maps help us describe conditions and situations, and help tell stories, often related to one’s own understanding of content.

I spoke with Dangermond about precisely this subject last year at the Gov 2.0 Summit in Washington. I believe the interview holds up and remains relevant to the conversation around open government today.