Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Geocoding of addresses #2

Open
waldoj opened this issue Jun 2, 2014 · 23 comments
Open

Geocoding of addresses #2

waldoj opened this issue Jun 2, 2014 · 23 comments

Comments

@waldoj
Copy link
Member

waldoj commented Jun 2, 2014

I'm not aware of any open, unencumbered, accurate tool for geocoding addresses. (e.g., Google's geocoder may only be used to plot points on a Google Map, as per their terms of service.) Here's a great list of available tools, with a bit of information about each one. The best option is an API-based service run by TAMU, which is much better than any other tools, but it's API-based, rather than being an open stack or a downloadable database.

@spara
Copy link

spara commented Jun 4, 2014

Include Data Science Tool Kit, you can use the online version or download a VM if you want to run it locally. Runs via API (also drop-in replacement for Google Style Geocoder) or batch. Also, there are a number of other interesting geo tools included.

Here's an example of using the the DSTK geocoder in an app

@paulfitz
Copy link

paulfitz commented Jun 4, 2014

Missing on the TAMU list is @petewarden's datasciencetoolkit, it has a handy drop-in google-style geocoder. Can't speak to its accuracy other than a "works for me". Documentation says it "uses data from the US Census and OpenStreetMap." VMs available. Oh, I see @spara beat me to it :-)

@waldoj
Copy link
Member Author

waldoj commented Jun 4, 2014

Y'all just blew my mind.

@waldoj
Copy link
Member Author

waldoj commented Jun 4, 2014

Man, this whole thing is just excellent, well beyond geocoding. I can't believe I didn't know about this.

@feomike
Copy link

feomike commented Jun 5, 2014

nice one @spara i didn't know about that one either. can you tell me more about the origin?

@spara
Copy link

spara commented Jun 5, 2014

Pete Warden took the geocoder that Schuyler Earle wrote for Fortius/GeoCommons and wrapped a bunch of tools with it. It was sort of an in between project when he was between leaving Apple, playing with big data, and starting JetPac. I think he's added British post codes as well. Pete still maintains it from time to time but he's been focused on JetPac for the past couple of years. I used it in production when I was doing stuff for InfoChimps in 2011 and it seemed pretty stable back them. Just for the sake of disclosure, I do consulting work for JetPac.

@spara
Copy link

spara commented Jun 5, 2014

The grand daddy of online TIGER based geocoders, geocoder.us is still available and has been updated (in 2013). I think Rich Gibson has also added a couple features such as including census information from a geocoding request. I do know that this is currently maintained.

@feomike
Copy link

feomike commented Jun 5, 2014

👍

@spara
Copy link

spara commented Jun 5, 2014

PostGIS 2.x includes a TIGER based geocoder. It also includes address normalization and the option to offset address points from the street centerline.

@petewarden
Copy link

Thanks for the kind words, and USODI looks awesome! The background to the DSTK was my need for a turnkey geocoding solution that included data. There's other amazing open source geocoders out there, I'd call out Nominatim too in addition to the previous ones mentioned, the tricky part is usually populating them.

@waldoj
Copy link
Member Author

waldoj commented Oct 29, 2014

The U.S. Census now provides a geocoder. In terms of API UX, it's really quite nice—no auth, it's fast, the results are clean and straightforward. I'm using it at this moment to geocode several hundred thousand business addresses. Unfortunately, it is of course based on TIGER data, so the accuracy isn't great, it does poorly in rural areas, etc. Still, they're doing something great with the data that they have.

@hampelm
Copy link

hampelm commented Oct 29, 2014

Here's a search of all the ArcGIS online locator services -- aka geocoders -- and a link to the docs via @ajturner

@waldoj
Copy link
Member Author

waldoj commented Oct 29, 2014

Here's New York (state's) geocoder, which they promote as publicly available.

@waldoj
Copy link
Member Author

waldoj commented Oct 29, 2014

Utah has a geocoder, complete with sample Python. Unfortunately, it requires registration. I don't see any reason to think that registration is limited to any particular group (e.g., state employees).

@waldoj
Copy link
Member Author

waldoj commented Oct 29, 2014

Arkansas seems to have a geocoder, but I can't find any documentation about permissible uses. I've linked to sample query, which works great. Nothing on that page says anything about a ToS, copyright, etc.

@steveoh
Copy link

steveoh commented Oct 29, 2014

I would not recommend using that python script for utah's locator. I would recommend the Geocoding Samples

@waldoj
Copy link
Member Author

waldoj commented Oct 29, 2014

Thank you, @steveoh!

@waldoj
Copy link
Member Author

waldoj commented Oct 29, 2014

@geostor writes on Twitter that Arkansas' "geocoding service is completely 'feeless' and open to the public, further explaining that they "have not technically stated CC0 (working on this), it would fall under that category. Public, private: have at it!"

@feomike
Copy link

feomike commented Oct 29, 2014

fwiw @waldoj Utah, NY and Arkansas are the three states with the top Geospatial leaders in state government. they are all the early adopters. follow the who ...

@waldoj
Copy link
Member Author

waldoj commented Oct 29, 2014

Washington DC has a geocoder (part of a suite of RESTful GIS tools), but I can't find any indication as to what its licensing status is. That said, it seems to be well documented, and my guess is that information is published within their "Master Address Repository" documentation.

@waldoj
Copy link
Member Author

waldoj commented Oct 29, 2014

Thanks for that, @feomike!

@feomike
Copy link

feomike commented Oct 30, 2014

👍 DC was number 4; he left to become MD GIO. he is in the process of building one. not sure if it is up yet.

@ajturner
Copy link

the DSTK geocoder as @spara pointed out is based on the GeoCommons Geocoder and is open-source. It was designed to have modular components for String address tokenization and for data sources. That way it could be easily extended for different addressing schemes and the OSM or other data as they became available.

It's been used since creation for unlimited GeoCommons geocoding and still churning along pretty well, through subject to the quality of Tiger. So I'm interested in how it could be connected to address point services for loading up 'official' and updating address data.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

8 participants