Bulk geocoding requests

[Gavin Jamie]

Hi

I have been doing a little project for my work where get a list of several
thousand postcodes, count up the number in each sector, geocode the sectors
and display the totals on a google map.

We only have local addresses so are using less than 20 sectors. The geocoder
on npemap.org.uk  is very fast and this is easy.

I am thinking of making this a website open to all (FOSS etc etc). Clearly
there is some scope for quite a lot of geocoder load and a web api may not be
suitable any more - and the load on this server may become a bit too high in
short bursts.

Is the geocoder available to download, and if so are there any hints for
converting a fastcgi to daemon?

Many thanks

Gavin

_______________________________________________
npemap-talk mailing list
npemap-talk@...
http://urchin.earth.li/mailman/listinfo/npemap-talk

[Nick Burch-7]

On Tue, 27 May 2008, Gavin Jamie wrote:
> Is the geocoder available to download

Yes, both the geocoder and a script to do nightly imports from the main
site are available.

The geocoder is cgi/geocoder.fgci, and the import script is in
scripts/npemap-importer/importer.pl . You may also want
scripts/freethepostcode.org-importer/importer.py to do a nightly import
from freethepostcode.

Dom - is svn open to all yet? If so, what's the public url?

> and if so are there any hints for converting a fastcgi to daemon?

Your life would probably be easier if you kept it running as a cgi, but I
suspect someone has already written a perl module to wrap a fastcgi script
in a little pure-perl webserver. Anyone know of one?

Nick

_______________________________________________
npemap-talk mailing list
npemap-talk@...
http://urchin.earth.li/mailman/listinfo/npemap-talk

[jmdh]

On Tue, May 27, 2008 at 09:21:06PM +0100, Nick Burch wrote:

> On Tue, 27 May 2008, Gavin Jamie wrote:
> > Is the geocoder available to download
>
> Yes, both the geocoder and a script to do nightly imports from the main
> site are available.
>
> The geocoder is cgi/geocoder.fgci, and the import script is in
> scripts/npemap-importer/importer.pl . You may also want
> scripts/freethepostcode.org-importer/importer.py to do a nightly import
> from freethepostcode.
>
> Dom - is svn open to all yet? If so, what's the public url?

Just opened up at

https://urchin.earth.li/svn/npemap/

Dominic.

--
Dominic Hargreaves | http://www.larted.org.uk/~dom/
PGP key 5178E2A5 from the.earth.li (keyserver,web,email)

_______________________________________________
npemap-talk mailing list
npemap-talk@...
http://urchin.earth.li/mailman/listinfo/npemap-talk

[Gavin Jamie]

On Tuesday 27 May 2008 23:06:06 you wrote:

> >
> > Dom - is svn open to all yet? If so, what's the public url?
>
> Just opened up at
>
> https://urchin.earth.li/svn/npemap/
>
> Dominic.


Many thanks guys. I have now got a working geocoder (after getting
dependencies and pointing the scripts to them - my ISP has a slightly unusual
setup)

Now at feed.gpcontract.co.uk/cgi-bin/geocoder.fcgi

Just to automate the process of grouping and coding postcodes now (which is
actually more a problem of getting the right data to the right requester than
any problem in the actual processing of the postcodes!


Gavin



_______________________________________________
npemap-talk mailing list
npemap-talk@...
http://urchin.earth.li/mailman/listinfo/npemap-talk