(no subject)

View: New views
2 Messages — Rating Filter:   Alert me  

(no subject)

by ernst_meier :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Hello,

I have created an SHP-File (polygon) with ArcGIS 9.2. I let ogrinfo show the coordinates of the vertexes and got decimals like .123000005 instead of
.123 or .129999999999 instead of .130

Any Ideas? What causes this change? Maybe a bug in ArcGIS or FWTools?


Ernst
--
GRATIS für alle GMX-Mitglieder: Die maxdome Movie-FLAT!
Jetzt freischalten unter http://portal.gmx.net/de/go/maxdome01
_______________________________________________
FWTools mailing list
FWTools@...
http://lists.maptools.org/mailman/listinfo/fwtools
http://fwtools.maptools.org/

Re: (no subject)

by Frank Warmerdam-2 :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Ernst Meier wrote:
> Hello,
>
> I have created an SHP-File (polygon) with ArcGIS 9.2. I let ogrinfo show the coordinates of the vertexes and got decimals like .123000005 instead of
> .123 or .129999999999 instead of .130
>
> Any Ideas? What causes this change? Maybe a bug in ArcGIS or FWTools?

Ernst,

Shapefile coordinates are stored in double precision IEEE floating point
and in that representation there are numbers that cannot be exactly
represented - perhaps including values like .123.  In these cases the
internal representation is very close and whether you see 0.123 or
0.12999999999999 will depend on the precision displayed.  So I believe
ogrinfo is just reporting so much precision that you see these small
inaccuracies.

There isn't really much to do about this.

Best regards,
--
---------------------------------------+--------------------------------------
I set the clouds in motion - turn up   | Frank Warmerdam, warmerdam@...
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush    | Geospatial Programmer for Rent

_______________________________________________
FWTools mailing list
FWTools@...
http://lists.maptools.org/mailman/listinfo/fwtools
http://fwtools.maptools.org/