Rendering OpenStreetMap Data using Mapnik
8 likes19,294 views
This presentation provides an overview of creating maps using OpenStreetMap data with Mapnik, including the necessary tools, database structure, and stylesheet creation. It highlights the complexity of using Mapnik due to its powerful capabilities and the need for additional tools like osm2pgsql to manage data. References are provided for further instructions and resources on installation and usage of the tools discussed.
Rendering OpenStreetMap Data using Mapnik
- 1. Creating Maps from OpenStreetMap Data Using Mapnik Graham Jones 23 February 2011
- 2. Purpose The purpose of this presentation is to: Provide an overview of the concepts associated with creating a map from OpenStreetMap data using mapnik.
- 3. Describe the structure of an osm2pgsql and a mapnik stylesheet.
- 4. Provide references to more detailed instructions.
- 5. Scope This presentation provides only a high level overview – there are many more resources on the internet that go into more detail.
- 6. It is not about detailed installation instructions for the tools – there are quite a few resources on the internet that do this.
- 7. References are provided at the end.
- 8. What do you need to make a map? OpenStreetMap Data: a '.osm' file covering the region you are interested in. Possible sources of this data are: The OSM api (using say JOSM)
- 9. XAPI (if it is working)
- 10. A 'planet extract' from http://www.geofabrik.de . Coastline & Population Centres data (for small sale maps).
- 11. Ideas about what information you would like to display, and how you would like to display it.
- 12. Why is it so complicated? The mapnik library that is discussed in this presentation is a general purpose map drawing utilitiy.
- 13. It is very powerful and can do all sorts – take data from different data sources, plot it in different ways depending on the map scale etc. With power comes complexity.
- 14. The main issue is that the usual way of using OSM data with mapnik is not to have mapnik read the data directly, but load the data into a database first, and mapnik gets the data from there. This means that you need a lot of tools to draw a map.
- 15. Is there an alternative? Yes – there are a few different renderers for OSM data – try searching the OSM wiki for: Osmarender
- 16. Maperitive But I understand mapnik better than these, so they are not considered further here.
- 17. The OSM Mapnik Rendering Tools Key OSM Data file (.osm) PostgreSQL / postGIS database mapnik Mapnik stylesheet (.xml) Extra Data (Coastline Shapefiles etc.) generate_image.py or generate_tiles.py osm2pgsql default.style Files to be Edited / Customised Fixed data / programs / libraries
- 18. osm2pgsql osm2pgsql is the tool that loads OSM data into the postgresql database.
- 19. It does three important things: Filters the data to limit the amount of data in the database.
- 20. Reprojects the data from lat,lon values to mercator projection x,y positions.
- 21. Creates points, lines and polygons from the OSM nodes, ways and relations, to be compatible with mapnik.
- 22. osm2pgsql style file osm2pgsql takes a file (called default.style by default), which tells it which data to put into the database.
- 23. It is a list of keys (highway, natural, waterway etc.). Only OSM entities with keys listed in default.style will be put into the database.
- 24. This means you need to think about which osm keys you will need to use to create your map before you import the database!
- 25. The osm2pgsql database The database contains a number of tables. planet_osm_point : OSM nodes.
- 26. planet_osm_line : OSM linear ways.
- 27. planet_osm_polygon : closed OSM ways (=areas). Each table has a number of colums: One column for each tag defined in default.style.
- 28. A 'way' column which contains the geometry of the entity (e.g. position of a point).
- 29. SQL SQL (Structured Query Language) is used to extract data from the postgresql database in the 'datasource' part of the mapnik layer definition (see later).
- 30. We need to use a select statement to get data out of the database. SELECT <list of database columns> FROM <database table> where <condition>.
- 31. e.g. SELECT way, name from planet_osm_point where historic is not null
- 32. The 'way' column is important – this tells mapnik where to plot the point!
- 33. What is a mapnik Stylesheet? A mapnik stylesheet is a text file in a format called 'XML'.
- 34. <map>
- 36. <style>
- 37. define a style
- 38. </style>
- 39. <layer>
- 40. define a layer
- 41. </layer>
- 42. </map>
- 43. Mapnik Styles and Layers A mapnik stylesheet will contain one or more layers and one or more styles.
- 44. The initial <map> element defines things like the map projection to be used, and the background colour.
- 45. Layers define what data should be displayed .
- 46. Styles define how to display it .
- 47. Mapnik Stylesheet Entities It is possible to write a mapnik stylesheet as a very simple text file.
- 48. But unless your style is extremely simple, there will be a lot of repetition – things like directory containing your map icons, your database username and password etc.
- 49. Entities are used to store this repeated data to make it easier to alter your stylesheet in the future.
- 50. Mapnik Layers A layer specification has to tell mapnik: What data to include in the layer.
- 51. What style to use to display it. <Layer name="Historic" >
- 53. <Datasource>
- 59. (select way, name, historic from planet_osm_point where historic is not null) as points
- 60. </Parameter>
- 61. </Datasource>
- 62. </Layer> Style to use to display data Tell mapnik to use postgresql /postgis to get the data SQL Statement to extract data from the database
- 63. Mapnik Styles A style tells mapnik how to display data on the map.
- 64. A style can have one or more rules that can define different ways of displaying the data (e.g. at different zoom levels).
- 66. <Rule>
- 67. <PointSymbolizer
- 69. />
- 70. </Rule>
- 71. </Style> This example style is as simple as it gets – just display an image, no matter what the zoom level. Reference to an Entity defined earlier in the file.
- 72. generate_image.py generate_image.py is a simple python script to use mapnik to produce a map image using a specified stylesheet.
- 73. The only thing that needs altering in it is the bounding box that defines the are you want the map to cover.
- 74. generate_tiles.py is similar, but produces a set of tiles at various zoom levels for use on a web site.
- 75. generate_tiles.py Generate_tiles.py is similar to generate_image.py, but it produces a set of map tiles to allow you to produce a 'slippy map' scrollable map on a web site.
- 76. There are more efficient tools for production services – try searching for mod_tile or tirex on the OSM wiki.
- 77. A working Example <?xml version="1.0" encoding="utf-8"?>
- 78. <!DOCTYPE Map[
- 80. ]>
- 81. <Map
- 83. >
- 85. <!-- ************** Ruins / Abbeys *************** -->
- 86. <Rule>
- 87. <PointSymbolizer
- 90. />
- 91. </Rule>
- 92. </Style>
- 95. <Datasource>
- 101. (select way from planet_osm_point where historic='ruins') as points
- 102. </Parameter>
- 103. </Datasource>
- 104. </Layer>
- 105. </Map>
- 106. And the result:
- 107. So how do I get started? Install the tools – see the References on the next slide.
- 108. Test using the standard OSM style – get that working before you try to create your own style sheets.
- 109. Start with something very simple and build up from it.
- 110. References A good set of instructions for instaling the tools: http://weait.com/content/build-your-own-openstreetmap-server
- 111. A nice introduction to mapnik: http://www.slideshare.net/artemp/mapnik-sotm-2007
- 112. More information on mapnik: http://trac.mapnik.org/wiki/MapnikTutorials
- 113. What is this XML stuff?: http://en.wikipedia.org/wiki/XML
- 114. What is SQL?: http://www.w3schools.com/sql/default.asp