Serverless PostGIS
Download as PPTX, PDF0 likes144 views
This document discusses Aurora Serverless for Postgres, a serverless database hosted on AWS. It provides an overview of Aurora Serverless and demonstrates how to set it up. Key features include horizontal scaling of compute and high availability. The document also covers accessing the database within a VPC, using the Data API to query from Lambda, and building serverless vector tiles with the database. In summary, Aurora Serverless scales automatically in response to usage, with one deployment experiencing a 5x scale during data loading and queries.
Serverless PostGIS
- 1. addresscloud.com Ā© 2018 addresscloudĀ® Serverless PostGIS Dr Tomas Holderness FOSS4G UK Online 2020 tomas@addresscloud.com
- 2. addresscloud.com Ā© 2018 addresscloudĀ® Ā© 2019 AddresscloudĀ® Overview 1. Context 2. What is Aurora Serverless for Postgres? 3. Setup (demo) 4. Security, VPCs, and database access 5. QGIS (demo) 6. The Data API 7. Working Example: Serverless Vector Tiles (code + demo) 8. Summary
- 3. addresscloud.com Ā© 2018 addresscloudĀ® Ā© 2019 AddresscloudĀ® Context (why a serverless database?) https://blog.addresscloud.com/serverless-geospatial/
- 4. addresscloud.com Ā© 2018 addresscloudĀ® Ā© 2019 AddresscloudĀ® Aurora Serverless for Postgres Source: https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/aurora-serverless.how-it-works.html#aurora-serverless.architecture
- 5. addresscloud.com Ā© 2018 addresscloudĀ® Ā© 2019 AddresscloudĀ® Aurora Serverless for Postgres Features ā Compute scales horizontally ā High-availability data store with redundancy ā Secured in a virtual private cloud ā Supports Postgres 10.7 and PostGIS 2.4 Key Constraints ā Time to scale ā Not publically accessible (VPC) ā Limited version support ā No easy pathway to migrate from RDS ā Not covered by SLA
- 6. addresscloud.com Ā© 2018 addresscloudĀ® Ā© 2019 AddresscloudĀ® Setup Demo
- 7. addresscloud.com Ā© 2018 addresscloudĀ® Ā© 2019 AddresscloudĀ® Database Access in VPC Accessing Aurora Serverless 1. EC2 in same VPC a. SSH tunnel 2. Data API to AWS Lambda 3. AppStream 2.0 in same VPC 4. Possibly VPN, DirectConnect et al. VPC Security Group AWS Aurora (Postgres) Data API Vector Data
- 8. addresscloud.com Ā© 2018 addresscloudĀ® Ā© 2019 AddresscloudĀ® QGIS via AppStream 2.0 demo VPC Security Group AWS Aurora (Postgres) Data API Vector Data QGIS App Stream (EC2) https browser
- 9. addresscloud.com Ā© 2018 addresscloudĀ® Ā© 2019 AddresscloudĀ® QGIS via AppStream 2.0 demo
- 10. addresscloud.com Ā© 2018 addresscloudĀ® Ā© 2019 AddresscloudĀ® The Data API https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/data-api.html#data-api.calling VPC Security Group AWS Aurora (Postgres) Data API Vector Data AWS Lambda ā HTTP interface to Aurora Serverless ā Query via a Rest API without managing connections ā Authenticated via AWS Secrets Manager ā Supported by Boto3 for Python ā For JS use data-api-cli https://github.com/jeremydaly/data-api-client https
- 11. addresscloud.com Ā© 2018 addresscloudĀ® Ā© 2019 AddresscloudĀ® Serverless Vector Tiles Demo
- 12. addresscloud.com Ā© 2018 addresscloudĀ® Ā© 2019 AddresscloudĀ® Serverless Vector Tiles VPC Security Group AWS Aurora (Postgres) Data API Vector Data https://github.com/addresscloud/minimal-mvt (forked from https://github.com/pramsey/minimal-mvt) browser API Gateway Lambda
- 13. addresscloud.com Ā© 2018 addresscloudĀ® Ā© 2019 AddresscloudĀ® Summary ā A serverless data-store for spatial data! ā Used in production for 6 months for ~800k queries ā Scaled ~5 times in response to high CPU ā Triggered by data loading + large queries ā Max scale duration 35 minutes ā Customer latency unaffected ā 4 minute outage due to AZ hardware failure ā Self-healed, compute moved to another AZ automatically