Getting started with postgresql
Download as PPTX, PDF3 likes2,714 views
This document provides an overview of Postgresql, including its history, capabilities, advantages over other databases, best practices, and references for further learning. Postgresql is an open source relational database management system that has been in development for over 30 years. It offers rich SQL support, high performance, ACID transactions, and extensive extensibility through features like JSON, XML, and programming languages.
![Psql tricks and tips
Command Description
l List of all databases
c <db> Change database name
d Show all objects in database
d <item> Describe database item
x [auto] Show one record at a time
timing Turn on/off sql timing
e Edit in an editor (vi or preferred editor)
copy … Save results to CSV file
h Help with SQL
Ctrl + R Search previous SQL command
ir Reference SQL file
Source: pgdash.io](https://image.slidesharecdn.com/gettingstartedwithpostgresql-181020144135/85/Getting-started-with-postgresql-18-320.jpg)
Getting started with postgresql
- 1. Getting Started with Postgresql For Charlotte SQL Saturday on 10/20/2018 By Ramu Pulipati
- 2. Sponsors
- 3. About Me Cofounder / CTO at Botsplash Software-as-a-service omnichannel messaging platform to engage businesses and customers. botsplash.com
- 4. About Postgresql • Free – Open Source RDMS alternative to Microsoft SQL Server, MySQL, Oracle, Mongo DB or any RDBMS and NoSQL databases • Battle tested for over 30 years with continuous improvements to support modern applications • Rich ANSI/ISO Complaint SQL, JSON and Multiple Languages support • Built-in and extensions for high scalability, geolocation and time series based applications • Hosted Providers and Commercial Support • Used for embedded database, web applications and data warehouses
- 5. History & What’s new Version Major Feature V11 10/18/2018 Partition & Index Improvements Query Parallelism Improvements Just-in-time compilation V10 10/05/2017 Declarative Table Partitions Logical Replication Improved Monitoring and Control V9.6 09/29/2016 Parallel Query Foreign Data Wrappers Replication V9.5 07/01/2016 JSONB Modifying Operators Row level security UPSERT statement V9.4 12/18/2014 Introduce JSONB Materialized View Improvements Source: Postgresql Releases
- 6. Capabilities • Full featured Database • ACID Transactions • Mature Server Side Programming • Hot Standby and High Availability • Online backups • Point-in-time recovery • Native Table Partitioning • Spatial Functionality • Full Text Search • JSON and HStore support Source: Introduction to Postgresql Slideshare 80% Commercial Databases Postgresql
- 7. Capabilities (contd …) • Replication and Read Replicas • Built-in pub-sub queue • Multiple schemas with security • Row level security • Native SSL Support • Data Level Encryption • Extensions • Database sharding • Timeseries data • Multi-tenancy • Extensible and Customizable
- 8. Licensing & Community • BSD License open for Open Source, Private and Commercial use • No vendor Lock-in • Predictable releases • Faster Bug fixes • Active Community Source: postgresql.org
- 9. Compare to RDBMS • MySQL • Has better write performance but Postgres is ACID compliant and has better features, reliability and consistency. • SQL Server • Featureful with recently introduced JSON support. Postgres has superset of features and scalable with extensions. • Oracle • Most comprehensive database but very expensive. • Mongo Db • Postgresql outshines read/write for unstructured with JSONB. Source: NoSQL Performance Benchmark 02/27/2018
- 11. Features • Affordability • Technology • Security • Flexibility • Stability • Extensibility • Reliability • Predictability • Community • Auditability Source: Introduction to Postgresql Slideshare
- 12. Getting Started • Download and Install • Windows packaged from EnterpriseDb • Linux from apt or source • Mac installations using homebrew. • Production recommended on *nix systems. Postgres 11 supports Windows 2012 R2 deployment. • Cloud hosted databases from Compose, Citus Data, AWS RDS, Goolge CloudSql, Azure Databases are excellent choice. • Be careful with Docker/Kubernetes deployments.
- 13. Postgresql Client • Instance accessed from TCP/IP Port: 5432 default • CLI/IDE Clients • PSQL, PgAdmin 4, PGCLI, TablePlus, Navicat • Application Clients • Python SqlAlchemy, NodeJs Pg, C# Client, Golang pq Sample Connection String: postgres://username:password@127.0.0.1:5432/northwind
- 14. Postgresql Architecture • Multi-process architecture • Primary postmaster • Per connection backend process • Background maintenance processes • Use pgBouncer to load balance large number of connections Source: The Internals of Postgresql
- 15. Schema and SQL Support • Basic and Complex data types • Complex Queries • Functions, Operators and Aggregate functions • Transactional Integrity • Indexes • Procedural Language • Optimized for data storage • Extend and create custom data types • Error handling Data Type Commonly Used Names Number Smallint, integer, Bigint, decimal, Money Number (auto) Serial, BigSerial Character Char, nchar, Text Binary Bytea Date Time Timestamp with timezone, Timestamp without Timezone, interval Collections Array, JSON, JSONB Misc Boolean, UUID, Geo Types, Network Address Mac Address, Custom Types Full Text Search TsVector, TsQuery See details from tutorials point
- 16. Demo Sample Table and DDL functions Table DDL Sample Function
- 17. More SQL / NoSQL Support • Case Sensitive Schema Names • Case Sensitive Data Storage • Type casting • Date Time formatting • Common Table Expressions • Array Data Types • Upserts • Pivot Tables crosstab function • Materialized Views • HStore • JSONB Structure • Rich Functions Support • EXPLAIN ANALYZE • Pg_stat
- 18. Psql tricks and tips Command Description l List of all databases c <db> Change database name d Show all objects in database d <item> Describe database item x [auto] Show one record at a time timing Turn on/off sql timing e Edit in an editor (vi or preferred editor) copy … Save results to CSV file h Help with SQL Ctrl + R Search previous SQL command ir Reference SQL file Source: pgdash.io
- 19. Concurrency - MVCC • Postgres uses “Multi-version concurrency control”. More details from postgres internals or interdb. • All reads are from the snapshot of the database until committed. • Advantage of this method is reading does not block writing and vice- versa. Isolation at “read-committed” level • This method supports table level and row level locking as well. • Other databases that use this technique are Oracle, CouchDB, etc
- 20. Indexes • Index Support • Single Column • Multi Column • Unique • Partial Indexes • Expression Indexes • Implicit Indexes (PK, UK) • Index Types • B-Tree: Balanced Trees used in most databases • Generalized Inverted Index (GIN): Useful for full text search • Generalized Search Tree (GIST): Useful for geometric and full text search B-Tree
- 21. Disadvantages / Limits • Database only solution • Few available tools compared to commercial. PgAdmin is catching up but relatively new. • CPU bound queries and table inheritance based partitioning before v10. • Limited Talent pool Source: https://www.youtube.com/watch?v=6p2TNPabt6M Source: Postgres limits from sreenstepslive.com
- 22. Best Practices • Performance Optimization • Do not read from Database at all • Use indexes efficiently • Use pg_stats collector to monitor usage and performance • Vacuum regularly to clean up storage • Bench mark hardware and optimize pg parameters • Always use SSL for connectivity in untrusted networks
- 23. References and Follow up • Introduction to Postgresql slideshare • The Internals of Postgresql • Postgresql excercises • Postgres Blogs: 2nd Quadrant, Percona and Citus Data, Citus - Craig Kerstiens Questions? Contact me at ramu@botsplash.com
Editor's Notes
- #3: A quick comment about sponsors. SQL Saturdays cannot take place without the funding provided by sponsors. The speakers are not paid. The organizers and other folks running around making sure this event runs smoothly are all volunteers. However, his facility, the food, and other expenses that go into putting on an event of this magnitude requires money. Sponsors provide that money. So, show your appreciation by saying hi and thank you when you stop by the sponsor tables to stuff your raffle ticket into the box. You might even take a couple of minutes to ask about their product and services. You may learn something valuable that you can bring back to your work, or that might become a career opportunity. It's all part of the very important networking you should be doing while you are here.
- #5: PostgreSQL is an object-relational database management system (ORDBMS) based on POSTGRES, Version 4.2, developed at the University of California at Berkeley Computer Science Department. POSTGRES pioneered many concepts that only became available in some commercial database systems much later.
- #10: ACID (Atomicity, Consistency, Isolation, Durability) https://www.youtube.com/watch?v=6p2TNPabt6M
- #24: https://www.slideshare.net/ScaleGrid/understanding-high-availability-options-in-postgresql?qid=d9d63ef4-7140-44a0-b9c6-5a5fafca02a0&v=&b=&from_search=18