SlideShare a Scribd company logo
Introducing PQuery by Percona
Open Source enterprise-class solutions
Alexey Bychko, Lead Release Manager (Percona)
Roel van de Paar, Senior QA Lead (Percona)
About Percona
Percona Server for
MySQL
Percona XtraDB
Cluster
Percona
XtraBackup
Percona Toolkit
150+ staff members
30 countries of the world, 30 US states
Perconians work remotely from their homes
HQ in Raleigh, North Carolina, USA
Founded in 2006, serving 3000 customers for 10 years
Many customers are well-known brands
Percona Server for
MongoDB
Percona Monitoring
and Management
Percona Software Users in Russia & CIS
* This information is available in the Internet and made public by these companies.
PQuery for multithreaded stress tests
… and much more
For What and Why?
Random Query Generator, pros & cons
Why we started it?
PQuery to solve RQG speed problems (at start)
new opensource and free tool from Percona
used in Percona on daily basis
first and second generations of PQuery
First results
to CRASH, to KILL and not to TEST
speed is important!
unexpected and great results
don’t share prototypes!
you can learn something only from logs
PQuery framework has been created
The success of PQuery
… and results in real life
First Success Stories
automatic test case creation
near 100% test reproducibility
15 seconds per trial
single and multi-threaded tests
sequential and random SQL
valued tool in Percona QA
evolution to powerful tool
PQuery is supported on *nix
MySQL Server 5.7, RC1 & RC2, were tested with pquery
a significant number of bugs were discovered in RocksDB
≈ 270 new bugs were found in 2 months
query correctness testing
•easy to build
•easy to use
•great flexibility
PQuery v2.0
… and even more
PQuery v1.0 -> v2.0 transition
can we support PXC? other multi-node setups?
produce different load to the different nodes?
include / exclude some particular nodes?
can we log extended information about queries?
client output for comparison?
reproduce something - log replaying?
PQuery v2.x changes
=> Isolated processes, fork() model
=> Configuration with rich INI file at start
=> Separated config for each node
=> Extended logging
PQuery to make the systems better
… learn and understand that first
What may be better in your setup?
do you need fine-tuning?
what to optimize if yes?
MySQL optimizations
OS optimizations
cluster optimizations
troubleshooting
Outcome: do you need High-Load setup?
ext4, xfs, zfs, ufs? LVM? virtualization or bare metal?
get timings for ALL queries. not only for slow ones.
look for dead or slow nodes
different nodes -> different queries
do the upgrade and run checks
cluster behavior at whole
The future of PQuery
… to make it even better
Possible future of PQuery
PostgreSQL support?
extended cluster and replication testing?
production packages and tarballs
comparing engines - timings, output, supported features, errors
replay scenarios and mysql logs
and much-much more …
Additional resources
https://github.com/Percona-QA/pquery.git main repository
https://goo.gl/nPAHVA Free MySQL QA & Bash/Linux Training Series
MySQL QA Episodes 1-13. PQuery, Framework, Reducer
How to download and use
the best tasks to apply
how to report the bugs and contribute
how to share your success stories
Percona celebrates its 10th anniversary!
Share your Percona success story with us
for cross promotion
=> percona10@percona.com <=
Send your CV to join our team!
https://www.percona.com/about-percona/careers
Percona Live: Call for Papers Deadline - November 13
Percona Live Santa Clara to take place April 24-27 in Santa Clara, CA.
Submission Guidelines:
http://bit.ly/2exss8u
Submission Form:
http://bit.ly/2e01oT2
DATABASE PERFORMANCE
MATTERS

More Related Content

PPT
Planning for-high-performance-web-application
PPTX
Jenkins as Code
DOCX
Tharun_Resume_Updated
PDF
PDF
Introduction to ClustrixDB
PPTX
Boulder_OneStop_presentation
PDF
제4회 한국IBM과 함께하는 난공불락 오픈소스 인프라 세미나-Asible
KEY
Rubyspec y el largo camino hacia Ruby 1.9
Planning for-high-performance-web-application
Jenkins as Code
Tharun_Resume_Updated
Introduction to ClustrixDB
Boulder_OneStop_presentation
제4회 한국IBM과 함께하는 난공불락 오픈소스 인프라 세미나-Asible
Rubyspec y el largo camino hacia Ruby 1.9

What's hot (20)

PDF
Trivadis TechEvent 2017 With the CLI through the Oracle Cloud Martin Berger
PDF
MySQL Storage Engines - which do you use? TokuDB? MyRocks? InnoDB?
PDF
Anton Moldovan "Building an efficient replication system for thousands of ter...
PDF
MySQL Oslayer performace optimization
PDF
제2회난공불락 오픈소스 세미나 커널튜닝
PDF
Oracle database might have problems with stale NFSv3 locks upon restart
PDF
SnapDiff
PPTX
OTN Tour 2014: Rac 11g vs 12c
PDF
Advanced Percona XtraDB Cluster in a nutshell... la suite
PPTX
MySQL InnoDB Cluster 미리보기 (remote cluster test)
PPT
High Availabiltity & Replica Sets with mongoDB
PDF
Prm dul is an oracle database recovery tool database
PDF
Oss4b - pxc introduction
PPTX
NodeJs Session02
PDF
MySQL Group Replication
PDF
ELK: Moose-ively scaling your log system
ODP
MySQL HA with PaceMaker
PPT
Postgres Presentation
PDF
Steps to identify ONTAP latency related issues
PDF
Erp installation r12.2
Trivadis TechEvent 2017 With the CLI through the Oracle Cloud Martin Berger
MySQL Storage Engines - which do you use? TokuDB? MyRocks? InnoDB?
Anton Moldovan "Building an efficient replication system for thousands of ter...
MySQL Oslayer performace optimization
제2회난공불락 오픈소스 세미나 커널튜닝
Oracle database might have problems with stale NFSv3 locks upon restart
SnapDiff
OTN Tour 2014: Rac 11g vs 12c
Advanced Percona XtraDB Cluster in a nutshell... la suite
MySQL InnoDB Cluster 미리보기 (remote cluster test)
High Availabiltity & Replica Sets with mongoDB
Prm dul is an oracle database recovery tool database
Oss4b - pxc introduction
NodeJs Session02
MySQL Group Replication
ELK: Moose-ively scaling your log system
MySQL HA with PaceMaker
Postgres Presentation
Steps to identify ONTAP latency related issues
Erp installation r12.2
Ad

Similar to Pquery_presentation_03 2 (20)

PDF
[db tech showcase OSS 2017] A11: How Percona is Different, and How We Support...
PDF
Proxy SQL 2.0 with PXC
PDF
Percona XtraDB 集群内部
PDF
Percona XtraDB Cluster - Small Presentation
PDF
17 Things Developers Should Know About Databases
PDF
Performance optimisations PHP meetup Rotterdam
PDF
Fosdem managing my sql with percona toolkit
PDF
Percona Xtradb Cluster (pxc) 101 percona university 2019
PDF
MySQL Ecosystem in 2020
PPTX
Webinar 2017. Supercharge your analytics with ClickHouse. Vadim Tkachenko
PDF
Percona XtraDB 集群安装与配置
PDF
Percona Server 8.0
PPTX
Finding an unusual cause of max_user_connections in MySQL
PDF
Percon XtraDB Cluster in a nutshell
PDF
Getting Modern With MySQL
PDF
Getting modern with my sql
PDF
Capacity planning for your data stores
PPTX
Mysql ecosystem in 2018
PPTX
Peter Zaitsev "18 ways to fix MySQL bottlenecks"
PDF
2014 OSDC Talk: Introduction to Percona XtraDB Cluster and HAProxy
[db tech showcase OSS 2017] A11: How Percona is Different, and How We Support...
Proxy SQL 2.0 with PXC
Percona XtraDB 集群内部
Percona XtraDB Cluster - Small Presentation
17 Things Developers Should Know About Databases
Performance optimisations PHP meetup Rotterdam
Fosdem managing my sql with percona toolkit
Percona Xtradb Cluster (pxc) 101 percona university 2019
MySQL Ecosystem in 2020
Webinar 2017. Supercharge your analytics with ClickHouse. Vadim Tkachenko
Percona XtraDB 集群安装与配置
Percona Server 8.0
Finding an unusual cause of max_user_connections in MySQL
Percon XtraDB Cluster in a nutshell
Getting Modern With MySQL
Getting modern with my sql
Capacity planning for your data stores
Mysql ecosystem in 2018
Peter Zaitsev "18 ways to fix MySQL bottlenecks"
2014 OSDC Talk: Introduction to Percona XtraDB Cluster and HAProxy
Ad

Pquery_presentation_03 2

  • 1. Introducing PQuery by Percona Open Source enterprise-class solutions Alexey Bychko, Lead Release Manager (Percona) Roel van de Paar, Senior QA Lead (Percona)
  • 2. About Percona Percona Server for MySQL Percona XtraDB Cluster Percona XtraBackup Percona Toolkit 150+ staff members 30 countries of the world, 30 US states Perconians work remotely from their homes HQ in Raleigh, North Carolina, USA Founded in 2006, serving 3000 customers for 10 years Many customers are well-known brands Percona Server for MongoDB Percona Monitoring and Management
  • 3. Percona Software Users in Russia & CIS * This information is available in the Internet and made public by these companies.
  • 4. PQuery for multithreaded stress tests … and much more
  • 5. For What and Why? Random Query Generator, pros & cons Why we started it? PQuery to solve RQG speed problems (at start) new opensource and free tool from Percona used in Percona on daily basis first and second generations of PQuery
  • 6. First results to CRASH, to KILL and not to TEST speed is important! unexpected and great results don’t share prototypes! you can learn something only from logs PQuery framework has been created
  • 7. The success of PQuery … and results in real life
  • 8. First Success Stories automatic test case creation near 100% test reproducibility 15 seconds per trial single and multi-threaded tests sequential and random SQL valued tool in Percona QA evolution to powerful tool
  • 9. PQuery is supported on *nix MySQL Server 5.7, RC1 & RC2, were tested with pquery a significant number of bugs were discovered in RocksDB ≈ 270 new bugs were found in 2 months query correctness testing •easy to build •easy to use •great flexibility
  • 10. PQuery v2.0 … and even more
  • 11. PQuery v1.0 -> v2.0 transition can we support PXC? other multi-node setups? produce different load to the different nodes? include / exclude some particular nodes? can we log extended information about queries? client output for comparison? reproduce something - log replaying?
  • 12. PQuery v2.x changes => Isolated processes, fork() model => Configuration with rich INI file at start => Separated config for each node => Extended logging
  • 13. PQuery to make the systems better … learn and understand that first
  • 14. What may be better in your setup? do you need fine-tuning? what to optimize if yes? MySQL optimizations OS optimizations cluster optimizations troubleshooting
  • 15. Outcome: do you need High-Load setup? ext4, xfs, zfs, ufs? LVM? virtualization or bare metal? get timings for ALL queries. not only for slow ones. look for dead or slow nodes different nodes -> different queries do the upgrade and run checks cluster behavior at whole
  • 16. The future of PQuery … to make it even better
  • 17. Possible future of PQuery PostgreSQL support? extended cluster and replication testing? production packages and tarballs comparing engines - timings, output, supported features, errors replay scenarios and mysql logs and much-much more …
  • 18. Additional resources https://github.com/Percona-QA/pquery.git main repository https://goo.gl/nPAHVA Free MySQL QA & Bash/Linux Training Series MySQL QA Episodes 1-13. PQuery, Framework, Reducer How to download and use the best tasks to apply how to report the bugs and contribute how to share your success stories
  • 19. Percona celebrates its 10th anniversary! Share your Percona success story with us for cross promotion => percona10@percona.com <= Send your CV to join our team! https://www.percona.com/about-percona/careers
  • 20. Percona Live: Call for Papers Deadline - November 13 Percona Live Santa Clara to take place April 24-27 in Santa Clara, CA. Submission Guidelines: http://bit.ly/2exss8u Submission Form: http://bit.ly/2e01oT2