Antonios Giannopoulos Percona 2016 WiredTiger Configuration Variables
0 likes210 views
The document discusses various WiredTiger configuration variables that can be used to tune MongoDB's performance. It provides details on variables like journalCompressor, blockCompressor, prefixCompression, concurrent transactions, eviction triggers and targets, dirty triggers and targets, and eviction threads. Benchmarks are presented comparing the default settings to alternative configurations, showing impacts on load time and transactions per second.
Antonios Giannopoulos Percona 2016 WiredTiger Configuration Variables
- 2. Agenda We are going to discuss : MongoDB WiredTiger Configura/on Variables - What they mean? - How to configure/change? - Benchmarks
- 6. WT configura/on/mongod.conf engineConfig: cacheSizeGB: <number> journalCompressor: <string> directoryForIndexes: <boolean> configString: <string> , <string> … collec/onConfig: blockCompressor: <string> indexConfig: prefixCompression: <boolean> setParameter: wiredTigerConcurrentReadTransac/ons: <number> wiredTigerConcurrentWriteTransac/ons: <number>
- 7. WT configura/on/mongod.conf engineConfig: cacheSizeGB: <number> journalCompressor: <string> directoryForIndexes: <boolean> configString: <string> , <string> … collec/onConfig: blockCompressor: <string> indexConfig: prefixCompression: <boolean> setParameter: wiredTigerConcurrentReadTransac/ons: <number> wiredTigerConcurrentWriteTransac/ons: <number>
- 9. Journal (cum tps) 0 200 400 600 800 1000 1200 0 100 200 300 400 500 600 700 default without compression without journal
- 10. Journal (int tps) 0 200 400 600 800 1000 1200 1400 0 100 200 300 400 500 600 700 default without compression without journal
- 11. WT configura/on/mongod.conf engineConfig: cacheSizeGB: <number> journalCompressor: <string> directoryForIndexes: <boolean> configString:<string> , <string> … collec/onConfig: blockCompressor: <string> indexConfig: prefixCompression: <boolean> setParameter: wiredTigerConcurrentReadTransac/ons: <number> wiredTigerConcurrentWriteTransac/ons: <number>
- 14. blockCompressor (cum tps) 0 200 400 600 800 1000 1200 0 100 200 300 400 500 600 700 snappy zlib no compression
- 15. blockCompressor (int tps) 0 200 400 600 800 1000 1200 1400 1600 0 100 200 300 400 500 600 700 snappy zlib none
- 16. WT configura/on/mongod.conf engineConfig: cacheSizeGB: <number> journalCompressor: <string> directoryForIndexes: <boolean> configString:<string> , <string> … collec/onConfig: blockCompressor: <string> indexConfig: prefixCompression: <boolean> setParameter: wiredTigerConcurrentReadTransac/ons: <number> wiredTigerConcurrentWriteTransac/ons: <number>
- 21. Prefix compression (cum tps) 0 200 400 600 800 1000 1200 0 100 200 300 400 500 600 700 default none
- 22. Prefix compression (int tps) 0 200 400 600 800 1000 1200 1400 0 100 200 300 400 500 600 700 default none
- 23. WT configura/on/mongod.conf engineConfig: cacheSizeGB: <number> journalCompressor: <string> directoryForIndexes: <boolean> configString:<string> , <string> … collec/onConfig: blockCompressor: <string> indexConfig: prefixCompression: <boolean> setParameter: wiredTigerConcurrentReadTransacKons: <number> wiredTigerConcurrentWriteTransacKons: <number>
- 26. Concurrent Transac/ons (cum tps) 0 200 400 600 800 1000 1200 0 100 200 300 400 500 600 700 trx-128 trx-64 trx-256
- 27. Concurrent Transac/ons (int tps) 0 200 400 600 800 1000 1200 1400 0 100 200 300 400 500 600 700 trx-128 trx-64 trx-256
- 28. WT configura/on/mongod.conf engineConfig: cacheSizeGB: <number> journalCompressor: <string> directoryForIndexes: <boolean> configString: <string> , <string> … collec/onConfig: blockCompressor: <string> indexConfig: prefixCompression: <boolean> setParameter: wiredTigerConcurrentReadTransac/ons: <number> wiredTigerConcurrentWriteTransac/ons: <number>
- 29. WT configura/on Every WT variable can be assigned to configString We are going to examine a subset: - evic/on_target - evic/on_trigger - evic/on_dirty_target - evic/on_dirty_trigger - evic/on.threads_min - evic/on.threads_max - direct_IO
- 38. evic/on_trigger/target (cum tps) 0 200 400 600 800 1000 1200 0 100 200 300 400 500 600 700 default 95 and 90 90 and 89 95 and 94
- 39. Evic/on_trigger/target (int tps) 0 200 400 600 800 1000 1200 1400 1600 0 100 200 300 400 500 600 700 default 95 and 90 90 and 89 95 and 94
- 43. dirty_trigger/target (cum tps) 0 200 400 600 800 1000 1200 0 100 200 300 400 500 600 700 default 20 and 5 80 and 70
- 44. dirty_trigger/target (int tps) 0 200 400 600 800 1000 1200 1400 1600 0 100 200 300 400 500 600 700 default 20 and 5 80 and 70
- 47. evict_threads_min/max (cum tps) 0 200 400 600 800 1000 1200 0 100 200 300 400 500 600 700 default 4 and 6 2 and 8 4 and 4
- 48. evict_threads_min/max (int tps) 0 200 400 600 800 1000 1200 1400 1600 0 100 200 300 400 500 600 700 default 4 and 6 2 and 8 4 and 4
- 49. direct_io STORAGE STORAGE FS cache WT cache WT cache FS cache RAM RAM
- 50. direct_io • minimize the opera/ng system cache effects of I/O to and from WiredTiger's buffer cache • avoid double-buffering of blocks in WiredTiger's cache and the opera/ng system buffer cache • avoid stalling underlying solid-state drives by wri/ng a large number of dirty blocks. WiredTiger.config: direct_io=(data) mongod.conf : storage.wiredTiger.engineConfig.configString: direct_io=(data)
- 52. Direct IO (cum tps) 0 200 400 600 800 1000 1200 0 100 200 300 400 500 600 700 default direct IO
- 53. Direct IO (int tps) 0 200 400 600 800 1000 1200 1400 1600 0 100 200 300 400 500 600 700 default direct IO