Three Strategies to Increase Performance for Your Applications in AWS.
Download as PPTX, PDF1 like286 views
The document outlines strategies to enhance application performance on AWS using SoftNAS managed storage and cloud NAS solutions, emphasizing the importance of storage size and throughput. It highlights benchmarks comparing AWS EFS and SoftNAS performance, demonstrating how various compute instance sizes affect throughput, IOPS, and latency. The findings suggest that increasing instance size, optimizing storage configurations, and leveraging caching can significantly improve data access and processing speeds.
Three Strategies to Increase Performance for Your Applications in AWS.
- 1. WEBINAR Three Strategies to Increase Performance for Your Applications in AWS Jeff Johnson Head of Product Marketing ARCHITECT LEVEL WEBINAR
- 2. Agenda Customers journey to Buurst SoftNAS Managed Storage Service and Cloud NAS Increasing performance with a managed storage service Increasing performance with a Cloud NAS Performance benchmark: AWS EFS and SoftNAS 2
- 3. Customers Journey to Buurst Companies migrating Lob applications to the cloud could not get the performance required using managed files services Many on-premises LOB applications were designed with fast storage SoftNAS provided cloud storage performance to meet the designed requirements of the LOB application Let’s dive into the data to see why 3
- 4. Companies Trust Buurst for Data performance Data availability Data cost control Data migration Data control and security 4
- 5. Managed Storage and Cloud NAS Physical Storage Interfaces • NFS • CIFS • iSCSI • AFP • FTP • SFTP SSD Cold HDD Cloud Clients On-Prem Clients Storage Cloud NAS Storage • SoftNAS Managed Storage • AWS EFS • AWS FSx 5
- 6. Managed Storage Service If committed to a managed storage – here are 2 strategies to get max perf Physical Storage Interfaces To increase performance 1. Purchase more storage 2. Purchase more throughput SSD Cold HDD Company A Company B Storage FSx: CIFS EFS: NFS Managed Storage • AWS EFS • AWS FSx Company N 6
- 7. Storage (GiB) Throughput (MiB/s) Price/Month 10 0.5 $3 256 12.5 $77 512 25 $154 1,024 50 $307 1,536 75 $461 2,048 100 $614 3,072 150 $922 4,096 200 $1,229 8,192 400 $2,458 16,384 *800 $4,915 32,768 *1600 $ 9,830 65,536 *3200 $19,661 131,072 *6400 $39,322 Increase Performance by Increasing Storage AWS EFS AWS FSx Storage (GiB) Throughput (MiB/s) Price/Month 10 0.5 $5 256 12.5 $115 512 25 $229 1,024 50 $458 1,536 75 $687 2,048 100 $916 3,072 150 $1,374 4,096 200 $1,833 8,192 400 $3,665 16,384 *800 $7,331 32,768 *1600 $14,661 65,536 *3200 $29,323 131,072 *6400 $58,645 7 *Not going to realize numbers above 800MiB/s
- 8. Increase Performance by Increasing Throughput (EFS) File System Size (GiB) Provisioned Throughput Price/Month 10 350 $2,100 256 350 $2,100 512 350 $2,100 1,024 350 $2,100 2,048 350 $2,100 4,096 350 $2,100 8,192 350 $2,458 16,384 400 $4,915 32,768 *800 $9,830 65,536 *1600 $19,661 131,072 *3200 $39,322 File System Size (GiB) Provisioned Throughput Price/Month 10 100 $600 256 100 $600 512 100 $600 1,024 100 $600 2,048 100 $614 4,096 150 $1,229 8,192 200 $2,458 16,384 400 $4,915 32,768 *800 $9,830 65,536 *1600 $19,661 131,072 *3200 $39,322 File System Size (GiB) Provisioned Throughput Price/Month 10 600 $3,600 256 600 $3,600 512 600 $3,600 1,024 600 $3,600 2,048 600 $3,600 4,096 600 $3,600 8,192 600 $3,600 16,384 600 $4,915 32,768 *800 $9,830 65,536 *1600 $19,661 131,072 *3200 $39,322 100 MiB/s 350 MiB/s 600 MiB/s 8
- 9. If AWS EFS is still not Getting the Perf you Need….. Physical Storage Interfaces To increase performance 1. Purchase more storage 2. Purchase more throughput SSD Cold HDD Company A Company B Storage FSx: CIFS EFS: NFS Managed Storage • AWS EFS • AWS FSx Company N Storage Physical Storage Interfaces NFS CIFS iSCSI AFP FTP SFTP To increase performance 1. Increase the compute instance 2. Utilizing read/write cache Other factors we will not be discussing • Disk type and speed • Efficient protocols NVMe Block Storage Cloud Clients On-Prem Clients Cloud NAS 9
- 10. Cloud NAS Storage Physical Storage Interfaces NFS CIFS iSCSI AFP FTP SFTP To increase performance 1. Increase the compute instance 2. Utilizing read/write cache Other factors we will not be discussing • Disk type and speed • Efficient protocols NVMe Block Storage Cloud Clients On-Prem Clients SoftNAS 10
- 11. Cloud NAS Compute Image vCPU RAM Throughput M3.xlarge 4 15 100 Mbps M4.4xlarge 16 64 350 Mbps M5dn.4xlarge 16 64 600 Mbps C5.9xlarge 36 72 1,200 Mbps R4.16xlarge 488 64 2,000 Mbps R5d.24xlarge 768 96 >2,000 Mbps AWS compute images CPU RAM Throughput 11
- 12. Caching of data is one of the most essential and proven technologies for improving cloud storage performance SoftNAS has two types of cache to increase performance, L1 and L2 cache • L1: SoftNAS will use ½ of NAS RAM • L2: SoftNAS can dedicate NVMe or SSD to specific storage pools Read/Write Cache 12
- 13. Throughput is the measurement of how fast (per second) your storage can read/write data The higher the IOPS, the faster you have access to the data stored on your disks Latency measures the time it takes for a component in a sub-system to process a data request or transaction Performance Benchmark AWS EFS and SoftNAS on AWS Throughput IOPS Latency 13
- 14. How we Benchmarked AWS EFS NFS Storage SoftNAS V 4.4.3 No L2 cache Storage Read/Write Sequential Read/Write Random SSDLinux FIO server SSD 14
- 15. 3 Categories of Performance SoftNAS Level: 200 Compute: M4.xlarge, 4 vCPU, 16GB RAM Network: Up to 10 Mbps Block Storage: 4 * EBS gp2 192GiB (768GiB) AWS EFS Storage: 768 GiB SoftNAS Level: 800 Compute: M5.2xlarge, 8 vCPU, 32GB RAM, Network: Up to 10 Mbps Block Storage: 4 * EBS gp2 192GiB (768GiB) AWS EFS Storage: 768 GiB SoftNAS Level 1600 Compute: C5.9xlarge, 36 vCPU, 72GB RAM Network: 1,200 Mbps Block Storage: 6 * EBS gp2 553GiB (3.25TiB) AWS EFS Storage: 3.5 TiB Basic Medium High 100 MB Throughput 350 MB Throughput 600 MB Throughput 15
- 16. SoftNAS on AWS learnings • Throughput is correlated by the size of the NAS virtual machine, the network, and disk speeds • AWS allocates more Throughput on VM images that have access to more RAM and CPU • SoftNAS provides continuous, sustained throughput for predictable performance Storage Throughput 16
- 17. 125.3 83.8 1453 82.6 1835 80.3 126.2 72.8 667 72.5 987 67.5 0 200 400 600 800 1000 1200 1400 1600 1800 2000 SoftNAS M4.xlarge 768 GiB EFS 768 GiB SoftNAS M5.2xlarge 768 GiB EFS 768 GiB SoftNAS C5.9xlarge 3.5 TiB EFS 3.5 TiB 64KiB 70/30 RW S 64KiB 70/30 RW R Throughput (MiBs) – Higher is Better 17
- 18. Storage IOPS *Not used in benchmark SoftNAS on AWS Learnings • Increase the NAS compute, CPU, RAM and network speed increased IOPS • *Use faster disks such as NVMe increases IOPS but dramatically increases the price • *Add more disks to an array aggregates and increases disk’s IOPS Example: SoftNAS has achieved 1 million IOPS with NVMe over 100 Gbps networking 18
- 19. IOPS – Higher is Better 2020 1339 23300 1320 29400 12832019 1164 10600 1160 15841 1080 0 5000 10000 15000 20000 25000 30000 35000 SoftNAS M4.xlarge 768 GiB EFS 768 GiB SoftNAS M5.2xlarge 768 GiB EFS 768 GiB SoftNAS C5.9xlarge 3.5 TiB EFS 3.5 TiB 64KiB 70/30 RW S 64KiB 70/30 RW R Read/Write Sequential Read/Write Random 19
- 20. Latency SoftNAS on AWS learnings • Increase the SoftNAS CPU, RAM and network speed decreases latency • *Use faster disks such as NVMe decrease latency but adds substantial cost • *Using smaller disks to add more disk to an array reduces latency IO Latency Start End Time 20 *Not used in benchmark
- 21. Latency – Lower is Better 30816.53 50642.03 2741.06 50826.38 2225.18 53119.46 30653.52 58374.81 5901.02 57262.05 4037.22 62803.66 0 10000 20000 30000 40000 50000 60000 70000 SoftNAS M4.xlarge 768 GiB EFS 768 GiB SoftNAS M5.2xlarge 768 GiB EFS 768 GiB SoftNAS C5.9xlarge 3.5 TiB EFS 3.5 TiB 64KiB 70/30 RW S 64KiB 70/30 RW R Read/Write Sequential Read/Write Random 21
- 22. Benchmark Results SoftNAS: Level 200 with M4.xlarge, 4 vCPU, 16GB RAM, High Network SoftNAS storage: 4 * EBS gp2 192GiB (768GiB) Total Capacity : 768 GiB AWS EFS storage: 768 GiB SoftNAS NFS 200 Level AWS EFS Block Size MiB/s IOPS Latency (usec) MiB/S IOPS Latency (usec) 4KiB SR 143.00 36700.00 1188.58 48.80 12500.00 2415.22 4KiB SW 84.60 21700.00 1476.64 1.64 410.00 78020.00 4KiB RR 38.50 9848.00 3248.30 47.50 12100.00 2625.66 4KiB RW 19.60 5028.00 6363.21 1.50 376.00 84940.00 64KiB 70/30 RW S 125.30 2020.00 30816.53 83.80 1339.00 50642.03 64KiB 70/30 RW R 126.20 2019.00 30653.52 72.80 1164.00 58374.81 1MiB SR 88.70 88.00 529540.00 99.90 99.00 320400.00 1MiB SW 88.70 88.00 531100.00 100.00 99.00 320400.00 1MiB RR 88.70 88.00 565560.00 99.80 99.00 320520.00 1MiB RW 88.60 88.00 482880.00 99.90 99.00 320290.00 SoftNAS: Level 800 with R5.2xlarge, 8 vCPU, 64 GiB RAM, Up to 10 Mbps SoftNAS storage: 4 * EBS gp2 192GiB (768GiB) Total Capacity : 768 GiB AWS EFS storage: 768 GiB SoftNAS NFS 800 Level AWS EFS Block Size MiB/s IOPS Latency (usec) MiB/S IOPS Latency (usec) 4KiB SR 597.00 153000.00 205.21 48.80 12500.00 2523.49 4KiB SW 261.00 66900.00 475.61 1.60 409.00 78240.00 4KiB RR 69.70 17800.00 1791.93 47.20 12100.00 2649.21 4KiB RW 50.70 12000.00 2462.84 1.50 375.00 86610.00 64KiB 70/30 RW S 1156.00 18500.00 3611.10 82.40 1318.00 50793.73 64KiB 70/30 RW R 687.00 10900.00 5820.06 70.20 1124.00 59428.27 1MiB SR 423.00 423.00 76250.00 99.90 99.00 320420.00 1MiB SW 581.00 580.00 55110.00 100.00 99.00 320000.00 1MiB RR 589.00 589.00 54400.00 99.90 99.00 320340.00 1MiB RW 389.00 388.00 82290.00 99.90 99.00 320220.00 SoftNAS: Level 1600 with C5.9xlarge, 36 vCPU, 72GB RAM, 1,200 Mbps SoftNAS storage: 6 * EBS gp2 553GiB (3.25TiB) Total Capacity : 3.25TiB AWS EFS storage: 3.25 TiB SoftNAS NFS 1600 Level AWS EFS Block Size MiB/s IOPS Latency (usec) MiB/S IOPS Latency (usec) 4KiB SR 550.00 141000.00 218.05 43.60 11200.00 2990.28 4KiB SW 316.00 80800.00 403.20 1.70 425.00 75240.00 4KiB RR 63.90 16400.00 1954.59 45.20 11600.00 2765.03 4KiB RW 87.20 22300.00 1432.68 1.50 374.00 85420.00 64KiB 70/30 RW S 1835.00 29400.00 2225.18 80.30 1283.00 53119.46 64KiB 70/30 RW R 987.00 15841.00 4037.22 67.50 1080.00 62803.66 1MiB SR 1436.00 1436.00 22276.27 339.00 338.00 94430.00 1MiB SW 1173.00 1172.00 29820.00 339.00 339.00 94320.00 1MiB RR 1436.00 1436.00 22280.00 339.00 338.00 94450.00 1MiB RW 1102.00 1101.00 28880.00 339.00 338.00 94380.00 SoftNAS: Level 800 with M5.2xlarge, 8 vCPU, 32GB RAM, Up to 10 Mbps SoftNAS storage: 4 * EBS gp2 192GiB (768GiB) Total Capacity : 768GiB AWS EFS storage: 768 GiB SoftNAS NFS 800 Level AWS EFS Block Size MiB/s IOPS Latency (usec) MiB/S IOPS Latency (usec) 4KiB SR 586.00 150000.00 217.32 52.20 13400.00 2419.08 4KiB SW 261.00 66900.00 475.04 1.70 406.00 78770.00 4KiB RR 111.00 28500.00 1122.81 48.90 12500.00 2515.01 4KiB RW 73.3.00 18800.00 1703.42 1.50 379.00 84320.00 64KiB 70/30 RW S 1453.00 23300.00 2741.06 82.60 1320.00 50826.38 64KiB 70/30 RW R 667.00 10600.00 5901.02 72.50 1160.00 57262.05 1MiB SR 296.00 296.00 107930.00 99.90 99.00 320330.00 1MiB SW 766.00 765.00 41790.00 100.00 99.00 320000.00 1MiB RR 589.00 589.00 54290.00 99.90 99.00 320340.00 1MiB RW 744.00 744.00 43040.00 99.90 99.00 320190.00 22
- 23. Buurst SoftNAS Helps you get the Best Experience for your AWS Investments Throughput is the measurement of how fast (per second) your storage can read/write data The higher the IOPS, the faster you have access to the data stored on your disks Latency measures the time it takes for a component in a sub-system to process a data request or transaction Throughput IOPS Latency 23
- 24. Time is crucial to our customers. By using SoftNAS, we get them up and running in a fraction of the time and our customers think that’s amazing. Michel Bernabel, Managing Director Intellisoft. Throughput: When you Need to Access Lots of Data Throughput Data centric solutions • Many client connections • Web server content • Video files • Office files • AutoCAD files 24
- 25. With SoftNAS, we have twelve workload instances running on EC2 on NFS. We use RAID-10 to get the IOPS and redundancy we need from EBS. Chris Mays IT Consultant The Street IOPS: When you Need to Scale Transitions Transaction centric solutions • Smaller block sizes • Data base • Email server IOPS 25
- 26. Latency: When you Can't Wait for Data Online transactional processing • Streaming & time sensitive • Stock exchange • Banking • Finance Latency SoftNAS has an elegant solution and makes a customer’s life easy. The reliability that SoftNAS products offer, means customers don’t have to get in and mess around with it – Saving valuable time and precious resources. Replication was really simple to implement. Effective and quick, it took only 15 minutes, Typically, this is a complicated and time intensive process. Rudy Pataro Founder Maghub 26
- 27. How to Increase Performance for Your AWS Application Achieve the highest performance for the lowest cost 1. Understand your solution and where the bottlenecks • Throughput • IOPS • Latency 2. Then understand if managed storage will work for you 3. Reach out to SoftNAS to better understand your performance options to develop a solution to meet the specification of your workload Availability Zone B SoftNAS Physical Storage Interfaces NFS CIFS iSCSI Storage NVMeBlock Storage Availability Zone A SoftNAS Physical Storage Interfaces NFS CIFS iSCSI Storage NVMeBlock Storage Replication File Server Index Server PortalWeb Server Database Server 27
- 28. Companies Trust Buurst for Data performance Data availability Data cost control Data migration Data control and security 28
- 29. Performance Blogs and eBooks 29 https://www.buurst.com/get-a-demo/https://www.buurst.com/blog/ https://www.buurst.com/news-resources/ebooks/
- 30. A data performance company
- 31. 1835 80.3 987 67.5 0 200 400 600 800 1000 1200 1400 1600 1800 2000 SoftNAS C5.9xlarge 3.5 TiB EFS 3.5 TiB 64KiB 70/30 RW S 64KiB 70/30 RW R Throughput (MiBs) – Higher is Better 31
- 32. IOPS – Higher is Better 29400 1283 15841 1080 0 5000 10000 15000 20000 25000 30000 35000 SoftNAS C5.9xlarge 3.5 TiB EFS 3.5 TiB 64KiB 70/30 RW S 64KiB 70/30 RW R Read/Write Sequential Read/Write Random 32
- 33. Latency – Lower is Better 2225.18 53119.46 4037.22 62803.66 0 10000 20000 30000 40000 50000 60000 70000 SoftNAS C5.9xlarge 3.5 TiB EFS 3.5 TiB 64KiB 70/30 RW S 64KiB 70/30 RW R Read/Write Sequential Read/Write Random 33
Editor's Notes
- #18: A Linux FIO server was used to perform a throughput evaluation of SoftNAS vs EFS. With a cloud storage capacity of 768 GiB, 3.5 TiB, and a test configuration of 64KiB, 70% read and 30% write, the SoftNAS was able to out perform AWS EFS MiB/s in both sequential and random read/writes.
- #32: A Linux FIO server was used to perform a throughput evaluation of SoftNAS vs EFS. With a cloud storage capacity of 768 GiB, 3.5 TiB, and a test configuration of 64KiB, 70% read and 30% write, the SoftNAS was able to out perform AWS EFS MiB/s in both sequential and random read/writes.