Series7 Performance Whitepaper
0 likes541 views
The document discusses Adaptec's Series 7 SAS/SATA RAID adapters, which provide high native port counts and PCIe Gen3 performance. Key points: - Series 7 adapters have 16 or 24 native SAS/SATA ports, allowing them to fully utilize PCIe Gen3's performance, unlike most adapters that max out at 8 ports. - Using expanders reduces performance significantly compared to direct port connections, causing up to 70% lower sequential speeds and 60% lower random IOPS. - In tests with 24 SSDs, the 24-port Series 7 adapter achieved over 500,000 random IOPS, 6.4GB/s read throughput, and was over 10 times
Series7 Performance Whitepaper
- 1. SERIES 7 PERFORMANCE WHITEPAPER Adaptec Series 7 SAS/SATA RAID Adapters PCIe Gen3 family of high port count 6Gb/s solutions with game-changing performance Introduction Business and consumer demand for fast and reliable access to A select group of storage adapters that claim to be designed for data and content continues to grow. Data centers are faced with PCIe Gen3 has appeared the market, but most of them max out the challenge of meeting that demand even as tight budgets at 8 ports and cannot take full advantage of PCIe Gen3’s superior force them to reduce the cost of service (COS) per user as well performance. as hardware-related Capital Expenses (CapEx) and Operating Expenses (OpEx). As we will see, only Adaptec Series 7 SAS/SATA RAID adapters, available with 16 or 24 native SAS/SATA ports, are designed to Compounding the challenge is the shrinking availability of fully exploit the high-performance characteristics of PCIe Gen3 physical space — many data centers are unwilling to take on the (Figure 1). expense of more real estate and the associated costs that come from powering and cooling larger spaces. 8 x 6Gb/s SAS ports 4.8 GB/s Bottleneck 16 x 6Gb/s SAS ports 9.6 GB/s Clearly, the days of simply adding more servers to accommo- date more traffic are over. As a result, server vendors have introduced smaller, denser, server chassis sizes that help data centers add more storage I/O capability while maintaining the same or a smaller footprint. Accordingly, storage vendors are focusing on small form-factor 8 lane PCI Gen3 8 GB/s 8 lane PCI Gen3 8 GB/s solutions that will fit into the smaller chassis while providing the high performance that data centers require. Storage components, such as hard disk drives, are getting physically Figure 1. PCIe Gen3 smaller (though increasing in capacity). Low-profile storage adapters are becoming more common as well, but only a select few are able to deliver top I/O performance and low latency in Significance of high native port count such a compact form factor. This is an important consideration In recent years, the storage industry has been transitioning from for data centers because finding the right combination of form, 3.5-inch storage drives to 2.5-inch Small Form Factor (SSF) fit and function, allows them to deploy one SKU for almost drives as advancements in technology allow storage vendors to any configuration and simplify everything from the purchase address the aforementioned physical space challenges faced by decision to installation to maintenance. data centers. Not only do SFF drives offer the obvious advantage of allowing more drives to fit into the same server rack space, but Adaptec Series 7 SAS/SATA RAID adapters address the 2.5-inch drives hold more capacity per space occupied than the needs of space-challenged modern data centers by doubling 3.5-inch drives they are replacing. Indeed, SFF HDDs now boast storage performance compared to previous-generation RAID storage capacities of 1TB or more. adapters while featuring high port counts and low-profile form factors that reduce latency, real estate requirements and power Additionally, the cost of 2.5-inch flash-based solid state drives consumption. (SSDs) is finally coming more in line with HDDs in terms of the traditional “cost per GB of capacity” metric. That, combined The new generation of PCIe with a higher read bandwidth, higher input/output operations per second (IOPs), better mechanical reliability, and higher PCI Express (PCIe) is a motherboard-mounted expansion resistance to shock and vibrations compared to HDDs, is driving bus that, through a connected device such as a RAID adapter, an industry-wide transition to SSDs. connects the host system processor to add-on peripherals, such as storage systems. Introduced into servers and workstations As the quantity of drives in a server chassis increases, the storage in 2012, the third generation of PCIe (PCIe Gen3) doubles adapter card’s port count requirements also increase. bandwidth to the host compared to its PCIe Gen2 predecessor, increasing per-lane throughput from 250 MB/s to 500 MB/s. The traditional method for increasing the storage adapter’s port count has been through the use of an expander — a board With PCIe Gen2, 8 6Gb/s SAS/SATA ports are sufficient to that enables the connection of additional attached SAS or achieve maximum performance. However, PCIe Gen3 requires SATA devices when the adapter does not have enough ports a minimum of 16 native 6Gb/s SAS/SATA ports to double the to accommodate them. However, expanders have a number bandwidth through the storage connections.
- 2. 7,000 7,000 6,000 6,000 SERIES 7 PERFORMANCEASRWHITEPAPER 24-port 72405 RAID adapter 24-port ASR 72405 5,000 (direct connection) RAID adapter 5,000 (direct connection) 8-port Competing RAID adapter 4,000 + I/O acceleration software RAID adapter 8-port Competing 4,000 (using 1 expander) Adaptec Series 7 SAS/SATA RAID Adapters 3,000 + I/O acceleration software (using 1 expander) 2 3,000 2,000 2,000 1,000 of limitations: not only do they add complexity, they also This problem can be partially overcome if SAS devices are used, 1,000 occasionally face compatibility issues with other components 0since they are dual-ported and allow all 8 SAS port connections 0 1MB Sequential Reads 1MB Sequential Writes in the storage solution. to be leveraged through the1MB Sequential Writes (MB/sec) expander. However, as illustrated 1MB Sequential Reads (MB/sec) (MB/sec) (MB/sec) in Figures 4 and 5 below, performance of the 8 6Gb/s SAS On top of that, expanders are notorious for causing latency ports flattens out at the peak data rate and competing products and limiting data transfer bandwidth. Both of these issues have Fig 4 RAID 5 performance (24 SAS SSDs) cannot match Adaptec 5 performance (24 SAS SSDs) Fig 4 RAID Series 7 speeds. long been tolerated by data centers using HDDs, as they did not cause a huge impact on the already slow read and write 600,000 speeds of HDDs. But as higher-performance SSDs gain traction 600,000 in storage solutions, the latency and bandwidth issues of 500,000 I/Os per second 500,000 expanders have become more noticeable, and therefore less I/Os per second 400,000 24-port ASR 72405 acceptable. 400,000 RAID adapter 24-port ASR 72405 (direct connection) RAID adapter 300,000 (direct connection) In a RAID 5 configuration using 24 SATA SSDs (Figure 2), 300,000 8-port Competing RAID adapter + 8-port Competing RAID I/O acceleration the use of expanders causes a roughly 60% performance drop 200,000 software (using 1 expander) adapter + I/O acceleration software (using 1 expander) 200,000 on random read IOPs, and a roughly 20% performance drop 100,000 on OLTP read/write IOPs, compared to a direct connection 100,000 through native RAID 5 Random Performance Fig 2 ports. 0 4K Random Reads 4K Random Writes 0 8K OLTP (IOPs)Random Reads 4K Random Writes 4K (IOPs) (IOPs) 8K OLTP (IOPs) (IOPs) (IOPs) 600,000 500,000 Figure 4. RAID 5 Performance (24 SAS SSDs) 24-port ASR 72405 Fig 5 RAID 5 Sequential Performance RAID adapter Fig 5 (24 SAS Sequential Performance RAID 5 SSDs) 400,000 (direct connection) (24 SAS SSDs) Fig 2 RAID 5 Random Performance 8-port Competing RAID adapter 300,000 + I/O acceleration software (using 1 expander) 7,000 7,000 600,000 200,000 6,000 MB per second 6,000 24-port ASR 72405 500,000 MB per second 100,000 5,000 RAID adapter 24-port ASR 72405 24-port ASR 72405 5,000 RAID adapter (direct connection) RAID adapter 400,000 (direct connection) 4,000 (direct connection) 8-port Competing RAID 0 4,000 4K Random Reads 4K Random Writes 8K OLTP 8-port Competing RAID adapter adapter + 8-port Competing RAID I/O acceleration (IOPs) (IOPs) (IOPs) + I/O acceleration software 3,000 software (using 1 expander) adapter + I/O acceleration 300,000 3,000 software (using 1 expander) (using 1 expander) 2,000 200,000 2,000 Figure Fig 3 RAID 5 Sequential Performance 2. RAID 5 Random Performance (24 SATA SSDs) 1,000 100,000 1,000 0 Similarly, 0 in a RAID 5 configuration with SATA SSDs (Figure 0 1MB Sequential Reads (MB/sec) 1MB Sequential Writes 1MB Sequential Reads (MB/sec) 1MB Sequential Writes 7,000 3), theRandom Reads 4K Random Writes a roughly 70% performance drop 4K use of expanders cause (IOPs) (IOPs) 8K OLTP (IOPs) (MB/sec) (MB/sec) 6,000 sequential read MB/s, and a roughly 40% performance drop on 24-port ASR 72405 Figure 5. RAID 5 Sequential Performance (24 SAS SSDs) 5,000 sequential write MB/s, compared to a direct connection on RAID adapter (direct connection) through native ports. 4,000 Fig 3 RAID 5 Sequential Performance 8-port Competing RAID adapter + I/O acceleration software (using 1 expander) 3,000 Another drawback of expanders is the additional cost they 7,000 2,000 add to a storage solution — about $200 for the expander 6,000 1,000 24-port ASR 72405 itself plus the cost of cables plus installation, increased power 5,000 RAID adapter (direct connection) consumption, and maintenance costs. 0 1MB Sequential Reads 1MB Sequential Writes 8-port Competing RAID adapter 4,000 (MB/sec) (MB/sec) + I/O acceleration software An ideal solution for data centers would be a 6Gb/s storage (using 1 expander) 3,000 controller with a high native port count that can take advantage 2,000 of PCIe Gen3’s performance. Fig 4 RAID 5 performance (24 SAS SSDs) 1,000 However, as mentioned, most 6Gb/s storage adapters max 0 out at only 8 ports. 600,000 1MB Sequential Reads 1MB Sequential Writes (MB/sec) (MB/sec) 500,000 I/Os per second Figure 3. RAID 5 Sequential Performance (24 SATA SSDs) 400,000 Fig 4 24-port ASR 72405 RAID 5 performance (24 SAS SSDs) RAID adapter (direct connection) 300,000 8-port Competing RAID adapter + I/O acceleration 600,000 200,000 software (using 1 expander) 500,000 100,000 r second 400,000 0 24-port ASR 72405 RAID adapter 4K Random Reads 4K Random Writes 8K OLTP
- 3. SERIES 7 PERFORMANCE WHITEPAPER Adaptec Series 7 SAS/SATA RAID Adapters 3 Adaptec Series 7 Performance comparison The Adaptec Series 7 SAS/SATA RAID adapter family features The following data compares the 24-port PCIe Gen3 Adaptec PMC’s 24 port PM8015 RAID-on-Chip (ROC), which 72405 SAS/SATA RAID adapter to a competing 8-port PCIe combines an x8 PCIe Gen3 interface with 6Gb/s SAS ports to Gen3 RAID adapter. enable a new generation of high performance, high native port count RAID adapters that are unmatched by any other ROC in Adaptec 72405 performance summary: the industry. • Max Read IOPs observed: 534k IOPs Traditionally, RAID adapter performance has centered around (RAID-0: 24x SSD: Random Read 4KB: Queue Depth = 64) read and write throughput, measured in megabytes per second • Max Write IOPs recorded: 374k IOPs (MB/s). Using this metric, Series 7 adapters perform up to (RAID-0: 24x SSD: Random Write 4KB: Queue Depth = 64) 83% better than competing RAID adapters — 6.6GB/s on sequential reads and up to 2.6GB/s on sequential writes on • Max Read throughput observed: 6400 MB/s parity RAID 5. (RAID-0: 24x SSD: Sequential Read 1MB: Queue Depth = 64) Moreover, with the popularity and growth of SSDs, input/ • Max Write throughput observed: 5229 MB/s output operations per second (IOPs) is emerging as the new (RAID-0: 24x SSD: Sequential Write 1MB: Queue Depth = 256) “lead horse” in performance metrics, with the most common • Coalesce Read IOPs performance is observed at: 1.02M IOPs configuration being the 4K random-read number. Using 4K (RAID-0: 24x SATA Sequential Read 512B: QD=256) I/O size in random scenarios is driven by the fact that most operating systems use 4K cache sizes in the server DRAM • Coalesce Write IOPs performance is observed at: 1.07M IOPs and, with that, 4K is typically the smallest I/O size for random (RAID-0: 24x SATA Sequential Write 512B: QD=256) workloads. In a RAID 5 configuration with 16 direct-connected SSDs, Series 7 adapters again lead the field with 450K IOPs — nearly 10x the performance of previous-generation RAID Platform: Intel CanoePass Qty. 1x Intel® Intel Xeon 2.9Ghz (8 Cores) (LGA2011) adapters, and more than double that of the competition. 2x 4GB (or 8GB total) DDR3-1333Mhz ECC As noted earlier, RAID adapters with only 8 native ports HBA: cannot pass PCIe Gen3’s performance gains through from Cache Mode: SSD: Logical Read=OFF / Write=OFF / Physical Write=ON the bus to the storage connections. Adaptec Series 7 RAID SAS/SATA: Logical Read=ON / Write=ON / Physical Write=ON adapters are the first on the market to take full advantage ASR 72405 Fw B20104 / Drv B20100 of PCIe Gen3 performance gains by using HD mini-SAS connectors to offer options with 16 or 24 native SAS/SATA Competing Fw v23.7.0-0035 / Drv v5.2.127.64 / MSM 12.05.03.00 adapter* * I/O acceleration software, costing additional ~ $150, ports (Figure 6). enabled via Software Key module Enclosure: Supermicro SAS216A, 24-bay SAS 6.0Gb/s Passive Backplane Supermicro SAS2-216EL2, two independent 24-bay Dual SAS Expander 6.0Gb/s Expander Backplanes 16 x 6Gb/s SAS ports Card: (Dual SMC expander backplanes needed to avoid SATA $200+ performance bottleneck) Device: Qty 24x SSD OCZ Deneva “R” Series SLC: D2RSTK251S14-005 6Gb 50GB Fw3.00E SAS Seagate Savvio 15K.3: ST9146853SS 6Gb 146GB Fw0002 8 x 6Gb/s SAS ports 16 x 6Gb/s SAS ports SATA Seagate Constellation.2: ST9500620NS 6Gb 500GB FwSN02 Software: OS Windows 2008 R2 SP1 64bit IOMETER Version: 2006.07.27 Workers: 4 Workload: SeqRead 512B/1MB, SeqWrite 512B/1MB Workload: RndRead 512B/4KB, RndWrite 512B/4KB Figure 6. Configuration Complexities and Costs Workload: OLTP 4KB/8KB Expanders vs. Direct Connect Ramp/Run: 10sec. / 30sec.
- 4. SERIES 7 PERFORMANCE WHITEPAPER Adaptec Series 7 SAS/SATA RAID Adapters 4 The following data compares the 24-port PCIe Gen3 Adaptec 72405 SAS/SATA RAID adapter to a competing 8-port PCIe Gen3 RAID adapter. RAID – 5 SSD Based on Queue Depth = 256 24-port ASR 72405 Competing 8-port adapter Competing 8-port adapter (with (Direct connection) % I/O acceleration software) % (No I/O acceleration software) 512B Random Reads (IOPs) 531,580 163,283 225.6% 373,054 42.5% 512B Random Writes (IOPs) 28,311 16,771 68.8% 16,759 68.9% 4K Random Reads (IOPs) 529,731 163,283 224.4% 377,448 40.3% 4K Random Writes (IOPs) 28,488 16,655 71.1% 16,660 71.0% 1MB Sequential Reads (MB/s) 6,192 3,928 57.6% 3,904 58.6% 1MB Sequential Writes (MB/s) 2,237 2,185 2.4% 2,190 2.2% Note: “%” references the comparison of ASR 72405 over competing product. RAID - 10 SSD Based on Queue Depth = 256 24-port ASR 72405 Competing 8-port adapter Competing 8-port adapter (with (Direct connection) % I/O acceleration software) % (No I/O acceleration software) 512B Random Reads (IOPs) 534,824 170,338 214.0% 373,396 43.2% 512B Random Writes (IOPs) 130,851 43,901 198.1% 43,752 199.1% 4K Random Reads (IOPs) 535,546 170,092 214.9% 364,165 47.1% 4K Random Writes (IOPs) 192,051 43,808 338.4% 43,508 341.4% 1MB Sequential Reads (MB/s) 5,433 3,911 38.9% 3,888 39.7% 1MB Sequential Writes (MB/s) 2,892 1,418 104.0% 1,404 106.0% Note: “%” references the comparison of ASR 72405 over competing product. RAID – 0 SSD Based on Queue Depth = 256 24-port ASR 72405 Competing 8-port adapter Competing 8-port adapter (Direct connection) (No I/O acceleration software) % (with I/O acceleration software) % 512B Random Reads (IOPs) 531,852 169,822 213.2% 375,676 41.6% 512B Random Writes (IOPs) 238,681 166,875 43.0% 352,385 -32.3% 4K Random Reads (IOPs) 527,425 170,024 210.2% 377,964 39.5% 4K Random Writes (IOPs) 245,327 166,803 47.1% 295,252 -16.9% 1MB Sequential Reads (MB/s) 6,182 3,467 78.3% 3,435 80.0% 1MB Sequential Writes (MB/s) 5,229 2,790 87.5% 2,751 90.1% Note: “%” references the comparison of ASR 72405 over competing product.
- 5. SERIES 7 PERFORMANCE WHITEPAPER Adaptec Series 7 SAS/SATA RAID Adapters 5 Conclusion In order to continue meeting customer demand for fast and reliable access to data and content, data centers must employ efficient storage solutions that maximize I/O capability while fitting within budgetary and physical space requirements. A new generation of PCIe Gen3 storage adapters seek to enhance storage I/O performance, but only Adaptec Series 7 SAS/SATA RAID adapters fully address the needs of space- challenged modern data centers by offering 16 ports required to maximize PCIe Gen3 performance. Series 7 adapters perform up to 83% better than competing RAID adapters in read and write throughput — 6.6 GB/s on sequential reads and up to 2.6 GB/s on sequential writes on parity RAID 5 — and lead the field with 450K IOPs — nearly 10x the performance of previous-generation RAID adapters, and more than double that of the competition. PMC-Sierra, Inc. 1380 Bordeaux Dr. World Wide Web: www.adaptec.com Sunnyvale, CA 94089 USA Pre-Sales Support: US and Canada: 1 (800) 442-7274 or (408) 957-7274 or adaptecsales@pmc-sierra.com Tel: +1 (408) 239-8000 UK: +44 1276 854 528 or uk_sales@pmc-sierra.com Australia: +61-2- 90116787 Singapore: +65-92351044 © Copyright PMC-Sierra, Inc. 2012. All rights reserved. PMC, PMC-SIERRA and Adaptec are registered trademarks of PMC-Sierra, Inc. “Adaptec by PMC” is a trademark of PMC-Sierra, Inc. Other product and company names mentioned herein may be trademarks of their respective owners. For a complete list of PMC-Sierra trademarks, see www.pmc-sierra.com/legal. WP_SERIES7PERF_100212_US Information subject to change without notice.