SlideShare a Scribd company logo
Lisa Spelman
VICE PRESIDENT & GENERAL MANAGER
INTEL® XEON® PRODUCTS AND DATA CENTER MARKETING
NEW:CascadeLakeAdvancedPerformance
New:XeonEProcessor–Entry1SServerSolution
New:OptaneDCPersistentMemoryUpdate
Cascade lake-advanced-performance-press-deck
SILICON PHOTONICS
ETHERNET
OMNI-PATH FABRIC
WORLDRECORDS
ANDCOUNTING…
intel®xeon®processor
CPUsShippedInto
Agrowing30MUnitTAM
spanningserver,storage,network
IN Q3’18
Security MitigationsLeadership Performance
Higher Frequencies
Optimized Cache Hierarchy Intel Deep Learning Boost (VNNI)
Optimized Frameworks & Libraries
NEXT GEN INTEL® XEON® SCALABLE PROCESSOR
NEW CLASS OF INTEL® XEON® SCALABLE PROCESSORS
ANNOUNCING
DDR4
12 channels
CASCADE LAKE ADVANCED PERFORMANCE
2-SOCKET SERVER
CASCADE LAKE
MCP
48 CORES
CASCADE LAKE
MCP
48 CORES
DDR4
12 channels
LINPACK STREAM TRIAD
vs AMD EPYC 7601
Up
to
Up
to
DL INFERENCE
IMAGES
PER
SECOND
vs Intel® Xeon® Platinum
Processor at launch
Up
to
ARCHITECTED FOR
DEMANDING HPC, AI
& IAAS WORKLOADS
MORE MEMORY
CHANNELS THAN
ANY OTHER CPU
HIGH
SPEED
INTERCONNECT
UP
TO
PERFORMANCE
IMPROVEMENT
4-YEARREFRESH1
UP
TO
UP
TO 2666
M
H
Z
DDR4
PERFORMANCEANDVISUALSWITH
EXPANDABILITY,RELIABILITY,Security
PERFORMANCE
IMPROVEMENT
GEN-ON-GEN2
UP
TO
TURBOBoost
WITHINTEL®
TECHNOLOGY2.0
AVAILABLE IN SINGLE-SOCKET CONFIGURATION ONLY
INTEL®SOFTWAREGUARDEXTENSIONS
DELIVERSADVANCEDSECURITYCAPABILITIES
ENHANCED
UP
TO
INTEL® SOFTWARE GUARD EXTENSIONS PROVIDE A MORE SECURE PROCESSING ENVIRONMENT
EVEN IF ATTACKER HAS CONTROL OF THE PLATFORM
Fortanix provides Runtime
Encryption® software to
protect keys, data, and x86
applications
IBM Cloud Data Shield
powered by Fortanix protects
run time data at scale on
Kubernetes Service
Azure Confidential Computing
protects customer’s most
sensitive data while it’s
processed in the cloud
R3 Corda’s approach to
privacy and security shares
data only with those who need
to see it, enabling strict
confidentiality for enterprise
blockchain applications
SILICON PHOTONICS
ETHERNET
OMNI-PATH FABRIC
VS. DRAM AT 2.6TB DATA SCALE
more
performance
SPARK SQL DS
VS. COMPARABLE SERVER SYSTEM WITH
DRAM & NAND NVME DRIVES
Moreread
transactions
Moreusers
Persystem
APACHE CASSANDRA
VALUE OF PERSISTENCE
minutes
to
S T A R T T I M E
Three9S
to
A V A I L A B I L I T Y
STORAGE
MEMORY
PERSISTENT
MEMORY
Improving
memorycapacity
DRAM
HOT TIER
HDD / TAPE
COLD TIER
SSD
WARM TIER
Delivering
efficientstorage Intel®3DNandSSD
Improving
SSDperformance
www.intel.com/benchmarks
BigandAffordableMemory
HighPerformanceStorage
DirectLoad/StoreAccess
128,256,512GB
HighReliability
HardwareEncryption
DDR4PinCompatible
NativePersistence
PERSISTENT PERFORMANCE
& MAXIMUM CAPACITY
APPLICATION
VOLATILE MEMORY POOL
OPTANE PERSISTENT MEMORY
DRAM AS CACHE
AFFORDABLE MEMORY CAPACITY
FOR MANY APPLICATIONS
APPLICATION
OPTANE PERSISTENT
MEMORY
DRAM
Cascade lake-advanced-performance-press-deck
SILICON PHOTONICS
ETHERNET
OMNI-PATH FABRIC
Cascade lake-advanced-performance-press-deck
ConfigurationDetails
LINPACK: AMD EPYC 7601: Supermicro AS-2023US-TR4 with 2 AMD EPYC 7601 (2.2GHz, 32 core) processors, SMT OFF, Turbo ON, BIOS ver 1.1a, 4/26/2018, microcode:
0x8001227, 16x32GB DDR4-2666, 1 SSD, Ubuntu 18.04.1 LTS (4.17.0-041700-generic Retpoline), High Performance Linpack v2.2, compiled with Intel(R) Parallel Studio XE 2018 for Linux,
Intel MPI version 18.0.0.128, AMD BLIS ver 0.4.0, Benchmark Config: Nb=232, N=168960, P=4, Q=4, Score = 1095GFs, tested by Intel as of July 31, 2018. compared to 1-node, 2-socket 48-
core Cascade Lake Advanced Performance processor projections by Intel as of 10/3/2018.
Stream Triad: 1-node, 2-socket AMD EPYC 7601, http://www.amd.com/system/files/2017-06/AMD-EPYC-SoC-Delivers-Exceptional-Results.pdf tested by AMD as of June 2017 compared to
1-node, 2-socket 48-core Cascade Lake Advanced Performance processor projections by Intel as of 10/3/2018.
DL Inference: Platform: 2S Intel® Xeon® Platinum 8180 CPU @ 2.50GHz (28 cores), HT disabled, turbo disabled, scaling governor set to “performance” via intel_pstate driver, 384GB DDR4-
2666 ECC RAM. CentOS Linux release 7.3.1611 (Core), Linux kernel 3.10.0-514.10.2.el7.x86_64. SSD: Intel® SSD DC S3700 Series (800GB, 2.5in SATA 6Gb/s, 25nm, MLC).Performance
measured with: Environment variables: KMP_AFFINITY='granularity=fine, compact‘, OMP_NUM_THREADS=56, CPU Freq set with cpupower frequency-set -d 2.5G -u 3.8G -g performance.
Caffe: (http://github.com/intel/caffe/), revision f96b759f71b2281835f690af267158b82b150b5c. Inference measured with “caffe time --forward_only” command, training measured with
“caffe time” command. For “ConvNet” topologies, dummy dataset was used. For other topologies, data was stored on local storage and cached in memory before training. Topology specs
from https://github.com/intel/caffe/tree/master/models/intel_optimized_models (ResNet-50),and https://github.com/soumith/convnet-benchmarks/tree/master/caffe/imagenet_winners
(ConvNet benchmarks; files were updated to use newer Caffe prototxt format but are functionally equivalent). Intel C++ compiler ver. 17.0.2 20170213, Intel MKL small libraries version
2018.0.20170425. Caffe run with “numactl -l“. Tested by Intel as of July 11th 2017 -. compared to 1-node, 2-socket 48-core Cascade Lake Advanced Performance processor projections by
Intel as of 10/7/2018.

More Related Content

PDF
INTEL® XEON® SCALABLE PROCESSORS
PDF
3rd Generation Intel® Xeon® Scalable Processor - Achieving 1 Tbps IPsec with ...
PDF
intel speed-select-technology-base-frequency-enhancing-performance
PDF
Using a Field Programmable Gate Array to Accelerate Application Performance
PDF
Intel xeon-scalable-processors-overview
PDF
Accelerating analytics workloads with Alluxio data orchestration and Intel® O...
PDF
Hands-on Lab: How to Unleash Your Storage Performance by Using NVM Express™ B...
PDF
Supermicro X12 Performance Update
INTEL® XEON® SCALABLE PROCESSORS
3rd Generation Intel® Xeon® Scalable Processor - Achieving 1 Tbps IPsec with ...
intel speed-select-technology-base-frequency-enhancing-performance
Using a Field Programmable Gate Array to Accelerate Application Performance
Intel xeon-scalable-processors-overview
Accelerating analytics workloads with Alluxio data orchestration and Intel® O...
Hands-on Lab: How to Unleash Your Storage Performance by Using NVM Express™ B...
Supermicro X12 Performance Update

What's hot (20)

PDF
Intel software guard extension
PDF
Intel dpdk Tutorial
PDF
Boosting performance with the Dell Acceleration Appliance for Databases
PDF
The Power of One: Supermicro’s High-Performance Single-Processor Blade Systems
PPTX
Accelerating Innovation from Edge to Cloud
PDF
Redis-SGX: Dmitrii Kuvaiskii
PDF
Intel Itanium Hotchips 2011 Overview
PDF
Ceph Day Beijing - SPDK for Ceph
PDF
Ceph Day Beijing - Optimizing Ceph Performance by Leveraging Intel Optane and...
PDF
Cache Consistency – Requirements and its packet processing Performance implic...
PDF
IMCSummit 2015 - Day 1 Developer Track - Evolution of non-volatile memory exp...
PDF
AWS EC2 M6i instances with 3rd Gen Intel Xeon Scalable processors accelerated...
PPTX
Revisit DCA, PCIe TPH and DDIO
PDF
DPDK: Multi Architecture High Performance Packet Processing
PDF
Quieting noisy neighbor with Intel® Resource Director Technology
PDF
Ceph Day Beijing - Storage Modernization with Intel and Ceph
PDF
SGI HPC DAY 2011 Kiev
PDF
Offer faster access to critical data and achieve greater inline data reductio...
PDF
Exceeding the Limits of Air Cooling to Unlock Greater Potential in HPC
PDF
SGI HPC Update for June 2013
Intel software guard extension
Intel dpdk Tutorial
Boosting performance with the Dell Acceleration Appliance for Databases
The Power of One: Supermicro’s High-Performance Single-Processor Blade Systems
Accelerating Innovation from Edge to Cloud
Redis-SGX: Dmitrii Kuvaiskii
Intel Itanium Hotchips 2011 Overview
Ceph Day Beijing - SPDK for Ceph
Ceph Day Beijing - Optimizing Ceph Performance by Leveraging Intel Optane and...
Cache Consistency – Requirements and its packet processing Performance implic...
IMCSummit 2015 - Day 1 Developer Track - Evolution of non-volatile memory exp...
AWS EC2 M6i instances with 3rd Gen Intel Xeon Scalable processors accelerated...
Revisit DCA, PCIe TPH and DDIO
DPDK: Multi Architecture High Performance Packet Processing
Quieting noisy neighbor with Intel® Resource Director Technology
Ceph Day Beijing - Storage Modernization with Intel and Ceph
SGI HPC DAY 2011 Kiev
Offer faster access to critical data and achieve greater inline data reductio...
Exceeding the Limits of Air Cooling to Unlock Greater Potential in HPC
SGI HPC Update for June 2013
Ad

Similar to Cascade lake-advanced-performance-press-deck (20)

PPT
SDC Server Sao Jose
DOCX
Intel Microarchitecture (Nehalem) and its Applications on Videogames
PPTX
Impact of Intel Optane Technology on HPC
PPT
No[1][1]
PDF
AI, A New Computing Model
PDF
Pedal to the Metal: Accelerating Spark with Silicon Innovation
PPTX
intel business presentation 77777777777.pptx
PDF
HPC Infrastructure To Solve The CFD Grand Challenge
PDF
NVIDIA DGX User Group 1st Meet Up_30 Apr 2021.pdf
PDF
Tesla Accelerated Computing Platform
PDF
NextHorizonOnTheCaseWirgThePresnrentions
PDF
Data Science Week 2016. NVIDIA. "Платформы и инструменты для реализации систе...
PDF
“Fast-track Design Cycles Using Lattice’s FPGAs,” a Presentation from Lattice...
PPTX
Ibm and Erb's Presentation Insider's Edition Event . September 2010
PPTX
Ac922 watson 180208 v1
PPTX
Nvidia Deep Learning Solutions - Alex Sabatier
PPT
Intel new processors
PDF
Intel 8th Core G Series with Radeon Vega M
PDF
00 opencapi acceleration framework yonglu_ver2
PDF
In-Memory and TimeSeries Technology to Accelerate NoSQL Analytics
SDC Server Sao Jose
Intel Microarchitecture (Nehalem) and its Applications on Videogames
Impact of Intel Optane Technology on HPC
No[1][1]
AI, A New Computing Model
Pedal to the Metal: Accelerating Spark with Silicon Innovation
intel business presentation 77777777777.pptx
HPC Infrastructure To Solve The CFD Grand Challenge
NVIDIA DGX User Group 1st Meet Up_30 Apr 2021.pdf
Tesla Accelerated Computing Platform
NextHorizonOnTheCaseWirgThePresnrentions
Data Science Week 2016. NVIDIA. "Платформы и инструменты для реализации систе...
“Fast-track Design Cycles Using Lattice’s FPGAs,” a Presentation from Lattice...
Ibm and Erb's Presentation Insider's Edition Event . September 2010
Ac922 watson 180208 v1
Nvidia Deep Learning Solutions - Alex Sabatier
Intel new processors
Intel 8th Core G Series with Radeon Vega M
00 opencapi acceleration framework yonglu_ver2
In-Memory and TimeSeries Technology to Accelerate NoSQL Analytics
Ad

More from DESMOND YUEN (20)

PDF
2022-AI-Index-Report_Master.pdf
PDF
Small Is the New Big
PDF
Intel® Blockscale™ ASIC Product Brief
PDF
Cryptography Processing with 3rd Gen Intel Xeon Scalable Processors
PDF
Intel 2021 Product Security Report
PDF
How can regulation keep up as transformation races ahead? 2022 Global regulat...
PDF
NASA Spinoffs Help Fight Coronavirus, Clean Pollution, Grow Food, More
PDF
A Survey on Security and Privacy Issues in Edge Computing-Assisted Internet o...
PDF
PUTTING PEOPLE FIRST: ITS IS SMART COMMUNITIES AND CITIES
PDF
BUILDING AN OPEN RAN ECOSYSTEM FOR EUROPE
PDF
An Introduction to Semiconductors and Intel
PDF
Changing demographics and economic growth bloom
PDF
Intel’s Impacts on the US Economy
PDF
2021 private networks infographics
PDF
Transforming the Modern City with the Intel-based 5G Smart City Road Side Uni...
PDF
Accelerate Your AI Today
PDF
Increasing Throughput per Node for Content Delivery Networks
PDF
"Life and Learning After One-Hundred Years: Trust Is The Coin Of The Realm."
PDF
Telefónica views on the design, architecture, and technology of 4G/5G Open RA...
PDF
Machine programming
2022-AI-Index-Report_Master.pdf
Small Is the New Big
Intel® Blockscale™ ASIC Product Brief
Cryptography Processing with 3rd Gen Intel Xeon Scalable Processors
Intel 2021 Product Security Report
How can regulation keep up as transformation races ahead? 2022 Global regulat...
NASA Spinoffs Help Fight Coronavirus, Clean Pollution, Grow Food, More
A Survey on Security and Privacy Issues in Edge Computing-Assisted Internet o...
PUTTING PEOPLE FIRST: ITS IS SMART COMMUNITIES AND CITIES
BUILDING AN OPEN RAN ECOSYSTEM FOR EUROPE
An Introduction to Semiconductors and Intel
Changing demographics and economic growth bloom
Intel’s Impacts on the US Economy
2021 private networks infographics
Transforming the Modern City with the Intel-based 5G Smart City Road Side Uni...
Accelerate Your AI Today
Increasing Throughput per Node for Content Delivery Networks
"Life and Learning After One-Hundred Years: Trust Is The Coin Of The Realm."
Telefónica views on the design, architecture, and technology of 4G/5G Open RA...
Machine programming

Recently uploaded (20)

DOCX
The AUB Centre for AI in Media Proposal.docx
PPTX
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PDF
Machine learning based COVID-19 study performance prediction
PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
PPTX
Big Data Technologies - Introduction.pptx
PPTX
Programs and apps: productivity, graphics, security and other tools
PPT
Teaching material agriculture food technology
PDF
Electronic commerce courselecture one. Pdf
PDF
Encapsulation_ Review paper, used for researhc scholars
PDF
Encapsulation theory and applications.pdf
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
PPTX
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PDF
Agricultural_Statistics_at_a_Glance_2022_0.pdf
PDF
Review of recent advances in non-invasive hemoglobin estimation
PDF
Chapter 3 Spatial Domain Image Processing.pdf
PDF
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
PDF
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
PDF
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
The AUB Centre for AI in Media Proposal.docx
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
Machine learning based COVID-19 study performance prediction
Dropbox Q2 2025 Financial Results & Investor Presentation
Big Data Technologies - Introduction.pptx
Programs and apps: productivity, graphics, security and other tools
Teaching material agriculture food technology
Electronic commerce courselecture one. Pdf
Encapsulation_ Review paper, used for researhc scholars
Encapsulation theory and applications.pdf
Per capita expenditure prediction using model stacking based on satellite ima...
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
Reach Out and Touch Someone: Haptics and Empathic Computing
Agricultural_Statistics_at_a_Glance_2022_0.pdf
Review of recent advances in non-invasive hemoglobin estimation
Chapter 3 Spatial Domain Image Processing.pdf
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
Profit Center Accounting in SAP S/4HANA, S4F28 Col11

Cascade lake-advanced-performance-press-deck

  • 1. Lisa Spelman VICE PRESIDENT & GENERAL MANAGER INTEL® XEON® PRODUCTS AND DATA CENTER MARKETING
  • 6. Security MitigationsLeadership Performance Higher Frequencies Optimized Cache Hierarchy Intel Deep Learning Boost (VNNI) Optimized Frameworks & Libraries NEXT GEN INTEL® XEON® SCALABLE PROCESSOR
  • 7. NEW CLASS OF INTEL® XEON® SCALABLE PROCESSORS ANNOUNCING DDR4 12 channels CASCADE LAKE ADVANCED PERFORMANCE 2-SOCKET SERVER CASCADE LAKE MCP 48 CORES CASCADE LAKE MCP 48 CORES DDR4 12 channels LINPACK STREAM TRIAD vs AMD EPYC 7601 Up to Up to DL INFERENCE IMAGES PER SECOND vs Intel® Xeon® Platinum Processor at launch Up to ARCHITECTED FOR DEMANDING HPC, AI & IAAS WORKLOADS MORE MEMORY CHANNELS THAN ANY OTHER CPU HIGH SPEED INTERCONNECT
  • 9. INTEL® SOFTWARE GUARD EXTENSIONS PROVIDE A MORE SECURE PROCESSING ENVIRONMENT EVEN IF ATTACKER HAS CONTROL OF THE PLATFORM Fortanix provides Runtime Encryption® software to protect keys, data, and x86 applications IBM Cloud Data Shield powered by Fortanix protects run time data at scale on Kubernetes Service Azure Confidential Computing protects customer’s most sensitive data while it’s processed in the cloud R3 Corda’s approach to privacy and security shares data only with those who need to see it, enabling strict confidentiality for enterprise blockchain applications
  • 11. VS. DRAM AT 2.6TB DATA SCALE more performance SPARK SQL DS VS. COMPARABLE SERVER SYSTEM WITH DRAM & NAND NVME DRIVES Moreread transactions Moreusers Persystem APACHE CASSANDRA VALUE OF PERSISTENCE minutes to S T A R T T I M E Three9S to A V A I L A B I L I T Y STORAGE MEMORY PERSISTENT MEMORY Improving memorycapacity DRAM HOT TIER HDD / TAPE COLD TIER SSD WARM TIER Delivering efficientstorage Intel®3DNandSSD Improving SSDperformance www.intel.com/benchmarks
  • 13. PERSISTENT PERFORMANCE & MAXIMUM CAPACITY APPLICATION VOLATILE MEMORY POOL OPTANE PERSISTENT MEMORY DRAM AS CACHE AFFORDABLE MEMORY CAPACITY FOR MANY APPLICATIONS APPLICATION OPTANE PERSISTENT MEMORY DRAM
  • 17. ConfigurationDetails LINPACK: AMD EPYC 7601: Supermicro AS-2023US-TR4 with 2 AMD EPYC 7601 (2.2GHz, 32 core) processors, SMT OFF, Turbo ON, BIOS ver 1.1a, 4/26/2018, microcode: 0x8001227, 16x32GB DDR4-2666, 1 SSD, Ubuntu 18.04.1 LTS (4.17.0-041700-generic Retpoline), High Performance Linpack v2.2, compiled with Intel(R) Parallel Studio XE 2018 for Linux, Intel MPI version 18.0.0.128, AMD BLIS ver 0.4.0, Benchmark Config: Nb=232, N=168960, P=4, Q=4, Score = 1095GFs, tested by Intel as of July 31, 2018. compared to 1-node, 2-socket 48- core Cascade Lake Advanced Performance processor projections by Intel as of 10/3/2018. Stream Triad: 1-node, 2-socket AMD EPYC 7601, http://www.amd.com/system/files/2017-06/AMD-EPYC-SoC-Delivers-Exceptional-Results.pdf tested by AMD as of June 2017 compared to 1-node, 2-socket 48-core Cascade Lake Advanced Performance processor projections by Intel as of 10/3/2018. DL Inference: Platform: 2S Intel® Xeon® Platinum 8180 CPU @ 2.50GHz (28 cores), HT disabled, turbo disabled, scaling governor set to “performance” via intel_pstate driver, 384GB DDR4- 2666 ECC RAM. CentOS Linux release 7.3.1611 (Core), Linux kernel 3.10.0-514.10.2.el7.x86_64. SSD: Intel® SSD DC S3700 Series (800GB, 2.5in SATA 6Gb/s, 25nm, MLC).Performance measured with: Environment variables: KMP_AFFINITY='granularity=fine, compact‘, OMP_NUM_THREADS=56, CPU Freq set with cpupower frequency-set -d 2.5G -u 3.8G -g performance. Caffe: (http://github.com/intel/caffe/), revision f96b759f71b2281835f690af267158b82b150b5c. Inference measured with “caffe time --forward_only” command, training measured with “caffe time” command. For “ConvNet” topologies, dummy dataset was used. For other topologies, data was stored on local storage and cached in memory before training. Topology specs from https://github.com/intel/caffe/tree/master/models/intel_optimized_models (ResNet-50),and https://github.com/soumith/convnet-benchmarks/tree/master/caffe/imagenet_winners (ConvNet benchmarks; files were updated to use newer Caffe prototxt format but are functionally equivalent). Intel C++ compiler ver. 17.0.2 20170213, Intel MKL small libraries version 2018.0.20170425. Caffe run with “numactl -l“. Tested by Intel as of July 11th 2017 -. compared to 1-node, 2-socket 48-core Cascade Lake Advanced Performance processor projections by Intel as of 10/7/2018.