Infrastructure Designed for Cognitive Workloads: Why is it Crucial? - Xavier Vasques
Download as PPT, PDF3 likes414 views
The document discusses the importance of IT infrastructure designed for cognitive workloads, highlighting how artificial intelligence mimics human cognitive functions for business improvement. It emphasizes the role of IBM Watson in providing cognitive capabilities through a growing set of APIs and the need for organizations to adapt to technology disruptions. Additionally, it outlines key technologies and strategies for businesses to harness data effectively and innovate in the cognitive era.
Infrastructure Designed for Cognitive Workloads: Why is it Crucial? - Xavier Vasques
- 1. Infrastructure designed for cognitive workloads: Why is it crucial? Xavier Vasques, Technical Director, Systems Hardware, IBM France @VasquesXavier Artificial intelligence (AI) ….the term "artificial intelligence" is applied when a machine mimics "cognitive" functions that humans associate with other human minds, such as "learning" and "problem solving
- 2. © 2015 IBM Corporation AI …. To Do What ? LEARN TRANS MIT IMPRO VE
- 3. © 2015 IBM Corporation AI …. To Do What ? LEARN, What ? Expertise/skills Knowledge DATAis transforming industries and professions Determine a Cognitive Strategy A foundation of data Becoming a cognitive business Analy tics
- 4. © 2015 IBM Corporation AI …. To Do What ? IMPROVE, What ? Your Business ! Hybrid Cloud services optimized for industry, data and cognitive APIs Becoming a cognitive business The world is being reinvented in ………………… code
- 5. © 2015 IBM Corporation AI …. To Do What ? TRANSMIT, HOW ? Systems ! IT infrastructure tuned for cognitive workloads Security Becoming a cognitive business Cognitive …. COMPUTING
- 6. © 2015 IBM Corporation Systems : The Brain The Brain ? Some Facts … Serving size 1 per Person (1300 g) Calories: 1958 (Calories from Fat 1239) Total Fat: 137.6 g Cholesterol: 40.30 g Carbohydrates: 19.88 g Protein 151.41 g Memory > 2.5 Million Giga Bytes Neurons: 80 000 000 000 Synapses: 100 000 000 000 000 Power: 20W Dimensions: 1450 cm3
- 7. © 2015 IBM Corporation Systems : The Brain The Brain ? “Non-Cognitive” abilities Sweating to keep cool Checking Blood Sugar Digesting Breakfast Raising “goose bumps” Pupils adjusting to sunlight Tears forming due to pollen Adjusting breathing rate Lowering heart rate
- 8. © 2015 IBM Corporation Systems : The Brain The Brain ? “Cognitive” abilities
- 9. © 2015 IBM Corporation Systems : The Brain 17 octobre 20169 If the brain doesn’t not work as expected ?
- 10. © 2015 IBM Corporation Systems 17 octobre 201610 It’s the same for any Systems ! The System has to work as it has to work … at the speed of the brain What happens if : The System doesn't reach the expected speed ? The System looses memory The System has I/O bottlenecks The System doesn’t store the data in the right location The System is not able to process all needed data … … The System is not designed for cognitive
- 11. © 2015 IBM Corporation Cognitive SYSTEMS Era IA was born Pragmatism and Humble : The emergence of Machine Learning Welcome to the Cognitive Era 1956 70s & 80s Today
- 12. © 2015 INTERNATIONAL BUSINESS MACHINES CORPORATION Cognitive Business is powered by IBM Watson. Watson is a cloud-based, open platform of expanding cognitive capabilities. With Watson, you can build cognition into digital applications, products and operations. 12
- 13. © 2015 INTERNATIONAL BUSINESS MACHINES CORPORATION Relationship Extraction Questions & Answers Language Detection Personality Insights Keyword Extraction Image Link Extraction Feed Detection Visual Recognition Concept Expansion Concept Insights Dialog Sentimen t Analysis Text to Speech Tradeoff Analytics Natural Language Classifier Author Extraction Speech to Text Retrieve & Rank Watson News Language Translation Entity Extraction Tone Analyzer Concept Tagging Taxonomy Text Extraction Message Resonance Image Tagging Face Detection Answer Generation Usage Insights Fusion Q&A Video Augmentation Decision Optimization Knowledge Graph Risk Stratification Policy Identification Emotion Analysis Decision Support Criteria Classification Knowledge Canvas Easy Adaptation Knowledge Studio Service Statistical Dialog Q&A Qualification Factoid Pipeline Case Evaluation 13 IBM Watson The Waston that competed on Jeopardy! in 2011 comprised what is now a single API—Q&A—built on five underlying technologies. Since then, Watson has grown to a family of 28 APIs. By the end of 2016, there will be nearly 50 Watson APIs— with more added every year. Natural Language Processing Machine Learning Question Analysis Feature Engineering Ontology Analysis
- 14. © 2015 INTERNATIONAL BUSINESS MACHINES CORPORATION 14 IBM Watson These APIs are underpinned by 50 technologies: Anaphoric Co-referencing Colloquialism Processing Content Management -- Versioning Convolutional Neural Networks Curation Deep Learning Dialog Framing Ellipses Embedded Table Processing Ensembles and Fusion Entity Resolution Factoid Answering Feature Engineering Feature Normalization Focus and Spurious Phrase Resolution HTML Page Analysis Image Management Information Retrieval Knowledge (Property) Graphs Knowledge Answering Knowledge Extraction Annotators Knowledge Validation and Extrapolation Language Modeling Latent Semantic Analysis Learn To Rank Linguistic Analysis Logical Reasoning Analysis Logistical Regression Machine Learning Multi-Dimensional Clustering Multilingual training n-Gram Analysis (word combinations and distance) Ontology Analysis Pareto Analysis Passage Answering PDF Conversion Phoneme Aggregation Question Analysis Question-answering Reasoning Strategies Recursive Neural Networks Rules Processing Scalable Search Similarity Analytics Statistical Language Parsing Support Vector Machines Syllable Analysis Table Answering Visual Analysis Visual Rendering Voice Synthesis
- 15. © 2015 INTERNATIONAL BUSINESS MACHINES CORPORATION 15 IBM Watson These technologies draw on five distinct fields of study: Big Data & Analytics Data Mining, Optimization, Text Analytics Artificial Intelligence Machine Learning, Natural Language Processing, Algorithms & Theory Cognitive Experience HCI, Speech, Translation, Machine Vision, Visualization Cognitive Knowledge Knowledge Representation, Ontologies, Semantics, Context Computing Infrastructure High Performance Computing, Distributed Systems, Programming Models & Tools
- 16. Architecting the future with IT infrastructure for the cognitive era The IBM point-of-view on IT infrastructure for the cognitive era July 2016
- 17. IBM Systems | 17 of CEOs feel technological disruption is making them reassess strategic direction “We see the business models changing as a result of the creative use of new technologies.” -Eelco Blok, CEO, KPN, Netherlands1 of global business leaders say that a substantial part of their revenue is at risk from technology shifts252% 67% Technology is the most important external influence among the C- Suite today Source: 1) IBM Institute for Business Value, Redefining Competition, Insights from the Global C-suite Study – The CEO Perspective, 2015 Source: 2) Harvard Business Review Analytic Services, The Ecosystem Equation: Competing in the Connected Economy, 2016
- 18. Organizations struggle with key technology challenges supporting insights, change, and speed Understanding Data Digital intelligence is a primary competitive advantage Yet 88% of all data today is unstructured and invisible to computers1 “The next wave will be all about connecting dots and correlating data to produce actionable insights.” –CIO, Retail, United States2 Keeping Pace Superior technology delivers superior performance Yet the pace of innovation (72%) is now the top CEO challenge, even greater than security (66%)3 “Disruptive technologies could change the fundamentals of our business” –Kazuo Hirai, CEO, Sony Corporation, Japan4 Accelerating Time-to- Market Sustainable success is now measured in days, not weeks Outperforming CxOs are 95% more likely to focus on being first to market4 “We’ve been charged with speeding up time-to-market, both for the products we sell and for our own internal tools.” ⎯Kalev Reiljan, CIO, TeliaSonera, Finland2 Source: 1) IBM Research Source: 2) IBM Institute for Business Value, Redefining Connections, Insights from the Global C-suite Study – The CIO Perspective Source: 3) Fortune, Myth-busting the Fortune 500, 2015 Source: 4) IBM Institute for Business Value, Redefining Boundaries: Insights from the Global C-Suite Study, 2015 IBM Systems | 18
- 19. IBM Systems | 19 Architects of the future require IT infrastructure that can do more than ‘just work’ Servers and storage are no longer inanimate. They can understand, reason, and learn. Today, they can think. Outthink status quo. Think IT infrastructure for the cognitive era. Detect anomalies to proactively resolve issues Move data to right location based on usage patterns
- 20. IBM Systems | 20 IT infrastructure for the cognitive era means thinking differently about how you design, build, and deliver services Design for Cognitive Business Act at the speed of thought Gives meaning to unstructured data and can perform when the window of action is milliseconds. Build with Collaborative Innovation Deliver through Cloud Platform Accelerate technology breakthroughs Takes advantage of perpetual motion for what is still unknown yet possible with future innovations. Extend the value of systems and data Extends existing business investments to integrate with the ecosystem and accelerate innovation.
- 21. IBM Systems | 21 Design for Cognitive Business
- 22. IBM Systems | 22 Designing for cognitive business means thinking differently about analytics acceleration and data centric design Solve complex business problems faster than competitors? Deliver better decisions by taking advantage of oceans of data? Analytics acceleration to deliver the fastest insights with infrastructure designed specifically for complex analytics and machine learning Data centric design to capture the largest variety and volume of data while efficiently locating data and applications in the right place How do I?
- 23. IBM Systems | 23 Leading US Healthcare Systems Accelerated the sequencing of 3.5 PB of human genome data by a factor of 10x for faster cancer diagnosis Created real-time pricing models to speed decision making by increasing response times by 60x Infrastructure in the cognitive era delivers ground-breaking research, faster cancer diagnostics and real-time pricing models Allowed scientists to produce ground breaking research faster by accessing PB of data in minutes, not days
- 24. IBM Systems | 24 Key technologies to design for cognitive business Analytics Acceleration Servers designed specifically for cognitive with fast processors, accelerators, memory and interconnect technology IBM Power Systems Flash storage that delivers consistent, highly efficient and fast microsecond data delivery IBM FlashSystemIntelligent workload management to orchestrate computing resources to solve the most challenging workloads IBM Spectrum Computing Data Centric Design Unified data access to file and object-based storage that scales up to petabytes of data and billions of files IBM Spectrum Scale Automatic, cognitive-based data management to optimize storage costs and application performance IBM Spectrum Control Run analytics applications next to the data or within the transaction to deliver real-time insights IBM z Systems with IBM DB2 Analytics Accelerator
- 25. IBM Systems | 25 Design for cognitive business with IBM Systems
- 26. IBM Systems | 26 Build with Collaborativ e Innovation
- 27. IBM Systems | 27 Building with Collaborative Innovation means thinking differently about open technologies and choice Optimize my services to support the dynamic needs of the business? Accelerate adoption of the latest technology advances without risk? Innovating with open technologies to deliver new solutions faster to market through community collaboration in support of a shared vision Choice for optimization to select the right platforms, runtimes and deployment models required of the workload How do I?
- 28. IBM Systems | 28 Key technologies to build with collaborative innovation Innovate with Open Technologies Open systems design and ecosystem to customize solutions to meet unique business needs The OpenPOWER Foundation and POWER CPU Architecture Infrastructure that combines attributes of Linux and open communities with the best of enterprise computing IBM LinuxONE Systems optimized for blockchain with advanced cryptography, transaction processing and integration IBM z Systems
- 29. Key technologies to build with collaborative innovation IBM z Systems Spark Demo: A Use Case Demo
- 30. IBM Systems | 30 Build with Collaborative Innovation with IBM Systems
- 31. IBM Systems | 31 Deliver through Cloud Platform
- 32. IBM Systems | 32 Delivering through Cloud Platforms means thinking differently about securely opening up and controlled iteration at scale Open up to partners while protecting data from unauthorized users? Accelerate response times and development cycles at scale? The ability to securely open up to enable partners to connect to your core systems and data while enhancing security to mitigate risk Controlled iteration at scale to deliver microsecond performance and agile DevOps processes while supporting millions of users How do I?
- 33. IBM Systems | 33 Key technologies to deliver through cloud platform Securely Open Up Securely connect cloud services to core business assets through APIs to extend the value of data and systems IBM z Systems with z/OS Connect, IBM Power Systems with API Connect Enable complete workload isolation and deliver high- speed encryption to protect data without sacrificing performance IBM z Systems, IBM LinuxONE Provide encryption down to the chip, transaction and file-level for highly sensitive data IBM z Systems, IBM Spectrum Scale Deliver microsecond response times for mobile applications to exceed customer expectations for immediate service IBM z Systems, IBM LinuxONE Support billions of web interactions, millions of transactions and billions of files for continuous service IBM z Systems, IBM LinuxONE, IBM Spectrum Scale Invest in enterprise DevOps processes and tools to improve quality and reduce risk in application development IBM z Systems with Enterprise DevOps Controlled Iteration at Scale
- 34. IBM Systems | 34 Deliver through cloud platform with IBM Systems
- 35. IBM Systems | 35 Infrastructure: New Computing Frontiers cognitive storage SyNAPSE quantum computing
- 36. © 2015 INTERNATIONAL BUSINESS MACHINES CORPORATION @VasquesXavier