Superhuman Cyberinfrastructure - Crossing the Rubicon
1 like672 views
Dr. Larry Smarr discusses the advancements in supercomputer technology, visualization, and connectivity that enable data transfer rates surpassing human cognitive capabilities, highlighting the path towards a technological singularity. Current scientific research allows for data-intensive streams at unprecedented speeds, facilitating near photorealistic visualization and transforming various applications, including brain research and disaster simulations. The document emphasizes the necessity of dedicated fiber-optic networks and scalable systems to cope with the increasing complexity and volume of data in contemporary research environments.
Superhuman Cyberinfrastructure - Crossing the Rubicon
- 1. Superhuman Cyberinfrastructure— Crossing the Rubicon Invited Talk Singularity University NASA Ames Mountain View, CA July 27, 2009 Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technology Harry E. Gruber Professor, Dept. of Computer Science and Engineering Jacobs School of Engineering, UCSD
- 2. An estimate of the input rate of the human eye-brain system is ~109 bits/sec (1 gigabit/sec) and the human brain’s compute speed is ~1015 to 1017 operations per second. With the use of dedicated fiber optics, scientific research labs globally are now routinely connecting with data-intensive streams at 10 gigabit/sec. This enables streaming of uncompressed high definition video (1.5 gigabit/sec) or digital cinema video with four times that resolution (7.6 gigabit/sec) on a planetary scale at near photorealism. In our laboratories, transmissions are being demonstrated with bandwidths exceeding terabit/sec, roughly one thousand times what a human eye-brain system can process. Persistent petaFLOPs (1015 floating point operations per sec) supercomputers are running complex scientific simulations and the planning is under way for Exascale computers, which will run at 1000 petaFLOPS, likely exceeding the capacity of a human brain. Visualization has expanded from the million pixels on most PCs to a fraction of a billion pixels, exceeding the resolution of a human eye. This allows for interactive viewing of hierarchical complex systems at high resolution, including brain structure. I will illustrate each of these post-human capabilities and explain how they are currently being interconnected on a planetary-scale, a critical step on the path to the Singularity.
- 3. Three Accelerators for an Exponentially Data Rich World • Supercomputers Surpassing Human Brain Speed • Scalable Visualization Surpassing Human Eye • Personal Lightpaths Surpassing Eye-Brain I/O All Are Transformational for Singularity University
- 4. From Elite Science to the Mass Market • Four Examples I Helped “Mid-Wife”: – Supercomputers to GigaHertz PCs – Scientific Visualization to Movie/Game Special Effects – CERN Preprints to WWW – NSFnet to the Commercial Internet • Technologies Diffuse Into Society Following an S-Curve “NSF Invests Automobile Here” Adoption { Source: Harry Dent, The Great Boom Ahead
- 5. Fifteen Years from Bleeding Edge Research to Mass Consumer Market • 1990 Leading Edge University Research Center-NCSA – Supercomputer GigaFLOPS Cray Y-MP ($15M) – Megabit/s NSFnet Backbone • 2005 Mass Consumer Market – PCs are Multi-Gigahertz ($1.5k) – Megabit/s Home DSL or Cable Modem NSF Blue Waters Petascale Supercomputer (2011) Will be Over 1 Million Times Faster than Cray Y-MP! Enormous Growth in Parallelism Processors: Y-MP 4, Blue Waters 200,000 www.ncsa.uiuc.edu/BlueWaters/system.html
- 6. Exponential Increases in Supercomputer Speed and Visualization Technology Drive Understanding and Applications Showed Thunderstorms Arise from Solving Physics Equations 1987 2005 Vastly Higher Resolution Uncovers Birth of Tornadoes Source: Donna Cox, Robert Patterson, Bob Wilhelmson, NCSA
- 7. Frontier Applications of High Performance Computing Enabled by NSF’s TeraGrid Investigating Alzheimer’s Plaque Proteins Designing Bird Flu Drugs Improving Hydrogen Storage in Fuel Cells
- 8. During the Next Decade We Will Witness the Transition of Silicon Supercomputers Pass Human Brain Speed Source: Ray Kurzweil, The Singularity is Near ExaFLOP PetaFLOP Computational Capacity of the Human Brain— “I will Use a More Conservative Figure of 1016cps for Our Subsequent Discussions.”--Kurzweil
- 9. Los Alamos Roadrunner- World’s First PetaFLOP Supercomputer PetaVision models the human visual system—mimicking more than 1 billion visual neurons and trillions of synapses. Los Alamos researchers believe they can study in real time the entire human visual cortex
- 10. Department of Energy Office of Science Leading Edge Applications of Petascale Computers Flames Supernova Fusion Parkinson’s
- 11. The Road to the ExaFLOP "Both the Department of Energy's Office of Science and the National Nuclear Security Administration have identified exascale computing as a critical need in roughly the 2018 timeframe,"
- 12. Fastest Computer on Earth will Reach ~ Human Brain Speed 100 PetaFLOPS by 2016 www.top500.org/lists/2008/06/performance_development
- 13. Exploring the Limits of Scalability The Metacomputer as a Megacomputer • Napster Meets Entropia – Distributed Computing and Storage Combined – Assume Ten Million PCs in Five Years – Average Speed Ten GigaFLOPs – Average Free Storage 100 GB – Planetary Computer Capacity – 100 PetaFLOPs Speed – 1,000 PetaByte Storage • ~1-100 PetaFLOPs is Roughly a Human Brain-Second – Morovec-Intelligent Robots and Mind Transferral – Kurzweil-The Age of Spiritual Machines – Joy-Humans an Endangered Species? – Vinge-Singularity Source: Larry Smarr Megacomputer Panel SC2000 Conference
- 14. The Planetary Computing Power is Passing Through an Important Threshold 1 Million x •Will the Grid Become Self- –Organizing –Powered –Aware? Source: Hans Moravec www.transhumanist.com/volume1/power_075.jpg
- 15. From Software as Engineering to Software as Biology • Stanford Professor John Koza • Uses Genetic Programming to Create a Working Computer Program From a High-Level Problem Statement of a Problem • Starting With a Primordial Ooze of Thousands of Randomly Created Computer Programs, a Population of Programs Is Progressively Evolved Over a Series of Generations • Has Produced 21 Human-Competitive Results 1,000-Pentium Beowulf-Style Cluster Computer for Genetic Programming www.genetic-programming.com/
- 16. Accelerator: Robots Tap the Power of the Planetary Computer • Sensors – Temperature – Distance – Speed – Accelerations – Pressure – IR Sony’s AIBO and SDR-4X – Vibration – Imaging • Linked to Internet by Wi-Fi Wireless Broadband – Completely Changes Robotics Architecture – Access to Nearly Infinite Computing, Storage, Software – Marriage of Net Software Agents to Physical Probes – Ad Hoc Teams of Interacting Intelligent Robots
- 17. “Broadband” Depends on Your Application: Data-Intensive Science Needs Supernetworks • Mobile Broadband 100,000 Fold Range – 0.1-0.5 Mbps All Here Today! • Home Broadband – 1-5 Mbps “The future is already here, it’s just not evenly distributed” William Gibson, Author of Neuromancer • University Dorm Room Broadband – 10-100 Mbps • Dedicated Supernetwork Broadband – 1,000-10,000 Mbps
- 18. What is the Rate at Which the Eye-Brain System Can Ingest Information? Frame Resolution Color Depth Frame Rate 10 Mpixels x 24 bits/pixel x 30 frames/sec = 7,200 Mbps or ~10 Gbps The Limits of Human Vision, Michael F. Deering, Sun Microsystems A model of the perception limits of the human visual system is presented, resulting in an estimate of ~15 million variable resolution pixels per eye. Assuming a 60 Hz stereo display with a depth complexity of 6, we make the prediction that a rendering rate of approximately ten billion triangles per second is sufficient to saturate the human visual system. www.swift.ac.uk/vision.pdf “How Much the Eye Tells the Brain” The human retina transmits data to the brain at the rate of 10 Mbps Koch et al., Current Biology 16, 1428–1434, July 25, 2006 http://citeseer.ist.psu.edu/cache/papers/cs2/127/http:zSzzSzretina.anatomy.upenn.eduzSzpdfileszSz6728.pdf/current-biology-july-elsevier.pdf
- 19. The Shared Internet Has a 10,000 Mbps Backbone Source: Ray Kurzweil, The Singularity is Near
- 20. Global Innovation Centers are Being Connected with 10,000 Megabits/sec Clear Channel Lightpaths 100 Gbps Commercially Available Research on 1 Tbps; 50 Tbps By 2020 Source: Maxine Brown, UIC and Robert Patterson, NCSA
- 21. Dedicated 10,000Mbps Supernetworks Tie Together State and Regional Fiber Infrastructure Interconnects Two Dozen State and Regional Internet2 Dynamic Optical Networks Circuit Network Is Now Available NLR 40 x 10Gb Wavelengths Expanding with Darkstrand to 80
- 22. Creating a California Cyberinfrastructure of OptIPuter “On-Ramps” to NLR, I2DC, & TeraGrid UC Davis UC Berkeley UC San Francisco UC Merced UC Santa Cruz Creating a Critical Mass of OptIPuter End Users on a Secure LambdaGrid UC Los Angeles UC Santa Barbara UC Riverside UC Irvine CENIC Workshop at Calit2 UC San Diego Sept 15-16, 2008
- 23. Accelerator: Global Connections Between University Research Centers at 10Gbps iGrid Maxine Brown, Tom DeFanti, Co-Chairs 2005 THE GLOBAL LAMBDA INTEGRATED FACILITY www.igrid2005.org September 26-30, 2005 Calit2 @ University of California, San Diego California Institute for Telecommunications and Information Technology 21 Countries Driving 50 Demonstrations 1 or 10Gbps to Calit2@UCSD Building Sept 2005
- 24. First Trans-Pacific Super High Definition Telepresence Meeting in New Calit2 Digital Cinema Auditorium Lays Technical Basis for Global Keio University Digital President Anzai Cinema Sony UCSD NTT Chancellor Fox SGI
- 25. NSF Instruments Generate Data at Enormous Rates-- Requiring Photonic Interconnects “The VLA facility is now able to generate 700 Gigabits/s of astronomical data and the Extended VLA will reach 3.2 Terabits/sec by 2009.” --Dr. Steven Durand, National Radio Astronomy Observatory, e-VLBI Workshop, MIT Haystack Observatory., Sep 2006. ALMA Has a Requirement for a 120 Gbps Data Rate per Telescope
- 26. Next Great Planetary Instrument: The Square Kilometer Array Requires Dedicated Fiber www.skatelescope.org Transfers Of 1 TByte Images World-wide Will Be Needed Every Minute!
- 27. Challenge—How to Bring Scalable Visualization Capability to the Data-Intensive End User? 1997 1999 1999 2004 NCSA 4 MPixel LLNL 20 Mpixel Wall ORNL 35Mpixel EVEREST NSF Alliance PowerWall 2008 2004 2005 EVL 100 Mpixel LambdaVision Calit2@UCI 200 Mpixel HiPerWall NSF MRI NSF MRI TACC 307 Mpixel Stallion NSF TeraGrid A Decade of NSF and DoE Investment-- Two Orders of Magnitude Growth!
- 28. NSF’s OptIPuter Project: Using Supernetworks to Meet the Needs of Data-Intensive Researchers OptIPortal– Termination Device for the OptIPuter Global Backplane Calit2 (UCSD, UCI), SDSC, and UIC Leads—Larry Smarr PI Univ. Partners: NCSA, USC, SDSU, NW, TA&M, UvA, SARA, KISTI, AIST Industry: IBM, Sun, Telcordia, Chiaro, Calient, Glimmerglass, Lucent
- 29. Accelerator: Visualize Vast Data Sets Using Scalable Commodity Systems 300 MPixel Image! Source: Mark Ellisman, David Green: Purkinje Cells Lee, Red: Glial Cells Jason Light Blue: Nuclear DNA Leigh OptIPuter
- 30. Scalable Displays Allow Both Global Content and Fine Detail Source: Mark Ellisman, David Lee, Jason Leigh 30 MPixel SunScreen Display Driven by a 20-node Sun Opteron Visualization Cluster
- 31. Allows for Interactive Zooming from Cerebellum to Individual Neurons Source: Mark Ellisman, David Lee, Jason Leigh
- 32. UM Professor Graeme Jackson Planning Brain Surgery for Severe Epilepsy www.calit2.net/newsroom/release.php?id=1219
- 33. Prototyping the PC of 2015: Two Hundred Million Pixels Connected at 10Gbps Data from the Transdisciplinary Imaging Genetics Center 50 Apple 30” Cinema Displays Driven by 25 Dual- Processor G5s Source: Falko Kuester, Calit2@UCI NSF Infrastructure Grant
- 34. Visualizing Human Brain Pathways Along White Matter Bundles that Connect Distant Neurons Head On View Rotated View Vid Petrovic, James Fallon, UCI and Falko Kuester, UCSD IEEE Trans. Vis. & Comp. Graphics, 13, p. 1488 (2007)
- 35. Ultra Resolution Virtual Reality: 3D Global Collaboratory See www.kurzweilai.net 15 Meyer Sound Connected at 50 Gb/s to Quartzite Speakers + Subwoofer 30 HD Projectors! Passive Polarization-- Optimized the Polarization Separation and Minimized Attenuation Source: Tom DeFanti, Greg Dawe, Calit2 Cluster with 30 Nvidia 5600 cards-60 GB Texture Memory
- 36. OptIPortals: Scaling up the Personal Computer For Supernetwork Connected Data-Intensive Users Mike Norman, SDSC October 10, 2008 Two 64K Images From a log of gas temperature log of gas density Cosmological Simulation of Galaxy Cluster Formation
- 37. Optical Fiber Telepresence Will Accelerate Rate of Global Discovery Melbourne, Australia January 15, 2008 UC San Diego
- 38. Victoria Premier and Australian Deputy Prime Minister Asking Questions www.calit2.net/newsroom/release.php?id=1219
- 39. University of Melbourne Vice Chancellor Glyn Davis in Calit2 Replies to Question from Australia Smarr OptIPortal Road Show
- 40. OptIPlanet Collaboratory Persistent Infrastructure Between Calit2 and U Washington Photo Credit: Alan Decker Feb. 29, 2008 Ginger Armbrust’s Diatoms: Micrographs, Chromosomes, Genetic Assembly iHDTV: 1500 Mbits/sec Calit2 to UW Research Channel Over NLR UW’s Research Channel Michael Wellings
- 41. Remote Control of Scientific Instruments: Live Session with JPL and Mars Rover from Calit2 September 17, 2008 Source: Falko Kuester, Calit2; Michael Sims, NASA
- 42. Just in Time OptIPlanet Collaboratory: Live Session Between NASA Ames and Calit2@UCSD Feb 19, 2009 From Start to This Image in Less Than 2 Weeks! View from NASA Ames Lunar Science Institute Mountain View, CA Virtual Handshake HD compressed 6:1 NASA Interest in Supporting Virtual Institutes Source: Falko Kuester, Calit2; Michael Sims, NASA
- 43. EVL’s SAGE OptIPortal VisualCasting Multi-Site OptIPuter Collaboratory CENIC CalREN-XD Workshop Sept. 15, 2008 Total Aggregate VisualCasting Bandwidth for Nov. 18, 2008 EVL-UI Chicago Sustained 10,000-20,000 Mbps! At Supercomputing 2008 Austin, Texas November, 2008 Streaming 4k SC08 Bandwidth Challenge Entry Remote: On site: U of Michigan SARA (Amsterdam) UIC/EVL U Michigan GIST / KISTI (Korea) U of Queensland Osaka Univ. (Japan) Russian Academy of Science Masaryk Univ. (CZ) Requires 10 Gbps Lightpath to Each Site Source: Jason Leigh, Luc Renambot, EVL, UI Chicago
- 44. Academic Research “OptIPlatform” Cyberinfrastructure: A 10Gbps Lightpath Cloud HD/4k Video Cams HD/4k Telepresence Instruments End User HPC OptIPortal 10G Lightpaths National LambdaRail Data Campus Repositories Optical & Clusters Switch HD/4k Video Images
- 45. We Stand at the Beginning of the Globalization 3.0 Era Globalization 1.0 was about countries and muscles. In Globalization 2.0 the dynamic force driving global integration was multinational companies. The dynamic force in Globalization 3.0 is the newfound power for individuals to collaborate & compete globally. And the lever that is enabling individuals and groups to go global is software in conjunction with the creation of a global fiber-optic network that has made us all next-door neighbors.” Globalization 3.0 Globalization 1.0 Globalization 2.0 1500 1600 1700 1800 1900 2000
- 46. The Technology Innovations of Ten Years Ago-the Shared Internet & the Web-Have Been Adopted Globally • But Today’s Innovations – Dedicated Fiber Paths – Streaming HD TV – Ubiquitous Wireless Internet – Location Aware Software – SensorNets • Will Reduce the World to a “Single Point” in Ten Years