Big data and its applications
- 1. Big Data and it’s applications A Concept Review by: Ali Easazadeh
- 2. Agenda »What is big data? »Somestunningfacts!! »Bigdatacharacteristics »Data scientists »Applications of bigdata »Related Technologies
- 3. DATA? BIG W h a t i s
- 5. 5
- 8. “Forbes.com : Big Data: 20 Mind-Boggling Facts Everyone Must Read
- 9. 1. The data volumes are exploding, more data has been created in the past two years than in the entire previous history of the human race.
- 10. 2. Data is growing faster than ever before and by the year 2020, about 1.7 megabytes of new information will be created every second for every human being on the planet.
- 11. 3. By then, our accumulated digital universe of data will grow from 4.4 zettabyets today to around 44 zettabytes, or 44 trillion gigabytes.
- 12. 4. Every second we create new data. For example, we perform 40,000 search queries every second (on Google alone), which makes it 3.5 searches per day and 1.2 trillion searches per year.
- 13. 5. In Aug 2015, over 1 billion people used Facebook in a single day.
- 14. 6. Facebook users send on average 31.25 million messages and view 2.77 million videos every minute.
- 15. 7. We are seeing a massive growth in video and photo data, where every minute up to 300 hours of video are uploaded to YouTube alone.
- 16. 8. In 2015, a staggering 1 trillion photos were taken and billions of them will be shared online.
- 17. 9. This year, over 1.4 billion smart phones will be shipped – all packed with sensors capable of collecting all kinds of data, not to mention the data the users create themselves.
- 18. 10. By 2020, we will have over 6.1 billion smartphone users.
- 19. 11. Within five years there will be over 50 billion smart connected devices in the world, all developed to collect, analyze and share data.
- 20. 12. By 2020, at least a third of all data will pass through the cloud (a network of servers connected over the Internet).
- 21. 13. Distributed computing is very real. Google uses it every day to involve about 1,000 computers in answering a single search query, which takes no more than 0.2 seconds to complete.
- 22. 14. The Hadoop (open source software for distributed computing) market is forecast to grow at a compound annual growth rate 58% surpassing $1 billion by 2020.
- 23. 15. Estimates suggest that by better integrating big data, healthcare could save as much as $300 billion a year — that’s equal to reducing costs by $1000 a year for every man, woman, and child.
- 24. 16. The White House has already invested more than $200 million in big data projects.
- 25. 17. A 10% increase in data accessibility translates into an additional $65.7 million in net income for a typical Fortune 1000 company.
- 26. 18. Retailers who leverage the full power of big data could increase their operating margins by as much as 60%.
- 27. 19. 73% of organizations have already invested or plan to invest in big data by 2016
- 28. 20. At the moment less than 0.5% of all data is ever analysed and used, just imagine the potential here.
- 29. Characteristics (V’s) of Big Data : Volume Variety Velocity Veracity
- 30. “ Volume
- 31. “ Velocity
- 32. “ Variety
- 33. “ Veracity
- 37. 37
- 38. 38
- 39. “ Key applications of big data
- 40. Key applications of big data » Application of big data in enterprises
- 41. Key applications of big data » Application of IoT based big data
- 42. Key applications of big data » Application of online social network-oriented big data
- 43. Key applications of big data » Applications of healthcare and medical big data
- 44. Key applications of big data » Mobile data analysis
- 45. Key applications of big data »Multimedia data analysis
- 46. Key applications of big data » Applications of big data in e-commerce
- 47. Big Data Related Technologies » cloud computing » IoT » Data center » Hadoop
- 48. Big Data Related Tools » R » Excel » Rapidminer » Weka » Python
- 49. Any questions? You can find me at: » Telegram.me/ali_E_13 » ali.easazadeh.13@gmail.com THANKS!
Editor's Notes
- #4: کلان داده یا عظیم داده یا مه داده 1 به گستره ای از داده ها اطلاق می شود که دارای مجموعه داده های بزرگ و یا پیچیده هستند که روش های قدیمی پاسخ گوی پردازش آن های نیستند. Structured and unstructured does not have a pre-defined data model or is not organized in a pre-defined manner. Normal database , all kind of data : text, comment, video, clicks, likes, links, tweets, voices
- #5: در حال حاضر این علم در ابتدای راه خود است و باید مسایلی بسیار زیاد در مورد آن کشف شود
- #6: By ibm 1 quintillion = 1000 peta 2.5 quintillion = 2500 peta 1 peta = 1000 tera 2.5 quintillion = 2,500,000 tera ايستگاههاي هواشناسي، سامانههاي امواج راديويي، دادههاي نجوم، پروندههاي پزشكي بيماران، اطلاعات سامانههاي خريد از فروشگاهها، پژوهشهاي زمينشناسي
- #10: Tell
- #11: Tell
- #12: Tell 1 zatabyte = 1e+9 terabyte
- #13: Tell 1 trillion = 10^12
- #14: Don’t tell
- #15: Don’t tell
- #16: Tell
- #17: Don’t tell
- #18: Don’t
- #19: Don’t
- #20: Tell
- #21: Don’t
- #22: Don’t
- #23: Tell هدوپ يك چارچوب يا مجموعه اي از نرم افزارها و كتابخانه هايي است كه ساز و كار پردازش حجم عظيمي از داده هاي توزيع شده را فراهم ميكند.
- #24: Don’t
- #25: Tell
- #26: Don’t
- #27: Don’t
- #28: Tell
- #29: Tell
- #30: صحت و راستی
- #31: حجم یکی از معیارهای اصلی در بحث کلان داده است. معمولا حجم این داده ها بالای چند صد ترابایت است.
- #32: سرعت تولید بالا سرعت پردازش هم باید بالا باشد Velocity : سازمان پیشگیری از بیماریهای امریکا و گوگل HFT = high frequency transaction
- #33: داده هایی که جهت پردازش به سیستم کلان داده ارجاع داده می شوند، از منابع مختلفی جمع آوری می شوند. لذا تنوع بسیاری در ساختار آن ها دیده می شود.
- #34: با توجه به اينكه داده ها از منابع مختلف دريافت ميشوند، ممكن است نتوان به همه آنها اعتماد كرد. مثلا در يك شبكه اجتماعي، ممكن است نظرهاي زيادي در خصوص يك موضوع خاص ارائه شود.
- #37: دانشمندان داده قهرمانان عصر حاضر به بیش از 4.4 میلیون دانشمند داده نیاز میباشد 2015-ibm
- #38: امروزه موقعیت شغلی جدیدی در بسیاری از شرکت ها و سازمان ها تحت عنوان مدیر داده ها تعریف شده است. به طور مثال در سال ۲۰۱۴ کاخ سفید دی جی پاتیل را به عنوان مدیر داده کاخ سفید استخدام کرد
- #39: به طور مثال در سال ۲۰۱۴ کاخ سفید دی جی پاتیل را به عنوان مدیر داده کاخ سفید استخدام کرد Dj patil
- #41: predict the consumer behavior finance, commodity prices improve their operation efficiency and satisfaction
- #42: important source of big data also one of the main markets of big data applications GPS, Smart city
- #43: Comments, clicks, relations, Comments what u like , links
- #44: ارائه خدمات بهتر به عموم شناسايي روشهايي شخصيسازي شده براي درمان بيماران افزايش سلامت جامعه و كاهش هزينههاي دولت داده هاي مربوط به ژنها از سري داده هايي هستند كه داراي رشد خيلي زياد هستند
- #45: Rightel
- #46: Image, audio, text, video
- #47: Customer Personalization Predictive Analysis
- #48: Data center : not only is a platform for concentrated storage of data, but also undertakes more responsibilities, such as acquiring data, managing data, organizing data Hadoop : HDFS : storage part, MapReduce : process part open-source software framework used for distributed storage and processing of very large data sets. storage part, known as Hadoop Distributed File System (HDFS), and a processing part called MapReduce.
- #49: R : (an open source programming language) Rapidminer : an open source software used for data mining, machine learning, and predictive analysis. Weka : free and open-source machine learning and datamining software written in Java Python : easy, libraries,open source