Big Data Lesson 1 Conference Jean-Antoine Moreau
0 likes616 views
The document discusses the importance of big data and analytics in modern business, emphasizing data management, storage, processing, and efficiency as key components. It covers various aspects of data handling, including simulation, optimization, and algorithm design, to improve decision-making and operational efficiency. Additionally, it highlights the technical constraints and requirements necessary for effective data processing and simulation strategies.
Big Data Lesson 1 Conference Jean-Antoine Moreau
- 1. BBIIGG DDAATTAA LLeessssoonn 11 Study : Jean-Antoine Moreau (Engineer - Lecturer) © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP.
- 2. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. "Information is the oil of the 21st century, and analytics is the combustion engine." Peter Sondergaard Contact http://www.jean-antoine-moreau.fr.nf JAM 2
- 3. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa • Choose • Transform; • Convert; • Scrutinized; • Analyzed; Contact http://www.jean-antoine-moreau.fr.nf JAM 3
- 4. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa • acquire knowledge by type (kind) of ddaattaa; • acquire knowledge by type (kind) of ccoonntteenntt; • acquire knowledge by type (kind) of uusseerr; Contact http://www.jean-antoine-moreau.fr.nf JAM 4
- 5. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa More informations for a GGlloobbaall BBuussiinneessss Contact http://www.jean-antoine-moreau.fr.nf JAM 5
- 6. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa • Data Management Contact http://www.jean-antoine-moreau.fr.nf JAM 6
- 7. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa • Data Storage Contact http://www.jean-antoine-moreau.fr.nf JAM 7
- 8. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa • Data Analysis Contact http://www.jean-antoine-moreau.fr.nf JAM 8
- 9. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa • Data Efficiency Contact http://www.jean-antoine-moreau.fr.nf JAM 9
- 10. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa • Data Performances Contact http://www.jean-antoine-moreau.fr.nf JAM 10
- 11. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa • Data Processing Contact http://www.jean-antoine-moreau.fr.nf JAM 11
- 12. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa are impacted by the big volume Contact http://www.jean-antoine-moreau.fr.nf JAM 12
- 13. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Programming Model Standardization Contact http://www.jean-antoine-moreau.fr.nf JAM 13
- 14. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa The data’s efficiency The data have a productivity Contact http://www.jean-antoine-moreau.fr.nf JAM 14
- 15. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Efficiency Cost Process DATA Contact http://www.jean-antoine-moreau.fr.nf JAM 15
- 16. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Input Output SYSTEM Contact http://www.jean-antoine-moreau.fr.nf JAM 16
- 17. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa binary join multidimensional join recursive join of object of database and also between databases. Contact http://www.jean-antoine-moreau.fr.nf JAM 17
- 18. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa binary join multidimensional join recursive join of object of database and also between databases. joining cycle Contact http://www.jean-antoine-moreau.fr.nf JAM 18
- 19. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Data Processing Cycle Contact http://www.jean-antoine-moreau.fr.nf JAM 19
- 20. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Data Processing Joining cycle Contact http://www.jean-antoine-moreau.fr.nf JAM 20
- 21. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa N+1 N+2 N+3 N Accuracy meaning, direction Contact http://www.jean-antoine-moreau.fr.nf JAM 21 Level optimization
- 22. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa • Data levels are include; • Data are include in data base and data base is included in system for management; • Management systems are included among them; Contact http://www.jean-antoine-moreau.fr.nf JAM 22
- 23. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa • Axis of : – Data; – Data base; – Management system; Each with different levels. Contact http://www.jean-antoine-moreau.fr.nf JAM 23
- 24. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Toolbox for Parallel Computing parallel computing distributed arrays Algorithms transmission functions communication > result Contact http://www.jean-antoine-moreau.fr.nf JAM 24
- 25. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa • Using • virtual matrix from • data storage across a cluster. Contact http://www.jean-antoine-moreau.fr.nf JAM 25
- 26. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa • Using : – Performing parallel computation • aggregate data set optimizing file I/O performance Contact http://www.jean-antoine-moreau.fr.nf JAM 26
- 27. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Data volume relation Data Processing Contact http://www.jean-antoine-moreau.fr.nf JAM 27
- 28. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa • Scenario; • Optimization; • Both models; • Algorithms; Contact http://www.jean-antoine-moreau.fr.nf JAM 28
- 29. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Complex operations Complex calculations Dimensions Simulation Process Focus Efficiency Contact http://www.jean-antoine-moreau.fr.nf JAM 29
- 30. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Goal Optimize the existing Reduce the running time Simulation Contact http://www.jean-antoine-moreau.fr.nf JAM 30
- 31. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Goal Scaling simulation Fonctional simulation Contact http://www.jean-antoine-moreau.fr.nf JAM 31
- 32. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Optimization SQL Data Base New algorithm to query Contact http://www.jean-antoine-moreau.fr.nf JAM 32
- 33. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Method Modelling Algorithm Contact http://www.jean-antoine-moreau.fr.nf JAM 33
- 34. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Simulation Simulation process Simulation effects Contact http://www.jean-antoine-moreau.fr.nf JAM 34
- 35. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa simulation Data n n-1 result Contact http://www.jean-antoine-moreau.fr.nf JAM 35
- 36. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Contact http://www.jean-antoine-moreau.fr.nf JAM 36 • Using: – Branch (data tree, software tree); – Node; – Aggregate; – Specific node; – Parameters; – Historical data;
- 37. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa • data tree; • decomposition tree; • general category; • Subcategory; • critical category; Contact http://www.jean-antoine-moreau.fr.nf JAM 37
- 38. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa • Structuring data approach; • Historical order of the information; Contact http://www.jean-antoine-moreau.fr.nf JAM 38
- 39. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa • Structuring data approach; • Historical order of the information; • Using : – Aggregate data; – Hierarchical data tree; – Taking in account different rate; Contact http://www.jean-antoine-moreau.fr.nf JAM 39
- 40. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa • Simulation • Process • Delais • Time Contact http://www.jean-antoine-moreau.fr.nf JAM 40
- 41. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Aggregating historical Including : Active condition; Behaviours; Running : Multiple times; Different rate for the same period; Contact http://www.jean-antoine-moreau.fr.nf JAM 41
- 42. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Simulation output Described in terms Profit Value Specification Contact http://www.jean-antoine-moreau.fr.nf JAM 42
- 43. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Contact http://www.jean-antoine-moreau.fr.nf JAM 43 • Simulation • Requirement • Specification methodological process
- 44. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Inheritance Level Node Contact http://www.jean-antoine-moreau.fr.nf JAM 44
- 45. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Inheritance Level Node Optimization Contact http://www.jean-antoine-moreau.fr.nf JAM 45
- 46. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Optimization – Database; – SQL query; – Database connexion; – Using the Database in the memory; • Cache memory; • Virtual memory; • Physical (internal / external) memory; Contact http://www.jean-antoine-moreau.fr.nf JAM 46
- 47. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Optimization – Database; – SQL query; – Database connexion; – Using the Database in the memory; • Cache memory; • Virtual memory; • Physical (internal / external) memory; Data architecture; • Physical; • Virtual; Contact http://www.jean-antoine-moreau.fr.nf JAM 47
- 48. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Physical Database Database stored Objects Database Tables Database time accuracy of data processing Contact http://www.jean-antoine-moreau.fr.nf JAM 48 memory
- 49. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Simulation process Volume IT architecture capacity Data sources Contact http://www.jean-antoine-moreau.fr.nf JAM 49
- 50. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Define The data tree structure The scaling axis The scrolling conditions Contact http://www.jean-antoine-moreau.fr.nf JAM 50
- 51. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa inputs Data Processing outputs Contact http://www.jean-antoine-moreau.fr.nf JAM 51 node Time - Period financial resources
- 52. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Ressources - Capacity Impact Algorithm Decision Tree Decision Matrix Choice of the aggregation type Contact http://www.jean-antoine-moreau.fr.nf JAM 52
- 53. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa aggregation Data Database Management System Database Contact http://www.jean-antoine-moreau.fr.nf JAM 53
- 54. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Aggregation Data Database Management System Database Contact http://www.jean-antoine-moreau.fr.nf JAM 54
- 55. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Aggregation Data Database Management System Database Contact http://www.jean-antoine-moreau.fr.nf JAM 55
- 56. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa • Technical Constraint : – Aggregated data; – Linked data; – Jointed data; Contact http://www.jean-antoine-moreau.fr.nf JAM 56
- 57. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Technical Constraint – Aggregated data; – Linked data; – Jointed data; •Traceability; •Coherence; •Accuracy; •Consistency; Contact http://www.jean-antoine-moreau.fr.nf JAM 57
- 58. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa • Technical Constraint • Optimized – Models; – Algorithms; Contact http://www.jean-antoine-moreau.fr.nf JAM 58
- 59. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Using the Data Science Customer Model Scaling Simulation Model Contact http://www.jean-antoine-moreau.fr.nf JAM 59
- 60. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa • Simulation suffer from high time complexity; • Data retrieval from data base and memory cache; • The same data is redundancy calculated and aggregated several time; To avoid reaggregation and recalculation; Contact http://www.jean-antoine-moreau.fr.nf JAM 60
- 61. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Data Simulation tagging History decision-making mechanism Contact http://www.jean-antoine-moreau.fr.nf JAM 61
- 62. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Prepare the simulation Specification Contact http://www.jean-antoine-moreau.fr.nf JAM 62
- 63. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Contact http://www.jean-antoine-moreau.fr.nf JAM 63 • Data – Variable; – Constant; – Magnetude; – Description • Tree path; • Historical; • Acces method; • Condition; • Dependent; • … • Algorithm Prepare the simulation Specification BBuussiinneessss
- 64. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Contact http://www.jean-antoine-moreau.fr.nf JAM 64 • Data – Variable; – Constant; – Magnetude; – Description Prepare the simulation Specification BBuussiinneessss • Tree path; • Historical; • Acces method; • Condition; • Dependent; • … • Algorithm
- 65. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Contact http://www.jean-antoine-moreau.fr.nf JAM 65 Data indexing Business needs
- 66. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Process Cycle Time Contact http://www.jean-antoine-moreau.fr.nf JAM 66 Your Model Use for Simulation
- 67. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Data Base / Query I/O physical logical virtualizing Data System Management data Data Base Contact http://www.jean-antoine-moreau.fr.nf JAM 67 Level
- 68. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Data collection strategy Business Case Use Case Data analysis Contact http://www.jean-antoine-moreau.fr.nf JAM 68
- 69. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Business Case Predictive Model Data collection strategy DDaattaa mmiinniinngg IInnffeerreennccee SSttaattiissttiiccaall MMooddeell Contact http://www.jean-antoine-moreau.fr.nf JAM 69
- 70. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Business Case Data Strategy Predictive node Data Exploring Process IT Infrastructure Contact http://www.jean-antoine-moreau.fr.nf JAM 70
- 71. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Business Case Open Data Meta Data Linked Data; Aggregated Data; Web Data; Contact http://www.jean-antoine-moreau.fr.nf JAM 71
- 72. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Business Case Data Base Data Mining •Data System Data Base; •Data Mart; •Data Mashup Software; Contact http://www.jean-antoine-moreau.fr.nf JAM 72
- 73. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa • Business case (Use Case) – Approach : • Community; • Dynamic; • Static; • geolocated; • contextual; • time; • trades; Contact http://www.jean-antoine-moreau.fr.nf JAM 73
- 74. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa • Using the right information at the right time. • The right information makes satisfaction cient. Contact http://www.jean-antoine-moreau.fr.nf JAM 74
- 75. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Internet e-commerce Contact http://www.jean-antoine-moreau.fr.nf JAM 75 computer application mail e-health e-finance mobile social network
- 76. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Data Science scalability availability performance The good information at the just time Contact http://www.jean-antoine-moreau.fr.nf JAM 76
- 77. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa • Properties: – atomicity; – Consistency; – insulation; – sustainability; Contact http://www.jean-antoine-moreau.fr.nf JAM 77
- 78. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Using Real time with contextualization Online Transaction Processing (OLTP) Contact http://www.jean-antoine-moreau.fr.nf JAM 78
- 79. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. Contact http://www.jean-antoine-moreau.fr.nf JAM 79 • Currently – Management System Database : • structured data; • transactional apllications; • SQL interface; • security; standardization Object Data Management Group
- 80. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa • OPEN DATA : – unstructured data; – real-time data; – questioning and investigation by machine; – collaborative sharing; Contact http://www.jean-antoine-moreau.fr.nf JAM 80
- 81. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa volume new algorithm sharing analysis virtualization research capture Contact http://www.jean-antoine-moreau.fr.nf JAM 81
- 82. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa volume new data administration process. Contact http://www.jean-antoine-moreau.fr.nf JAM 82
- 83. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa open data; accessible data; reusable data; Open Data new control mechanisms of coherence Contact http://www.jean-antoine-moreau.fr.nf JAM 83
- 84. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa • Define a scale of data quality – The unfiltered unformatted data sets; – Data provided in a structured format; – Free data to be used and exploited without license; – Data identified from URL (Uniform Resource Locator); – Data related to actors which are themselves associated with a context; Contact http://www.jean-antoine-moreau.fr.nf JAM 84
- 85. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa The use of open data (Web) is uncontrollable by the producer. Contact http://www.jean-antoine-moreau.fr.nf JAM 85
- 86. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa using of open data data warehousing Contact http://www.jean-antoine-moreau.fr.nf JAM 86
- 87. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa using of open data Data warehouse Using the rules of management appropriate for each business line. Contact http://www.jean-antoine-moreau.fr.nf JAM 87
- 88. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa using of open data Data warehouse Data update using SPARQL service (Protocol and RDF Query Language) Contact http://www.jean-antoine-moreau.fr.nf JAM 88
- 89. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa using of open data Data warehouse Using the Web semantique (Data Web) Contact http://www.jean-antoine-moreau.fr.nf JAM 89
- 90. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Study and research in the classic mode: • Problem statement; • Intuition - deduction; • Validation: • experience; • simulation; • computation; Contact http://www.jean-antoine-moreau.fr.nf JAM 90
- 91. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa Study and research in a context Big Data: • Computer analysis: • Identification; • Correlation; • Proximity card (Geo-localization); • Generation of hypothesis; • Options; • Emergence of new solutions; • Experimentation; Contact http://www.jean-antoine-moreau.fr.nf JAM 91
- 92. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa • Highlighting correlations; • Getting Relief aggregations; • Search model of explanation: explanation : – Implementation; – Contectuel model; • Direction of the work; Contact http://www.jean-antoine-moreau.fr.nf JAM 92
- 93. © Jean-Antoine Moreau copying and reproduction prohibited Managing my copyright ADAGP. BBiigg DDaattaa • Using Open format – PDF; – CSV; – HTML; – XML; – RDF; – RSS; – Atom; – Json (JavaScript Object Notation ); – … Contact http://www.jean-antoine-moreau.fr.nf JAM 93