Social Analytics for Crypto: Myths, Realities, GPT-3 and Some Astonishing Data Science
Download as PPTX, PDF1 like1,151 views
The document discusses the evolving role of social analytics and language intelligence in the crypto markets, focusing on the advanced capabilities of models like GPT-3. It highlights the limitations of traditional sentiment and topic analysis techniques and emphasizes the transformative potential of transformer models in enhancing crypto analysis through tasks like news summarization and question-answering. Overall, it underscores the relevance of language intelligence in navigating the complexities of crypto narratives and improving market insights.
Social Analytics for Crypto: Myths, Realities, GPT-3 and Some Astonishing Data Science
- 1. Social Analytics for Crypto: Myths, Realities, GPT-3 and Some Astonishing Data Science April 2021
- 2. Agenda ● Traditional language analytics and crypto markets ● Transformers and GPT-3 ● New language intelligence capabilities that crypto experts should be excited about SOCIAL ANALYTICS FOR CRYPTO: MYTHS, REALITIES, GPT-3 AND SOME ASTONISHING DATA SCIENCE
- 3. A quick update about IntoTheBlock…
- 4. Lots of new customer launches… SOCIAL ANALYTICS FOR CRYPTO: MYTHS, REALITIES, GPT-3 AND SOME ASTONISHING DATA SCIENCE
- 5. SOCIAL ANALYTICS FOR CRYPTO: MYTHS, REALITIES, GPT-3 AND SOME ASTONISHING DATA SCIENCE
- 6. SOCIAL ANALYTICS FOR CRYPTO: MYTHS, REALITIES, GPT-3 AND SOME ASTONISHING DATA SCIENCE
- 7. New ITB Corp Website SOCIAL ANALYTICS FOR CRYPTO: MYTHS, REALITIES, GPT-3 AND SOME ASTONISHING DATA SCIENCE
- 8. Upcoming Exciting Features ● Curve DeFi analytics ● New blockchain ownership indicators ● Social analytics ● NFT analytics SOCIAL ANALYTICS FOR CRYPTO: MYTHS, REALITIES, GPT-3 AND SOME ASTONISHING DATA SCIENCE
- 9. Natural language understanding and crypto: A traditional perspective
- 10. The Key Question Can we extract alpha by analyzing social data feeds for crypto-assets? SOCIAL ANALYTICS FOR CRYPTO: MYTHS, REALITIES, GPT-3 AND SOME ASTONISHING DATA SCIENCE
- 11. Maybe But it’s not as simple as you might think… SOCIAL ANALYTICS FOR CRYPTO: MYTHS, REALITIES, GPT-3 AND SOME ASTONISHING DATA SCIENCE
- 12. The crypto market is dominated by narratives...
- 13. Large number of highly diverse sources of narratives…
- 14. But narratives are hard to quantify in an actionable way… SOCIAL ANALYTICS FOR CRYPTO: MYTHS, REALITIES, GPT-3 AND SOME ASTONISHING DATA SCIENCE
- 15. Text Intelligence Social Data Fees Sentiment Analysis News/Market Commentary Fees Topic Analysis SOCIAL ANALYTICS FOR CRYPTO: MYTHS, REALITIES, GPT-3 AND SOME ASTONISHING DATA SCIENCE Text Intelligence for Capital Markets has been Dominated by Two Main Techniques
- 16. Assigns a numeric score to a text representation based on its affective state Sentiment Analysis SOCIAL ANALYTICS FOR CRYPTO: MYTHS, REALITIES, GPT-3 AND SOME ASTONISHING DATA SCIENCE
- 17. Extracts key topics and entities from long-form textual representations Topic Analysis SOCIAL ANALYTICS FOR CRYPTO: MYTHS, REALITIES, GPT-3 AND SOME ASTONISHING DATA SCIENCE
- 18. Some Key Observations SOCIAL ANALYTICS FOR CRYPTO: MYTHS, REALITIES, GPT-3 AND SOME ASTONISHING DATA SCIENCE Topic and sentiment analysis are both reductionist techniques that compact information into a single- term representation 1 Both types of techniques need to be heavily trained into a specific domain such as crypto markets and they are expensive to maintain 2 Noisy environment like crypto can drastically impact the effectiveness of sentiment and topic analysis methods 3
- 19. Sentiment and topic analysis are still far away from methods that resemble how humans consume financial information….
- 20. Today we can do so much more... SOCIAL ANALYTICS FOR CRYPTO: MYTHS, REALITIES, GPT-3 AND SOME ASTONISHING DATA SCIENCE
- 21. Transformers, language pretrained models and the language intelligence revolution… SOCIAL ANALYTICS FOR CRYPTO: MYTHS, REALITIES, GPT-3 AND SOME ASTONISHING DATA SCIENCE
- 22. You have probably heard about GPT-3
- 23. GPT-3 is the most popular example of an architecture that has revolutionized the deep learning space…
- 24. Started with a Groundbreaking Paper from Google Research in 2018 SOCIAL ANALYTICS FOR CRYPTO: MYTHS, REALITIES, GPT-3 AND SOME ASTONISHING DATA SCIENCE
- 25. That Introduced a New Architecture Based on Attention Mechanisms SOCIAL ANALYTICS FOR CRYPTO: MYTHS, REALITIES, GPT-3 AND SOME ASTONISHING DATA SCIENCE
- 26. Transformers completely revolutionized natural language understanding and gave birth to the concept of “language pretrained models”… SOCIAL ANALYTICS FOR CRYPTO: MYTHS, REALITIES, GPT-3 AND SOME ASTONISHING DATA SCIENCE
- 27. ● Train a model in a large textual corpus (ex: Wikipedia) ● Fine-tune it for specific tasks ● Is the analogous of a “well-read” human expert Language Pretrained Models SOCIAL ANALYTICS FOR CRYPTO: MYTHS, REALITIES, GPT-3 AND SOME ASTONISHING DATA SCIENCE
- 28. Multi-Task Language Model Paradigm SOCIAL ANALYTICS FOR CRYPTO: MYTHS, REALITIES, GPT-3 AND SOME ASTONISHING DATA SCIENCE
- 29. And the Race to Master Natural Language Started…
- 30. Bigger is Better SOCIAL ANALYTICS FOR CRYPTO: MYTHS, REALITIES, GPT-3 AND SOME ASTONISHING DATA SCIENCE
- 32. Bringing transformers to crypto analysis: The possibilities….
- 33. Transformers changed natural language understanding, but how are they relevant to crypto analytics today? SOCIAL ANALYTICS FOR CRYPTO: MYTHS, REALITIES, GPT-3 AND SOME ASTONISHING DATA SCIENCE
- 34. Some Key Scenarios SOCIAL ANALYTICS FOR CRYPTO: MYTHS, REALITIES, GPT-3 AND SOME ASTONISHING DATA SCIENCE News Summarization News / Tweets Classification Question Answering Text Generation Machine Translation
- 35. News Summarization Goal ● Generate 3-4 sentences summaries of top crypto news Value ● Help users understand the key points of different long-form news SOCIAL ANALYTICS FOR CRYPTO: MYTHS, REALITIES, GPT-3 AND SOME ASTONISHING DATA SCIENCE
- 36. One-Shot Classification Goal ● Classify news/tweets based on specific categories relevant to the crypto market like “”bullish”, “bearish”, “risk”, “trading”, etc. Value ● Help users filter content based on different perspectives SOCIAL ANALYTICS FOR CRYPTO: MYTHS, REALITIES, GPT-3 AND SOME ASTONISHING DATA SCIENCE
- 37. Question-Answering Goal ● Produce answers to long-form text questions about crypto news Value ● Allow users to ask specific questions about the crypto market and review relevant news SOCIAL ANALYTICS FOR CRYPTO: MYTHS, REALITIES, GPT-3 AND SOME ASTONISHING DATA SCIENCE
- 38. Text Generation Goal ● Generate text narratives based on crypto-datasets. Ex: futures, blockchain activity… Value ● Help investors to review market datasets using interpretable, text-based explanations SOCIAL ANALYTICS FOR CRYPTO: MYTHS, REALITIES, GPT-3 AND SOME ASTONISHING DATA SCIENCE
- 39. Machine Translation Goal ● Create accurate translations of crypto news Value ● Expand crypto market knowledge to many languages and dialects SOCIAL ANALYTICS FOR CRYPTO: MYTHS, REALITIES, GPT-3 AND SOME ASTONISHING DATA SCIENCE
- 40. These scenarios are possible with today’s technologies… SOCIAL ANALYTICS FOR CRYPTO: MYTHS, REALITIES, GPT-3 AND SOME ASTONISHING DATA SCIENCE
- 41. Transformer Models are Expensive but Available SOCIAL ANALYTICS FOR CRYPTO: MYTHS, REALITIES, GPT-3 AND SOME ASTONISHING DATA SCIENCE
- 42. And we are working on it… SOCIAL ANALYTICS FOR CRYPTO: MYTHS, REALITIES, GPT-3 AND SOME ASTONISHING DATA SCIENCE
- 43. Summary ● Language intelligence is incredibly relevant in the current state of the crypto markets ● Traditional models are based on sentiment analysis and topic extraction techniques ● Transformers represent a massive evolution in natural language intelligence ● Scenarios such as text generation, translation, question-answering, long-form summarization and classification are very relevant to the crypto space SOCIAL ANALYTICS FOR CRYPTO: MYTHS, REALITIES, GPT-3 AND SOME ASTONISHING DATA SCIENCE