HPCC Systems 6.4.0 and Beyond
0 likes247 views
The document discusses updates and improvements in HPCC Systems version 6.4.0 and subsequent version 7.0, highlighting enhancements in productivity, interoperability, performance, security, and reliability. Key features include better ECL development tools, support for new data formats, and advancements in statistical processing capabilities. The document also outlines new tools for cluster migration and improved error reporting mechanisms.
HPCC Systems 6.4.0 and Beyond
- 1. October 4, 2017 Gavin Halliday, Enterprise Architect, LexisNexis HPCC Systems 6.4.0 and Beyond
- 2. Productivity
- 3. Productivity 6.4 – ECL Developers • Git • 64 bit windows client • Improved compiler speed • --fastsyntax option • LOOKUP - compile time record resolution • IDE • Usability • Language integration (HIPIE, KEL, ESDL) • Dynamic ESDL • ML library in core and bundles HPCC Systems 6.4.0 and Beyond 3
- 4. Productivity 6.4 - Operations • File history • Cluster migration tool • Package map tools • Copying packages • Parts manipulation • Improved error reporting HPCC Systems 6.4.0 and Beyond 4
- 5. Productivity 7.0 • EclWatch • Dashboards • Better access to query statistics • Session management • Compiler improvements • Ecl indexer • --fastsyntax v2 • New config manager • Language enhancements • MATCHED(LEFT) HPCC Systems 6.4.0 and Beyond 5
- 7. Interoperability 6.4 • New support • Python 3 • Couchbase • AWS SQS (Simple Queue Service) • New capabilities • Nested datasets in R • Persistent data • Compile time embed • WsSQL HPCC Systems 6.4.0 and Beyond 7
- 8. Interoperability 7.0 • Spark • UnicodeLib • R? • Tensorflow? HPCC Systems 6.4.0 and Beyond 8
- 9. Performance
- 10. Performance 6.4 • Roxie • Xml reading • Index reading • EclWatch wildcards • Cassandra • ML Myriad interface for Logistic and Linear regression • New Hardware • Knights Landing (244 threads) • Containers HPCC Systems 6.4.0 and Beyond 10
- 11. Performance 7.0 • More of the same • More XML improvements • Memory manager • Thor • Remote file operations • Filtering and projecting • Keyed joins • R threading HPCC Systems 6.4.0 and Beyond 11
- 12. Security
- 13. Security • Roxie SSL • Encryption in transit • Restrict file access to signed code • Dropzone whitelists HPCC Systems 6.4.0 and Beyond 13
- 14. Reliability
- 15. Reliability • Fixes • Major minor point • RCA (Regress/Point incompatible) • Catching problems • Smoke test • Coverity • Regression suite • Performance suite HPCC Systems 6.4.0 and Beyond 15
- 16. Reliability HPCC Systems 6.4.0 and Beyond 16
- 17. Questions?