SQL Server Denali: BI on Your Terms
Download as PPTX, PDF0 likes817 views
The document provides an overview and agenda for a presentation on SQL Server Denali business intelligence (BI) capabilities. Key points include: - PowerPivot and Excel Services allow self-service BI through a familiar Excel interface while leveraging Analysis Services for storage and collaboration features. - Analysis Services Tabular Mode is the server implementation of PowerPivot, supporting partitions, roles and other enterprise features. - Project "Crescent" provides ad hoc reporting directly against PowerPivot and Analysis Services Tabular models through a browser-based, Excel-like interface in Silverlight. - Master Data Services and Data Quality Services provide master data management and data cleansing capabilities to support better data quality for BI initiatives.
![Formula syntax is called DAX (Data Analysis eXpressions).Not to be confused with MDX or DMX. Or DACs.DAX expressions are similar to Excel formulasWork with tables and columns; similar to, but distinct from, worksheets and their columns (and rows)=FUNC('table name'[column name])](https://image.slidesharecdn.com/msbidenalicodecampnyc2011-111004130432-phpapp01/85/SQL-Server-Denali-BI-on-Your-Terms-28-320.jpg)
![FILTER(Resellers,[ProductLine] = "Mountain")](https://image.slidesharecdn.com/msbidenalicodecampnyc2011-111004130432-phpapp01/85/SQL-Server-Denali-BI-on-Your-Terms-30-320.jpg)
![RELATED(Products[EnglishProductName])](https://image.slidesharecdn.com/msbidenalicodecampnyc2011-111004130432-phpapp01/85/SQL-Server-Denali-BI-on-Your-Terms-31-320.jpg)
SQL Server Denali: BI on Your Terms
- 1. SQL Server DenaliBI on Your TermsCode Camp NYC 2011Andrew J. Brust, Founder/CEO Blue Badge Insights
- 5. GOLD SPONSOR
- 6. GOLD SPONSOR
- 7. GOLD SPONSOR
- 8. GOLD SPONSOR
- 9. GOLD SPONSOR
- 10. GOLD SPONSOR
- 11. SILVER SPONSORS
- 12. Who Am I?Founder, CEO, Blue Badge InsightsMicrosoft Regional Director, MVPOrganizing team, Code Camp NYCCo-chair Visual Studio Live!Co-moderator, NYC .NET Developers Grouphttp://www.nycdotnetdev.comFounder, MS BI User Group NYChttp://www.msbinyc.combrustblog.com, Twitter: @andrewbrust
- 13. Column and Blog
- 14. Book
- 15. AgendaSQL Server BI – High LevelPowerPivot and Excel ServicesAnalysis Services Tabular ModeProject “Crescent”Overview: Master Data Services and Data Quality Services
- 16. SQL Server BI Overview
- 17. Microsoft Business IntelligenceBusiness User ExperienceFamiliar User Experience Self-Service access & insightData exploration & analysisPredictive analysisData visualizationContextual visualizationBusiness Collaboration PlatformDashboards & ScorecardsExcel ServicesWeb based forms & workflowCollaborationSearchContent ManagementLOB data integrationBusiness Collaboration PlatformData Infrastructure and BI PlatformAnalysis ServicesReporting ServicesIntegration ServicesMaster Data ServicesData MiningData WarehousingInformation Platform
- 18. SQLServer2008 BIComponentsIT PROFESSIONALSBUSINESS DECISIONMAKERSINFORMATIONWORKERSPOWER USERSDEVELOPERSMICROSOFT BI PLATFORM
- 19. But Wait, There’s More!R2: PowerPivotR2: Report Parts in SSRSDenali: Analysis Services Tabular modeAnd corresponding improvements in PowerPivotDenali: “Crescent”Denali: Data Quality Services
- 20. PowerPivot and Excel Services
- 21. Self-Service BI with PowerPivotExcel + Analysis Services + SharePointEnables the working in Excel but mitigates the “spreadmart” pitfalls:Use Analysis Services (AS) as a hidden engineInstead of no engineShare via SharePoint, accessible by all AS clientsInstead of “deploying” via emailFormal data refresh on serverSo data doesn’t get stale, and users don’t have to make effort at updatingAllow IT to monitorSo it’s not all rogueProvide path to more rigorous implementationsCan be upsized to Analysis Services
- 23. You have:
- 24. Perf: values you wish to aggregate are adjacent
- 25. Efficiency: great compression from identical or nearly-identical values in proximity
- 26. Fast aggregation and high compression means huge volumes of data can be stored and processed, in RAMData ImportRelational databasesSQL Server (including SQL Azure!), AccessOracle, DB2, Sybase, InformixTeradata“Others” (OLE DB, including OLE DB provider for ODBC)OData feeds, incl. R2/Denali Reporting Services, Azure DataMarket, ADO.NET Data Services (Astoria)Excel via clipboard, linked tablesFilter, preview, friendly names for tables/columns
- 27. Calculated Columns and DAXFormula-based columns may be created
- 28. Formula syntax is called DAX (Data Analysis eXpressions).Not to be confused with MDX or DMX. Or DACs.DAX expressions are similar to Excel formulasWork with tables and columns; similar to, but distinct from, worksheets and their columns (and rows)=FUNC('table name'[column name])
- 29. =FUNCX('table name', <filter expression>)
- 32. DAX expressions can be heavily nestedPowerPivot GuidebookImport data fromalmost anywhereView data in ExcelSort one column by anotherCalculatedcolumnentrySort and filterDAX formula barRelationship indicatorTable tabs
- 33. What’s New?Data and Diagram viewsKPIsMeasuresMeasuregridMeasureformula
- 34. Diagram ViewPerspectivesDefault AggregationsSpecial Advanced ModeReporting PropertiesHierarchiesHide specific columns and tablesCreate relationshipsvisuallyMeasuresKPIs
- 36. Excel ServicesA component of SharePoint Server 2007/2010; requires Enterprise CAL
- 37. Allows export of workbook, worksheet, or individual items to SharePoint report libraryWorks great for PivotTables and Charts!Also for sheets with CUBExxx formulas or conditional formatting-driven “scorecards”Content can be viewed in browserExcel client not requiredDrilldown interactivity maintainedRendered in pure AJAX/HTMLParameterization supported
- 38. PowerPivot ServerPublish to Excel ServicesViewing and interactingData RefreshTreating as SSAS cubeURL to .xlsx as server nameDb name is GUID-based; best to discover itUse Excel, Reporting Services as clientsAnd now “Crescent” too…more later
- 39. The IT DashboardIncrease IT efficiency:Familiar Technologies for Authoring, Sharing, Security, and ComplianceCustomizable IT DashboardVisualize usage with animated chartsSimplify management of SSBI content usingIT Operations Dashboard for SharePoint
- 41. Analysis Services Tabular Mode
- 42. Analysis Services Tabular ModeSSAS Tabular Mode is the enterprise/server implementation of PowerPivotYou must have a dedicated tabular mode SSAS instanceBI Developer Studio (BIDS) does PowerPivotImplements equivalent tooling to PowerPivot WindowCan create an SSAS Tabular database project by importing an Excel workbook with PowerPivot modelSSAS tabular models support partitions and roles
- 43. SSAS Tabular Project in BIDS SSAS tabular projectmenus and toolbarMeasure grid and formula barReporting properties in Properties window
- 44. DirectQuery ModeIn DQ mode, model defines schema, but is not used for dataQueries issued directly against sourceSimilar to ROLAP storage for conventional cubes
- 47. What is Crescent?Ad hoc reporting. Really!Analysis, data ExplorationData VisualizationIn Silverlight, in the browser, in SharePointFeels a little like Excel BIIs actually based on SSRSCrescent makes a special RDL fileAnd wraps it in an RDLX
- 48. Crescent Data SourcesCrescent works only against PowerPivot/SSAS Tabular modelsDirectQuery mode supported, howeverFor PowerPivot, click “Create Crescent Report” button or option on workbook in SharePoint report galleryFor SSAS tabular model, create BISM data source, then click its “Create Crescent Report” button or optionBISM data sources can point to PowerPivot workbooks too, if you want.
- 49. Crescent!In the browser, in SilverlightRibbon, like ExcelVariety of visualizationsand data formatsField list, like ExcelData regions pane,like Excel
- 50. Text and ViewingText boxes edited asif in OfficeMaximize one chart, or put whole report in preview or full-screen
- 51. Crescent Basics
- 52. Constraining Your Data In CrescentTilesA filtering mechanism within a visualizationHighlightingSelection in one visualization affects the othersSlicersSimilar to Excel against PowerPivotTrue FiltersChecked drop-down list; very Excel-likeRight Hand Filter Pane, similar to SSRS and Excel Services
- 54. Scatter/Bubble ChartsAllow for 3 measures by up to 4 dimensionsOne dimension is “playable” through a slider or animationExcellent way to visualize trends over time
- 55. Small MultipliersMultiple charts within a chart, in columns, rows, or a matrixAllows for visualizing an additional dimensionThink of it like a clustered chart with each series shown individually
- 56. Advanced PropertiesSetting the representative column and image tells Crescent how to summarize your data, and show stored imagesOther properties tell it about key attribute, default aggregation and moreFor SSAS tabular models, “Direct Query” mode tells Crescent to get data from relational data source instead of columnar cache
- 58. VocabularyMOLAP: Multidimensional OLAPUDM: Unified Dimensional ModelCube: Unit of schema in a dimensional databaseVertiPaq: PowerPivot/SSAS’ column store engineBISM: BI Semantic ModelTabular: A column store-based modelBecause it uses tables, not cubes
- 59. ApolloImplementation of VertiPaq columnar storage engine for SQL Server relational databasesUse it by creating a column store indexCREATE COLUMNSTORE INDEX index ON table(col1, Col2, …)Can ignore it too:OPTION (IGNORE_NONCLUSTERED_COLUMNSTORE_INDEX)Significantly increases performance of star join queries (i.e. aggregating queries with dimension lookups).Not as good as SSAS, but better than plain old GROUP BY
- 60. Overview:Master Data ServicesANDData Quality Services
- 61. Microsoft’s Master Data Management (MDM) toolExamples:Sales states, countries, currencies, customer typesCustomers, productsThink of “lookup tables” or just think of dimensions!Slowly changing non-transactional entities in your dataWhat gets stored:SchemasAny hierarchiesThe data!Other features:Collections, business rules, security, workflowsVersioning
- 62. Other FactsResult of acquisition of Stratature
- 63. v1 was an ASP.NET application; UI is “different”
- 64. New in v2:
- 65. Now Silverlight-based; UI is still “different”
- 66. Excel add-in for data entry; creation of entities and attributes
- 67. Perform matching with DQS before loading
- 68. Includes .NET and Web Services APIs for reading/writing data and creating/editing models
- 69. Does not integrate with Analysis Services tools even though many of its features and concepts mirror those of dimension designer
- 70. Catalog kept in SQL Server database
- 71. Deployment packages can be created, shared and deployedObjects in MDSModelsEntities (like tables or SSAS dimensions)Attributes (like columns/fields or SSAS attributes)Common attributes are Name and CodeAttribute GroupsUsed to taxonomize attributes within tabs in UI Members (like rows/records or SSAS members)Hierarchies (like SSAS hierarchies)Derived or ExplicitCollections (like SSAS named sets)VersionsBusiness rulesWorkflows
- 72. Data Quality ServicesData Cleansing ToolNew to DenaliResult of Zoomix AcquisitionUses Artificial Intelligence algorithms detect invalid data and perform matching (for de-duplication)Allows manual intervention, tooCan integrate with MDS and SSISCleaner data = better adoption of your BI project
- 73. DQS ConceptsKnowledge BasesDomains“semantic representation[s] of a type of data in a data field…[contain] a list of trusted values, invalid values, and erroneous data.”MappingData Quality ProjectsCleansing (i.e. correcting)Validate Using Reference Data Services and Use Azure DataMarket (or 3rd party providers)Matching (i.e. de-duping)ConfidenceProfiling, Monitoring
- 74. Questions?Now?Later?Andrew.Brust@BlueBadgeInsights.com@andrewbrust on Twitterwww.brustblog.comWant to get the weekly Redmond Roundup Plus dispatch? Just text the word “bluebadge” to 22828