Introducing microsoft bi tools
1 like859 views
This article discusses Microsoft business intelligence tools for different types of reporting and analysis workloads, including self-service BI, corporate BI, and advanced analytics. It describes tools like Excel, Power BI, SQL Server Analysis Services, and others, explaining their uses and typical architectures. Key considerations for each workload are also outlined.
Introducing microsoft bi tools
- 1. Introducing Microsoft BI Reporting and Analysis Tools Summary: This article assists you with choosing the reporting and analysis tools that meet your organization’s BI needs. Microsoft provides a variety of BI tools that can address key workloads, such as Power BI and Excel. The article discusses the workloads and the tools that best support each workload. To view a mapping of Microsoft BI tools to data analysis and reporting workloads, see Choosing Microsoft Business Intelligence (BI) Tools for Analysis and Reporting (http://msdn.microsoft.com/en- us/library/d0e16108-7123-4788-87b3-05db962dbc94). Writer: Carla Sabotta Technical Reviewer: Mike Plumley, Maggie Sparkman, Parikshit Savjani, Jeff Stokes, Jeannine Nelson-Takaki Published: May, 2015 Applies to: SQL Server 2014, SharePoint 2013, Excel 2013, Office 365, Microsoft Azure
- 2. 2 Copyright This document is provided “as-is”. Information and views expressed in this document, including URL and other Internet Web site references, may change without notice. You bear the risk of using it. Some examples depicted herein are provided for illustration only and are fictitious. No real association or connection is intended or should be inferred. This document does not provide you with any legal rights to any intellectual property in any Microsoft product. You may copy and use this document for your internal, reference purposes. © 2015 Microsoft. All rights reserved.
- 3. 3 Contents Introducing Microsoft BI Reporting and Analysis Tools................................................................................1 Introduction ..................................................................................................................................................4 Self-Service BI................................................................................................................................................5 Tool Options..............................................................................................................................................5 Microsoft Excel......................................................................................................................................6 Power Pivot for Excel ............................................................................................................................6 Power Query for Excel ..........................................................................................................................7 Power View for Excel ..........................................................................................................................10 Power Map for Excel...........................................................................................................................13 SharePoint 2013 Sites .........................................................................................................................15 Power BI for Office 365.......................................................................................................................15 Power BI Designer Preview.................................................................................................................18 Power BI Preview................................................................................................................................19 Data Mining Client for Excel................................................................................................................20 Typical Infrastructure..............................................................................................................................21 Key Considerations .................................................................................................................................21 Corporate BI................................................................................................................................................22 Tool Options............................................................................................................................................22 Microsoft SQL Server 2014 Analysis Services .....................................................................................23 Microsoft SQL Server 2014 Reporting Services...................................................................................23 Power View for SharePoint 2013........................................................................................................26 SharePoint 2013 Dashboards..............................................................................................................27 PerformancePoint Services.................................................................................................................28 Typical Infrastructure..............................................................................................................................29 Key Considerations .................................................................................................................................29 BI and Microsoft Azure Technologies .........................................................................................................31 Azure Machine Learning .........................................................................................................................31 Azure Stream Analytics...........................................................................................................................33 Advanced Analytics.....................................................................................................................................35 Tool Options............................................................................................................................................35 Data Mining Client for Excel (2010, 2013) ..........................................................................................35
- 4. 4 Data Mining in Analysis Services.........................................................................................................35 Conclusion...................................................................................................................................................36 Introduction The intent of this article is to assist you with choosing the business intelligence (BI) tools that meet your organization’s BI needs. Microsoft provides a variety of BI tools that can address key workloads. The article discusses the workloads and the tools that best support each workload. To view a mapping of Microsoft BI tools to data analysis and reporting workloads, see Choosing Microsoft Business Intelligence (BI) Tools for Analysis and Reporting (http://msdn.microsoft.com/en- us/library/d0e16108-7123-4788-87b3-05db962dbc94). The following are the workloads. Self-Service BI – Involves free-form reporting and analysis that enables you to integrate data from disparate sources and drill-down and understand the root cause for data anomalies. You can perform your own reporting and analysis without relying on IT or others. Corporate BI – Involves formatted reports that are typically based upon approved corporate data, and then shared more broadly with managers, teams, or departments. IT oversees the distribution and monitoring of the reporting environment and building of the structured data layer upon which the reports are built. Reports are authored and managed by IT and usually follow a pixel perfect format and rendering style One type of report is dashboard reports. Dashboard reports allow you to monitor the performance and health of your business, often permitting further investigation via interactivity. Another type of report is scorecards. Scorecards are highly summarized views with Key Performance Indicators (or KPIs) measured and scored against predefined targets such as a balanced scorecard. These reports are generally a part of a performance management program, though they can also be used to measure operational performance. Advanced Analytics – Involves tools and techniques that are used to forecast future outcomes and behaviors. Data mining and predictive analytics are some of the analytical categories that are part of advanced analytics. Data mining uses mathematical analysis to derive patterns and trends that exist in data. Typically, these patterns cannot be discovered by traditional data exploration because the relationships are too complex or because there is too much data. These patterns and trends can be collected and defined as a data mining model. The following are the tools.
- 5. 5 Microsoft Excel o Power Pivot o Power Query o Power View o Power Map o Data Mining Client for Excel SharePoint 2013 Sites o Power View for SharePoint 2013 o SharePoint 2013 Dashboards o PerformancePoint Services in SharePoint 2013 Power BI for Office 365 o Power BI Sites o Data Catalog o Admin Center o Q & A o Power View in HTML5 Power BI Designer Power BI Preview Power BI for Windows app iPad app for Power BI SQL Server Analysis Services o Data Mining in Analysis Services SQL Server Reporting Services Self-Service BI Self-service BI involves data analysis and reporting without reliance on IT. The following are some key characteristics: Users are familiar with the business data and have strong Excel skills, and have minimal specialized technical skills such as SQL, MDX, or other query languages. Users want to easily drill down, pivot, filter, and format the data. Frequently information is integrated from a variety of sources, and data sources can include corporate sanctioned and IT managed data sources. Frequently small-to-medium sized data sets are used. Distributing the information on a regular basis is not typically the primary purpose, although the analysis might be shared with others. Tool Options The following tools support self-service BI. Microsoft Excel o Power Pivot
- 6. 6 o Power Query o Power View o Power Map o Data Mining add-Ins for Excel SharePoint 2013 Sites Power BI for Office 365 o Power BI Sites o Data Catalog o Admin Center o Q & A o Power View in HTML5 Power BI Designer Power BI Preview Power BI for Windows app iPad app for Power BI Microsoft Excel Microsoft Excel enables you to collect and analyze data, and to develop reports. Excel Services enables you to render a workbook in a browser window and refresh the associated data connection. Others have access to the workbook or specific parts of it without being able to modify the workbook or calculations, thereby ensuring a single version of the workbook is maintained and viewed by everyone. With an Excel Services workbook you can also perform live, interactive analysis through any supported browser, including sorting and filtering of data, as well as expanding or collapsing of PivotTables. For more information, see What’s New in Excel 2013 (http://office.microsoft.com/en-us/excel- help/what-s-new-in-excel-2013-HA102809308.aspx ) and Excel 2013 Quick Start Guide (http://office.microsoft.com/en-us/support/excel-2013-quick-start-guide-HA103673690.aspx). Power Pivot for Excel Power Pivot for Excel 2013 builds on top of Excel functionality and adds additional features that support self-service BI. With Power Pivot, you can collect, interact with, and manipulate data from a broader range of sources, as well as work with data sets far larger than the Excel 2013 limit of 1 million rows per sheet. Power Pivot can scale to millions and even hundreds of millions of rows. With Power Pivot you can filter data and rename columns and tables while importing the data, and create perspectives to limit the number of columns and tables that your workbook consumers see. You can write advanced formulas with the Data Analysis Expressions (DAX) expression language. You can create key performance indicators (KPIs), PivotTables and PivotCharts. You can create a relationship between two tables of data, based on matching data in each table, even when the tables are from different sources. The following Diagram view in Power Pivot shows relationships between several tables.
- 7. 7 You can also use Power Pivot to prototype the solution quickly before involving IT in building more traditional BI infrastructure like a formal SQL Server Analysis Services cube. For more information, see the following articles. What’s new in Power Pivot in Microsoft Excel 2013 (http://office.microsoft.com/en-us/excel- help/whats-new-in-power-pivot-in-microsoft-excel-2013-HA102893837.aspx ) Power Pivot: Powerful data analysis and data modeling in Excel (http://office.microsoft.com/en- us/excel-help/powerpivot-powerful-data-analysis-and-data-modeling-in-excel- HA102837110.aspx) Data Model specification and limits (Excel workbooks) (http://office.microsoft.com/en-us/excel- help/data-model-specification-and-limits-HA102837464.aspx) Power Pivot Data Refresh with SharePoint 2013 (http://technet.microsoft.com/en-us/library/jj879294(v=sql.120).aspx) Power Pivot Data Refresh with SharePoint 2010 (http://technet.microsoft.com/en-us/library/ee210595(v=sql.120).aspx) Create Your First PowerPivot Workbook (Tutorial) (https://technet.microsoft.com/en- us/library/ee835510.aspx) Power Query for Excel Microsoft Power Query for Excel 2013 enables you to discover, combine, and refine data across a wide variety of sources including relational, structured and semi-structured data, OData, Web, Hadoop, Azure Marketplace, and more. Power Query also provides you with the ability to search for public data from sources such as Wikipedia.
- 8. 8 With Power Query you can do the following. Merge and shape data sources to match your data analysis requirements or prepare it for further analysis and modeling by using tools such as Power Pivot and Power View. Create custom views over data. Use the JSON parser to create data visualizations over Big Data and Azure HDInsight. Perform data cleansing operations. Import data from multiple log files. Perform Online Search for data from a large collection of public data sources including Wikipedia tables, a subset of Windows Azure Marketplace, and a subset of Data.gov. Create a query from your Facebook likes that render an Excel chart. Pull data into Power Pivot from new data sources, such as XML, Facebook, and File Folders as refreshable connections. You can share and manage queries as well as search data within your organization. The following images show examples of merging and shaping data. Transform Date Column to Display Year
- 9. 9 Combine Columns from a Related Table (Order_Details) into another table (Orders)
- 10. 10 1) Merge Multiple Queries (Total Sales & Products). 2) Combine Columns from Total Sales into Products For more information, see Introduction to Microsoft Power Query for Excel (http://office.microsoft.com/en-us/excel-help/introduction-to-microsoft-power-query-for-excel- HA104003940.aspx), and Tutorial: Combine data from multiple data sources (Power Query) (https://support.office.com/en-us/article/Combine-data-from-multiple-data-sources-Power-Query- 70cfe661-5a2a-4d9d-a4fe-586cc7878c7d?ui=en-US&rs=en-US&ad=US). Power View for Excel Power View is an interactive data exploration, visualization, and presentation experience. Power View enables the following options for interacting with data. In the same Excel workbook as the Power View sheet. In data models in Excel workbooks published in a Power Pivot Gallery. In tabular models deployed to SQL Server Analysis Services (SSAS) instances. The following images show some of the different types of data visualizations that you can add to a Power View report. The data shown in each visualization is USA 2011 Car Crash Data. The data source is the Fatality Analysis Reporting System (FARS) Encyclopedia.
- 11. 11 Figure -- Power View Bar Chart Figure -- Power View Map
- 12. 12 Figure -- Power View Tiles Figure -- Power View Card with Filters You can view Power View in Excel sheets in your browser without installing Silverlight. For more information about supported features, see HTML5 version of Power View (http://office.microsoft.com/en-us/office365-sharepoint-online-enterprise-help/power-view-in-html5- HA104102908.aspx?CTT=5&origin=HA102835634).
- 13. 13 Power View is a feature of Microsoft Excel 2013 as well as part of the Microsoft SQL Server 2014 Reporting Services add-in for Microsoft SharePoint Server 2010 and 2013 Enterprise Editions. Power View reports in SharePoint Server are RDLX files. Power View sheets in Excel are part of the Excel XLSX workbook. You can’t open a Power View RDLX file in Excel, or open an Excel XLSX file with Power View sheets in Power View in SharePoint. You also can’t copy charts or other visualizations from the RDLX file into the Excel workbook. You can save Excel XLSX files with Power View sheets to SharePoint Server, either on premises or in Office 365, and open those files in SharePoint 2013. Read more about Power View in Excel in SharePoint Server 2013 or in SharePoint Online in Office 365. Both Power View in SharePoint Server and Power View in Excel need Silverlight installed on the machine. For information about what’s new in Power View in Excel 2013, see What’s new in Power View in Excel 2013 and in SharePoint Server (http://office.microsoft.com/en-us/excel-help/whats-new-in-power-view- in-excel-2013-and-in-sharepoint-server-HA102901475.aspx). For additional information about Power View for Excel, see the following articles. Create a Power View sheet in Excel 2013 (http://office.microsoft.com/en-us/excel-help/create- a-power-view-sheet-in-excel-2013-HA102899553.aspx?CTT=5&origin=HA102835634) Relationships in Power View (http://office.microsoft.com/en-us/excel-help/relationships-in- power-view-HA104048146.aspx?CTT=5&origin=HA102835634) Refresh the data or data model for a Power View sheet (http://office.microsoft.com/en- us/excel-help/refresh-the-data-or-data-model-for-a-power-view-sheet- HA103289400.aspx?CTT=5&origin=HA102835634) Power View in Excel on Office 365 or in SharePoint Server (http://office.microsoft.com/en- us/excel-help/power-view-in-excel-on-office-365-or-in-sharepoint-server- HA103276078.aspx?CTT=5&origin=HA102835634) Power View: Explore, visualize, and present your data (http://office.microsoft.com/en-us/excel- help/power-view-explore-visualize-and-present-your-data-HA102835634.aspx) Power View: Videos, Tutorial, and Documentation (http://www.microsoft.com/en- us/bi/Products/PowerView.aspx) Data Model specification and limits (Excel workbooks) (http://office.microsoft.com/en-us/excel- help/data-model-specification-and-limits-HA102837464.aspx) Power Map for Excel Power Map for Excel 2013 is a 3D data visualization tool for Excel. Power Map lets you plot geographic and temporal data visually, analyze that data in 3D, and create cinematic tours to share with others.
- 14. 14 The following is an image of a Power Map. The data shown is energy output capacity for U.S. counties, zoomed in to show this data in more detail for certain states such as California and Arizona. The data source is U.S. Energy Information Administration (EIA). Power Map includes the following features. Plot more than a million rows of data in 3D visually on Bing maps and visualize the data with 3D columns, bubble/pie charts, heat maps, and regions. Online connectivity is required and performance experience depends on hardware/software configuration. Discover new insights by seeing your data in geographic space and seeing time-stamped data change over time. Capture screenshot scenes and build cinematic, guided interactive or video tours that can be shared broadly, engaging audiences like never before. Power Map for Excel is available with any Office 365 subscription that comes with Office desktop apps. For more information, see Power Map for Excel (http://www.microsoft.com/en-us/powerBI/power- map.aspx#Getstart). You can also download the Power Map Preview for Excel 2013 at http://www.microsoft.com/en- us/download/details.aspx?id=38395 . For more information about Power Map, see Get Started with Power Map (https://support.office.com/en-us/article/Get-started-with-Power-Map-88a28df6-8258-40aa-b5cc- 577873fb0f4a?CorrelationId=40d32515-9816-44be-9c39-b4d1102071ef&ui=en-US&rs=en-US&ad=US).
- 15. 15 SharePoint 2013 Sites Organizations use SharePoint 2013 to create websites. You can use it as a secure place to store, organize, share, and access information from almost any device. You can also use SharePoint to work with others, organize your projects and teams, and discover people and information. The following some of the types of sites that you can create. BI Center Sites: A basic SharePoint 2013 site that contains a set of prebuilt lists and libraries to organize BI content. For more information, see Create, share, and consume BI content in a BI Center site (http://office.microsoft.com/en-us/office365-sharepoint-online-enterprise- help/create-share-and-consume-bi-content-in-a-bi-center-site-HA104046017.aspx), and Set up a Business Intelligence Center site (http://office.microsoft.com/en-us/sharepoint-server-help/set- up-a-business-intelligence-center-site-HA104046016.aspx). Document Center Sites: Sites that are for large-scale document management. SharePoint includes the Document Center site template. Key features such as document versions, document IDs, document sets, metadata navigation, and content types are built in to the template for you. For more information, see Use a Document Center site (http://office.microsoft.com/en-us/sharepoint-server-help/use-a-document-center-site- HA102773263.aspx). For more information, see the following articles. Best practices for creating and managing team sites (http://office.microsoft.com/en- us/office365-sharepoint-online-enterprise-help/best-practices-for-creating-and-managing-team- sites-HA102779556.aspx) Build sites for SharePoint 2013 (http://msdn.microsoft.com/en-us/library/office/jj163242.aspx) Find content about SharePoint Server 2013 (http://office.microsoft.com/en-us/sharepoint- help/find-content-about-sharepoint-server-2013-HA103047055.aspx ) Power BI for Office 365 Power BI for Office 365 includes the following features and services. Q & A: Use natural language queries to find, explore, and report over your data.
- 16. 16 Figure – Results Returned by Power BI Q & A Sites: Share, view and interact with reports in collaborative Power BI sites. For more information, see Power BI sites on Power BI for Office 365 (http://office.microsoft.com/en- us/office365-sharepoint-online-enterprise-help/power-bi-sites-on-power-bi-for-office-365- HA104097290.aspx). Power BI for Windows app: The Microsoft Power BI Windows Store app provides live on-the-go access to the important business information stored in your Office 365 account. Upload your Excel workbooks to O365 SharePoint Online, and then connect to the cloud with the Power BI app to discover, explore, and share the business intelligence in your workbooks. Browse to reports on your own SharePoint Online sites and add a report to Favorites. On the home page, you see thumbnail images of your report favorites. To refresh the data in a report, tap or click the Sync icon.
- 17. 17 Power BI for Windows App For more information, see Power BI for Windows app (https://support.office.com/en- us/article/Power-BI-for-Windows-app-6e4145b4-e882-4134-a89c-66e54cc5c8eb?ui=en- US&rs=en-US&ad=US). iPad app for Microsoft Power BI: The iPad app for Microsoft Power BI preview brings the mobile BI experience to Power BI. It provides live, touch-enabled mobile access to your important business information, so you can easily view and interact with your company dashboards and reports. You can add annotations to a dashboard tile and then share a snapshot of the tile with others. For more information, see Get started with the iPad app (Power BI for iOS preview) (http://support.powerbi.com/knowledgebase/articles/467172-get-started-with-the-ipad-app- power-bi-for-ios-pr). iPhone app for Microsoft Power BI: The iPhone app brings Power BI to your pocket, with live, touch-enabled mobile access to your business information. View and interact with your company dashboards from anywhere. You can also set alerts to notify you when data in your dashboards changes beyond limits that you’ve set. You can add annotations to a dashboard tile and then share a snapshot of the tile with others.
- 18. 18 For more information, see Get started with the iPhone app (Power BI for iOS preview) (http://support.powerbi.com/knowledgebase/articles/527036-get-started-with-the-iphone- app-power-bi-for-ios). Admin Center: Register on-premise data sources with the portal, enable OData feed for the data sources and select tables/views to be included in the feed, and/or allow Excel workbooks stored in SharePoint Online to be refreshed with data from on-premises data sources. For more information, see Power BI for Office 365 Admin Center Help (http://office.microsoft.com/en- us/office365-sharepoint-online-enterprise-help/power-bi-for-office-365-admin-center-help- HA104078330.aspx). Data Catalog: Store, view, and manage data sets. Metadata and data are indexed in the Data Catalog. For more information, see Manage Data Source Information using the Manage Data Portal (http://office.microsoft.com/en-us/office365-sharepoint-online-enterprise-help/manage- data-source-information-using-the-manage-data-portal-HA104079190.aspx). Power View in HTML 5: Access your data through the browser in HTML5. As Power View moves to HTML5, you can view it on more devices, operating systems, and browsers. For more information, see Power View in HTML5 Preview (http://office.microsoft.com/en-001/office365- sharepoint-online-enterprise-help/power-view-in-html5-preview- HA104102908.aspx?CTT=5&origin=HA104168262). For more information about Power BI for Office 365, see Power BI Support (http://www.microsoft.com/en-us/powerBI/support/default.aspx#fbid=n_i1a9wne9q). Power BI Designer Preview The Power BI Designer Preview is a standalone Windows Desktop application that is a companion application for Power BI. The application combines Power Query, Power Pivot Data Model and Power View to enable you to build Power BI reports offline. You can then upload the reports to the Power BI Preview to share the reports with other users.
- 19. 19 You use the Get Data command on the ribbon to connect to a variety of data sources such as Excel, SQL Server, an OData Feed, or SharePoint list. There are many more data sources to choose from. For more information, see Getting Started with Power BI Designer (http://support.powerbi.com/knowledgebase/articles/471664-getting-started-with-power-bi-designer) Power BI Preview With the Power BI Preview you can bring together in one place dashboards that help you track the pulse of your business or organization, drill down to report details, and connect multiple datasets from a variety of data sources. You can share your dashboards with people in your organization.
- 20. 20 Power BI Preview Dashboard For more information, see Get started with Power BI Preview (http://support.powerbi.com/knowledgebase/articles/430814-get-started-with-power-bi-preview). For advice on creating dashboards, see Tips for designing a great dashboard (http://support.powerbi.com/knowledgebase/articles/433616-tips-for-designing-a-great-dashboard). Data Mining Client for Excel The Data Mining Client for Excel is a set of tools that let you perform common data mining tasks, from data cleansing to model building and prediction queries. You can use data in Excel tables or ranges, or access external data sources. Figure – Data Mining Ribbon in Excel The Data Mining Client includes the following features. Load your data into Excel, cleanse the data, check for outliers, and create statistical summaries. You can also perform different kinds of sampling, profile the data, and test models using external data. The Data Mining Client is the easiest way to prepare data for analysis without complex scripts or ETL processes. Use wizard interfaces to access well-known, empirically tested data mining algorithms, including clustering (K-means and EM), association analysis, time series analysis, and decision trees. Advanced modeling options for each wizard let you choose different algorithms, such as the
- 21. 21 Naïve Bayes or neural networks, and customize behavior such as the cluster seed or initial sampling size. All data mining algorithms are hosted in an instance of Analysis Services, giving you more power to build complex models. Use industry-standard tools for testing models, including lift charts and cross-validation. The wizards provided enable you to test the validity of the data set and its accuracy. The query wizard builds queries to use the models for prediction and scoring. Charts generated by most tools can be saved directly to Excel. Use the Browsing Models in Excel (SQL Server Data Mining Add-ins) tool to explore the models. Save your data mining model to the server, to use in further testing, or to deploy to a production server for greater scalability. The Data Mining Client for Excel maintains an active connection to the server. For more information, see Data Mining Client for Excel (SQL Server Data Mining Add-ins) (http://msdn.microsoft.com/en-us/library/dn282385(v=sql.120).aspx). For help with installation, see this page on the Download Center: http://www.microsoft.com/en- us/download/details.aspx?id=35578 . Typical Infrastructure Infrastructure requirements for self-service BI are minimal, and you can generally develop and share reports and information with little to no IT support, although IT infrastructure is a helpful mechanism for report distribution and collaboration. Implementations of SharePoint Server with Excel Services or Power Pivot for SharePoint enabled, allow more efficient management and distribution of the self- service analysis solutions. Key Considerations The following table briefly explains the data capabilities of tools that support self-service BI. Tool Volume of data analyzed Data refresh Excel Ideal for small to medium data sets (100s - approximately 1MM records) Refreshing data is manual or requires macros Power Pivot for Excel Can handle large amounts of data (100’s of millions of records) Refreshing data is automatic if published to SharePoint 2013 Server. Power Query for Excel Data is pulled into Power Pivot from data sources, such as XML, Facebook, and File Folders as refreshable connections. Power View for Excel Retrieves only the data it needs at any given time for a data visualization, to enhance performance. Thus, even if a table in You can choose to refresh the data for a Power View sheet or view. You have no choice about refreshing the data model; if it changes, you get a
- 22. 22 the sheet or view is based on an underlying data model that contains millions of rows, Power View fetches data only for the rows that are visible in the table at any one time. message that Power View needs to refresh the sheet or view. Power Map for Excel Plots more than a million rows of data in 3D visually on Bing maps. Power BI sites Supports larger workbook viewing (up to 250MB). Power BI Admin Center IT administrators can allow Excel workbooks stored in SharePoint Online to be refreshed with data from on-premises data sources. Power BI Preview Supports scheduled and manual refresh for a select number of data sources. Power BI for Windows App You can refresh data manually, and every time you open a report in the Power BI app, the data is refreshed automatically. Refreshing updates the data in the report on the Power BI app, but not the data in the Excel workbook. Corporate BI Corporate BI involves creating highly formatted and distributable reports. Examples of these reports include sales order detail reports, inventory-on-hand reports, or sales attainment reports. Some key characteristics are: Data used to create reports comes from corporate sanctioned and IT managed data sources. Reports are highly formatted and frequently printed. Reports may be complex and require special technical skills such as advanced SQL, MDX, or other query languages to build. Reports are often created with one or more user selectable parameters, but are not capable of extensive interactivity. Reports are usually authored by IT or BI developers, often because the complexity of the reports exceeds the capabilities of the user base for self-service reporting. The reports are refreshed on a regular basis and available on-demand. Reports may be delivered in multiple formats such as PDF, Excel, HTML, and so on. Reports may be shared broadly across the organization. Tool Options The following tools support corporate BI.
- 23. 23 SQL Server Analysis Services SQL Server Reporting Services Power View for SharePoint 2013 SharePoint 2013 Dashboards PerformancePoint Services Microsoft SQL Server 2014 Analysis Services The basis of any Analysis Services solution is a business intelligence semantic data model and a server instance that instantiates, processes, queries, and manages objects in that model. Models are built on historical data that you are already collecting in transactional databases and other data stores, and then annotated with metadata that lets you measure, manipulate, and compare business data in ad hoc queries or custom reports. After a model is designed, it is deployed to an Analysis Services server as a database, where it becomes available to authorized users who connect to it through Excel and other tools. The SQL Server 2014 release of Analysis Services adds a new tabular modeling approach that is easier to understand if you are a business analyst who is accustomed to working with relational data. Tabular modeling is different because you build a business intelligence semantic model using tables and relationships rather than cubes and dimensions. For more information, see Analysis Services (http://msdn.microsoft.com/en- us/library/bb522607(v=sql.120).aspx). Microsoft SQL Server 2014 Reporting Services Microsoft SQL Server Reporting Services enables IT to create and manage both static and parameterized reports and provides a platform for delivering information throughout the organization.
- 24. 24 Advanced Data Visualization When the report is accessed via a portal, you can interact and perform analysis through the use of parameters and filters embedded in the reports. With the use of parameters, drill-down, and drill- through capabilities, you are able to perform more guided reporting and analysis. Additionally, reports can be linked together to allow for more in-depth analysis via drill-through capabilities. The report distribution components of Reporting Services allow reports to be scheduled and distributed using different delivery mechanisms and in different generation formats. The reports may be delivered
- 25. 25 via portal, file share, email, or sent directly to a printer, and may be generated as PDF, Excel, XML, comma delimited text file, TIFF image, HTML or Microsoft Word formats. You can create Reporting Services reports using Report Builder 3.0 and SQL Server Data Tools – Business Intelligence (SSDT BI). Report Builder Report Builder 3.0 provides a full-featured reporting environment that allows you to develop highly formatted reports using an Excel-like ribbon. Report Builder provides formatting and pagination features, and advanced visualization options such as geospatial mapping, sparklines, and gauges. Although you don’t necessarily need to know how to write SQL queries to author reports with Report Builder, it does typically require a more sophisticated skill set then Excel or PowerPivot does. Figure – Report Builder 3.0 The reports can be fully managed by IT, as well as scheduled for automatic refresh and distribution using the SSRS report distribution mechanisms using Report Manager or enhanced through the integration with SharePoint Server 2013. SSDT BI SSDT BI is a Microsoft Visual Studio environment with enhancements that are specific to business intelligence solutions.
- 26. 26 NOTE: The previous generations of this toolset was known as SQL Server Business Intelligence Development Studio (BIDS). SQL Server 2012 includes SSDT that includes the BIDS functionality for BI. SQL Server 2014 does not include SSDT; instead, SSDT BI is a separate download: Microsoft SQL Server 2014 Data Tools - Business Intelligence for Visual Studio 2013 (http://www.microsoft.com/en-us/download/details.aspx?id=42313). For more information, see SQl Server Data Tools and SQL Server Business Intelligence (SSDT-BI) (http://curah.microsoft.com/30004/sql-server-data-tools-ssdt-and-sql-server-business- intelligence). You can use SSDT BI to create and manage solutions and projects for Reporting Services reports and report-related items. It provides the Report Designer authoring environment. In Report Designer, you can open, modify, preview, save, and deploy report definitions, shared data sources, shared datasets, and report parts. When you install Reporting Services, the following project templates are made available in SSDT BI: Report Server Project. A Report Server Project is a Business Intelligence Projects template installed by Visual Studio. Report Server project properties apply to all reports and all shared data sources in the project. These properties include the URL for the report server and the folder names for reports and shared data sources. Report Server Project Wizard. In the wizard, you can create a report by creating a connection string to a data source, setting data source credentials, designing a query, adding a table or matrix data region, specifying report data and groups, picking a font and color style, publishing the report to a report server, and previewing the report locally. After you create a report with the wizard, you can change the report data and the report designer by using Report Designer in the Report Server project. For more information, see Reporting Services in SQL Server Data Tools (SSDT) (http://technet.microsoft.com/en-us/library/ms173745(v=sql.120).aspx) and Reporting Services (SSRS) (http://msdn.microsoft.com/en-us/library/ms159106(v=sql.120).aspx). Power View for SharePoint 2013 Power View is a browser-based application launched from SharePoint Server 2013 that enables you to present and share insights with others in their organization through interactive presentations. You can create a single report with multiple views. All the views in one report are based on the same Data Model. You can copy and paste from one view to another, and duplicate whole views. If you save preview images of the views, an image of each view is displayed in the Power Pivot Gallery in SharePoint Server 2013. Creating, opening, and saving Power View reports (RDLX files) all take place in SharePoint Server. Power View is part of the Microsoft SQL Server 2014 Reporting Services add-in for Microsoft SharePoint Server 2010 and 2013 Enterprise Editions, as well as a feature of Microsoft Excel 2013.
- 27. 27 Power View reports in SharePoint Server are RDLX files. Power View sheets in Excel are part of the Excel XLSX workbook. You can’t open a Power View RDLX file in Excel, or open an Excel XLSX file with Power View sheets in Power View in SharePoint. You also can’t copy charts or other visualizations from the RDLX file into the Excel workbook. You can save Excel XLSX files with Power View sheets to SharePoint Server, either on premises or in Office 365, and open those files in SharePoint. Read more about Power View in Excel in SharePoint Server 2013 or in SharePoint Online in Office 365. Both Power View in SharePoint Server and Power View in Excel need Silverlight installed on the machine. For information about what’s new in Power View in SharePoint Server, see What’s new in Power View in Excel 2013 and in SharePoint Server (http://office.microsoft.com/en-us/excel-help/whats-new-in- power-view-in-excel-2013-and-in-sharepoint-server- HA102901475.aspx?CTT=5&origin=HA102835634#_Toc358038111). For additional information about Power View in SharePoint 2013, see the following articles. System requirements for Power View in SharePoint (http://office.microsoft.com/en-us/excel- help/system-requirements-for-power-view-HA102835724.aspx) Create, save, and print Power View in SharePoint reports (http://office.microsoft.com/en- us/excel-help/power-view-in-sharepoint-server-create-save-and-print-reports- HA102834736.aspx) Keyboard shortcuts and accessibility in Power View in SharePoint (http://office.microsoft.com/en-us/excel-help/keyboard-shortcuts-and-accessibility-in-power- view-in-excel-HA102834863.aspx) Reports with multiple views in Power View in SharePoint (http://office.microsoft.com/en- us/excel-help/reports-with-multiple-views-in-power-view-in-sharepoint-HA102835711.aspx) Understanding Multidimensional Model Objects in Power View (SharePoint) (http://office.microsoft.com/en-us/excel-help/understanding-multidimensional-model-objects- in-power-view-HA104018589.aspx) Power View: Explore, visualize, and present your data (http://office.microsoft.com/en-us/excel- help/power-view-explore-visualize-and-present-your-data-HA102835634.aspx) SharePoint 2013 Dashboards A SharePoint dashboard is a related group of interactive scorecard and report views that are organized together in a SharePoint or Web-hosted site. SharePoint Server 2013 enables you to create and use dashboards that provide up-to-date information in a centrally managed, easily accessed location. You can use SharePoint Server tools to create and use dashboards that are suitable for an individual, team, group, or the entire organization.
- 28. 28 A dashboard report helps business decision makers understand the current health of their business. A dashboard often combines key performance indicators from various business functions on a single page to help provide an at-a-glance view of performance and the ability to drill down further when something is off track or performing extremely well. The following are key characteristics of performance monitoring dashboards. Provides an at-a-glance view of business performance. Provides a more holistic view of the business or business function by combining multiple types of content together. Data in multiple formats are combined on one page. Some examples might include a tabular report with spark-lines, along with trended graphs or bar charts, and geospatial maps or scorecards. Enables drill down to perform root cause analysis for data anomalies. A corporate data platform is in place and includes an OLAP component, all being refreshed regularly. Often deployed broadly across the organization and various levels in the organization. If you want to create a simple dashboard for an individual or a small group, you might want to create a Web Part page and add status indicators and a Chart Web Part to it. For more information, see the following articles. Create SharePoint site pages (http://office.microsoft.com/en-us/sharepoint-designer- help/create-sharepoint-site-pages-HA101782505.aspx) Create a chart by using the Chart Web Part (http://office.microsoft.com/en-us/sharepoint- server-help/create-a-chart-by-using-the-chart-web-part-HA101889211.aspx) Getting started with SharePoint status indicators (http://office.microsoft.com/en-us/sharepoint- server-help/getting-started-with-sharepoint-status-indicators-HA010380634.aspx) PerformancePoint Services The PerformancePoint Services component of Microsoft SharePoint Server 2013 is a performance management service that is used to create dashboards and scorecards. PerformancePoint Services provides the ability to pull multiple view types into a single dashboard. In a PerformancePoint Services dashboard, you can interact with SSRS reports, cube-based graphs, performance maps, decomposition trees and Visio diagrams. Other content types can even be integrated by displaying any web page desired within a frame of the dashboard. Dashboard filters can be applied across the dashboard components, allowing you to update multiple or all parts of a dashboard simultaneously. With cube-based graphs and charts, you can perform ad-hoc analysis, slice and dice dimensional data, navigate through hierarchies, and pivot and change chart types. Dashboards can incorporate data from a variety of sources, providing the capability to develop and manage the presentation of reports through one tool.
- 29. 29 PerformancePoint Services provides a platform for designing and building both balanced and free-form scorecards. The balanced scorecards focus the organization on finding a balanced set of metrics across multiple perspectives – balancing the typical lagging financial indicators with a broader set of leading indicators that better predict future performance. Balanced and Free-form scorecards along with Strategy Maps allow organizations to provide a concise vehicle for communicating overall company performance against well-defined targets. A major benefit of scorecards is the ability to aggregate and display non-like data into unified and summarized scores. PerformancePoint Services allows companies to set up hierarchical KPIs with relative weightings that align with perspectives and objectives. Targets can be defined at each intersection and ranges can be set for defining Red/Yellow/Green status thresholds for each KPI. Scorecards can also be pivoted and filtered by a number of dimensions, allowing you to perform root cause analysis on KPIs that are not meeting the targets. Scorecards are often displayed as a component within in a Dashboard and interact with other reports in the dashboard. Because PerformancePoint Services is a part of SharePoint Server 2013, the Scorecards are easily shared and distributed For more information, see the following articles. PerformancePoint Services in SharePoint Server 2013 overview (http://technet.microsoft.com/en-us/library/ee424392.aspx) Overview of PerformancePoint KPI Details reports (http://technet.microsoft.com/en- us/library/gg482033.aspx) Overview of PerformancePoint scorecards (http://technet.microsoft.com/en- us/library/gg410938.aspx) Typical Infrastructure For corporate BI, a data warehouse, data mart and/or online-analytical-processing (OLAP) environment is often in place and used as the data source. The existence of OLAP cubes forms the foundation of BI analysis in these environments. Data is typically refreshed regularly on schedule to provide the most current information possible. For these reasons, an IT department is needed to support the infrastructure for BI. The IT department is in charge of creating and managing the corporate data sources. The IT department should be experienced dealing with BI structures and reporting technologies, and will be heavily involved in report development and management including having a firm understanding of how to use the reporting tools and query languages such as SQL and MDX. Key Considerations The following table briefly explains the data capabilities of tools that support corporate BI. Tool Supported data sources Report distribution Geospatial reporting Visualizations
- 30. 30 SQL Server Reporting Services Built-in data extensions include the following data connection types: Microsoft SQL Server Microsoft SQL Server Analysis Services Microsoft SharePoint List Windows Azure SQL Database Microsoft SQL Server Parallel Data Warehouse OLE DB Oracle SAP NetWeaver BI Hyperion Essbase Teradata XML ODBC Reports reside in SSRS and can take advantage of robust report distribution, including data-driven distributions. Build geospatial reports with Report Builder 3.0 Provides ability to include SSRS Geospatial visualizations, charts and gauges. Power View for SharePoint 2013 In Excel 2013, use data in Excel as the basis for Power View in SharePoint. You can also create Power View reports based on a tabular model running on a SQL Server 2014 Analysis Services (SSAS) server, and on a multidimensional model on an SSAS server. Maps in Power View display your data in the context of geography. Quickly create a variety of visualizations, from tables and matrices to pie, bar, and bubble charts and sets of multiple charts. PerformancePoint Services in Supports Power Pivot models, Analysis Combine data from various sources including
- 31. 31 SharePoint Server 2013 Services data cubes, SharePoint lists, Excel files published to Excel Services, Excel workbooks, and Microsoft SQL Server tables, as data sources. the following: Visio Services Decomposition Trees Geospatial Weighted Scorecards KPIs BI and Microsoft Azure Technologies The Azure Machine Learning and the Azure Stream Analytics are enabling technologies for business intelligence. Azure Machine Learning With Microsoft Azure Machine Learning Studio, you can build, test, and deploy predictive analytics solutions that operate on your data. The Machine Learning service and development environment is cloud-based, providing compute resource and memory flexibility. In Machine Learning Studio, you drag-and-drop datasets and analysis modules onto a canvas, connect them together to create an experiment, and then run the experiment. You can edit the experiment and re-run it, enabling you to iterate on your model design. Programming is not required, but if you need to extend your experiment with custom code you can use both R and Python. More languages will be supported in the future. You can also publish your experiment, or part of the experiment, as a web service that can be consumed by applications and BI tools. An experiment typically includes data that you have either uploaded to your workspace or loaded from a cloud data source such as Azure storage or URLs. And, the experiment includes an analytical module that processes or analyzes data. In Azure Machine Learning, you work with data in the form of datasets, which are tables of data with accompanying metadata that describes the schema and analytical usage of each column. The modules provide many tools that are important and useful in data science, including a variety of leading-edge machine learning algorithms. Other modules provide data entry functions, tools for transforming data for statistical analysis, and support for machine learning workflows such as training, scoring, and validation processes. The following image shows a typical experiment with multiple modules. One module is used to choose a subset of columns (Project Columns), another creates a linear regression model to predict a numeric outcome (Linear Regression), and successive modules train the model (Train Model) and generate predictions using a trained regression or classification model (Score Model).
- 32. 32 Image based on “Create your first experiment in Azure Machine Learning Studio” article For more information about Microsoft Azure Learning, see these articles. Microsoft Azure Machine Learning (http://azure.microsoft.com/en-us/services/machine- learning/?WT.mc_id=azurebg_US_sem_bing_BR_BRMachineLearningSolution_Nontest_Machin eLearning_azureml&WT.srch=1) What is Azure Machine Learning Studio? (http://azure.microsoft.com/en- us/documentation/articles/machine-learning-what-is-ml-studio/) Develop a predictive solution by using Azure Machine Learning (http://azure.microsoft.com/en- us/documentation/articles/machine-learning-walkthrough-develop-predictive-solution/) Learning Guide: Advanced data processing in Azure (http://azure.microsoft.com/en- us/documentation/articles/machine-learning-data-science-advanced-data-processing/) Cloud data science process (http://azure.microsoft.com/en- us/documentation/articles/machine-learning-data-science-how-to-create-machine-learning- service/)
- 33. 33 For tutorials, templates, and pre-developed solutions and walkthroughs for a variety of scenarios, see the following. Microsoft Azure Machine Learning Gallery (http://gallery.azureml.net/) The experiment samples in the Model Gallery include walkthroughs for some of the more popular machine learning scenarios, including fraud detection and retail sales prediction Azure Machine Learning Studio includes many sample datasets that have been pre-configured to make analysis easier. Create your first experiment in Azure Machine Learning Studio (http://azure.microsoft.com/en- us/documentation/articles/machine-learning-create-experiment/) Azure Stream Analytics Azure Stream Analytics provides complex event processing over streaming data in the cloud. The processing is low-latency, highly available with built-in recovery and checkpointing capabilities, and scalable. You can combine streams of data with historic records or reference data to derive business insights. The key scenarios are: Perform complex event processing on high-volume and high-velocity data Collect event data from globally distributed assets or equipment, such as connected cars or utility grids Process telemetry data for near real-time monitoring and diagnostics Capture and archive real-time events for future processing Building a stream-processing system is easy with Azure Stream Analytics. In the Azure portal, you author a streaming job by using a language similar to the familiar SQL language to specify transformations and analyze the data. You don’t have to write complex, custom code. Using the SQL-like Stream Analytics query language operators, you can define time-based windowed operations, correlate multiple streams to detect patterns, or even compare current conditions to historic values and models. The following image shows the dashboard for a Stream Analytics job. A query is run against a stream of call data (input). This image is based on the tutorial, Get started using Azure Stream Analytics: Real-time fraud detection.
- 34. 34 The service can easily scale from a few kilobytes to a gigabyte or more of events processed per second. The configurability of Stream Analytics enables you to determine how much compute power to each step of the pipeline to achieve the desired peak throughput. Connection support includes connecting Stream Analytics directly Azure Event Hubs, and to the Azure Blob service for historical data. With Azure Event Hubs, you can then integrate Stream Analytics with other data sources and processing engines. The results of the Stream Analytics job can be outputted to a number of targets, including but not limited to Azure Blog Storage, Azure Table Storage, and Azure SQL Database. For more information about Azure Stream Analytics, see these articles. Introduction to Azure Stream Analytics (http://azure.microsoft.com/en- us/documentation/articles/stream-analytics-introduction/) Get started using Azure Stream Analytics: Real-time fraud detection (http://azure.microsoft.com/en-us/documentation/articles/stream-analytics-get- started/#create-a-stream-analytics-job) Azure Stream Analytics & Power BI: Live Dashboard on Real time Analytics of Streaming Data (http://azure.microsoft.com/en-us/documentation/articles/stream-analytics-power-bi- dashboard/)
- 35. 35 Azure Stream Analytics key concepts (http://azure.microsoft.com/en- us/documentation/articles/stream-analytics-developer-guide/) Advanced Analytics Advanced analytics involves tools and techniques that are used to forecast future outcomes and behaviors. Data mining and predictive analytics are some of the analytical categories that are part of advanced analytics. Tool Options The following tools support advanced analytics. Data Mining Client for Excel Data Mining in Analysis Services Data Mining Client for Excel (2010, 2013) The Data Mining Client for Excel enables you to create, test, explore, and manage data mining models within Excel using either your spreadsheet data or external data accessible through your SQL Server 2014 Analysis Services instance. Figure – Data Mining Ribbon in Excel You can perform common data mining tasks, from data cleansing to model building and prediction queries. The options on the Data Modeling section of the toolbar let you derive patterns from data; group rows of data based on attributes, or explore associations. Use the wizards on the Accuracy and Validation toolbar to use industry-standard tests for validating the accuracy of your models, and for assessing the viability of the data set for creating models. Models you create are automatically opened for browsing. However, you can also browse models on the server and generate new visualizations. Use the Visio shapes to export model diagrams to a customizable canvas. For more information, see Data Mining Client for Excel (SQL Server Data Mining Add-ins) (http://msdn.microsoft.com/en-us/library/dn282385(v=sql.120).aspx). Data Mining in Analysis Services SQL Server Analysis Services provides an integrated platform for solutions that incorporate data mining. You can use either relational or cube data to create business intelligence solutions with predictive analytics.
- 36. 36 Data mining in Analysis Services uses well-researched statistical principles to discover patterns in your data, helping you make intelligent decisions about complex problems. By applying the data mining algorithms in Analysis Services to your data, you can forecast trends, identify patterns, create rules and recommendations, analyze the sequence of events in complex data sets, and gain new insights. In SQL Server 2014, data mining is powerful, accessible, and integrated with the tools that many people prefer to use for analysis and reporting. For more information, see Data Mining (SSAS) (http://technet.microsoft.com/en- us/library/bb510516(v=sql.120).aspx) and Data Mining Concepts (http://technet.microsoft.com/en- us/library/ms174949(v=sql.120).aspx). Conclusion Microsoft provides a variety of Business Intelligence (BI) tools that can address key (BI) workloads. This article discussed the workloads and the tools that best support each workload. The intent was to assist you with choosing the BI tools that meet your organization’s information needs. For more information: Office 365 (http://technet.microsoft.com/en-us/library/dn127064(v=office.14).aspx) SharePoint Online administration (http://technet.microsoft.com/en-us/library/gg132908.aspx) Business intelligence in Office 365 (http://technet.microsoft.com/en-us/library/dn198234.aspx) SharePoint 2013 (http://technet.microsoft.com/en-us/library/cc303422.aspx) Microsoft BI Videos (http://www.microsoft.com/en-us/bi/LearningCenter/BIVideos.aspx) Books Online for SQL Server 2014 (http://technet.microsoft.com/en- us/library/ms130214(v=sql.120).aspx) Install SQL Server 2014 Business Intelligence Features (http://technet.microsoft.com/en- us/library/hh231681(v=sql.120).aspx) Did this paper help you? Please give us your feedback. Tell us on a scale of 1 (poor) to 5 (excellent), how would you rate this paper and why have you given it this rating? For example: Are you rating it high due to having good examples, excellent screen shots, clear writing, or another reason? Are you rating it low due to poor examples, fuzzy screen shots, or unclear writing? This feedback will help us improve the quality of white papers we release.