SQL2014 Big Data Module 3 best database in the word
- 1. Click to edit Master subtitle style 03 | Windows Azure PowerShell Graeme Malcolm | Data Technology Specialist, Content Master Pete Harris | Learning Product Planner, Microsoft
- 2. • Windows Azure PowerShell • Windows Azure PowerShell Config • Running Map/Reduce Jobs Module Overview
- 3. Windows Azure PowerShell • Install from Microsoft Web Platform Installer • Cmdlets to manage Windows Azure services, including HDInsight,
- 4. Windows Azure PowerShell Config • Connect PowerShell to Windows Azure – Download and import a certificate – Use Windows Azure AD • Access services in multiple subscriptions – Specify subscription in cmdlet parameters – Set subscription context Get-AzurePublishSettingsFile Import-AzurePublishSettingsFile "<file_path>" Add-AzureAccount Select-AzureSubscription
- 5. Demo: Configuring PowerShell In this demonstration, you will see how to: • Configure Windows Azure PowerShell
- 6. Uploading Files to Windows Azure 1. Get the Windows Azure Storage key – Get-AzureStorageKey 2. Create the Windows Azure Storage context – New-AzureStorageContext 3. Upload local files to blobs in Windows Azure – Set-AzureStorageBlobContent
- 7. Demo: Uploading Files In this demonstration, you will see how to: • Upload Source Data to HDFS
- 8. Running a Map/Reduce Job 1. Create a job definition – New- AzureHDInsightMapReduceJobDefinition 2. Submit the job – Start-AzureHDInsightJob 3. View the job execution information – Wait-AzureHDInsightJob – Get-AzureHDInsightJobOutput
- 9. Demo: Running a Map/Reduce Job In this demonstration, you will see how to: • Run a Map/Reduce Job in PowerShell
- 10. Getting Map/Reduce Output 1. Get the Windows Azure Storage key – Get-AzureStorageKey 2. Create the Windows Azure Storage context – New-AzureStorageContext 3. Download job output files in Windows Azure to local files – Get-AzureStorageBlobContent
- 11. Demo: Getting Job Output In this demonstration, you will see how to: • View Map/Reduce Job Output in PowerShell
- 12. Module Summary • Install Windows Azure PowerShell from the Web Platform • Connect PowerShell to your Subscription • Use PowerShell to: – Upload Jars and data – Run Map/Reduce jobs – Download output files
- 13. ©2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, Office, Azure, System Center, Dynamics and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.