Windows Azure Storage & Sql Azure

Windows Azure StorageSQL AzureDeveloping with Windows Azure storage & SQL AzureMaarten Balliauwhttp://blog.maartenballiauw.behttp://twitter.com/maartenballiauwmaarten@maartenballiauw.be

Whoam I?Maarten BalliauwAntwerp, Belgiumwww.realdolmen.comFocus on webASP.NET, ASP.NET MVC, PHP, Azure, VSTS, …Special interest in interopPHPExcel, PHPLinq, PHPMEF, Windows Azure SDK for PHP, ...http://blog.maartenballiauw.behttp://twitter.com/maartenballiauw

SQL AzureStorage conceptsWhere can I store my stuff?

Windows Azure Data StorageQueueBlobAccountTablesDrives

Azure Platform Data Storage OptionsWindows Azure Data StorageBlobsUnstructured data storageTablesSemi-structured or tabular data storageQueuesBuffered delivery data storageDrivesDurable NTFS volumes that Windows Azure applications can use. See: http://microsoftpdc.com/Sessions/SVC14SQL AzureRelational data storage

PHP + Cloud StorageWindows Azure StoragePHPInstance (web/worker)On-PremiseVIPLoad BalancerPHP AppSQL AzureWindows Azure Platform

Windows Azure SDK for PHPA PHP porgramming model for Windows Azure Storage

PHP with Windows Azure StorageWindows Azure SDK for PHP at http://phpazure.codeplex.comPHP programming model for Windows Azure StorageFeatures PHP classes for Blobs, Tables & QueuesStore PHP sessions in Table StorageFile system wrapper for Blob Storage

Blob ContainerEntitiesAccountTablehttp://<account>.blob.core.windows.net/<container>MessagesWindows Azure Storage Conceptshttp://<account>.table.core.windows.net/<table>Queuehttp://<account>.queue.core.windows.net/<queue>

Windows Azure BlobsUnstructured dataScale massivelyAt least 3 instances, 5 in optimal situationCan be used as CDNCan be mapped using a custom domain

Tools for connecting to blob storageCloudBerryLab Explorerhttp://www.cloudberrylab.comAzure Storage Explorerhttp://azurestorageexplorer.codeplex.com/Onlinehttp://myazurestorage.com / ftp://ftp.cloudapp.netWindows Azure tooling for Eclipse

Blobs Sample$blobStorage= new Microsoft_WindowsAzure_Storage_Blob();// Createif (!$blobStorage->containerExists($containerName)){$blobStorage->createContainer($containerName);$blobStorage->setContainerAcl($containerName, Microsoft_WindowsAzure_Storage_Blob::ACL_PUBLIC);}// Store$blob = $blobStorage->putBlob($containerName, $blobName, $localFilename, $metadata);/* @var $blob Microsoft_WindowsAzure_Storage_BlobInstance */

Blobs Sample Cont…// Copy$result = $blobStorage->copyBlob( $containerName, $blobName, $containerName, $blob2Name);// Retrieve$tempStore= azure_getlocalresourcepath('tempstore');$tempPath= $tempStore. '\\' . $imageId;$blobStorage->getBlob($containerName, $blobName, $tempPath);// Delete$result = $blobStorage->deleteBlob($containerName, $blobName);$result = $blobStorage->deleteContainer($containerName);http://phpazurecontrib.codeplex.com

Blob Stream Wrapper$blobStorage= new Microsoft_WindowsAzure_Storage_Blob();// Register:$blobStorage->registerStreamWrapper(); // registers azure://// or$blobStorage->registerStreamWrapper('blob://'); // use blob://// Use$fp= fopen('azure://mycontainer/myfile.txt', 'r');// ...fclose($fp);

Windows Azure Drive (a.k.a. Xdrive)Virtual NTFS volume that can be mounted.vhd formatUse existing NTFS API’sEasier migrationStored on blob storage provides quick mount/unmount in other VM

Queue Workflow ConceptsWindows Azure Queue ProvidesGuarantee delivery (two-step consumption)Worker Dequeues Message and mark it as InvisibleWorker Deletes Message when finished processing itIf Worker role crashes, message becomes visible for another Worker to processDoesn’t guarantee “only once” deliveryDoesn’t guarantee orderingBest effort FIFOWorker RoleWeb RoleInput Queue (Work Items)Worker RoleAzure QueueWeb RoleWorker RoleWeb RoleWorker Role

Azure QueuesRemoveMessageGetMessage (Timeout)Worker RolePutMessageQueueMsg 1Msg 2Msg 2Msg 1Web RoleWorker RoleWorker RoleMsg 3Msg 4Msg 2

Loosely Coupled Work with QueuesWorker-Queue ModelLoad work in a queueMany workers consume the queueInput Queue (Work Items)Azure QueueWorker RoleWeb RoleWorker RoleWeb RoleWorker RoleWeb RoleWorker Role

Queues$queueClient= new Microsoft_WindowsAzure_Storage_Queue();// Create$result = $queueClient->createQueue('imageQueue');// Delete$queueClient->deleteQueue('imageQueue');// Add message$queueClient->putMessage('imageQueue', $message, $ttl);// Retrieve Messages$messages = $queueClient->getMessages('imageQueue', 10);foreach($messages as $message) {// Do work here...$queueClient->deleteMessage('imageQueue', $message);}

Windows Azure Data Storage – Tables (Terms Part 1)Table Contains a set of entities. Entity (Row) Basic data items stored in a table. Property (Column) Single value in an entity. RowKeyUnique ID of the entity within a partitionTimestampTime it was created

Windows Azure Data Storage – Tables (Terms Part 2)Partition Entities in a table with the same partition keyPartitionKey Segments entities in to partitions to automatically distribute the table’s entities over many storage nodes.Sort OrderThere is a single index provided, where all entities in a table are sorted by PartitionKey and then RowKey

Key Example – Blog PostsPartition 1Partition 2Getting all of dunnry’s blog posts is fastSingle partitionGetting all posts after 2008-03-27 is slowTraverse all partitions

Table Sample$tableStorage= new Microsoft_WindowsAzure_Storage_Table('table.core.windows.net', 'myaccount', 'myauthkey');// Create$result = $tableStorage->createTable($tableName);// List $result = $tableStorage->listTables();foreach($result as $table) {echo 'Table name is: ' . $table->Name . "\n";}// Delete$tableStorage->deleteTable($tableName);

Tables with Entities// Structured entityclass ImageEntityextends Microsoft_WindowsAzure_Storage_TableEntity{/** * @azure filename */public $filename;/** * @azure size Edm.Int64 */public $size;}// Unstructured entity// Microsoft_WindowsAzure_Storage_DynamicTableEntity

Tables with Entities Cont…// Insert$image = new ImageEntity($partitionKey, $rowKey);$image->filename = $_FILES['imageUpload']['name'];$image->size = $_FILES['imageUpload']['size'];$image = $tableStorageClient->insertEntity($tableName, $image);// Retrieve$image = $tableStorage->retrieveEntityById($tableName, $partitionKey, $rowKey, 'ImageEntity');// Update$image->filename = 'newname.jpg';$result = $tableStorage->updateEntity($tableName, $image);// Delete$result = $tableStorage->deleteEntity($tableName, $image);

Table Queries// Filter condition$select = "filesizegt 1024 and PartitionKeyeq '$partitionKey'";// Or fluent interface$select = $tableStorage->select()->from($tableName) ->where('filesizegt 1024') ->andWhere('PartitionKeyeq ?', $partitionKey);// Run query$images = $tableStorage->storageClient->retrieveEntities('testtable', $select, 'ImageEntity');foreach($images as $image) {echo 'Name: ' . $image->filename . "\n";}

Batching Operations// Start batch$batch = $tableStorage->startBatch();// Insert multiple$images = generateEntities();foreach($images as $image) {$tableStorage->insertEntity($tableName, $image);}// Commit$batch->commit();

Table session handler$sessionHandler = new Microsoft_WindowsAzure_SessionHandler($tableStorage);$sessionHandler->register();session_start();if (!isset($_SESSION['start'])) {$_SESSION['start'] = time();}

SQL AzureA relational database for the cloud

SQL Azure and Windows Azure Table ComparisonSQL Azure TablesWindows Azure TablesFully structuredStrongly typedRelational(RDBMS)Highly scalableSemi-structuredLoosely typedNon-Relational(Not RDBMS)Massively scalable

MySQL: Simple ConfigurationVIPLoad BalancerWeb RoleMySQLWorker Role

MySQL in a Windows Azure ApplicationRunning MySQL in a worker roleCopy MySQL to the worker role sub-directoryCopy to read-write local storageConfigure MySQL to listen on the right portMonitor MySQL healthConsuming MySQLDiscover IP address and portNormal access from then onHandle topology changes

Simple ConfigurationVIPLoad BalancerMySQL

ReplicationVIPLoad BalancerMSSMySQLMySQLMySQL

Windows Azure Drive with Hot SpareVIPLoad BalancerMySQLMySQL

SQL Azure FeaturesSupportedNot supportedTables, Indexes, ViewsStored ProceduresTriggersConstraintsTable VariablesTemp Tables (#Name)Physical Server Access Catalog DDLCommon Language RuntimeService BrokerReporting ServicesAnalysis ServicesDistributed Transactions and Queries

SQL AzureDeploymentWeb Portal(API)DB ScriptSQL AzureTDS

SQL AzureAccessing databasesWeb Portal(API)Your AppSQL AzureTDSChange Connection String

Database ReplicasSingle DatabaseMultiple ReplicasReplica 1Single PrimaryReplica 2DBReplica 3

SQL AzureDatabase Monitoring & RecoveryWeb Portal(API)!Your AppSQL AzureTDS

Windows Azure Storage & Sql Azure

More Related Content

What's hot (20)

Viewers also liked (7)

Similar to Windows Azure Storage & Sql Azure (20)

More from Maarten Balliauw (20)

Recently uploaded (20)

Windows Azure Storage & Sql Azure

Editor's Notes