GDG Ternopil TechTalks Web #1 2015 - Data storages in Microsoft Azure
Download as PPTX, PDF0 likes218 views
The document discusses various data storage options in Microsoft Azure, including Azure Cloud Storage, MS SQL Azure, and Azure DocumentDB, highlighting their advantages and use cases. It emphasizes the importance of selecting the right storage solution based on specific tasks, load patterns, and cost considerations. Additionally, it covers the features and operational capabilities of Azure's storage services, such as scalability, security, and API accessibility.
![#dfua
Azure DocumentDb access via HTTP
POST https://<REST URI>/docs HTTP/1.1
...
x-ms-documentdb-isquery: True
Content-Type: application/query+json
{
"query": "SELECT * FROM Families f WHERE f.id = @familyId",
"parameters":
[
{"name": "@familyId", "value": "AndersenFamily"}
]
}](https://image.slidesharecdn.com/derenaazurestorages-151228151419/85/GDG-Ternopil-TechTalks-Web-1-2015-Data-storages-in-Microsoft-Azure-29-320.jpg)
GDG Ternopil TechTalks Web #1 2015 - Data storages in Microsoft Azure
- 1. Data storages in Microsoft Azure Andriy Deren CEO, Onlizer/Dreams IT a.deren@onlizer.com
- 2. #dfua Agenda • Why cloud storages? • Cheap multipurpose NoSQL cloud storage (Azure Cloud Storage) • Cloud-based relational storage (MS SQL Azure) • Document-oriented storage in cloud (Azure DocumentDb) • Fast and furious in cloud (Azure Redis Cache)
- 3. Pros/Cons, Usage Cases Why cloud storages?
- 4. #dfua Solution search • When engineer has hummer in hands all problems looks like nails • When engineer has screwdriver in hands all problems looks like screws Use wrong tool Use tool wrong way We are trying to topple a tree with a sledgehammer We are trying to topple a tree with a saw
- 5. #dfua First conclusions • Universal solution - a solution that is equally bad for all tasks. • Specialized solution - well-suited to address only specific tasks. • Best the enemy of the good.
- 6. #dfua So when cloud storages are useful? • On and off (short-time and periodical load) • Fast grow • Unpredictable load • Predictable load • Geo-redundant access • Real-time sync and near 100% transactions success
- 7. #dfua General Pros & Cons Pros • SaaS & PaaS models – lower developer responsibility • Easier management and scale • Transparent work & API models • Predictable cost Cons • Lower control • Public cloud • Cost
- 8. #dfua Storages in Microsoft Azure SQL VM SQL Azure Document DB Table Storage Blob Storage Relational DBMS Reach query syntax Transactions support Service model Elastic scale Schema less Access via HTTP(S) Any data formats
- 9. Cheap multipurpose NoSQL storage Azure Storage
- 10. #dfua Azure Storage • Exposed via RESTful web services • Scalable, durable, available globally • Only pay for what the service uses
- 11. #dfua Storage SDKs on many languages C#/.NET Python Ruby Perl Node.JS Java PHP Erlang Common LISP Objective- C
- 12. #dfua Storage security • HTTP or HTTPS • Two independent 512bit symmetric master keys • Shared access signatures for more granular access
- 13. #dfua Storage artifacts Blobs Drives Queues Tables Files
- 14. #dfua Blob storage concept https://contoso.blob.core.windows.net/image/pic01.jpg Block/Page Blob Container Account contoso image pic01.jpg block01 block02 pic02.jpg video mov01.avi page01 page02
- 15. #dfua Blob storage operations • Get • Put • Delete • Copy • Snapshot • Lease
- 16. #dfua Block blobs Benefit Efficient continuation and retry Parallel and out of order upload of blocks
- 18. #dfua Table storage concept Entity Table Account contoso users FName=Bob LName=Smith FName=Inga Phone=123 groups Name=Admin
- 19. #dfua Entity details • Entity can have up to 255 properties –Up to 1MB per entity • Mandatory Properties for every entity –PartitionKey & RowKey (only indexed properties) •Uniquely identifies an entity •Defines the sort order –Timestamp •Optimistic Concurrency •Exposed as an HTTP Etag • No fixed schema for other properties –Each property is stored as a <name, typed value> pair –No schema stored for a table –Properties can be the standard .NET types: String, binary, bool, DateTime, GUID, int and double
- 20. #dfua Entity details • Entity Locality –Entities in the same partition will be stored together –Efficient querying and cache locality –Endeavour to include partition key in all queries • Entity Group Transactions –Atomic multiple Insert/Update/Delete in the same partition in a single transaction • Table Scalability –Target throughput – 2 000 tps/partition, 20 000 tps/account –Azure monitors usage patterns of partitions –Automatically load balance partitions –Each partition can be served by a different storage node –Scale to meet traffic needs of your table
- 21. #dfua Data operations • Create • Query • Delete Table operations Entity operations • Insert • Update • Merge • Replace • Upsert • Query • Delete
- 22. Cloud-based relational storage Microsoft SQL Azure
- 23. #dfua Relational DBMS as a Service Service Resources management Routing Platform Infrastructure Billing & monitoring SQL Server Database Management General Management
- 25. Document-oriented storage in cloud Azure DocumentDb
- 26. #dfua Azure DocumentDb NoSQL database solution designed “from scratch” for better JavaScript and JSON support on data-engine level.
- 27. #dfua Azure DocumentDb Transactions support Service model Schema less Elastic scale Access via HTTP(S) Rich query syntax
- 29. #dfua Azure DocumentDb access via HTTP POST https://<REST URI>/docs HTTP/1.1 ... x-ms-documentdb-isquery: True Content-Type: application/query+json { "query": "SELECT * FROM Families f WHERE f.id = @familyId", "parameters": [ {"name": "@familyId", "value": "AndersenFamily"} ] }
- 30. Fast and furious in cloud Azure Redis Cache Service
- 31. #dfua Azure Redis Cache • Simple but powerful Key/Value storage • Service model • Easy scale to cluster • Monitoring and metrics • Web-based CLI • Persistent save (Premium)