Azure Storage Services – Table storage

Anil Erduran Wed, Jul 6 2016 azure, cloud computing, database, storage 0

In this part of my Azure Storage Services series, we are going to cover Azure Table storage and look at how to manage tables and entities using PowerShell.

Author
Recent Posts

Follow me:

Anil Erduran

Anil Erduran is a principal consultant and subject matter expert for Hitachi Data Systems EMEA, based in London, UK. He is also a dual category Microsoft Most Valuable Professional in Cloud and Datacenter Management and Microsoft Azure. Anil can be found on Twitter @anil_erduran.

Follow me:

Table Storage Concept ^

Let’s go back to my previous article and review the concept behind the storage account and relevant sub-components.

Azure Storage Account Structure

Once you create your storage account, you have different storage service options. A table is one of those services and you can create multiple tables under a single storage account. Tables are used to group multiple entities.

Entities are similar to rows in a typical RDB and consist of a primary key and a set of properties. Property, on the other hand, is the actual name/value pair, which is similar to columns.

As this is not a traditional RDB, tables also don’t enforce a fixed scheme. So you can have one row with 5 columns and another row with 2 columns. Or you can store different sets of properties/formats in the same column.

No fixed scheme for tables

Entity Key Properties: ^

As we said, each entity has a primary key and three default system properties:

PartitionKey: This property should be populated by the developer for each insert, update, and delete operation. It’s actually used to organize entities in partitions to scale and load-balance tables across storage nodes. Each partition key is a unique identifier and is used to identify the partition that entities belong to. Also, each partition is served from a partition server, which means that you can separate your entities by using different PartitionKeys in multiple partitions, which are served by different servers. Or you can keep them under the same partition to query faster.

RowKey: Unique strings are used to identify entities within the partitions. PartitionKey and RowKey are usually used together to access particular entities.

Timestamp: This property is managed by the server itself and tracks the modified time of an entity. It cannot be updated or changed.

Getting Started: ^

First you need a “General Purpose” storage account in order to play with tables.

Creating General Purpose Storage account

It’s important to copy your Storage Access Keys as we are going to use them in our script:

Copying Access Keys

Creating your first table is a straightforward process. First you need to create a storage context for your storage account and then pass it to the New-AzureStorageTable cmdlet:

Creating a table with PowerShell

Table details

Adding entities with PowerShell ^

Current PowerShell cmdlets are limited when it comes to managing entities. But you can install Storage Client Library packages, which come with Azure SDK for .NET and then you can access .NET classes within PowerShell.

Installing NuGet packages

Microsoft.WindowsAzure.Storage.Table.DynamicTableEntity class is part of the Microsoft.WindowsAzure.Storage.Table namespace and helps you to create a PowerShell object.

You then can call the Microsoft.WindowsAzure.Storage.Table.TableOperation.Insert method on this object to add it to the existing table.

First we need to create a connection to our Azure Storage Account and specify table name, storage account name, and access keys.

$StorageAccountName = "storageaccountanil"
$StorageACcessKey = "6nVoPw3yzEEbAEmboxtZ4L4zhg7 +TZX/iFNB7d3Z4KllE2Rg=="
$Context = New-AzureStorageContext $StorageAccountName -StorageAccountKey $StorageACcessKey
$TableName = Get-AzureStorageTable –Name "TestTable01" -Context $Context

Then we need to create a custom object with the DynamicTableEntity class.

$entity = New-Object -TypeName Microsoft.WindowsAzure.Storage.Table.DynamicTableEntity -ArgumentList Partition1, Row1
$entity.Properties.Add("Name", "AnilErduran")
$entity.Properties.Add("Phone", "444-44-44")

If you check the entity variable, you will see the assigned values:

Entity object values

I specified Partition1 and Row1 for this entity as these properties are mandatory.

Now we should call the TableOperation.Insert method

$Add = $TableName.CloudTable.Execute([Microsoft.WindowsAzure.Storage.Table.TableOperation]::Insert($entity))

This is a simple example of using .NET classes and methods to manage entities with PowerShell. You can always create a PowerShell function, which accepts parameters like partitionKey, RowKey, Key, and Value and does batch entity adding.

Or you can simply create a PowerShell script, which reads a CSV file and import all the information into the Azure Table.

Querying Table entities with PowerShell ^

In order to query existing entities from a given table, we need to use the Microsoft.WindowsAzure.Storage.Table.TableQuery class.

$queryEntity = New-Object Microsoft.WindowsAzure.Storage.Table.TableQuery
$entities = $TableName.CloudTable.ExecuteQuery($queryEntity)

Query existing entities

You can also define additional filter options. A QueryEntity object accepts additional properties, as follows:

Filter options for entities

You can also easily play with output using a PowerShell format-table:

Subscribe to 4sysops newsletter!

Format query output

This has been a quick overview of Azure Table Storage and I wanted to show you how to leverage existing .NET classes to manage tables and entities via PowerShell. In the next part, we will have a look at File storage service.

Want to write for 4sysops? We are looking for new authors.

Read 4sysops without ads and for free by becoming a member!

Articles in series