Azure

Azure Information Lake Storage Gen2 Studying Avro Information Utilizing .Web Core

After logging in, you possibly can see your all lively subscriptions within the output and you want to set the subscription for this present context. To take action use the next command. I’ve a number of subscriptions and I’ll use my Azure move sponsorship for this context.

  1. az account set –subscription “Azure Move – Sponsorship”

 

Step 2 – Create an Azure Useful resource Group Utilizing Portal and CLI

 

As you understand, we already logged in utilizing CLI. Now we are going to create a useful resource group for the Azure net app and app service plan. We are going to maintain our all assets on this useful resource group that we’re creating. Use the next command with a purpose to create the useful resource group.

  1. az group create –name “datalake-rg” –location “centralus”   
Azure Data Lake Storage Gen2 Reading Avro Files Using .Net Core

 

Azure Data Lake Storage Gen2 Reading Avro Files Using .Net Core

 

Step 3 – Create Azure Information Lake Storage Gen2 Account

 

Click on on create a brand new useful resource and search storage account and select the storage account from the outcome. You can even use the next instructions with a purpose to create the storage account utilizing Azure CLI.

  1. # Create managed id  
  2. az id create -g <RESOURCEGROUPNAME> -n <MANAGEDIDENTITYNAME>  
  3.   
  4. az extension add –name storage-preview  
  5.   
  6. az storage account create –name <STORAGEACCOUNTNAME>   
  7.     –resource-group <RESOURCEGROUPNAME>   
  8.     –location eastus –sku Standard_LRS   
  9.     –kind StorageV2 –hierarchical-namespace true   
Azure Data Lake Storage Gen2 Reading Avro Files Using .Net Core

 

Azure Data Lake Storage Gen2 Reading Avro Files Using .Net Core

 

Select your subscription, useful resource group, and storage account title and click on Subsequent: Networking >

 

Azure Data Lake Storage Gen2 Reading Avro Files Using .Net Core

 

The networking, tab these are the default chosen choices and possibly you wish to use one other one however for this demo please use the default chosen choices and hits Subsequent: Information Safety >

 

Azure Data Lake Storage Gen2 Reading Avro Files Using .Net Core

 

The info safety, tab these are the non-compulsory possibility you wish to use however for this demo please additionally use the default chosen choices and hits Subsequent: Information Safety >

 

Azure Data Lake Storage Gen2 Reading Avro Files Using .Net Core

 

The advance, tab is the default chosen possibility and possibly you wish to use one other one however for this demo please use the default chosen choices and select the allow towards the Information Lake Storage Gen2 possibility, and hits Subsequent: Tags > and subsequent assessment + create.

 

Azure Data Lake Storage Gen2 Reading Avro Files Using .Net Core

 

After creating the azure knowledge lake gen2 account, open the newly created azure knowledge lake storage gen2 account.

 

Azure Data Lake Storage Gen2 Reading Avro Files Using .Net Core

 

Step 4 – Create Azure Information Lake Container

 

Choose the container possibility from the left navigation. Click on on the + Container button and create a brand new container. 

 

Azure Data Lake Storage Gen2 Reading Avro Files Using .Net Core

 

Step 5 – Add Avro File

 

Open the newly created container and add an Avro file contained in the container. I additionally connected the pattern Avro file on the highest. You’ll be able to obtain and use it to your studying.

 

Azure Data Lake Storage Gen2 Reading Avro Files Using .Net Core

 

Step 6 – Create a brand new Console App in Visual Studio 2019

 

Open the visible studio and create a brand new venture and add a console app (.Web Core) with C#.

 

Azure Data Lake Storage Gen2 Reading Avro Files Using .Net Core

 

Step 7 – Add References to NuGet Packages

 

Initially, in References, add the references to WindowsAzure.Storage, Microsoft.Avro.Core and Newtonsoft.Json utilizing NuGet Bundle Supervisor, as proven under. 

 

Azure Data Lake Storage Gen2 Reading Avro Files Using .Net Core

 

Step 8 – Add Sensor Mannequin Class

 

Add a brand new class to your venture with the title SensorModel.cs. Add the next properties to get the outcome set from JSON response with an acceptable namespace.

(FileName: SensorModel.cs)

  1. public class SensorModel  
  2.     {  
  3.         public string refid { getset; }  
  4.         public lengthy measuringpointid { getset; }  
  5.         public lengthy dateid { getset; }  
  6.         public lengthy timeid { getset; }  
  7.         public string timestamp { getset; }  
  8.         public double worth { getset; }  

  9.         public override string ToString()  
  10.         {  
  11.             return $“DateTime: {timestamp:HH:mm:ss} | MeasuringPointId: {measuringpointid} | “  
  12.                  + $“Date: {dateid} | Serialnumber: {refid} | SensorValue: {worth} “;  
  13.         }  
  14.     }  

Open the Program class and change the next code with an acceptable namespace. Please seize your connection string out of your storage account and change it within the code and in addition use your container title contained in the code.

Run your console app after which you will notice the next output within the console.

Tags
Show More

Related Articles

Leave a Reply

Your email address will not be published. Required fields are marked *

Close