Oh where, oh where did my S3N go? (in Windows Azure HDInsight) Oh where, Oh where, can it be?!

As noted in my previous post Connecting Hadoop on Azure to your Amazon S3 Blob storage, you could easily setup HDInsight Azure to go against your Amazon S3 / S3N storage.  With the updates to HDInsight, you’ll notice that Manage Cluster dialog no longer includes the quick access to Set up S3. Yet, there are times where you may want to connect your HDInsight cluster to access your S3 storage.  Note, this can be a tad expensive due to transfer costs. To get S3 setup on your Hadoop cluster, from the HDInsight dashboard click on the Remote Desktop tile so…

Rate this:

Connecting Hadoop on Azure to your Amazon S3 Blob storage

When working with Hadoop on Azure, you may be used to the idea of putting your data in the Cloud.  In addition to using Azure Blob Storage, another option is connecting your Hadoop on Azure cluster to query data against Amazon S3.  To configure Hadoop on Azure to connect to it, below are the steps (with the presumption that you already have an Amazon AWS / S3 account) and have uploaded data into your S3 account. 1) Log into your Amazon AWS Account  and click onto Security Credentials 2) Obtain your access credentials – you’ll need both your Access Key…

Rate this: