Connecting PowerPivot to Hadoop on Azure – Self Service BI to Big Data in the Cloud

PASS 2011 Keynote Isotope
.

“I caught a fish thiiiiis biiig”

– On stage with Ted Kummert during the PASS 2011 Keynote on Big Data (thanks to Karen Lopez @datachick for the pic)

.
.
During the PASS 2011 Keynote (back in October 2011), I had the honor to demo Hadoop on Windows / Azure.   One of the key showcases during that presentation was to show how to connect PowerPivot to Hadoop on Windows.  In this post, I show the steps on how to connect PowerPivot to Hadoop on Azure.

Pre-requisites

.

Configuration Steps

1) Reference the following steps from How To Connect Excel to Hadoop on Azure via HiveODBC

The steps to follow are the:

  • Install the HiveODBC Driver (we will configure the DSN later)
  • Steps 1 – 3 from Using the Excel Hive Add-In to open the ports in Hadoop on Azure

image
.
.
2) Create a Hive ODBC Data Source > File DSN

Here, we will go about creating a File DSN Hive ODBC Data Source.

Thanks to Andrew Brust (@andrewbrust), the better way to make a connection from PowerPivot to Hadoop on Azure is to create a File DSN.  This allows the full connection string to be stored directly within the PowerPivot workbook instead of relying on an existing DSN.

To do this:

  • Go to the ODBC Data Sources Administrator and click on the File DSN tab.

image

  • Click on Add, Choose HIVE, Click Next, Click Browse to choose a location of the file; click Finish.

image

  • Open the File DSN you just created and click Configure.  The ODBC Hive Setup and configure the host (e.g. [clustername].cloudapp.net) and authentication information (the username is what you had specified when you had created the cluster)

image
.
.
3) Connect PowerPivot to Hadoop on Azure via the HiveODBC File DSN

  • Open up the PowerPivot ribbon and click on the Get External Data from Other Sources.

image

  • From the Table Import Wizard, click on the Others (OLEDB/ODBC) and click Next.

image

  • From here, click Build and the Data Link Properties, click on Provider, and ensure the Microsoft OLEDB Provider for ODBC Drivers is selected. Click Next.
  • In the Data Link Properties dialog, choose “Use connection string”, and click Build and choose the File DSN you had created from Step #2.  Enter in the password to your Hadoop on Azure cluster.  Click OK.

image

  • The Data Link Properties now contains a connection string do the Hadoop on Azure cluster.

image

Note, after this dialog, verify that the password has been entered into the connection string that that has been built into the Table Import Wizard.  Note, the blue arrow points to a lack of a PWD=<password> clause.  If the password isn’t specified, make sure to add it back in.

image

  • Click OK, click Next.  From here you will get the Table Import Wizard and we are back to the usual PowerPivot steps.
  • Click on “Select from a list of tables and views to choose the data to import”

image

  • Choose your table (e.g. hivesampletable) and import the data in.

image

It looks like a lot of steps but once you get into the flow of things, it’s actually a relatively easy flow.

Enjoy!

15 thoughts on “Connecting PowerPivot to Hadoop on Azure – Self Service BI to Big Data in the Cloud

  1. Hello Denny,

    Great demo, thanks for this.

    i’m trying to follow your demo but i’m experiencing problems : cannot turn port 10000 on. each time i set it on, when i come back to setting page it’s off again… ever heard about this ?

    many thanks for your response

    • Hi Damien, glad you like the post. Sorry about the port issue, we did an update yesterday that accidentally turned the port toggle off. We’re fixing this now and will update the DL. HTH! Denny

  2. Pingback: Connecting Power View to Hadoop on Azure–An #awesomesauce way to view Big Data in the Cloud « Denny Lee

  3. Pingback: Windows Azure and Cloud Computing Posts for 2/9/2012+ - Windows Azure Blog

    • I haven’t personally tried it on AWS yet but it should be compatible with Hive 0.7.1. Checking AWS’ documentation at http://aws.amazon.com/elasticmapreduce/faqs/#hive-9 – it appears that their Elastic Map Reduce 0.20 and 0.20.205 both support Hive 0.7.1. So it should work provided that the ports are open to allow for that type of connection. Worst case scenario, you can setup your HadoopOnAzure cluster and connect to Amazon S3 from Azure.

      Note this is a personal observation, NOT an official Microsoft response, eh?! :)

      HTH!

  4. Pingback: SQL 2012 újdonságok: HiveODBC driver hadoop-hoz - Kővári Attila szakmai blogja - TechNetKlub

  5. Pingback: To the Cloud…and Beyond! « Denny Lee

  6. Pingback: Office 2013 Power View, Bing Maps, Hive, and Hadoop on Azure … on my! « Denny Lee

  7. Pingback: Microsoftov pogled na Big Data fenomen | Business Intelligence

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s