Connecting PowerPivot to Hadoop on Azure – Self Service BI to Big Data in the Cloud
.
“I caught a fish thiiiiis biiig”
– On stage with Ted Kummert during the PASS 2011 Keynote on Big Data (thanks to Karen Lopez @datachick for the pic)
.
.
During the PASS 2011 Keynote (back in October 2011), I had the honor to demo Hadoop on Windows / Azure. One of the key showcases during that presentation was to show how to connect PowerPivot to Hadoop on Windows. In this post, I show the steps on how to connect PowerPivot to Hadoop on Azure.
Pre-requisites
- PowerPivot for Excel (as of this post, using SQL Server 2012 RC1 version)
- Access to Hadoop on Azure CTP
.
Configuration Steps
1) Reference the following steps from How To Connect Excel to Hadoop on Azure via HiveODBC
The steps to follow are the:
- Install the HiveODBC Driver (we will configure the DSN later)
- Steps 1 – 3 from Using the Excel Hive Add-In to open the ports in Hadoop on Azure
.
.
2) Create a Hive ODBC Data Source > File DSN
Here, we will go about creating a File DSN Hive ODBC Data Source.
Thanks to Andrew Brust (@andrewbrust), the better way to make a connection from PowerPivot to Hadoop on Azure is to create a File DSN. This allows the full connection string to be stored directly within the PowerPivot workbook instead of relying on an existing DSN.
To do this:
- Go to the ODBC Data Sources Administrator and click on the File DSN tab.
- Click on Add, Choose HIVE, Click Next, Click Browse to choose a location of the file; click Finish.
- Open the File DSN you just created and click Configure. The ODBC Hive Setup and configure the host (e.g. [clustername].cloudapp.net) and authentication information (the username is what you had specified when you had created the cluster)
.
.
3) Connect PowerPivot to Hadoop on Azure via the HiveODBC File DSN
- Open up the PowerPivot ribbon and click on the Get External Data from Other Sources.
- From the Table Import Wizard, click on the Others (OLEDB/ODBC) and click Next.
- From here, click Build and the Data Link Properties, click on Provider, and ensure the Microsoft OLEDB Provider for ODBC Drivers is selected. Click Next.
- In the Data Link Properties dialog, choose “Use connection string”, and click Build and choose the File DSN you had created from Step #2. Enter in the password to your Hadoop on Azure cluster. Click OK.
- The Data Link Properties now contains a connection string do the Hadoop on Azure cluster.
Note, after this dialog, verify that the password has been entered into the connection string that that has been built into the Table Import Wizard. Note, the blue arrow points to a lack of a PWD=<password> clause. If the password isn’t specified, make sure to add it back in.
- Click OK, click Next. From here you will get the Table Import Wizard and we are back to the usual PowerPivot steps.
- Click on “Select from a list of tables and views to choose the data to import”
- Choose your table (e.g. hivesampletable) and import the data in.
It looks like a lot of steps but once you get into the flow of things, it’s actually a relatively easy flow.
Enjoy!
About dennyglee
Super; Worked seamlessly so far on my VM ; Thanks Denny;
Glad to hear it!
Hello Denny,
Great demo, thanks for this.
i’m trying to follow your demo but i’m experiencing problems : cannot turn port 10000 on. each time i set it on, when i come back to setting page it’s off again… ever heard about this ?
many thanks for your response
Hi Damien, glad you like the post. Sorry about the port issue, we did an update yesterday that accidentally turned the port toggle off. We’re fixing this now and will update the DL. HTH! Denny
Hi Denny,
Many thanks for your reply, i’m glad to have discovered this problem
Please let me know when this issue is fixed.
Have a good we.
Damien
ok it works nows. Thank you for resolving.
Well, I think @bradoop and the other engineers on the dev team get more credit for that than I do
Pingback: Connecting Power View to Hadoop on Azure–An #awesomesauce way to view Big Data in the Cloud « Denny Lee
Pingback: Windows Azure and Cloud Computing Posts for 2/9/2012+ - Windows Azure Blog
Denny, would this driver works for clusters on AWS?
I haven’t personally tried it on AWS yet but it should be compatible with Hive 0.7.1. Checking AWS’ documentation at http://aws.amazon.com/elasticmapreduce/faqs/#hive-9 – it appears that their Elastic Map Reduce 0.20 and 0.20.205 both support Hive 0.7.1. So it should work provided that the ports are open to allow for that type of connection. Worst case scenario, you can setup your HadoopOnAzure cluster and connect to Amazon S3 from Azure.
Note this is a personal observation, NOT an official Microsoft response, eh?!
HTH!
Pingback: SQL 2012 újdonságok: HiveODBC driver hadoop-hoz - Kővári Attila szakmai blogja - TechNetKlub
Pingback: To the Cloud…and Beyond! « Denny Lee
Pingback: Office 2013 Power View, Bing Maps, Hive, and Hadoop on Azure … on my! « Denny Lee
Pingback: Microsoftov pogled na Big Data fenomen | Business Intelligence