Dorky attempts at geek Shakespere aside; as the volume, complexity, and variability of your data systems increase in … entropy …, this becomes a fundamental question in whether one scales up or scale out their data problem. Apologies for the nerdy chemistry references in advance – which starts with this picture of Dr. Arthur Grosser (more later) As noted in the previous post Scale Up or Scale Out your Data Problems? A Space Analogy, the decision to scaling up or scaling out your data problem is a key facet in your Big Data problem. But just as important as the…
Month: January 2012
Cool Hadoop on Azure How To Videos by @bradoop
A big shout out to Brad Sarsfield (@bradoop) for creating these great How-To videos for Hadoop on Azure. How To: Upload Data and Use the WordCount Sample with Hadoop Services for Windows Azure (video) Run the Pi Estimator Sample on Hadoop on Windows Azure (video)
Scale Up or Scale Out your Data Problems? A Space Analogy
As I am writing more about Big Data, I’m been asked whether we need to have traditional relational or cube systems now that we have Big Data / NoSQL / Hadoop. My responses are to note that these are different systems that serve different purposes even though both are used to better understand data. But before we dive into the specifics surrounding relational databases compared to Hadoop / Big Data, we need to first talk about the differences between solving the a data problem by scaling up the problem or scaling it out. One way to understand the difference is…
Sunny Sunday: Tofino
This is a picture of an isolated beach in the wonderful town of Tofino (yes, I actually took it!). Located on the west coast of Vancouver Island – if you are surfer, camper, hiker, or just plain old nature lover – this is a beautiful place to hang out. Drive up from Victoria to Nanaimo (yes, of the famed Nanimo bars) and then cut through Vancouver Island to its west coast – it is a wonderfully scenic drive (this from a person that doesn’t like driving). For more information on Tofino, check out Tofino’s Wikipedia page – and check out…
Connecting PowerPivot to Hadoop on Azure – Self Service BI to Big Data in the Cloud
. “I caught a fish thiiiiis biiig” — On stage with Ted Kummert during the PASS 2011 Keynote on Big Data (thanks to Karen Lopez @datachick for the pic) . . During the PASS 2011 Keynote (back in October 2011), I had the honor to demo Hadoop on Windows / Azure. One of the key showcases during that presentation was to show how to connect PowerPivot to Hadoop on Windows. In this post, I show the steps on how to connect PowerPivot to Hadoop on Azure. Pre-requisites PowerPivot for Excel (as of this post, using SQL Server 2012 RC1 version)…
Travel Tuesday: Top 5 reasons to go to Costco in Taiwan (from a US expat)
. . . I love Pittsburgh, they put fries on nachos here. — Pete Lattimer, Warehouse 13 . . . For those un-familar with the reference, Warehouse 13 is an awesome Syfy show…and Costco is a warehouse store – yeah, weak connection here. Yet another themed blog series Starting with the recent Foodie Friday blog post (Foodie Friday: Taiwanese dessert 芋圓), figured I should add another non-geek themed blog post series – Travel Tuesday – probably every week or two, eh?! Okay…so what’s this about Costco? yeah right – so back to the title of this post – what are…
Sunny Sunday: Rattlesnake Ledge
When you hike up to Rattlesnake Ridge, you get a nice 270’ view of Rattlesnake Ridge area. For more info, check out: ttp://www.wta.org/go-hiking/hikes/rattle-snake-ledge — About “Sunny Sunday”: The Sunny Sunday blog posts are photos from various travel and/or outdoor (hiking) trips.
Hadoop on Azure: HiveQL query against Azure Blob Storage
The posting Setup Azure Blob Store for Hadoop on Azure CTP provides a quick way to upload files to your Azure Blob storage account and connect Hadoop on Azure CTP to it. Now that you have done that, one of the first things you may want to do is to interact with the data. To do this, let’s create a Hive table within Hadoop on Azure CTP that is connected to the files you uploaded to your Azure Blob storage account and query it. We will be referencing the scenario noted at: Hadoop on Azure Scenario: Query a web log…
Denny Lee 