Comments for Denny Lee http://dennyglee.com Ramblings of a data dork: from BI and Big Data to Travel and Food Wed, 01 Feb 2012 23:42:22 +0000 hourly 1 http://wordpress.com/ Comment on Moving data to compute or compute to data? That is the Big Data question by dennyglee http://dennyglee.com/2012/01/31/moving-data-to-compute-or-compute-to-data-that-is-the-big-data-question/#comment-5761 Wed, 01 Feb 2012 23:42:22 +0000 https://dennyglee.wordpress.com/?p=883#comment-5761 Thanks to Phil Young for calling out the typo – I meant 64MB not 64K block sizes!

]]> Comment on Moving data to compute or compute to data? That is the Big Data question by Windows Azure and Cloud Computing Posts for 1/30/2012+ - Windows Azure Blog http://dennyglee.com/2012/01/31/moving-data-to-compute-or-compute-to-data-that-is-the-big-data-question/#comment-5754 Wed, 01 Feb 2012 02:05:31 +0000 https://dennyglee.wordpress.com/?p=883#comment-5754 [...] Lee (@dennylee) asked Moving data to compute or compute to data? That is the Big Data question in a 1/31/2012 post: Dorky attempts at geek Shakespere aside; as the volume, complexity, and [...]

]]> Comment on Scale Up or Scale Out your Data Problems? A Space Analogy by dennyglee http://dennyglee.com/2012/01/24/scale-up-or-scale-out-your-data-problems-a-space-analogy/#comment-5744 Mon, 30 Jan 2012 01:16:28 +0000 https://dennyglee.wordpress.com/?p=854#comment-5744 Fair enough on the definition of teraFLOP, but that’s still a lot of floating point processing. And unless SETI is processing via wasted cycles, that’s still a lot of work. But you are right, that isn’t the amount of data per se.

As for the current paradigm of NoSQL, while we’re talking about Godzilla amounts of data, the whole point is to not move the data around – its really about moving compute to the data vs. data to the compute. I have a blog post coming up on Tuesday that gets into this.

And no disagreement on the RM/RDBMS paradigm. In fact, while I’m currently espousing the benefits of Hadoop / Big Data / NoSQL in general, there was never an attempt to minimize the utter importance of the RDBMS paradigm. In fact, my background is that of the SQL world, eh?!

]]> Comment on Scale Up or Scale Out your Data Problems? A Space Analogy by Robert Young http://dennyglee.com/2012/01/24/scale-up-or-scale-out-your-data-problems-a-space-analogy/#comment-5742 Sun, 29 Jan 2012 17:28:43 +0000 https://dennyglee.wordpress.com/?p=854#comment-5742 – around 5.2 Million participants processing 769 teraFLOPS (11/14/2009) of data!

Bad analogy: a teraFLOP is a measure of floating point processing, not byte footprint.

The “network is the computer” meme, associated with Scott McNealy, embodies the scientific LAN paradigm: lots o cpu cycles (distributed to many cpus) processing small amounts of data. The current NoSql, et al, paradigm is to ship Godzilla quantities of data around for minimal processing. Not a smart paradigm.

The RM/RDBMS paradigm is rooted in the TPM, classically embodied in CICS. If transaction doesn’t matter to you, or you’re willing to ignore transaction, then any file based system will do.

]]> Comment on Connecting PowerPivot to Hadoop on Azure – Self Service BI to Big Data in the Cloud by dennyglee http://dennyglee.com/2012/01/21/connecting-powerpivot-to-hadoop-on-azure-self-service-bi-to-big-data-in-the-cloud/#comment-5737 Sat, 28 Jan 2012 10:47:21 +0000 https://dennyglee.wordpress.com/?p=823#comment-5737 Well, I think @bradoop and the other engineers on the dev team get more credit for that than I do :)

]]> Comment on Connecting PowerPivot to Hadoop on Azure – Self Service BI to Big Data in the Cloud by Damien DORISON http://dennyglee.com/2012/01/21/connecting-powerpivot-to-hadoop-on-azure-self-service-bi-to-big-data-in-the-cloud/#comment-5736 Sat, 28 Jan 2012 10:00:09 +0000 https://dennyglee.wordpress.com/?p=823#comment-5736 ok it works nows. Thank you for resolving.

]]> Comment on Connecting PowerPivot to Hadoop on Azure – Self Service BI to Big Data in the Cloud by Damien DORISON http://dennyglee.com/2012/01/21/connecting-powerpivot-to-hadoop-on-azure-self-service-bi-to-big-data-in-the-cloud/#comment-5734 Fri, 27 Jan 2012 21:26:36 +0000 https://dennyglee.wordpress.com/?p=823#comment-5734 Hi Denny,

Many thanks for your reply, i’m glad to have discovered this problem :)
Please let me know when this issue is fixed.
Have a good we.

Damien

]]> Comment on Connecting PowerPivot to Hadoop on Azure – Self Service BI to Big Data in the Cloud by dennyglee http://dennyglee.com/2012/01/21/connecting-powerpivot-to-hadoop-on-azure-self-service-bi-to-big-data-in-the-cloud/#comment-5733 Fri, 27 Jan 2012 19:48:22 +0000 https://dennyglee.wordpress.com/?p=823#comment-5733 Hi Damien, glad you like the post. Sorry about the port issue, we did an update yesterday that accidentally turned the port toggle off. We’re fixing this now and will update the DL. HTH! Denny

]]> Comment on Connecting PowerPivot to Hadoop on Azure – Self Service BI to Big Data in the Cloud by Damien DORISON http://dennyglee.com/2012/01/21/connecting-powerpivot-to-hadoop-on-azure-self-service-bi-to-big-data-in-the-cloud/#comment-5732 Fri, 27 Jan 2012 18:29:36 +0000 https://dennyglee.wordpress.com/?p=823#comment-5732 Hello Denny,

Great demo, thanks for this.

i’m trying to follow your demo but i’m experiencing problems : cannot turn port 10000 on. each time i set it on, when i come back to setting page it’s off again… ever heard about this ?

many thanks for your response

]]> Comment on Scale Up or Scale Out your Data Problems? A Space Analogy by dennyglee http://dennyglee.com/2012/01/24/scale-up-or-scale-out-your-data-problems-a-space-analogy/#comment-5728 Thu, 26 Jan 2012 07:24:35 +0000 https://dennyglee.wordpress.com/?p=854#comment-5728 Well do note that I am an employee of Microsoft so there probably is a bias here. One of the key aspect of HANA is its abilities to perform calculations against a column store in memory, but also being able to utilize a row store and persisting the data. By itself, I would consider this a scale up technology because to improve performance, it still is about adding more RAM or faster CPUs to a single box.

]]>