Warehouse: Relational DW or Hadoop?

Soldier: Damn Trekkies, always crashing the party pretending they’re time travelers. Claudia: What a nerd. — Warehouse 13 episode “Queen for a Day” I was asked the question “What’s the point of a data warehouse if I have Hadoop”?  And if you know me – I tend to answer in terms of an analogy: The best way to think about it is that a data warehouse (in the relational world) is like a Costco – lots of different stuff but still has a particular business domain (e.g. consumer goods from toilet paper for a year to laptops). While Hadoop is…

Rate this:

Before Big Data mining, we need to ensure privacy–but how?

  First things first, but not necessarily in that order! — words of wisdom from Doctor Who         The tweet below got me thinking about the importance of privacy. Data mining demands sound privacy policies in age of ‘big data’ http://t.co/1N0gZhz #datamining #BI #bigdata   After all, in this day of age, with access to all sorts of disparate information, it becomes easier and easier to uniquely identify a person by their behaviors and external patterns.   In Dr. Latanya Sweeney’s ground breaking paper k-Anonymity: a model for protecting privacy, she had noted the following startling observations: Based…

Rate this:

SQL Server 2008 Data Warehousing Channel 9 Videos

Eric Hanson has created a series of SQL Server 2008 data warehousing videos posted on Channel 9.  They cover data compression, backup compression, star join enhancements, parallel query enhancements, change data capture, grouping sets, and partition-aligned indexed views.   Quick and informative videos to get you up to speed on SQL Server Data Warehousing.  For these videos, checkout http://channel9.msdn.com/Search/?Term=eric%20hanson   Enjoy!  

Rate this:

Web Analytics and Data Warehousing

Extracted from Graves et. al., Professional SQL Server 2000 Data Warehousing with Analysis Services, Wrox Press, ISBN: 1861005407; Chapter 18:   Web Analytics is the analysis of web data. More specifically, it is business intelligence that allows analysts to gain insight into their web-based businesses (e.g. e-commerce, customer support, etc.). Web Analytics allows you to understand customer behavior and identify common sales trends allowing you to personalize services for your customers and increase customer satisfaction.  It allows you to understand how well your products, content, and online processes are working.   The difficulty of Web Analytics is that it requires…

Rate this:

Data Warehousing Planning

When planning to build an enterprise data warehouse, there are many of small details ranging from hardware allocation to error reporting.  So unless you plan for this correctly, you may deliver an inadequate system.   A good article to review on the issues to resolve when planning a data warehouse can be found in Craig Utley’s article within the July 2004 edition of SQL Server Magazine "Beating the Odds" Company Politics: turf battles, lack of clear vision, bureaucracy, etc.  Lack of User Involvement: Ask the questions and figure out what is needed and what to report.  Overbuilding: Do not try…

Rate this: