- Stargate-SG1 Quote from SG-1 episode Bad Guys:
- (Vala is attempting to power the stargate with a Goa’uld bomb.)
- Vala: There’s a 70% chance that if we dial manually we’ll be able to establish a connection, and a 50% chance the bomb will just go off.
- Lt. Col. Mitchell: That a 120%.
- Vala: Well there’s some crossover where we establish a wormhole and it blows up.
- Lt. Col. Mitchell: [on the radio] Jackson, did you catch any of that?
- Dr. Jackson: Yeah, 100% chance we should have brought someone who knows what they’re doing.
In the posting Parallel Data Warehouse News and Hadoop Interoperability Plans, definitely another nugget of exciting news in Big Data.
In the data deluge faced by businesses, there is also an increasing need to store and analyze vast amounts of unstructured data including data from sensors, devices, bots and crawlers. By many accounts, almost 80% of what businesses store is unstructured data – and this volume is predicted to grow exponentially over the next decade. We have entered the age of Big Data. Our customers have been asking us to help store, manage, and analyze both structured and unstructured data – in particular, data stored in Hadoop environments. As a first step, we will soon release a Community Technology Preview (CTP) of two new Hadoop connectors – one for SQL Server and one for PDW. The connectors provide interoperability between SQL Server/PDW and Hadoop environments, enabling customers to transfer data between Hadoop and SQL Server/PDW. With these connectors, customers can more easily integrate Hadoop with their Microsoft Enterprise Data Warehouses and Business Intelligence solutions to gain deeper business insights from both structured and unstructured data.
In the last few months, we have peeling the onion layers on our foray into Big Data including:
- Project Daytona: Allow users to run large scale machine learning distributed across many nodes via iterative MapReduce runtime on Windows Azure.
- LINQ to HPC: Large scale unstructured data analysis based on Microsoft Research’s DryAd via .NET and LINQ.
This is yet another yummy layer … I wonder what’s next 🙂
We got some work to do around the architectural positioning of this exciting new suite of technologies mate. I look forward to working with you on it.
Absolutely – lots of fun here, eh?! 🙂