Stephen Swoyer recently wrote a really interesting article on how the landscape of the data warehouse is changing.
“The DW and big data: Two platforms, two very different purposes, two agendas – seemingly on a collision course. It isn’t so much a question of which platform vision will triumph, but of how two such different visions can be reconciled” http://radiantadvisors.com/2013/03/07/time-for-an-architectural-reckoning
I totally agree with Claudia Imhoff that “not all analytics now belong inside the BI architecture” and that we are in a “very disruptive period of a lot of new technologies flooding in to business intelligence”. I also am not actually that far away from the position Scott Davis takes – I agree that “Hadoop is a hugely transformational technology.” I just think for the short to medium term Hadoop et al are going to augment rather than replace traditional data warehouses. Will Hadoop replace a traditional data warehouse database in the long term? Only if it adds a lot of database like features, and then the argument becomes a lot less interesting – something akin to the “Will Ingres/Informix/Sybase replace Oracle?” debate of yesteryear.
My main concern is how customers are going to embrace this new data landscape rather than if they are going to. How are organizations going to build a data landscape that includes Teradata, Aster and Hadoop? How are they going to manage Analysis Services cubes and a smattering of legacy Oracle data warehouses?
Data warehouses currently take too long to build and are too hard to change. The new architectural changes are going to make things worse not better.
Yes, WhereScape does have a stake in the game –although not in the status quo. Regardless of the platform, design and technology the need to deliver quickly without compromise remains the same. Who wants to manually build out a multiple platform data warehouse? Having a data warehouse automation environment such as WhereScape RED helps simplify the approach, and I believe is a key piece of the new architecture.