Save your team from the frustrations of...
Data Warehouse Development
Dr Barry Devlin is among the foremost authorities on business insight and one of the founders of data warehousing, having published the first architectural paper on the topic in 1988. Today he is a leading consultant and speaker on data warehouse development.
Barry has published a number of articles for WhereScape, to follow you will find a synopsis and introduction to some of these. Each has a link to the full blog so you can explore that specific subject in more detail.
Designing a Data Warehouse
Always keep in mind the basic goal of your project: to deliver a cross-functional, long-life foundation for data provision and decision support. Data warehouse development project types vary and will continue to mutate over time with requirements that you cannot predict now, and your data warehouse must continue to provide accurate data throughout this evolution.
This blog explains how to:
- Use templates to save time and money rather than building from scratch
- How to define and refine the logical structure of relational tables
- Choose which approach of data modelling is best for you – 3NF, Star Schema, Data Vault etc.
Building a Data Warehouse
This blog explains how every design is only as good as the reality of its source systems, their missing data and poorly defined data structures. The finished design is always a balance between the vision for the model and the constrains of the sources. The article covers:
- The five steps to follow when building a data warehouse
- How Data Warehouse Automation can help
- How to move from design to build
- Building a Data Vault with WhereScape Data Vault Express
Operating a Data Warehouse
This blog explains how to deliver your data warehouse successfully to the business and run it smoothly on a daily basis. We must avoid the problems of past ad hoc data warehouse development approaches that combined manual and semi-automated methods, and adopt advanced data management and automation practices. Find out how:
- Deployment needs to be treated as a long-term, monogamous relationship
- To address issues such as packaging and installation of the code
- To bundle sets of objects and transport from dev to QA and through to production
- To handle interdependencies between the data warehouse, data marts and data lake
- To automate the historical information that tracks performance over time
Maintaining a Data Warehouse
In some development projects, once a piece of software is up and running it needs only minor bug-fixing, but maintaining a data warehouse needs more attention than that. The nature of creative decision-making support is that users are continuously discovering new business requirements, changing their mind about what data they need and thus demanding new data elements and structures on a weekly or monthly basis. Indeed, in some cases, the demands may arrive daily! Read this blog to find out:
- What a data lake should and shouldn’t be used for
- Why and how a Data Vault gives more agility in the maintenance phase
- The role of metadata in data warehouse maintenance
- How to predict downstream impact of changes from automated documentation
Maximizing Data Potential: Microsoft Fabric and WhereScape in Harmony
Forget gold. Forget oil. We are living in an era where data is our most precious commodity. As organizations strive for deeper insights into how their products perform, how their brand is perceived, and how customers behave, the need for stronger and more efficient...
Efficient Processing Techniques for JSON and Parquet Semi-Structured Data
Introduction to Semi-Structured Data and Its Importance Semi-structured data sits on the spectrum somewhere between traditional database tables and unstructured data. It has organizational properties that make it easier to analyze than raw text, but it doesn’t fit...
A Webinar Recap: Exploring Data Automation Levels with Kent Graziano
Our most recent webinar, "The Future of Data Warehousing: Understanding Automation Levels," hosted by Patrick O'Halloran, Solutions Architect, and esteemed guest speaker Kent Graziano dove into the transformative world of data warehouse automation. They discussed its...
WhereScape’s Supported Platforms: Accelerating Data Solutions Across the Board
The Future of Data Warehouse Automation with WhereScape Data warehouse automation represents a transformative shift in how businesses manage and utilize their data. WhereScape is at the forefront of this movement, offering tools that automate code generation,...
Overcoming Challenges with AI Hallucinations
Conversing with your digital assistant on your smartphone, using facial recognition for security, traveling in autonomous vehicles, or browsing recommended products based on your search history - there is no denying AI is embedded in many aspects of our lives. AI has...
Navigating Data Governance with WhereScape 3D
Properly managing and organizing data allows businesses to not only understand crucial patterns and trends, but also to leverage that data in strategic ways that grow revenue over time. Data drives decision-making and paves the way for innovation when used properly....
Deep Dive into WhereScape RED: Features and Benefits
Transforming a business’s various databases and files into actionable insights and reports is crucial, but incredibly time-consuming with traditional tools. Fortunately, with data warehouse automation tools like WhereScape RED, organizations can take advantage of a...
Brief Insights from Gartner® Latest Report on Data Fabric and Data Mesh
In the rapidly evolving world of data management, distinguishing between the myriad of strategies and technologies can be daunting. The latest Gartner® report, "How Are Organizations Overcoming Issues to Start Their Data Fabric or Mesh?" provides critical insights...
ETL vs ELT: What are the Differences?
In data management, the debate between ETL and ELT strategies is at the forefront for organizations aiming to refine their approach to handling vast amounts of data. Each method, ETL vs ELT, offers a unique pathway for transferring raw data into a warehouse, where it...
Embracing the Future of Data Management Recap: Insights from Mike Ferguson
In our recent webinar, "Embrace the Future of Data Management with Automated Cloud Data Warehousing," we had the privilege of diving into the transformative world of cloud data warehousing and highlighting the pivotal role of automation. Guided by our own Brad Kloth,...
Related Content
Maximizing Data Potential: Microsoft Fabric and WhereScape in Harmony
Forget gold. Forget oil. We are living in an era where data is our most precious commodity. As organizations strive for deeper insights into how their products perform, how their brand is perceived, and how customers behave, the need for stronger and more efficient...
Efficient Processing Techniques for JSON and Parquet Semi-Structured Data
Introduction to Semi-Structured Data and Its Importance Semi-structured data sits on the spectrum somewhere between traditional database tables and unstructured data. It has organizational properties that make it easier to analyze than raw text, but it doesn’t fit...
A Webinar Recap: Exploring Data Automation Levels with Kent Graziano
Our most recent webinar, "The Future of Data Warehousing: Understanding Automation Levels," hosted by Patrick O'Halloran, Solutions Architect, and esteemed guest speaker Kent Graziano dove into the transformative world of data warehouse automation. They discussed its...
WhereScape’s Supported Platforms: Accelerating Data Solutions Across the Board
The Future of Data Warehouse Automation with WhereScape Data warehouse automation represents a transformative shift in how businesses manage and utilize their data. WhereScape is at the forefront of this movement, offering tools that automate code generation,...