"Why Data Modeling is More Essential In The New...
WhereScape 3D 8.6.6 – February 2022 Release
By WhereScape
| February 28, 2022
Welcome to the WhereScape Metadata Integration, Model Test Automation, and Enablement Pack Release!
Hot on the heels of our December “DevOps” release, we are delighted to announce the General Availability of WhereScape 3D 8.6.6. This includes new Metadata Ingestion, Model Test Automation workflows, Merge and Compare options, and Performance tweaks PLUS the official launch of WhereScape Enablement Packs along with our new File Parser Enablement Pack.
This is an essential release for:
- Our Current Customers: Today’s users are incredibly excited to see the range of new features added to WhereScape 3D along with the formal release of WhereScape Enablement Packs. We continue to deliver on our promise to provide a platform that supports their needs today while providing a sustainable data infrastructure that evolves with their business and technical needs.
- Our Partners: This network of associates that utilizes WhereScape to provide their customers with rapid and stable project delivery can improve their service even further by expanding the scope of discoverable metadata and integrations with other tools. The new Enablement Packs bring a modularised approach to keep up with the growing needs of data platforms.
- Our Prospects: For people facing data integration challenges or struggling to modernize their data infrastructure – there has never been a better time to meet WhereScape. Our Enablement Packs are just one example of how WhereScape continues to lead the way in breaking down the barriers to data delivery.
What are Enablement Packs?
While many of our current customers and partners have benefited from “sneak previews” of these, we are delighted to introduce WhereScape Enablement Packs.
These packs enable our users to more easily configure their data platform in a way that meets their specific needs while standardizing on architecture, automation patterns, and integrations. They provide Data Engineers, Data Architects and Designers with templates to maximize the use of automation in the delivery of data platforms and data assets that their consumers need.
- SOURCE ENABLEMENT PACKS for Amazon S3, Azure Data Lake Storage Gen2, Azure Blob, Google Cloud Storage (GCS), Google Drive, File parsers: Parquet / JSON / XML / Avro / ORC / Excel / CSV.
- TARGET ENABLEMENT PACKS for Snowflake, Azure Synapse Analytics / SQL Pool, Amazon Redshift, Hive, PostgreSQL, Google BigQuery, Exasol, SAP HANA Cloud, MySQL.
- DESIGN ENABLEMENT PACKS & UTILITIES for different Modeling templates and lifecycle patterns, Model Validation templates, Configurations for Metadata Imports, and Integrations with wider toolsets, including the Idera Data Fabric.
What’s New in WhereScape 3D?
Enhanced Discovery and Metadata Import
Import full lineage, transformation logic, and more
We have extended the metadata you can discover and import, improving WhereScape 3D’s ability to integrate with other tools and frameworks. Users can download a set of WhereScape RED metadata integration rules, bringing full bi-directional support between WhereScape 3D and WhereScape RED. Additionally, custom rules can be defined for ingesting metadata from external sources such as legacy ETL platforms or automation frameworks. This has already proven incredibly helpful in ‘lift-and-shift’ projects to move an existing Data Warehouse to a new target.
New Model Validation Templates and Workflow
Automate integrity tests on models as they are generated
Users can now validate models on-demand or as part of an automated workflow. This provides the opportunity to run automated checks on models to validate standards and soft rules during model-generation workflows. Automated validation tests can be executed, for example, when converting a logical/business model into a raw data vault and its staging model. This ensures that entity and attribute types are correctly set and data sources correctly mapped and ensures that your model conforms to all of your organization-specific rules.
Empowering Developers and Supporting Remote Working
Compare and merge templates and configurations + performance gains
This wave of performance improvements allows WhereScape 3D development teams to work together and compare and merge Model Conversion Rules, templates, scripts and configurations. Especially useful during software upgrades to easily compare changes in new releases with local forks/customer solutions. As part of our ongoing focus on performance and remote working, we have significantly reduced processing times for Displaying, Refreshing, Copying and Deleting Models.
You can check out the full updates in the WhereScape 3D 8.6.6 Release Notes.
Is Data Vault 2.0 Still Relevant?
TL;DR Yes. Data Vault 2.0 Design Principles Data Vault 2.0 is a database modeling method published in 2013. It was designed to overcome many of the shortcomings of data warehouses created using relational modeling (3NF) or star schemas (dimensional modeling)....
Data Vault Revisited: A Six-Year Journey into the Secure Data Repository
In 2017, Dr. Barry Devlin provided valuable insights about Data Vaults, a concept that sparked interest among businesses and IT professionals. Data Vaults were envisioned as secure repositories for core data assets, designed to provide easy access for business users....
Understanding Data Vault 2.0 and How to Avoid Pitfalls During Implementation
Implementing a data vault as your Data Modeling approach has many advantages, such as flexibility, scalability, and efficiency. But along with that, one must be aware of the challenges that come along with that. Data vault modeling leads to a significantly larger...
Navigating the AI Landscape: The Pivotal Role of Data Modeling
In the rapidly evolving digital age, artificial intelligence (AI) has emerged as a game-changer, deeply impacting the business landscape. Its ability to automate operations, refine decision-making processes, and significantly enhance customer experiences has proven...
Unlocking Your Business Potential: Understanding and Enhancing Information Management Maturity
Introduction: In a recent report by Gartner, they emphasize the crucial role of information in the current business environment, stating, "Through 2025, organizations that are data-driven will outperform their industry peers in profitability by an average of 8%." This...
Data Warehousing Best Practices
In modern times, organizations are daily generating huge volumes of data. Appreciating the significance of data, companies are storing data from different departments which can be analyzed to gather insights to help the organization in better decision-making. This...
Unlocking the Benefits of Auditability and Adaptability with Data Vault 2.0
Introduction Data management has become a crucial aspect of modern businesses as the data volume grows exponentially. Organizations must ensure that the data they collect, store, and use is reliable and trustworthy. Data Vault 2.0 provides a robust data warehousing...
WhereScape 3D 8.6.7 Release – June 2022
WhereScape provides design automation to some of the world’s largest and most complex data platforms. The latest release of WhereScape 3D further improves the User Interface (UI), the templating options, and delivers significant enhancements and value to the...
WhereScape STAR: Our New Tool for Easily Creating SQL Server Data Warehouses
Developing and operating a data warehouse or simply generating reports, dashboards and spreadsheets can become a challenge for a smaller organization with a staff of 1 or 2 (or part-time) or for larger organizations that do not have full IT support. For the...
WhereScape 3D 8.6.8 Release – October 2022
WhereScape provides design automation to some of the world’s largest and most complex data platforms. The latest release of WhereScape 3D further improves the User Interface (UI), the templating options, and delivers significant enhancements and value to the...
Related Content
Is Data Vault 2.0 Still Relevant?
TL;DR Yes. Data Vault 2.0 Design Principles Data Vault 2.0 is a database modeling method published in 2013. It was designed to overcome many of the shortcomings of data warehouses created using relational modeling (3NF) or star schemas (dimensional modeling)....
Data Vault Revisited: A Six-Year Journey into the Secure Data Repository
In 2017, Dr. Barry Devlin provided valuable insights about Data Vaults, a concept that sparked interest among businesses and IT professionals. Data Vaults were envisioned as secure repositories for core data assets, designed to provide easy access for business users....
Understanding Data Vault 2.0 and How to Avoid Pitfalls During Implementation
Implementing a data vault as your Data Modeling approach has many advantages, such as flexibility, scalability, and efficiency. But along with that, one must be aware of the challenges that come along with that. Data vault modeling leads to a significantly larger...
Is Data Vault 2.0 Still Relevant?
TL;DR Yes. Data Vault 2.0 Design Principles Data Vault 2.0 is a database modeling method published in 2013. It was designed to overcome many of the shortcomings of data warehouses created using relational modeling (3NF) or star schemas (dimensional modeling)....
Data Vault Revisited: A Six-Year Journey into the Secure Data Repository
In 2017, Dr. Barry Devlin provided valuable insights about Data Vaults, a concept that sparked interest among businesses and IT professionals. Data Vaults were envisioned as secure repositories for core data assets, designed to provide easy access for business users....
Understanding Data Vault 2.0 and How to Avoid Pitfalls During Implementation
Implementing a data vault as your Data Modeling approach has many advantages, such as flexibility, scalability, and efficiency. But along with that, one must be aware of the challenges that come along with that. Data vault modeling leads to a significantly larger...
Navigating the AI Landscape: The Pivotal Role of Data Modeling
In the rapidly evolving digital age, artificial intelligence (AI) has emerged as a game-changer, deeply impacting the business landscape. Its ability to automate operations, refine decision-making processes, and significantly enhance customer experiences has proven...