Data
Iceberg and Data Format open standards
Iceberg Cometh Open table formats, such as Apache Iceberg, enable scale-out data warehousing directly on a data lake. This architecture has become known as a d…
Read More »
AWS TechnologyData Lake Basics and AWS
A data lake is a centralized repository that allows a firm to store structured and unstructured data at any scale. You can store your data as-is, without havin…
Read More »
DataData Products, overview, summary
Traditional Data Product Management Federated data management and data product builds and sharing has little to do with traditional data product management. Tr…
Read More »
DataData Lake Architecture(s) overview
Data Lake Architecture Data lake architecture was introduced in 2010 in response to the challenges of data warehousing architecture in satisfying the new uses …
Read More »
AWS TechnologyAWS, Snowpipe, Snowflake
Moving data from S3 to Snowflake to satisfy use cases around analysis, corporate reporting, or cross-domain information collaboration is best achieved through …
Read More »
Cloud Design GoalsAWS S3 and Snowflake – use case summary
Both platforms are valid and will likely work together in larger enterprises. The tricky part is always access, entitlements and RBAC or TBAC. Across the 2 pla…
Read More »
DataAWS S3 vs Snowflake (use cases)
AWS S3-based Data Lakes and Snowflake are both powerful solutions for data storage and analysis, but they serve different use cases and operational needs. Belo…
Read More »
DataData Quality and Governance in AWS
If you are building a Data platform the first consideration should be around data quality, cleaning, traceability, ownership and reporting on quality. If the d…
Read More »
AWS TechnologyData Glossary, Dictionary, Catalogue
The Data Glossary focuses on business terminology and definitions, bridging the gap between business and IT. A data glossary is a document that defines and des…
Read More »
AWS TechnologyAWS Sagemaker vs Databricks
A comparison of AWS Sage Maker and Databricks. Both satisify different use cases. A key aspect is the principle of ‘cloud native’, meaning that if …
Read More »
Cloud Design GoalsTeradata to AWS and Snowflake
Snowflake and S3 Data Lake(s) provide a cloud native, scalable, cheaper, easier to use options when consolidating data within a corporation. Teradata is largel…
Read More »
DataData Architecture, an overview related to AI implementations
There are components to a Data Architecture, namely a Data Model, a Reference Architecture, and a Star Graph. A Data Architecture is the language and represent…
Read More »