AWS Technology
Standard Technology Stack for an AWS based Data Lake
A typical Technology Stack for a Data Lake. S3 as the Golden Source. Snowflake as a corporate Data Share with SQL use cases. If AWS-S3 and Redshift are not pro…
Read More »
DataImproving Redshift Data Warehouse performance
(ETL engine in the above could be AWS Glue) There are various ways to define performance and what that means. A simple way to be consistent with management is …
Read More »
DataIceberg and Data Format open standards
Iceberg Cometh Open table formats, such as Apache Iceberg, enable scale-out data warehousing directly on a data lake. This architecture has become known as a d…
Read More »
DataData Products, overview, summary
Traditional Data Product Management Federated data management and data product builds and sharing has little to do with traditional data product management. Tr…
Read More »
AWS TechnologyAWS, Snowpipe, Snowflake
Moving data from S3 to Snowflake to satisfy use cases around analysis, corporate reporting, or cross-domain information collaboration is best achieved through …
Read More »
DataData Quality and Governance in AWS
If you are building a Data platform the first consideration should be around data quality, cleaning, traceability, ownership and reporting on quality. If the d…
Read More »
DataData Architecture, an overview related to AI implementations
There are components to a Data Architecture, namely a Data Model, a Reference Architecture, and a Star Graph. A Data Architecture is the language and represent…
Read More »
DataData Strategy Framework, leading to a POC, MVP and implementation.
Data Strategy framework to implementation.
Read More »
Application TransformationSOAP vs REST APIs – use cases, differences, impacts on architecture
What is the difference between SOAP and REST? SOAP and REST are two internet data exchange mechanisms. For example, imagine that your internal accounts system …
Read More »