Parquet file format for Data Lakes
Parquet is a file format standard used in many enterprises. It allows the standardisation of files and provides a common framework for queries and storage. Par…
Read More »
Data products – a summary
Data products are the end result of file or data movements to the cloud; ETL; processing; de-duplication; curation and storage in a consumable layer. There is …
Read More »
Understanding Data Lakes and Data Warehouses
In simple terms we can identify the differences between Data Lakes and Data Warehouses. Data Lake: A data lake is a centralized repository, usually a platform,…
Read More »
Digital and Data Transformation (Why)
Digital Transformation Digital transformation not a magic solution nor a buffet of word salads. DT is roughly defined as the integration of digital technologie…
Read More »
AWS S3 and Snowflake – use case summary
Both platforms are valid and will likely work together in larger enterprises. The tricky part is always access, entitlements and RBAC or TBAC. Across the 2 pla…
Read More »
AWS Sagemaker vs Databricks
A comparison of AWS Sage Maker and Databricks. Both satisify different use cases. A key aspect is the principle of ‘cloud native’, meaning that if …
Read More »
Teradata to AWS and Snowflake
Snowflake and S3 Data Lake(s) provide a cloud native, scalable, cheaper, easier to use options when consolidating data within a corporation. Teradata is largel…
Read More »
SOAP vs REST APIs – use cases, differences, impacts on architecture
What is the difference between SOAP and REST? SOAP and REST are two internet data exchange mechanisms. For example, imagine that your internal accounts system …
Read More »
Cost Optimisation Techniques in AWS
AWS cost optimisation is not merely a financial exercise; it is a strategic imperative that demands a meticulous approach to extract maximum value from cloud i…
Read More »