AWS Technology
AWS RDS summary
Amazon RDS (Relational Database Service) RDS is a managed relational database service that supports various database engines such as MySQL, PostgreSQL, Oracle,…
Read More »
DataAWS Redshift, a summary
Amazon Redshift Redshift is a fully managed data warehousing service designed for online analytical processing (OLAP) workloads. It is optimized for high-perfo…
Read More »
Cloud Design GoalsImproving data queries, pipelines
On real world projects and deployments, you hear the lament that a datawarehouse or data engine ‘does not work’. Query response times are slow, it …
Read More »
AWS TechnologyRelational, Document, Key Value Databases: summary, use cases
There are a wide variety of databases. With cloud and hybrid architectures often see the following: Relational DB A structured format with rows and columns, re…
Read More »
AWS TechnologyBatching and AWS S3 on prem to S3 cloud
A useful architecture to move data from on-premises to AWS is to consider using AWS S3 outputs and move data directly over a Direct Connect to S3 in AWS. This …
Read More »
DataAWS DataBase Migration Service Overview
AWS Database Migration Service or DMS is a mature process to move on premises data to the AWS cloud, including to a S3 Data Lake. It is not recommended that fi…
Read More »
DataData Platform Automation
The problems with Data Pipelines and the hydration of a Data Lake include: Data teams often end with technical debt surrounding CI/CD, IaS, observability, and …
Read More »
AgileDataLake and its Challenges
DataLake The entire concept of a Data Operations Platform rests on top of a Data Lake. There is no simple definition of a Data Lake, but based on the author’s …
Read More »
AgileData Operations + Agile
Data Operations ‘DataOps’ has been inspired by the Agile-premised ‘Development Operations’ model. The ‘DevOps’ model which usually includes security (DevSecOps…
Read More »