Iceberg Architecture
For heterogenous data sources and compute. An abstraction and middleware for data and formats.
Read More »
Low Code Automation Platforms: Appian, Pega, Outsystems
Appian Appian is a low-code platform built on the philosophy of “Total Experience.” Its primary strength lies in end-to-end process automation and …
Read More »
Data Lakehouse and the ‘Medallion’ Architecture
In order to manage data – migrations and operational updates – it has been necessary to take raw data and parse or process it, into both OLTP (on l…
Read More »
Agentic AI and Data Management
Generative AI has given rise to Agentic AI. While ChatGPT is primarily a chatbot that can generate text responses, AI agents can execute complex tasks autonomo…
Read More »
DataOps and ML Ops
The data (pre-)processing part of MLOps focuses on moving data from the source to ML model, without necessarily including how the model executes on the data it…
Read More »
S3 Tables and AI
Amazon S3 Tables provide S3 storage that’s optimized for analytics workloads, with features designed to continuously improve query performance and reduce stora…
Read More »
Changing historical data records
When migrating data to a new platform, for example from on premises to cloud, you should fix-forward, meaning, that any data record changes are of current, not…
Read More »
Data issues when integrating a SaaS with a CRM system
When integrating different systems, the data details are important to understand and mitigate. An example would be integrating an industry specific SaaS applic…
Read More »
AWS Glue and Databricks
AWS Glue and Databricks Unity Catalog are both data management tools, but they have some key differences in focus and functionality: AWS Glue Focus: ETL (Extra…
Read More »