
Iceberg Architecture
For heterogenous data sources and compute. An abstraction and middleware for data and formats.
Read More »

For heterogenous data sources and compute. An abstraction and middleware for data and formats.
Read More »
The data (pre-)processing part of MLOps focuses on moving data from the source to ML model, without necessarily including how the model executes on the data it…
Read More »
Amazon S3 Tables provide S3 storage that’s optimized for analytics workloads, with features designed to continuously improve query performance and reduce stora…
Read More »
AWS Glue and Databricks Unity Catalog are both data management tools, but they have some key differences in focus and functionality: AWS Glue Focus: ETL (Extra…
Read More »
A SaaS platform for CRM and SFA in the wholesale/distribution industry, deployed in AWS, typically involves several key technical components. These components …
Read More »
AWS Glue can serve a wide array of data engineering use cases. Loading Data To The Data Warehouse: One of Glue’s earliest and most popular use cases is loading…
Read More »
AWS Glue was designed based on these principles: Provide customers the ability to solve problems when the system can not satisfy their needs. Examples include …
Read More »
Migrating ‘ Big Data’ pipelines and data processes to AWS will allow organizations to: Scale Seamlessly: AWS services like EMR (to replace Hadoop),…
Read More »
Example project deployment at a Financial Institution. Creation of a Data Lake with a streaming/real time data ingestion requirement. AWS Data Architecture Des…
Read More »