List: Data engineering - Storage | Curated by Xavier Escudero | Medium

Xavier Escudero

Jan 17, 2024

7 stories

Data engineering - Storage

Mohammad Aftab

A Comprehensive Guide to File Formats in Data Engineering:

Understanding the Pros and Cons of using CSV, JSON, Parquet, Avro, and ORC file format in Data Engineering.

Dec 15, 2023

Photo by Mika Baumeister on Unsplash

Dec 15, 2023

Neeraj Kushwaha

Deep Dive into Apache Parquet: Efficient Data Storage for Analytics

In today’s digital age, the amount of data being generated is growing at an unprecedented rate. This explosion of data has given rise to…

Aug 27, 2023

Deep Dive into Apache Parquet: Efficient Data Storage for Analytics

Aug 27, 2023

Ankush Singh

Comparing Data Storage: Parquet vs. Arrow

Data storage formats have significant implications on how quickly and efficiently we can extract and process data. In today’s blog, we’re…

Jun 11, 2023

Comparing Data Storage: Parquet vs. Arrow

Jun 11, 2023

ah

Loading Parquet in PostgreSQL via DuckDB: Testing queries and exploring the Core

In the realm of data management and analytics, PostgreSQL has long been a popular choice as an open-source relational database management…

Nov 5, 2023

Loading Parquet in PostgreSQL via DuckDB: Testing queries and exploring the Core

Nov 5, 2023

In

TDS Archive

by

Alon Agmon

Boost Your Cloud Data Applications with DuckDB and Iceberg API

Use Iceberg API with DuckDB to optimize analytics queries on massive Iceberg tables in your cloud storage

Dec 23, 2022

Boost Your Cloud Data Applications with DuckDB and Iceberg API

Dec 23, 2022

Dipankar Mazumdar

Building a Streamlit app on a Lakehouse using Apache Iceberg & DuckDB

Developing full-stack data applications can be a massive overhead for data scientists or analysts who would need to spend a considerable…

Apr 25, 2023

Building a Streamlit app on a Lakehouse using Apache Iceberg & DuckDB

Apr 25, 2023

In

Better Programming

by

Marin Aglić

Learning Apache Iceberg — Storing the Catalog to Postgres

An interesting experiment to see how Apache Iceberg organised the table data and metadata under the hood

May 17, 2023

Learning Apache Iceberg — Storing the Catalog to Postgres

May 17, 2023

Xavier Escudero
658 Followers
Innovation enthusiast, passionate about automation in several fields, like software testing and trading bots
Following
DataDrivenInvestor
Data Science Collective
Kevin Meneses González
Unicorn Day
Investor’s Handbook
See all (171)

Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams