『Deep Dive Into Data Engineering』のカバーアート

Deep Dive Into Data Engineering

Deep Dive Into Data Engineering

著者: Hessum
無料で聴く

Here we talk about data and the related technologies:1- The first season is about Fundamental of Data Engineering by Joe Reis, Matt Housley2- Different modules of a data pipeline architecture

Hosted on Acast. See acast.com/privacy for more information.

Hessum
エピソード
  • 13-How Databases Ingest Store and Retrieve Data
    2025/11/25
    Unlock the fundamental structure of modern databases! We break down how Database Management Systems (DBMS) are classified—from OLTP and OLAP systems to those optimized for time-series data. Learn the roles of the query optimizer and the storage engine in the client/server architecture, and understand the crucial differences between Memory- versus Disk-Based DBMS and row- and column-oriented data layouts. Finally, we explore the three core techniques shaping efficient storage structures: Buffering, Immutability, and Ordering.

    Hosted on Acast. See acast.com/privacy for more information.

    続きを読む 一部表示
    13 分
  • 12-Data Validation
    2024/11/04
    In this episode, we will deep dive into data validation and its principles. Also, some tools will be reviewed at the end.

    Hosted on Acast. See acast.com/privacy for more information.

    続きを読む 一部表示
    28 分
  • 11-The Future of Data Engineering
    2024/10/26
    This episode excerpt focuses on the future of data engineering, covering the emergence of a "live data stack" that will replace the current "modern data stack" and its associated technologies. The authors argue that data engineering is evolving from a focus on batch processing to real-time data ingestion and processing, driven by the increasing use of cloud-based services, the growth of streaming technologies, and the need for faster, more accurate insights. They predict that these changes will lead to the development of new tools and frameworks that simplify data engineering tasks for data scientists and engineers alike, and emphasize the importance of interoperability and the tight feedback loop between data applications and machine learning models. They also explore the impact of the rise of "enterprise data engineering", which focuses on building and maintaining data systems for businesses of all sizes.

    Hosted on Acast. See acast.com/privacy for more information.

    続きを読む 一部表示
    18 分
adbl_web_anon_alc_button_suppression_t1
まだレビューはありません