エピソード

  • 13-How Databases Ingest Store and Retrieve Data

    13-How Databases Ingest Store and Retrieve Data
    2025/11/25
    Unlock the fundamental structure of modern databases! We break down how Database Management Systems (DBMS) are classified—from OLTP and OLAP systems to those optimized for time-series data. Learn the roles of the query optimizer and the storage engine in the client/server architecture, and understand the crucial differences between Memory- versus Disk-Based DBMS and row- and column-oriented data layouts. Finally, we explore the three core techniques shaping efficient storage structures: Buffering, Immutability, and Ordering.

    Hosted on Acast. See acast.com/privacy for more information.
    続きを読む 一部表示
    13 分
  • 12-Data Validation

    12-Data Validation
    2024/11/04
    In this episode, we will deep dive into data validation and its principles. Also, some tools will be reviewed at the end.

    Hosted on Acast. See acast.com/privacy for more information.
    続きを読む 一部表示
    28 分
  • 11-The Future of Data Engineering

    11-The Future of Data Engineering
    2024/10/26
    This episode excerpt focuses on the future of data engineering, covering the emergence of a "live data stack" that will replace the current "modern data stack" and its associated technologies. The authors argue that data engineering is evolving from a focus on batch processing to real-time data ingestion and processing, driven by the increasing use of cloud-based services, the growth of streaming technologies, and the need for faster, more accurate insights. They predict that these changes will lead to the development of new tools and frameworks that simplify data engineering tasks for data scientists and engineers alike, and emphasize the importance of interoperability and the tight feedback loop between data applications and machine learning models. They also explore the impact of the rise of "enterprise data engineering", which focuses on building and maintaining data systems for businesses of all sizes.

    Hosted on Acast. See acast.com/privacy for more information.
    続きを読む 一部表示
    18 分
  • 10-Security and Privacy

    10-Security and Privacy
    2024/10/26
    Security is a key ingredient for privacy

    Hosted on Acast. See acast.com/privacy for more information.
    続きを読む 一部表示
    23 分
  • 09-Serving Data for Analytics, Machine Learning, and Reverse ETL

    09-Serving Data for Analytics, Machine Learning, and Reverse ETL
    2024/10/26
    Various ways to serve data for major use cases

    Hosted on Acast. See acast.com/privacy for more information.
    続きを読む 一部表示
    34 分
  • 08-Queries, Modeling, and Transformation

    08-Queries, Modeling, and Transformation
    2024/10/26
    How to make data useful

    Hosted on Acast. See acast.com/privacy for more information.
    続きを読む 一部表示
    49 分
  • 07-Ingestion

    07-Ingestion
    2024/10/26
    Ingestion

    Hosted on Acast. See acast.com/privacy for more information.
    続きを読む 一部表示
    31 分
  • 06-Storage

    06-Storage
    2024/10/26
    Storage is the cornerstone of the data engineering lifecycle

    Hosted on Acast. See acast.com/privacy for more information.
    続きを読む 一部表示
    21 分