Code

Microbatch Strategy#1108

Code

Merged

MichelleArk merged 14 commits intomaindbt-labs/dbt-spark:mainfrom microbatch-strategydbt-labs/dbt-spark:microbatch-strategyCopy head branch name to clipboardSep 25, 2024

+43-4

Commits

Commits on Sep 19, 2024

• first pass: microbatch

  MichelleArk

  committed
  0b8f111

  Copy full SHA for 0b8f111

Commits on Sep 23, 2024

• make microbatch valid strategy

  MichelleArk

  committed
  82d98de

  Copy full SHA for 82d98de

• Merge branch 'main' into microbatch-strategy

  MichelleArk

  authored
  41acea7

  Copy full SHA for 41acea7

Commits on Sep 24, 2024

• skip microbatch testing on profiles that don't support insert_overwrite

  MichelleArk

  committed
  8da7bda

  Copy full SHA for 8da7bda

• set overwrite mode for microbatch

  MichelleArk

  committed
  1f0d48d

  Copy full SHA for 1f0d48d

• add begin config + create date_day

  MichelleArk

  committed
  5501549

  Copy full SHA for 5501549

• temporarily run only microbatch tests in CI

  MichelleArk

  committed
  0231ec7

  Copy full SHA for 0231ec7

• partition_by date_day in microbatch model

  MichelleArk

  committed
  3c30100

  Copy full SHA for 3c30100

• test using parquet

  MichelleArk

  committed
  287531c

  Copy full SHA for 287531c

• partition_by required for dbt-spark microbatch

  MichelleArk

  committed
  835cb47

  Copy full SHA for 835cb47

Commits on Sep 25, 2024

• changelog entry

  MichelleArk

  committed
  846eb3f

  Copy full SHA for 846eb3f

• improve partition_by missing error message

  MichelleArk

  committed
  3a9d7ce

  Copy full SHA for 3a9d7ce

• restore testing setup

  MichelleArk

  committed
  07544fe

  Copy full SHA for 07544fe

• Update .changes/unreleased/Features-20240925-125242.yaml

  Show description for 4ad1bc6
  

  MichelleArk

  and

  colin-rogers-dbt

  authored
  4ad1bc6

  Copy full SHA for 4ad1bc6