Code

Pull request made in error, sorry!#1134

Code

Closed

LoudCloudCrowd wants to merge 56 commits intodbt-labs:maindbt-labs/dbt-spark:mainfrom CybercentreCanada:feature/custom-python-model-locationCybercentreCanada/dbt-spark:feature/custom-python-model-locationCopy head branch name to clipboard

+877-147

Commits

Commits on Nov 19, 2022

• Adding in additional support for iceberg v2 tables

  Show description for 9d88e83
  

  dparent1

  authored and

  cccs-jc

  committed
  9d88e83

  Copy full SHA for 9d88e83

• Setting _schema rather than replacing it

  Show description for 3d6d5bd
  

  dparent1

  authored and

  cccs-jc

  committed
  3d6d5bd

  Copy full SHA for 3d6d5bd

• Renaming macro and method name

  Show description for b3bc8a4
  

  dparent1

  authored and

  cccs-jc

  committed
  b3bc8a4

  Copy full SHA for b3bc8a4

• Adding changelog entry.

  

  dparent1

  authored and

  cccs-jc

  committed
  cb3a1a7

  Copy full SHA for cb3a1a7

• Removing the is_iceberg check it is not needed

  Show description for b8d3aa0
  

  dparent1

  authored and

  cccs-jc

  committed
  b8d3aa0

  Copy full SHA for b8d3aa0

• added iceberg test cases

  

  cccs-jc

  committed
  fab6c96

  Copy full SHA for fab6c96

• re-added Dan's fix taken out in rebase operation

  

  cccs-jc

  committed
  7a764ca

  Copy full SHA for 7a764ca

Commits on Nov 20, 2022

• added tblproperties support and test

  

  cccs-jc

  committed
  67e71d4

  Copy full SHA for 67e71d4

• iceberg tblproperties test

  

  cccs-jc

  committed
  028890f

  Copy full SHA for 028890f

• _make_relation instead of calling adapter directly

  

  cccs-jc

  committed
  973191f

  Copy full SHA for 973191f

• hook to create session and register python UDF

  

  cccs-jc

  committed
  2067c94

  Copy full SHA for 2067c94

Commits on Nov 21, 2022

• support for custom pyspark views

  

  cccs-jc

  committed
  6308ae0

  Copy full SHA for 6308ae0

• depend on dbt-core 1.3.0 for now

  

  cccs-jc

  committed
  2464ccb

  Copy full SHA for 2464ccb

• initial pipeline

  cccs-nik

  committed
  f322c03

  Copy full SHA for f322c03

• shell script not python

  cccs-nik

  committed
  3b6d626

  Copy full SHA for 3b6d626

• pip install correct pkgs

  cccs-nik

  committed
  e7df002

  Copy full SHA for e7df002

• adding missing display names

  cccs-nik

  committed
  4354db7

  Copy full SHA for 4354db7

Commits on Nov 22, 2022

• publishing to nexus

  cccs-nik

  committed
  5fbb168

  Copy full SHA for 5fbb168

• cauldron pool

  cccs-nik

  committed
  ffea5dd

  Copy full SHA for ffea5dd

• python 3.8

  cccs-nik

  committed
  3981eaf

  Copy full SHA for 3981eaf

• python for second job

  cccs-nik

  committed
  cc96981

  Copy full SHA for cc96981

Commits on Nov 25, 2022

• bug fix

  

  cccs-jc

  committed
  2588982

  Copy full SHA for 2588982

• bumped version

  

  cccs-jc

  committed
  9d348e3

  Copy full SHA for 9d348e3

• remove check for multiple database

  

  cccs-jc

  committed
  0207f0c

  Copy full SHA for 0207f0c

• Merge pull request #8 from dparent1/feature/pipeline

  Show description for 6a0ae71
  cccs-jc

  authored
  6a0ae71

  Copy full SHA for 6a0ae71

Commits on Jan 11, 2023

• added missing iceberg check

  

  cccs-jc

  committed
  1abbb28

  Copy full SHA for 1abbb28

• bumped version

  

  cccs-jc

  committed
  26908e0

  Copy full SHA for 26908e0

• Merge pull request dbt-labs#13 from dparent1/feature/pipeline

  Show description for 804ab03
  cccs-jc

  authored
  804ab03

  Copy full SHA for 804ab03

Commits on Jan 20, 2023

• Fix for datahub recipe

  Show description for 3b62715
  

  cccs-jc

  committed
  3b62715

  Copy full SHA for 3b62715

• Merge pull request dbt-labs#14 from dparent1/feature/pipeline

  Show description for 999d3d0
  cccs-jc

  authored
  999d3d0

  Copy full SHA for 999d3d0

Commits on Jan 30, 2023

• temporary fix for iceberg table discovery

  Show description for f432695
  

  cccs-jc

  committed
  f432695

  Copy full SHA for f432695

• Merge pull request dbt-labs#15 from dparent1/feature/pipeline

  Show description for 64c78a4
  cccs-jc

  authored
  64c78a4

  Copy full SHA for 64c78a4

Commits on May 18, 2023

• snapshot changes (dbt-labs#26)

  cccs-nik

  authored
  df25656

  Copy full SHA for df25656

Commits on Jun 12, 2024

• Port over Yuyu's changes from 1.6.0 to 1.3.0

  cccs-seb

  committed
  1c3d63b

  Copy full SHA for 1c3d63b

• Use dbt-spark-cccs and stick to 1.3.0, but add build number for subsequent versions

  cccs-seb

  committed
  6a648d7

  Copy full SHA for 6a648d7

• Changes to work with new buildpool

  cccs-seb

  committed
  a5898ec

  Copy full SHA for a5898ec

• Attempt to fix missing Python command

  cccs-seb

  committed
  fe6ed4e

  Copy full SHA for fe6ed4e

• Update dev-requirements to point to correct dbt-core verson

  cccs-seb

  committed
  28b1275

  Copy full SHA for 28b1275

• Bad venv directory

  cccs-seb

  committed
  d12e189

  Copy full SHA for d12e189

• Update python_submissions.py

  LoudCloudCrowd

  authored
  ff77f35

  Copy full SHA for ff77f35

Commits on Jun 13, 2024

• Missing lib

  cccs-seb

  committed
  e27e95d

  Copy full SHA for e27e95d

• Missing bz2, plaster it everywhere to see if it works

  cccs-seb

  committed
  ab7aed6

  Copy full SHA for ab7aed6

• Can't read, removing deps and updating build agent

  cccs-seb

  committed
  df2207a

  Copy full SHA for df2207a

Commits on Jun 19, 2024

• Versioning changes until we move to 1.6.0 or higher

  cccs-seb

  committed
  db90b1e

  Copy full SHA for db90b1e

• Missing pyspark requirement

  cccs-seb

  committed
  3e72f75

  Copy full SHA for 3e72f75

• Merge pull request #5 from CybercentreCanada/cccs/1.3.0-change-pipeline

  Show description for 09b71b7
  cccs-seb

  authored
  09b71b7

  Copy full SHA for 09b71b7

Commits on Jul 11, 2024

• Add model_config to python model submit locals + explicitly use iceberg in writes

  cccs-seb

  committed
  8f0c2a3

  Copy full SHA for 8f0c2a3

Commits on Jul 19, 2024

• Merge pull request #4 from CybercentreCanada/cccs/1.3.0-python-models-yuyu

  Show description for f0b9911
  cccs-seb

  authored
  f0b9911

  Copy full SHA for f0b9911

Commits on Jul 30, 2024

• 1.4.7

  cccs-seb

  committed
  eda284d

  Copy full SHA for eda284d

Commits on Aug 21, 2024

• Removes v1 table operations and allows throwing of exception when catalog return is bad

  LoudCloudCrowd

  committed
  c4679e7

  Copy full SHA for c4679e7

Commits on Aug 22, 2024

• 1.4.8 branch

  cccs-seb

  committed
  a49dd6c

  Copy full SHA for a49dd6c

• Merge pull request #6 from LoudCloudCrowd/fix/adapter-handle-rest-outage

  Show description for 215ed92
  cccs-seb

  authored
  215ed92

  Copy full SHA for 215ed92

Commits on Aug 27, 2024

• Merge pull request #7 from CybercentreCanada/cccs/1.4.8

  Show description for beac3a0
  cccs-seb

  authored
  beac3a0

  Copy full SHA for beac3a0

• Cccs/main setuptools bugfix (#8)

  Show description for 48bd31e
  cccs-seb

  authored
  48bd31e

  Copy full SHA for 48bd31e

Commits on Oct 18, 2024

• Bump to 1.4.9 (#10)

  Show description for b0113bd
  

  cccs-seb

  and

  LoudCloudCrowd

  authored
  b0113bd

  Copy full SHA for b0113bd

Commits on Oct 31, 2024

• Implements ability to propagate the location_clause() to dbt python models

  LoudCloudCrowd

  committed
  c16084c

  Copy full SHA for c16084c