Code

Add table upsert support#1660

Code

Merged

Fokko merged 59 commits intoapache:mainapache/iceberg-python:mainfrom kevinjqliu:StateFarmIns/mainkevinjqliu/iceberg-python:StateFarmIns/mainCopy head branch name to clipboardFeb 13, 2025

+539-7

Commits

Commits on Jan 14, 2025

• test

  mattmartin14

  committed
  fccb74b

  Copy full SHA for fccb74b

• unit testing

  mattmartin14

  committed
  7298589

  Copy full SHA for 7298589

• adding unit tests

  mattmartin14

  committed
  25bc9cf

  Copy full SHA for 25bc9cf

• adding unit tests

  mattmartin14

  committed
  af6c868

  Copy full SHA for af6c868

• adding unit tests

  mattmartin14

  committed
  94be807

  Copy full SHA for 94be807

Commits on Jan 15, 2025

• adding unit tests

  mattmartin14

  committed
  269d9f5

  Copy full SHA for 269d9f5

• adding unit tests

  mattmartin14

  committed
  f44c61a

  Copy full SHA for f44c61a

Commits on Jan 16, 2025

• finished unit tests

  mattmartin14

  committed
  a96fdf9

  Copy full SHA for a96fdf9

• removed unnecesary return

  mattmartin14

  committed
  fa5ab35

  Copy full SHA for fa5ab35

Commits on Jan 17, 2025

• updated poetry manifest list for datafusion package dependency

  mattmartin14

  committed
  cfa2277

  Copy full SHA for cfa2277

Commits on Jan 22, 2025

• added license headers, cleaned up dead code

  mattmartin14

  committed
  35f29be

  Copy full SHA for 35f29be

Commits on Jan 29, 2025

• updated the merge function to use bools for matched and not matched rows

  mattmartin14

  committed
  6c68d0d

  Copy full SHA for 6c68d0d

Commits on Jan 31, 2025

• incorporated changes for boolExpression. It simplified the filters a lot

  mattmartin14

  committed
  2d1e8ae

  Copy full SHA for 2d1e8ae

• moved the filter build function to a separate function to accomodate what actually needs to get updated

  mattmartin14

  committed
  f988f25

  Copy full SHA for f988f25

• removed unneccessary comment

  mattmartin14

  committed
  43393b4

  Copy full SHA for 43393b4

• removed test files

  mattmartin14

  committed
  9a561b4

  Copy full SHA for 9a561b4

Commits on Feb 3, 2025

• bug fixes and removed some more dependency on datafusion

  mattmartin14

  committed
  9ef39a6

  Copy full SHA for 9ef39a6

Commits on Feb 4, 2025

• updated various items including adding a dataclass return result

  mattmartin14

  committed
  2ba1ed6

  Copy full SHA for 2ba1ed6

• updated merge_rows to remove dependency from datafusion! wahoo

  mattmartin14

  committed
  a42eecd

  Copy full SHA for a42eecd

Commits on Feb 5, 2025

• renamed merge_rows to upsert, removed unnecessary code. will put in final tweaks to test code soon to paramaterize for pytests

  mattmartin14

  committed
  1305f58

  Copy full SHA for 1305f58

• adding params to unit testing for pytest; having some errors

  mattmartin14

  committed
  b2be3db

  Copy full SHA for b2be3db

• fixed bugs on unit testing; added context wrapper for txn; fixed various items

  mattmartin14

  committed
  f5688ad

  Copy full SHA for f5688ad

Commits on Feb 6, 2025

• bug fixes

  mattmartin14

  committed
  7d55a4e

  Copy full SHA for 7d55a4e

• updated some error throwing items

  mattmartin14

  committed
  2e14767

  Copy full SHA for 2e14767

• moved datafusion to just a dev dependency in poetry toml

  mattmartin14

  committed
  85c5848

  Copy full SHA for 85c5848

• updated UpsertRow class to be recognized in the return statement

  mattmartin14

  committed
  6472071

  Copy full SHA for 6472071

• removed some spaces and streamlined assert statements in unit testing

  mattmartin14

  committed
  51c34da

  Copy full SHA for 51c34da

Commits on Feb 7, 2025

• updated test cases to use an InMemory catalog

  mattmartin14

  committed
  862a69a

  Copy full SHA for 862a69a

• updated some formatting; added more commentary on the rows_to_update section

  mattmartin14

  committed
  3731b86

  Copy full SHA for 3731b86

Commits on Feb 10, 2025

• rebased poetry lock file and pyproject.toml file; removed sf repo info

  mattmartin14

  committed
  bbb35d6

  Copy full SHA for bbb35d6

• Merge branch 'main' into main

  mattmartin14

  authored
  c8189c9

  Copy full SHA for c8189c9

• updated equality checks with not instead of == false

  mattmartin14

  committed
  02af4d4

  Copy full SHA for 02af4d4

• ran ruff check --fix

  mattmartin14

  committed
  cc75192

  Copy full SHA for cc75192

Commits on Feb 11, 2025

• manually added lint fixes and updated poetry toml and lock files. thank you kevin

  mattmartin14

  committed
  998d98b

  Copy full SHA for 998d98b

• added formatting fices

  mattmartin14

  committed
  513c839

  Copy full SHA for 513c839

• remove the node_modules

  mattmartin14

  committed
  0fd6446

  Copy full SHA for 0fd6446

• updated code for another round of fixes

  mattmartin14

  committed
  5fc3478

  Copy full SHA for 5fc3478

• removed npm uneeded files

  mattmartin14

  committed
  6cef789

  Copy full SHA for 6cef789

Commits on Feb 12, 2025

• fixed formatting on upsert function for docs build

  mattmartin14

  committed
  40b69b8

  Copy full SHA for 40b69b8

• Merge branch 'main' into main

  mattmartin14

  authored
  804c526

  Copy full SHA for 804c526

• rebased for poetry lock files

  mattmartin14

  committed
  09e0347

  Copy full SHA for 09e0347

• updated lock files. thanks kevin

  mattmartin14

  committed
  ca2d904

  Copy full SHA for ca2d904

• fixed other changes

  mattmartin14

  committed
  77375fb

  Copy full SHA for 77375fb

• fixed gitignore file

  mattmartin14

  committed
  ba4db49

  Copy full SHA for ba4db49

• no whitespace

  mattmartin14

  committed
  622e66c

  Copy full SHA for 622e66c

• fixed vendor fb file from kevins changes

  mattmartin14

  committed
  9e79dad

  Copy full SHA for 9e79dad

• reverting vendor changes

  mattmartin14

  committed
  4cbf3e3

  Copy full SHA for 4cbf3e3

• removing node modules

  mattmartin14

  committed
  5333a1e

  Copy full SHA for 5333a1e

• updating vendor files

  mattmartin14

  committed
  11a25be

  Copy full SHA for 11a25be

• Update vendor/fb303/FacebookService.py

  Show description for 03a8d10
  

  mattmartin14

  and

  Fokko

  authored
  03a8d10

  Copy full SHA for 03a8d10

• updated vendor files

  mattmartin14

  committed
  8a2143c

  Copy full SHA for 8a2143c

• updated vendor files

  mattmartin14

  committed
  e719cf8

  Copy full SHA for e719cf8

• attempting to update poetry files

  mattmartin14

  committed
  245b4a9

  Copy full SHA for 245b4a9

• Merge branch 'main' into main

  mattmartin14

  authored
  e3e9611

  Copy full SHA for e3e9611

Commits on Feb 13, 2025

• restore vendor/

  kevinjqliu

  committed
  e575b3c

  Copy full SHA for e575b3c

• resetore pyproject.toml

  kevinjqliu

  committed
  e4e530f

  Copy full SHA for e4e530f

• poetry lock

  kevinjqliu

  committed
  2ff2083

  Copy full SHA for 2ff2083

• add datafusion to tool.mypy.overrides

  kevinjqliu

  committed
  8585d2d

  Copy full SHA for 8585d2d

• Merge remote-tracking branch 'apache/main' into StateFarmIns/main

  kevinjqliu

  committed
  f673b70

  Copy full SHA for f673b70