Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature/add transformation runs #141

Merged
merged 63 commits into from
Jan 22, 2025
Merged
Changes from 1 commit
Commits
Show all changes
63 commits
Select commit Hold shift + click to select a range
fe37e04
add transformation_runs staging
fivetran-reneeli Dec 17, 2024
740b493
add seed
fivetran-reneeli Dec 17, 2024
1c536fc
fix name to platform and use most current staging template
fivetran-reneeli Dec 17, 2024
741a9bc
correct useage to usage
fivetran-reneeli Dec 17, 2024
ca1a85f
add transformation runs downstream, doc updates
fivetran-reneeli Dec 17, 2024
0132c30
docs
fivetran-reneeli Dec 17, 2024
f179557
changelog and versioning
fivetran-reneeli Dec 17, 2024
77a6dae
Merge branch 'main' into feature/add_transformation_runs
fivetran-reneeli Dec 19, 2024
008abb4
up version to v1.11.0, add docs
fivetran-reneeli Dec 19, 2024
83c76a1
derive measured month in staging and remove from downstream
fivetran-reneeli Dec 19, 2024
09a6ae5
docs
fivetran-reneeli Dec 19, 2024
9066d57
try new schema
fivetran-reneeli Dec 20, 2024
9a64100
add run count test, move the date cast upstream and rm the source rel…
fivetran-reneeli Jan 4, 2025
2487556
Update models/staging/src_fivetran_platform.yml
fivetran-reneeli Jan 4, 2025
13bffa5
Update models/staging/src_fivetran_platform.yml
fivetran-reneeli Jan 4, 2025
1aeec5f
Update models/staging/stg_fivetran_platform__transformation_runs.sql
fivetran-reneeli Jan 4, 2025
1e665d9
Update CHANGELOG.md
fivetran-reneeli Jan 4, 2025
5e1350e
Update models/staging/stg_fivetran_platform.yml
fivetran-reneeli Jan 4, 2025
875679e
Update models/staging/stg_fivetran_platform.yml
fivetran-reneeli Jan 4, 2025
c390c8f
Update models/staging/stg_fivetran_platform__transformation_runs.sql
fivetran-reneeli Jan 4, 2025
4979d60
Update models/staging/stg_fivetran_platform.yml
fivetran-reneeli Jan 4, 2025
1b1aee6
update schema, changelog, and add unique test
fivetran-reneeli Jan 4, 2025
30338cf
rm extra date cast
fivetran-reneeli Jan 4, 2025
1a5ec7b
try new schema for databricks
fivetran-reneeli Jan 4, 2025
b21a322
update schema for databricks sql in run script
fivetran-reneeli Jan 6, 2025
5c82182
add using_transformations variable to models
fivetran-reneeli Jan 8, 2025
7516e1a
add true test to run script for using_transformations
fivetran-reneeli Jan 8, 2025
e3e62ed
add using_transformations to quickstart
fivetran-reneeli Jan 8, 2025
c3be6df
add config to src
fivetran-reneeli Jan 8, 2025
8deed94
add commented out var for using_transformations for docs gen
fivetran-reneeli Jan 8, 2025
3849f8a
schema and update readme
fivetran-reneeli Jan 9, 2025
2c2fa6d
changelog
fivetran-reneeli Jan 9, 2025
5a0fa12
try schema again
fivetran-reneeli Jan 9, 2025
40bd14a
switch to using does table exist for transformation runs
fivetran-reneeli Jan 10, 2025
bc648d8
update docs and configs for the new logic for transformation_runs
fivetran-reneeli Jan 10, 2025
c42d41f
rm transformation_runs var from quickstart file, update run script to…
fivetran-reneeli Jan 10, 2025
1709106
schema
fivetran-reneeli Jan 10, 2025
27931d2
docs
fivetran-reneeli Jan 10, 2025
00587b5
updates to changelog
fivetran-reneeli Jan 10, 2025
10775d9
add freshness null
fivetran-reneeli Jan 14, 2025
5e25ebe
revert join case for usage cte
fivetran-reneeli Jan 14, 2025
f16db58
update some documentation
fivetran-reneeli Jan 14, 2025
b495f78
docs
fivetran-reneeli Jan 14, 2025
adc741c
Update DECISIONLOG.md
fivetran-reneeli Jan 16, 2025
315ac86
doc updates
fivetran-reneeli Jan 16, 2025
c148487
add false config for transformation runs
fivetran-reneeli Jan 16, 2025
ca007f3
schema
fivetran-reneeli Jan 16, 2025
b352519
databricks
fivetran-reneeli Jan 16, 2025
4827893
Merge branch 'main' into feature/add_transformation_runs
fivetran-reneeli Jan 21, 2025
a052a13
changelog
fivetran-reneeli Jan 22, 2025
0b2d46a
Update models/fivetran_platform__usage_mar_destination_history.sql
fivetran-reneeli Jan 22, 2025
b896ad0
Update models/staging/src_fivetran_platform.yml
fivetran-reneeli Jan 22, 2025
e6bfd21
add redshift limit 1
fivetran-reneeli Jan 22, 2025
6936d29
add documentation
fivetran-reneeli Jan 22, 2025
6aa7939
Merge branch 'feature/add_transformation_runs' of https://github.com/…
fivetran-reneeli Jan 22, 2025
15a55f3
merge
fivetran-reneeli Jan 22, 2025
2589cbe
changelog updates
fivetran-reneeli Jan 22, 2025
0cc1669
schema
fivetran-reneeli Jan 22, 2025
402758c
databricks schema change
fivetran-reneeli Jan 22, 2025
6334ff5
Update CHANGELOG.md
fivetran-reneeli Jan 22, 2025
9f095e8
Update models/staging/src_fivetran_platform.yml
fivetran-reneeli Jan 22, 2025
1865693
schema
fivetran-reneeli Jan 22, 2025
6471698
Merge branch 'feature/add_transformation_runs' of https://github.com/…
fivetran-reneeli Jan 22, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Update models/staging/stg_fivetran_platform.yml
Co-authored-by: Jamie Rodriguez <[email protected]>
fivetran-reneeli and fivetran-jamie authored Jan 4, 2025
commit 5e1350e6fbdcd17be3cec6e8d396f4f8915897dd
2 changes: 1 addition & 1 deletion models/staging/stg_fivetran_platform.yml
Original file line number Diff line number Diff line change
@@ -199,7 +199,7 @@ models:
- name: measured_date
description: The date in UTC format of when models were run.
- name: measured_month
description: The month (yyyy-mm) of the usage activity.
description: The month (yyyy-mm) of the transformation activity.
- name: project_type
description: The type of transformation project that was run (ie DBT_CORE, QUICKSTART).
- name: free_type