Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

An 5714/traces2 hotswap polygon #414

Merged
merged 7 commits into from
Jan 29, 2025
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
46 changes: 0 additions & 46 deletions .github/workflows/dbt_run_overflowed_traces2.yml

This file was deleted.

50 changes: 0 additions & 50 deletions .github/workflows/dbt_run_traces_fix.yml

This file was deleted.

60 changes: 36 additions & 24 deletions models/bronze/overflow/bronze__potential_overflowed_traces.sql
Original file line number Diff line number Diff line change
Expand Up @@ -6,50 +6,62 @@
WITH impacted_blocks AS (

SELECT
VALUE :: INT AS block_number
blocks_impacted_array
FROM
(
SELECT
blocks_impacted_array
FROM
{{ ref("silver_observability__traces_completeness") }}
ORDER BY
test_timestamp DESC
LIMIT
1
), LATERAL FLATTEN (
{{ ref("silver_observability__traces_completeness") }}
ORDER BY
test_timestamp DESC
LIMIT
1
), all_missing AS (
SELECT
DISTINCT VALUE :: INT AS block_number
FROM
impacted_blocks,
LATERAL FLATTEN (
input => blocks_impacted_array
)
),
all_txs AS (
SELECT
t.block_number,
t.position,
t.tx_hash
block_number,
POSITION AS tx_position,
tx_hash
FROM
{{ ref("silver__transactions") }}
t
JOIN impacted_blocks USING (block_number)
JOIN all_missing USING (block_number)
),
missing_txs AS (
SELECT
DISTINCT block_number,
POSITION,
DISTINCT txs.block_number,
txs.tx_position,
file_name
FROM
all_txs
LEFT JOIN {{ ref("silver__traces") }}
tr USING (
all_txs txs
LEFT JOIN {{ source(
"polygon_gold",
"fact_traces"
) }}
tr2 USING (
block_number,
tx_hash
tx_position
)
JOIN {{ ref("streamline__traces_complete") }} USING (block_number)
LEFT JOIN {{ source(
'polygon_silver',
'overflowed_traces'
) }}
ot USING (
block_number,
tx_position
)
WHERE
tr.tx_hash IS NULL
tr2.block_number IS NULL
AND ot.block_number IS NULL
)
SELECT
block_number,
POSITION,
tx_position AS POSITION,
file_name,
build_scoped_file_url(
@streamline.bronze.external_tables,
Expand Down
80 changes: 0 additions & 80 deletions models/bronze/overflow/v2/bronze__overflowed_traces2.sql

This file was deleted.

77 changes: 0 additions & 77 deletions models/bronze/overflow/v2/bronze__potential_overflowed_traces2.sql

This file was deleted.

Loading