You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
24/08/21 09:18:24 INFO @penMetadata Transport: lineage was sent successfully to OpenMetadata for from Table: workspace_db:tableA, toTable: /C:/Users/leomag/spark- warehouse/workspace_db.db/tableB
When we use df.write operations to external tables, the agent identifies the output table name as a location path:
code:
(
df.write.partitionBy("pk_datref_ox")
mode("overwrite")
format("parquet")
saveAs Table("workspace_db.tableB")
)
log spark:
24/08/21 09:18:24 INFO @penMetadata Transport: lineage was sent successfully to OpenMetadata for from Table: workspace_db:tableA, toTable: /C:/Users/leomag/spark- warehouse/workspace_db.db/tableB
log OM server:
127.0.0.6--[21/Aug/2024:12:17:22 +0000] "GET /api/v1/search/query?q-fullyQualifiedName% 3Aathena-sirius-teste.*%2FC%3A%2Fusers%2Fleomag%2Fspark-warehouse% 2Fworkspace_db.db%2Ftableb&size=10 HTTP/1.1" 200 301 "." "Apache- HttpClient/4.5.14 (Java/15.0.1) 55
So, the output table it´s not found in the Open Metadata and the lineage do not work.
The text was updated successfully, but these errors were encountered: