-
Notifications
You must be signed in to change notification settings - Fork 61
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Update the version of spark in etl to 3.3.1 #1275
Conversation
可否分享來源連結 |
docker/etl.dockerfile
Outdated
# this dockerfile is generated dynamically | ||
FROM ghcr.io/skiptests/astraea/spark:3.1.2 | ||
this dockerfile is generated dynamically | ||
FROM ghcr.io/skiptests/astraea/spark:3.3.1 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
這個檔案怎麼又跑出來了,刪掉喔
apache/spark#38355
怪怪的怎麼又出來了,已刪除 |
https://issues.apache.org/jira/browse/SPARK-40886 麻煩先把議題開好並且在TODO中說明 |
#1276 已在gradle中添加完善的相關說明 |
蠻詭異的,以防萬一可否開另一隻PR?我擔心這隻branch 已經被污染了 |
沒事的學長,我找到原因了是我的自己的github倉庫被污染了,這支已經清除毒素了,可以merge。 |
resolve #1261
jackson在2.13.4.1中gradle的配置有問題,這會影響到spark3.3.1版本。
FasterXML/jackson-databind#3627
預計其會在3.3.2版本中修復