This document records all notable changes to Skeleton-Pyspark.
- Bugfix/docker-compose used instead of docker compose
- Updated HOWTO and Makefile to run through the poetry run
- Add a task in the
Makefile
to build a.whl
package
- Feature/Install dependabot
- Feature/Ability to package and send dependency to the cluster (Stage 2)
https://www.notion.so/dataroots/Pyspark-metho-as-code-repo-d2ea171872604cc1bbf062cf4131373f
- Change argument parser from argparse to typer
- Initial private release (Stage 1)
https://www.notion.so/dataroots/Pyspark-metho-as-code-repo-d2ea171872604cc1bbf062cf4131373f