Feature Store

Overall data pipeline architecture:

In this repo, we deploy a data pipeline having one flow for batch data and one flow for streaming data. Depend on each flow, we use different services to serve these flows. Some services we can mention are Pyspark, PostgreSQL, Flink, Kafka, Airflow...

Name		Name	Last commit message	Last commit date
Latest commit History 11 Commits
batch_processing		batch_processing
data		data
data_validation		data_validation
datalake		datalake
dependencies		dependencies
images		images
infra		infra
models		models
pipeline		pipeline
stream_processing		stream_processing
.env		.env
Dockerfile		Dockerfile
README.md		README.md
airflow-docker-compose.yaml		airflow-docker-compose.yaml
docker-compose.yml		docker-compose.yml
main.py		main.py
requirements.txt		requirements.txt