Process remote data

[bellanov]

Utilize SerenadeFlow in processing data accessed remotely.

There will be another Python library consuming SerenadeFlow called fantasy-ace-odds, which is where odds data will be farmed, so this is where any scripts utilizing SerenadeFlow should be located.

Tasks

• @bellanov provides data to process remotely
• @aybanda uses SerenadeFlow to process the information

[bellanov]

Sorry for the delay, the 9-5 was getting a bit needy.

Looking forward to this more. Time to get back to things.

[bellanov]

@aybanda Posted some data to process in the other issue. I'll post the link here for convenience.

https://github.com/bellanov/fantasy-data-farming/tree/main/data

In this issue, I'll set up a pattern with docker-compose so you can have a remote target to emulate.

[aybanda]

@bellanov Implemented remote data processing capability in the ETL pipeline with test coverage using mock responses. Ready to integrate with the actual remote endpoint once docker-compose setup is provided.

[bellanov]

Awesome, I'll get to it today.