feat: retrieve ddo claims

[NikolasHaimerl]

This MR proposes the following changes

1. Add an rpc service for retrieving data from glif
2. Add an ilpd schema

Context: We are using the glif api to retrieve data from Filecoin. In Filecoin built in actors are responsible for managing and updating the global state of the filecoin network.
DDO (Direct Data Oboarding) in FIL+ deals bypass the usually used StorageActor and oboard data directly. The actor which registers the oboarded data is the verified registry actor (Source).
For spark to be aware of these deals we need to listen to the events emmitted by this actor and look for deals with certain properties (new deals, updated deals,...).

The glif api allows for the fetching of raw built-in Actorevents. The returned data needs to be processed, extracted and then parsed into the correct actor event type.
In this PR the parsing of the ClaimEvent type is being implemented. A sample data point of how the fetched data (after some preprocessing) might look like is stored in test_data. Here, we test that the data can be successfully parsed by the transformer and a class object of the type ClaimEvent can be retrieved for further use.

This implementation is inspired by an existing prototype for fetching build in actor events.

See issue.

[bajtos]

Almost there! 💪🏻

[bajtos]

@NikolasHaimerl please remove this line (the unused dependency).

[bajtos]

@NikolasHaimerl please remove this line (the unused dependency).

[bajtos]

I reviewed the latest version and have a few more comments to address.

Also not all of my previous comments have been addressed, PTAL.

Remember to expand the hidden conversations as shown on this screenshot:

[bajtos]

Please make sure the loop iterating over multiple epochs is written correctly, see https://github.com/filecoin-station/deal-observer/pull/12/files#r1928634351

Other than that, the pull request looks great now! 👌🏻

No further review is necessary as far as I am concerned, merge at will.

[NikolasHaimerl]

@bajtos

Please make sure the loop iterating over multiple epochs is written correctly, see https://github.com/filecoin-station/deal-observer/pull/12/files#r1928634351

Other than that, the pull request looks great now! 👌🏻

No further review is necessary as far as I am concerned, merge at will.

I believe I committed your code suggestion. Which is why the comment was resolved. But I see that the loop is incorrect. I"ll fix that.

[sentry-io]

Suspect Issues

This pull request was deployed and Sentry observed the following issues:

• ‼️ SyntaxError: Unexpected token '<', "<!DOCTYPE "... is not valid JSON rpcRequest(service) View Issue
• ‼️ Error: Expected required property rpcRequest(service) View Issue
• ‼️ Error: Expected string ?(deal-observer) View Issue
• ‼️ Error: Expected string ?(deal-observer) View Issue
• ‼️ error: relation "active_deals" does not exist loadDeals(deal-observer) View Issue

_{Did you find this useful? React with a 👍 or 👎}