Skip to content

Commit

Permalink
Raw Atlas Flow Integration (#25)
Browse files Browse the repository at this point in the history
* Working end-to-end raw atlas flow

* refactor to make Spark flow more apparent

* Adding metrics and atlas deltas to new flow, moving calculations to helper functions

* Upgrading to atlas 5.0.11

* Updating integraton test, accounting for empty Clipped loading area

* Implementing Atlas fetcher policy when sectioning atlases

* Depending on atlas 5.0.12

* Re-using shard calculation, unpersisting un-needed RDDs, moving more methods to helper class

* Removing google common Maps dependency
  • Loading branch information
MikeGost authored and matthieun committed Apr 12, 2018
1 parent 8c9cb93 commit c5a9dd3
Show file tree
Hide file tree
Showing 4 changed files with 911 additions and 228 deletions.
2 changes: 1 addition & 1 deletion dependencies.gradle
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
project.ext.versions = [
checkstyle: '7.6.1',
atlas: '5.0.10',
atlas: '5.0.12',
spark: '1.6.0-cdh5.7.0',
snappy: '1.1.1.6',
]
Expand Down
Loading

0 comments on commit c5a9dd3

Please sign in to comment.