New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[cosmos-sequence-api] Create #176

Open

frbattid opened this issue Aug 18, 2016 · 0 comments

Labels

backlog

Member

frbattid commented Aug 18, 2016

It seems WebHDFS, the official REST API for doing HDFS I/O does not support Hadoop sequence files, a special binary data format.

Thus, it would be nice to create a REST API similar to WebHDFS supporting sequence files. Even, this API could "extend" the original WebHDFS:

Operations such as "open" or "append" must include a header or parameter describing if the payload contains sequence or text data.
Text data related operations would be forwarded to the original WebHDFS API.
Sequence data related operations would be managed by our API, using the Hadoop Java API about sequence files.

Additional useful links:

http://hadooptutorial.info/hadoop-sequence-files-example/

frbattid added the backlog label

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment