Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[cosmos-gui] Temporal access to shared cluster, allowing the usage of a CapacityScheduler queue #4

Open
frbattid opened this issue Jun 24, 2015 · 1 comment
Assignees
Labels

Comments

@frbattid
Copy link
Member

Through the GUI, a Cosmos user must be able to request a temporal access to the shared Hadoop cluster (computing), in order to submit a MapReduce job into one of the available queues the CapacityScheduler manages.

From the queues management point of view, this feature implies:

  • The GUI is able to remotely connect to the shared Hadoop cluster, edit $HADOOP_CONF_DIR/capacity-scheduler.xml in order to allow the user to use one of the queues and refresh them, as stated here.
  • The GUI must be able to control the status/occuancy/usage of each queue, in order to allocate the job to most apropriate queue. There exists the possibility to handle high priority queues for special users, and low priority queues for normal users, etc.

Regarding the temporal access to the computing cluster:

  • It must be controlled the time passed from the access request to the job submission. In this sense, the temporal accesses may work as web sessions that can expire if no action is taken.
  • Depending on the number of job submissions and usage of the queues, the access request may be delayed --> in this sense, requesting this kind of accesses and requesting a Sahara's private cluster is quite similar, and the concept of scheduling calendar may be used.
@frbattid frbattid added this to the release/0.1.0 milestone Jun 29, 2015
@frbattid frbattid self-assigned this Jul 21, 2015
@frbattid
Copy link
Member Author

Do not implement until #23 is done.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant