Hierarchical Scheduling in on-demand GPU-as-a-Service Systems