Wednesday, March 2, 2016
11:00 AM in Rice 504
Md Anindya Prodhan
Advisor: Andrew Grimshaw
Attending Faculty: Alfred Weaver (Committee Chair), Kamin Whitehouse, Malathi Veeraraghavan and Federico Ciliberto (Minor Representative)
Title: Market Based on-Demand Computing in Co-operative Grid Environment (CG-Market)
Computational and data scientists at universities have heterogeneous job resource requirements. Most universities maintain a set of shared resources to support these computational needs. Access to these resources is often free and the access policy is First Come First Serve (FCFS). However, FCFS policies on shared resources often lead to sub-optimal value from the organization’s point of view as different jobs contribute different values to the users. Furthermore, the set of resources at a single institution may fail to satisfy the diverse needs of the institutions researchers. We argue the solution is differentiated quality of service (QoS) based on the user’s willingness to pay to rationalize resource usage and federation of university resources to improve both the size of the resource pool as well as the diversity of resources. The proposed XSEDE Campus Bridging (CB) Shared Virtual Compute Facility (SVCF) provides both. The CB-SVCF will be deployed using existing XSEDE Execution Management Services (EMS) and the XSEDE Global Federated File System (GFFS).
Although, there has been rich literature in both computational grids and grid economy, much of the work has all been done in simulation. The researchers did not have access to production quality systems on which to test their simulation results, nor did they have a production quality infrastructure and a real user community. We propose to carry out our experiments on a production quality testbed with real data traces from real users and answer the fundamental question in grid economy: “whether federation of resources among Universities with market based resource allocation yields more value to the organizations individually and/or overall or not?” Three university resources from UVa and IU will serve as a hardware testbed for the system. A modest number of researchers at each university will be authorized to submit and run jobs on the testbed and will be charged based on their resource and QoS requirement. With these real data traces we will calculate the organizational value achieved using and without CG-Market for the two universities and compare them to verify whether the advantages of market based grid actually holds in real infrastructure.