A Hierarchical Approach to Improve Job Scheduling and Data Replication in Data Grid

Somayeh Abdi¹ and Sayyed Mohsen Hashemi²

^*,1Faculty of Computer Engineering, Islamic Azad University, Iran

²Faculty of Computer Engineering, Islamic Azad University, Iran

 Abstract: In dynamic environment of Data Grid effective job scheduling methods consider location of required data in dispatching jobs to resources. Also job scheduling methods are combined with data replication mechanisms to reduce remote data access as well as save network bandwidth. In this paper we combine job scheduling method and dynamic data replication to reduce data access delay and job execution time. Also we expand our work by applying Bloom Filter in job scheduling decision. In Data Grid, appropriate mechanisms for recording, deleting and inquiring information about data files are required for implementing proper job scheduling method. Therefore we apply counting Bloom Filter for recording/deleting and inquiring information about data files in replica catalogue. Result of simulation indicates that proposed job scheduling and data replication methods reduce job execution time, also using Bloom Filter saves network bandwidth and reduces time of gathering information for selecting appropriate resources in job scheduling.

Keywords: Job scheduling, data replication, replica catalogue, replica manager, resource discovery, counting bloom filter.

Received August 8, 2012; accept April 24, 2014

Full Text