Author Login IJIRT Partner Network (IPN) Login

Dynamic slot allocation for mapreduce workload

  • Unique Paper ID: 144281
  • Volume: 3
  • Issue: 10
  • PageNo: 58-61
  • Abstract:
  • MapReduce is a popular parallel Computing paradigm, for large-scale data processing in cluster and data centers. However, the slot utilization can be low, especially when Hadoop Fair scheduler is used, due to the pre-allocation of slots among map and reduce tasks, and the order that map tasks followed by reduce task in a typical MapReduce environment. To address this problem, we propose to allow slots to be dynamically allocated to either map or reduce tasks depending on their actual requirement. Specifically, we have proposed two types of Dynamic Hadoop Fair scheduler (DHFS), for two different levels of fairness (i.e., cluster and pool level).The experimental results show performance significantly while guaranteeing the fairness.
email to a friend

Cite This Article

  • ISSN: 2349-6002
  • Volume: 3
  • Issue: 10
  • PageNo: 58-61

Dynamic slot allocation for mapreduce workload

Related Articles

Impact Factor
8.01 (Year 2024)
UGC Approved
Journal no 47859

Join Our IPN

IJIRT Partner Network

Submit your research paper and those of your network (friends, colleagues, or peers) through your IPN account, and receive 800 INR for each paper that gets published.

Join Now

Latest Publication

Archive

View More

Recent Conferences

NCSEM 2024

National Conference on Sustainable Engineering and Management - 2024 Last Date: 15th March 2024

Submit inquiry