Advanced resource management with access control for multitenant Hadoop

Multitenancy has gained growing importance with the development and evolution of cloud computing technology. In a multitenant environment, multiple tenants with different demands can share a variety of computing resources (e.g., CPU, memory, storage, network, and data) within a single system, while...

Full description

Saved in:
Bibliographic Details
Published in:Journal of communications and networks 2015, 17(6), , pp.592-601
Main Authors: Won, Heesun, Nguyen, Minh Chau, Gil, Myeong-Seon, Moon, Yang-Sae
Format: Article
Language:English
Subjects:
Access control
Big data
cloud
Cloud computing
Containers
Data processing
Hadoop
Metadata
multi-tenancy
Resource management
Yarn
yet another resource negotiator (YARN)
전자/정보통신공학
Citations: Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Multitenancy has gained growing importance with the development and evolution of cloud computing technology. In a multitenant environment, multiple tenants with different demands can share a variety of computing resources (e.g., CPU, memory, storage, network, and data) within a single system, while each tenant remains logically isolated. This useful multitenancy concept offers highly efficient, and cost-effective systems without wasting computing resources to enterprises requiring similar environments for data processing and management. In this paper, we propose a novel approach supporting multitenancy features for Apache Hadoop, a large scale distributed system commonly used for processing big data. We first analyze the Hadoop framework focusing on "yet another resource negotiator (YARN)", which is responsible for managing resources, application runtime, and access control in the latest version of Hadoop. We then define the problems for supporting multitenancy and formally derive the requirements to solve these problems. Based on these requirements, we design the details of multitenant Hadoop. We also present experimental results to validate the data access control and to evaluate the performance enhancement of multitenant Hadoop.
ISSN:1229-2370
1976-5541
DOI:10.1109/JCN.2015.000106