Loading…

AIP: a tool for flexible and transparent data management

Existing data management tools have some limitations such as restrictions to specific file systems or shortage of transparence to applications. In this paper, we present a new data management tool called AIP, which is implemented via the standard data management API, and hence it supports multiple f...

Full description

Saved in:
Bibliographic Details
Published in:Science China. Information sciences 2013-05, Vol.56 (5), p.186-196
Main Authors: Zhang, GuangYan, Qiu, JianPing, Shu, JiWu, Zheng, WeiMin
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by
cites cdi_FETCH-LOGICAL-c327t-c094191146f2f2871e48762bf0989363fb690f547372f1803a927b21b3d5bb513
container_end_page 196
container_issue 5
container_start_page 186
container_title Science China. Information sciences
container_volume 56
creator Zhang, GuangYan
Qiu, JianPing
Shu, JiWu
Zheng, WeiMin
description Existing data management tools have some limitations such as restrictions to specific file systems or shortage of transparence to applications. In this paper, we present a new data management tool called AIP, which is implemented via the standard data management API, and hence it supports multiple file systems and makes data management operations transparent to applications. First, AIP provides centralized policy-based data management for controlling the placement of files in different storage tiers. Second, AIP uses differentiated collections of file states to improve the execution efficiency of data management policies, with the help of the caching mechanism of file states. Third, AIP also provides a resource arbitration mechanism for controlling the rate of initiated data management operations. Our results from representative experiments demonstrate that AIP has the ability to provide high performance, to introduce low management overhead, and to have good scalability.
doi_str_mv 10.1007/s11432-011-4466-6
format article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_1429862542</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><cqvip_id>45769455</cqvip_id><sourcerecordid>2918545903</sourcerecordid><originalsourceid>FETCH-LOGICAL-c327t-c094191146f2f2871e48762bf0989363fb690f547372f1803a927b21b3d5bb513</originalsourceid><addsrcrecordid>eNp9UMtKA0EQHETBEPMB3la8eBmdnueOtxB8BAJ6UPA2zG5mYsI-kpkN6K_4Lf6Tv-CEDQoe7Et3Q1VXdSF0CuQSCFFXEYAzigkA5lxKLA_QAHKpMWjQh2mWimPF2MsxGsW4IqkYI1TlA3Q9nj5-fX5kNuvatsp8GzJfubdlUbnMNvOsC7aJaxtc02Vz29msto1duDrtJ-jI2yq60b4P0fPtzdPkHs8e7qaT8QyXjKoOl0Tz5AO49NTTXIHjuZK08ETnmknmC6mJF1wxRT3khFlNVUGhYHNRFALYEF30d9eh3Wxd7Ey9jKWrKtu4dhsNcKpzSQWnCXr-B7pqt6FJ7gzVkAsudPp8iKBHlaGNMThv1mFZ2_BugJhdoKYP1KRAzS5QIxOH9pyYsM3Chd_L_5HO9kKvbbPYJN6PEhdKai4E-wbjjoDY</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2918545903</pqid></control><display><type>article</type><title>AIP: a tool for flexible and transparent data management</title><source>Springer Link</source><creator>Zhang, GuangYan ; Qiu, JianPing ; Shu, JiWu ; Zheng, WeiMin</creator><creatorcontrib>Zhang, GuangYan ; Qiu, JianPing ; Shu, JiWu ; Zheng, WeiMin</creatorcontrib><description>Existing data management tools have some limitations such as restrictions to specific file systems or shortage of transparence to applications. In this paper, we present a new data management tool called AIP, which is implemented via the standard data management API, and hence it supports multiple file systems and makes data management operations transparent to applications. First, AIP provides centralized policy-based data management for controlling the placement of files in different storage tiers. Second, AIP uses differentiated collections of file states to improve the execution efficiency of data management policies, with the help of the caching mechanism of file states. Third, AIP also provides a resource arbitration mechanism for controlling the rate of initiated data management operations. Our results from representative experiments demonstrate that AIP has the ability to provide high performance, to introduce low management overhead, and to have good scalability.</description><identifier>ISSN: 1674-733X</identifier><identifier>EISSN: 1869-1919</identifier><identifier>DOI: 10.1007/s11432-011-4466-6</identifier><language>eng</language><publisher>Heidelberg: SP Science China Press</publisher><subject>AIP ; API ; Arbitration ; Collection ; Computer Science ; Data management ; Information Systems and Communication Service ; Management ; Research Paper ; Shortages ; Standard data ; 基于策略 ; 应用程序 ; 控制文件 ; 数据管理工具 ; 文件系统 ; 管理操作 ; 管理政策</subject><ispartof>Science China. Information sciences, 2013-05, Vol.56 (5), p.186-196</ispartof><rights>Science China Press and Springer-Verlag Berlin Heidelberg 2012</rights><rights>Science China Press and Springer-Verlag Berlin Heidelberg 2012.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c327t-c094191146f2f2871e48762bf0989363fb690f547372f1803a927b21b3d5bb513</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Uhttp://image.cqvip.com/vip1000/qk/84009A/84009A.jpg</thumbnail><link.rule.ids>314,780,784,27924,27925</link.rule.ids></links><search><creatorcontrib>Zhang, GuangYan</creatorcontrib><creatorcontrib>Qiu, JianPing</creatorcontrib><creatorcontrib>Shu, JiWu</creatorcontrib><creatorcontrib>Zheng, WeiMin</creatorcontrib><title>AIP: a tool for flexible and transparent data management</title><title>Science China. Information sciences</title><addtitle>Sci. China Inf. Sci</addtitle><addtitle>SCIENCE CHINA Information Sciences</addtitle><description>Existing data management tools have some limitations such as restrictions to specific file systems or shortage of transparence to applications. In this paper, we present a new data management tool called AIP, which is implemented via the standard data management API, and hence it supports multiple file systems and makes data management operations transparent to applications. First, AIP provides centralized policy-based data management for controlling the placement of files in different storage tiers. Second, AIP uses differentiated collections of file states to improve the execution efficiency of data management policies, with the help of the caching mechanism of file states. Third, AIP also provides a resource arbitration mechanism for controlling the rate of initiated data management operations. Our results from representative experiments demonstrate that AIP has the ability to provide high performance, to introduce low management overhead, and to have good scalability.</description><subject>AIP</subject><subject>API</subject><subject>Arbitration</subject><subject>Collection</subject><subject>Computer Science</subject><subject>Data management</subject><subject>Information Systems and Communication Service</subject><subject>Management</subject><subject>Research Paper</subject><subject>Shortages</subject><subject>Standard data</subject><subject>基于策略</subject><subject>应用程序</subject><subject>控制文件</subject><subject>数据管理工具</subject><subject>文件系统</subject><subject>管理操作</subject><subject>管理政策</subject><issn>1674-733X</issn><issn>1869-1919</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2013</creationdate><recordtype>article</recordtype><recordid>eNp9UMtKA0EQHETBEPMB3la8eBmdnueOtxB8BAJ6UPA2zG5mYsI-kpkN6K_4Lf6Tv-CEDQoe7Et3Q1VXdSF0CuQSCFFXEYAzigkA5lxKLA_QAHKpMWjQh2mWimPF2MsxGsW4IqkYI1TlA3Q9nj5-fX5kNuvatsp8GzJfubdlUbnMNvOsC7aJaxtc02Vz29msto1duDrtJ-jI2yq60b4P0fPtzdPkHs8e7qaT8QyXjKoOl0Tz5AO49NTTXIHjuZK08ETnmknmC6mJF1wxRT3khFlNVUGhYHNRFALYEF30d9eh3Wxd7Ey9jKWrKtu4dhsNcKpzSQWnCXr-B7pqt6FJ7gzVkAsudPp8iKBHlaGNMThv1mFZ2_BugJhdoKYP1KRAzS5QIxOH9pyYsM3Chd_L_5HO9kKvbbPYJN6PEhdKai4E-wbjjoDY</recordid><startdate>20130501</startdate><enddate>20130501</enddate><creator>Zhang, GuangYan</creator><creator>Qiu, JianPing</creator><creator>Shu, JiWu</creator><creator>Zheng, WeiMin</creator><general>SP Science China Press</general><general>Springer Nature B.V</general><scope>2RA</scope><scope>92L</scope><scope>CQIGP</scope><scope>W92</scope><scope>~WA</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>8FE</scope><scope>8FG</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>GNUQQ</scope><scope>HCIFZ</scope><scope>JQ2</scope><scope>K7-</scope><scope>P5Z</scope><scope>P62</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>7SC</scope><scope>8FD</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope></search><sort><creationdate>20130501</creationdate><title>AIP: a tool for flexible and transparent data management</title><author>Zhang, GuangYan ; Qiu, JianPing ; Shu, JiWu ; Zheng, WeiMin</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c327t-c094191146f2f2871e48762bf0989363fb690f547372f1803a927b21b3d5bb513</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2013</creationdate><topic>AIP</topic><topic>API</topic><topic>Arbitration</topic><topic>Collection</topic><topic>Computer Science</topic><topic>Data management</topic><topic>Information Systems and Communication Service</topic><topic>Management</topic><topic>Research Paper</topic><topic>Shortages</topic><topic>Standard data</topic><topic>基于策略</topic><topic>应用程序</topic><topic>控制文件</topic><topic>数据管理工具</topic><topic>文件系统</topic><topic>管理操作</topic><topic>管理政策</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Zhang, GuangYan</creatorcontrib><creatorcontrib>Qiu, JianPing</creatorcontrib><creatorcontrib>Shu, JiWu</creatorcontrib><creatorcontrib>Zheng, WeiMin</creatorcontrib><collection>维普_期刊</collection><collection>中文科技期刊数据库-CALIS站点</collection><collection>中文科技期刊数据库-7.0平台</collection><collection>中文科技期刊数据库-工程技术</collection><collection>中文科技期刊数据库- 镜像站点</collection><collection>CrossRef</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Central</collection><collection>Advanced Technologies &amp; Aerospace Collection</collection><collection>ProQuest Central Essentials</collection><collection>AUTh Library subscriptions: ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central</collection><collection>ProQuest Central Student</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Computer Science Collection</collection><collection>Computer Science Database</collection><collection>Advanced Technologies &amp; Aerospace Database</collection><collection>ProQuest Advanced Technologies &amp; Aerospace Collection</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>Computer and Information Systems Abstracts</collection><collection>Technology Research Database</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>Science China. Information sciences</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Zhang, GuangYan</au><au>Qiu, JianPing</au><au>Shu, JiWu</au><au>Zheng, WeiMin</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>AIP: a tool for flexible and transparent data management</atitle><jtitle>Science China. Information sciences</jtitle><stitle>Sci. China Inf. Sci</stitle><addtitle>SCIENCE CHINA Information Sciences</addtitle><date>2013-05-01</date><risdate>2013</risdate><volume>56</volume><issue>5</issue><spage>186</spage><epage>196</epage><pages>186-196</pages><issn>1674-733X</issn><eissn>1869-1919</eissn><abstract>Existing data management tools have some limitations such as restrictions to specific file systems or shortage of transparence to applications. In this paper, we present a new data management tool called AIP, which is implemented via the standard data management API, and hence it supports multiple file systems and makes data management operations transparent to applications. First, AIP provides centralized policy-based data management for controlling the placement of files in different storage tiers. Second, AIP uses differentiated collections of file states to improve the execution efficiency of data management policies, with the help of the caching mechanism of file states. Third, AIP also provides a resource arbitration mechanism for controlling the rate of initiated data management operations. Our results from representative experiments demonstrate that AIP has the ability to provide high performance, to introduce low management overhead, and to have good scalability.</abstract><cop>Heidelberg</cop><pub>SP Science China Press</pub><doi>10.1007/s11432-011-4466-6</doi><tpages>11</tpages></addata></record>
fulltext fulltext
identifier ISSN: 1674-733X
ispartof Science China. Information sciences, 2013-05, Vol.56 (5), p.186-196
issn 1674-733X
1869-1919
language eng
recordid cdi_proquest_miscellaneous_1429862542
source Springer Link
subjects AIP
API
Arbitration
Collection
Computer Science
Data management
Information Systems and Communication Service
Management
Research Paper
Shortages
Standard data
基于策略
应用程序
控制文件
数据管理工具
文件系统
管理操作
管理政策
title AIP: a tool for flexible and transparent data management
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-06T00%3A34%3A34IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=AIP%EF%BC%9A%20a%20tool%20for%20flexible%20and%20transparent%20data%20management&rft.jtitle=Science%20China.%20Information%20sciences&rft.au=Zhang,%20GuangYan&rft.date=2013-05-01&rft.volume=56&rft.issue=5&rft.spage=186&rft.epage=196&rft.pages=186-196&rft.issn=1674-733X&rft.eissn=1869-1919&rft_id=info:doi/10.1007/s11432-011-4466-6&rft_dat=%3Cproquest_cross%3E2918545903%3C/proquest_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c327t-c094191146f2f2871e48762bf0989363fb690f547372f1803a927b21b3d5bb513%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2918545903&rft_id=info:pmid/&rft_cqvip_id=45769455&rfr_iscdi=true