{"id":15196,"date":"2013-08-13T22:02:18","date_gmt":"2013-08-14T02:02:18","guid":{"rendered":"http:\/\/rbachnet.wwwmi3-ss40.a2hosted.com\/index.php\/"},"modified":"2022-08-31T12:38:39","modified_gmt":"2022-08-31T16:38:39","slug":"data-growth-tests-backup-capabilities","status":"publish","type":"post","link":"https:\/\/rbach.net\/index.php\/data-growth-tests-backup-capabilities\/","title":{"rendered":"Data Growth Tests Storage Capabilities"},"content":{"rendered":"

\u00a0<\/em>\"Data<\/a>Data Center Knowledge<\/a><\/em> had an article<\/a> by Steven Rodin<\/a>, CEO of Storagepipe Solutions<\/a>, that lays out the challenges that those of us charged with managing backups face every day. Storagepipe Solutions, which has been a provider of online backup services<\/strong> for business since 2001, has identified several emerging storage trends that organizations will need to overcome in the future.<\/p>\n

\"Storagepipe<\/a>In the early days, the author says, organizations were primarily concerned with data protection, encryption and automation. The era of “Big Data<\/a>” has changed those demands. The new demands are overwhelming most backup and storage systems. The article cites data from IBM<\/a> (IBM<\/a>), which claims that worldwide annual data production has actually exceeded worldwide storage capacity. Big Blue believes that demand for storage capacity is growing nearly 60 percent a year. The gap between the data that organizations produce and their ability to store it will continue to grow for years.<\/p>\n

The Storagepipe Solutions CEO identified a number of important storage trends which are accelerating the growth rate of corporate data.\u00a0 He provided a few of the most important factors.<\/p>\n

Cheaper Storage Hardware<\/h3>\n

\"Cheaper<\/a>Hard drive capacity has fallen exponentially in price ever since Moore\u2019s Law was introduced. This has changed attitudes to backups. The article says that today, hardware is so cheap and abundant that attitudes have shifted to a \u201cBetter keep this. We may need it someday\u201d mentality.<\/p>\n

New technologies, such as advancements in compression, deduplication and hardware virtualization, have improved overall storage utilization and further accelerated the rate at which the cost-per-gigabyte of storing data is falling.<\/p>\n

Cheap and Abundant Bandwidth<\/h3>\n

\"Abundant<\/a>Internet bandwidth<\/a> is no longer a bottleneck. Bandwidth availability has accelerated the growth of file sharing and online storage. Now large files are copied and distributed at an exponential rate which has caused duplicate data to become a major source of storage waste and data growth. The CEO of the firm based out of Toronto, calculates that if one person shares a 1GB file with 500 people, that\u2019s half a terabyte of storage consumption.<\/p>\n

Business is Going Paperless<\/strong> – Email has replaced letters, eBooks and tablets have nearly replaced paper books, and digital imaging has replaced photographs and x-rays. Not only are paperless offices better for the environment, but Mr. Rodin writes, they are also more productive, flexible and better able to extract value from their business data. Many industries are using more and more video (which is highly storage intensive) for marketing online, security and communication.<\/p>\n

Enhanced Automated Data Collection Capabilities<\/h3>\n

\"Automated<\/a>Automated data collection is one of the fastest-growing areas in the \u201cbig data\u201d space. With every move we make, the article says we\u2019re generating GPS data, web traffic statistics, power usage data, surveillance video, and a broad range of data which companies and governments are collecting.<\/p>\n

The author calls automated data collection the \u201cPandora\u2019s Box\u201d of the big data revolution. The information being collected about us through the electronic devices we use every day could present a threat to our privacy, but they also have the potential to offer tremendous value to society.<\/p>\n

Advances in Data Analysis Technology<\/h3>\n

\"Data<\/a>The blog says that until recently, data analysis was almost exclusively performed on structured relational databases, maintained and organized by humans. But now, a\u00a0 new approach to data storage which focuses on rapid analysis and processing of vast data volumes. Technologies like Hadoop<\/a>, Cassandra<\/a>, MapReduce<\/a> and NoSQL<\/a> have given birth to a whole new class of services, and have revolutionized the way organizations think about the data they collect. Organizations can now get more insight into their internally generated business data by integrating external feeds and databases into their reporting and analysis.<\/p>\n

The Growing Strategic Importance of Data<\/h3>\n

In the past, data was simply a tool which assisted in decision-making and helped companies execute on their strategic objectives. But recently Google<\/a> (GOOG<\/a>), Facebook<\/a> (FB<\/a>),\u00a0Apple’s<\/a> (AAPL<\/a>) iTunes<\/a> and other brands have built their entire corporate strategy around the data they own. The DCK<\/em> article states, information is power, and it\u2019s now more powerful than ever.<\/p>\n

\"Regulatory<\/a>Regulatory Compliance<\/h3>\n

Even if companies wanted to cut the amount of data they store, they wouldn\u2019t always be able to. Laws like PIPEDA<\/a>, HIPAA<\/a>, Sox404<\/a> and many others are forcing companies to keep historical archives of their exponentially growing business data going back several years.<\/p>\n

As this data grows, storage increasingly becomes a major business problem. Also, companies must plan for cost-efficient search and retrieval of these large historical data volumes to stay ready for an unexpected electronic discovery request.<\/p>\n

As the scale and complexity of big data storage grows, it\u2019ll quickly reach a point where manual handling is no longer practical, desirable, economical, or even possible. Automation will become absolutely essential when it comes to backing up big data.<\/p>\n

Many big data applications have serious privacy implications for the customers that benefit from their use. So security will become a top priority for backup administrators. Gone are the days of unencrypted backup tapes.<\/p>\n

The big data applications has created a whole new class of applications built on real-time data. These applications require much more frequent\u00a0 backups to optimize Recovery Point Objectives (RPOs<\/a>). Strategic big data apps will need minimized downtime. This means smaller backup windows, built-in redundancy, and server fail-over<\/strong> to disaster recovery sites.<\/p>\n

That\u2019s why many organizations are opting to outsource their data backups by partnering with experts who run ahead of the trends and who can help with the complexity of some situations.<\/p>\n

Related articles<\/h6>\n