By Peter Olding, General Manager, SAND Technology
What keeps you awake at night? Is it having to go to your Board of Directors or CIO tomorrow and explain why your organisation cannot hit agreed service levels around your storage infrastructure or perhaps beg for more capital expenditure to increase your existing infrastructure footprint? If so, read on…
We all know the challenge of retaining and maintaining the vast volumes of data required for business and regulatory requirements, is one that faces every modern IT organisation. Increasingly, this puts pressure on IT budgets and data centre infrastructure and is compounded by rising operational and energy costs.
So in the current economic and environmental climate, should we really be buying and consuming more storage? Somewhat controversially, but perhaps timely, I will discuss a way to buy less storage - or do more with your existing infrastructure.
By way of example, let’s consider a 100 Terabytes (TB) of structured data with varying requirements such as complex analysis, long term data retention and archiving. These may be new requirements or extra load on an existing data warehouse. Either way, you’re faced with a number of questions and decisions and you will no doubt be bombarded by vendors and consultants offering best advice - or their version of best advice – which isn’t usually cheap! Either way you’re looking at an expensive system with some expensive consulting. Or are you?
Very few people tend to look at these requirements from the perspective of the data or consider a data-centric architecture, as we are so used to deploying application- centric architectures. In simplistic terms you’re looking at a large pool of data. And you’re not entirely sure what it’s going to be used for except that you have to store, manage and retrieve it. In essence, this large pool of data is a corporate information memory – a primary repository of enterprise data which will enable your company to face the challenges mentioned earlier.
There are a number of approaches to deploying a corporate information memory architecture but in essence it comprises a mix of software, solutions and techniques which, when combined, enables companies to deliver significant commercial, competitive and environmental advantage.
By way of example, by combining deduplication, compression and indexing techniques, this 100 TB of data can be held in under 2 TB. That’s right - 2 TB – or a 98% reduction. Not only that, but it is optimised for fast querying and retrieval, requiring little administration and can work with Oracle, SQL Server, DB2, SAS, Business Objects and so on.
To demonstrate the benefits of this approach, consider an organisation that retains and analyses huge volumes of retail data in an ever changing, very demanding and thin margin industry. They are constantly striving to introduce operational improvements across the business. As a result of deploying a corporate information memory architecture, they reduced their storage infrastructure for their analysts by a factor of thirty which resulted in:
- Lower administration costs enabling IT staff to creatively support the business instead of constantly fire fighting
- Improved operational efficiency to over deliver on service levels for operations and querying
- Increased productivity of their end user analysts by a factor of three
For years the IT industry has been obsessed with size – who has the largest data centres, largest data warehouses, largest severs and so on. Isn’t it about time we got clever and applied innovative solutions to problems and brag out who has the smallest data centre footprint and shortest batch windows?
By the way - what keeps me awake at night? It’s the ducks that live at the end of my garden performing duck karaoke well into the night.
Peter rejoined SAND in 2006 bringing a wealth of commercial experience in data analysis and retention. Prior to this, he was instrumental in the early success of ClarityBlue as a Business Development Director which spun off from SAND in the UK as an analytic CRM provider. Prior to this, he was an Account Director at WhiteCross Systems (Kognitio) having moved from a consulting role with British Telecom where he was involved in a number of data centric projects.
Peter has a Bachelor's Degree in Geological Sciences and spent his early career as a data analyst on the rigs in Africa, the Middle East and Scandinavia, and a Master's Degree in Information Technology. He started a PhD in genetic algorithms until the lure of industry was too great.
He feeds ducks in his spare time.
SAND Technology is exhibiting at Storage Expo 2008 the UK’s definitive event for data storage, information and content management. Now in its 8th year, the show features a comprehensive FREE education programme and over 100 exhibitors at the National Hall, Olympia, London from 15 - 16 October 2008 www.storage-expo.com
Source: StoragePR
<>
Seed Newsvine