Archive for the ‘ECS’ Category

Unwrapping Machine Learning

Ashvin Naik

Cloud Infrastructure Marketing at Dell EMC

In a recent IDC spending guide titled Worldwide cognitive systems and artificial intelligence spending guide,   some fantastic numbers were thrown out in terms of opportunity and growth 50+ % CAGR, Verticals pouring in billions of dollars on cognitive systems. One of the key components of cognitive systems is Machine Learning.

According to wikipedia Machine Learning is a subfield of computer science that gives the computers the ability to learn without being explicitly programmed. Just these two pieces of information were enough to get me interested in the field.

After hours of daily  searching, digging through inane babble and noise across the internet, the understanding of how machines can learn evaded me for weeks, until I hit a jackpot. A source, that should not be named pointed me to a “secure by obscurity” share that had the exact and valuable insights on machine learning. It was so simple, elegant and completely made sense to me.

Machine Learning was not all noise, it worked on a very simple principle. Imagine, there is a pattern in this world that can be used to forecast or predict a behavior of any entity. There is no mathematical notation available to describe the pattern, but if you have the data that can be used to plot the pattern, you can use Machine Learning to model it.  Now, this may sound like a whole lot of mumbo jumbo but allow me to break it down in simple terms.

Machine learning can be used to understand patterns so you can forecast or predict anything provided

  • You are certain there is a pattern
  • You do not have a mathematical model to describe the pattern
  • You have the data to try to figure out the pattern.

Viola, this makes so much sense already. If you have data, know there is a pattern but don’t know what that is, you can use machine learning to find it out. The applications for this are endless from natural language processing, speech to text to predictive analytics. The most important is forecasting- something we do not give enough credit these days. The Most critical component of Machine Learning is Data – you should have the data. If you do not have data, you cannot find the pattern.

As a cloud storage professional, this is a huge insight. You should have data. Pristine, raw data coming from the systems that generate it- sort of like a tip from the horses mouth. I know exactly where my products fit in. We are able to ingest, store, protect and expose the data for any purposes in the native format complete with the metadata all through one system.

We have customers in the automobile industry leveraging our multi-protocol cloud storage across 2300 locations in Europe capturing data from cars on the roads. They are using proprietary Machine Learning systems to look for patterns in how their customers- the car owners use their products in the real world to predict the parameters of designing better, reliable and efficient cars. We have customers in the life-sciences business saving lives by looking at the patterns of efficacy and effective therapies for terminal diseases. Our customers in retail are using Machine Learning to detect fraud and protect their customers. This goes on and on and on.

I personally do not know the details of how they make it happen, but this is the world of the third platform. There are so many possibilities and opportunities ahead if only we have the data. Talk to us and we can help you capture, store and secure your data so you can transform humanity for the better.

 

Learn more about how Dell EMC Elastic Cloud Storage can fit into your Machine Learning Infrastructure

 

 

Digital Transformation with Radical Simplicity

Corey O'Connor

Senior Product Marketing Manager at Dell EMC² ETD

Digital Transformation with Radical Simplicity

Welcome to another edition of the Emerging Technologies ECS blog series, where we discuss topics related to cloud storage and ECS (Elastic Cloud Storage), Dell EMC’s cloud-scale storage platform.

The Inflection Point

It’s no surprise that unstructured data continues to grow exponentially year over year and doesn’t show signs of slowing down anytime soon. Some organizations are left managing this data with traditional storage infrastructure which is not only very expensive, but does not scale at the rate in which the data is growing.  IT budgets continue to remain flat or grow at an ungenerous rate of about 5% annually and capital expenses tend to double almost every year for most organizations.  The other pressing issue is the requirement of somehow maintaining the same (if not better) level of service with fewer resources as data growth continues to strain storage infrastructure.  This type of trend is not sustainable and if certain organizations do not transform their business then they will struggle without question.  We know what you’re thinking – wouldn’t it be great if the world’s largest provider of data storage systems created a cost effective, cloud-scale solution to solve this enterprise level challenge?

Dell EMC’s Elastic Cloud Storage (ECS)

Elastic Cloud Storage (ECS) is Dell EMC’s 3rd generation object-based storage system that provides the ability to:

  • Consolidate primary storage resources and elevate ROI
  • Modernize traditional and legacy applicationsfor better storage utilization
  • Accelerate cloud native applications to deliver new business value

ECS delivers a multipurpose platform that satisfies a variety of different use cases and plugs in perfectly to almost any existing Dell EMC investment(s). ECS singlehandedly simplifies management, increases agility, and most importantly – lowers costs.  At scale, ECS is undoubtedly one of the most cost effective solutions available in the market today.  In fact, analyst Enterprise Strategy Group (ESG) recently conducted a survey that shows ECS provides a 60% or greater cost advantage compared to other leading public cloud providers.   

ECS extends the cloud to primary storage and allows you to free up your infrastructure through Dell EMC cloud-enabled solutions (e.g. CloudPools, CloudBoost, CloudArray, etc.).  Customers have the ability to seamlessly tier colder, inactive workloads from existing primary storage investments (e.g. Isilon, VMAX Series, VPLEX, VNX Series, Vx Series, Data Domain, Data Protection Suite, etc.) to ECS.  This resource consolidation eliminates the need to purchase additional, more expensive platforms and better utilizes the infrastructure you have in your storage environment today.

An object-based platform like ECS can drastically increase responsiveness and better secure data when you compare it to that of a traditional NAS system.  Data is protected using erasure coding and the chunks of data are then geo-distributed across all nodes within the system providing instant read/write access from any location.  Strong consistency semantics ensures only the most recent copy of data is accessed simplifying application development efforts.  A geo-caching capability further enhances responsiveness through intelligent system recognition of access patterns which minimizes WAN traffic and improves system latency.

ECS provides simple and easy access to applications through a single global namespace.  This makes it easy for developers not having to deal with complex NFS file systems – they can focus on app development and not the operations and implementation details behind it.   By modernizing traditional applications into an object store, users get fast and easy provisioning, direct access to content over the web via HTTP, global accessibility through a single namespace, and the absolute best utilization of storage resources in the datacenter.

Cloud-native applications take full advantage of a cloud system framework.  ECS’ architecture is completely software defined with total abstraction from the north and southbound allowing compute and storage resources to scale independently from each other.  Everything within ECS is containerized and there are no hardware dependencies or the need to re-code, re-tool or reconfigure applications as ECS provides multi-protocol support. This allows developers to innovate and deliver their applications to market at a much quicker rate.

Bridging the Gap

Enterprises and cloud service providers alike can leverage ECS as a way to fund their ‘digital transformation’ as traditional, line-of-business applications go into decline and cloud-native apps begin to surge over the next decade.  ECS bridges the gap between Platform 2 (traditional) and Platform 3 (next-gen) applications on a single storage system.  Not only can ECS easily handle the extraordinary amount of unstructured data that’s growing, but as a multi-purpose platform it can serve up all the many different workloads you currently manage today and ready your organization for what the future throws at you.

India’s Largest Search Engine Dials into Object Storage

Corey O'Connor

Senior Product Marketing Manager at Dell EMC² ETD

Welcome to another edition of the Emerging Technologies ECS blog series, where we take a look at issues related to cloud storage and ECS (Elastic Cloud Storage), Dell EMC’s cloud-scale storage platform. 

Navigating the World Wide Websearch

The World Wide Web was invented by an independent contractor at a nuclear research facility in Switzerland back in the late 80’s (who knew!) In its early stages, the web was extremely clumsy and had to be completely indexed by hand. It didn’t take long for the computer geeks of the world to create a very rudimentary search engine tool comprised of a searchable database of files that captured all public directory listings – the big problem here was the data they were able to ingest was limited and searching through it was a very manual and tedious task. After a few years of development, “all text” search engines were established (which is what we currently use today) providing users the ability to search for any word within the contents of any web page.

Up to this point, search engine tools were developed mostly by university researchers and small startups and although showing lots of promise, they had a difficult time monetizing them. Then one day a spinoff from a startup shop came up with the brilliant idea to sell search terms; a ‘pay-for-placement’ service to businesses which made search engines one of the most lucrative tech businesses almost overnight.     

Just Dial Limited

Like Google to the United States and Baidu Inc. to China, Just Dial Limited is the premier search engine provider in India. Just Dial also provides services to the US, UK, UAE, Canada and satisfies over 1.5 billion daily customer requests that come in from around the world.

The challenge: Just Dial had a strict retention policy of five years for their customer’s data with most of it being static and infrequently accessed. Their traditional SAN infrastructure was neither a cost effective nor scalable solution and like many other organizations, they had their concerns around putting sensitive customer data into the public cloud. There was also a constant demand for storage from their application developers and storage admins as capacity seemed to always be running thin.

The solution: Just Dial was in the market for an in-house, native object cloud-based solution that provided universal access, multi-site support, and easily integrated with their cloud services. They chose Dell EMC’s Elastic Cloud Storage (ECS) and would see an 80% reduction in their overall storage management costs. Just Dial was able to easily provision unlimited capacity to their end-users, move all static archival data to ECS by policy, and experience true cloud-scale economics across their data centers. Watch the video below for the full story:

 

Want to start your Digital Transformation with ECS? Find out how by visiting us at www.dellemc.com/ecs or try the latest version of ECS for FREE for non-production use by visiting www.dellemc.com/getecs.

Embrace Digital Transformation with Elastic Cloud Storage (ECS) 3.0

Sam Grocott

Senior Vice President, Marketing & Product Management at EMC ETD

Digital Transformation is drastically changing the business landscape, and the effects are being felt in every industry, and every region of the world. For some, the goal of this transformation is to use technology to leapfrog the competition by offering innovative products and services. For others, the focus is on avoiding disruption from new market entrants. Whatever your situation might be, it’s clear that you can’t ignore the change. In a recent study by Dell Technologies, 78% of global businesses surveyed believe that digital start-ups will pose a threat to their organization, while almost half (45%) fear they may become obsolete in the next three to five years due to competition from digital-born start-ups. These numbers are a stark indication of the pressure that business leaders are feeling to adapt or fall by the wayside.

But for IT leaders, this raises an uncomfortable question: Where will you find the money to make this transformation? You’re already under constant pressure to lower IT costs. How can you invest in new technologies while still doing this?

Elastic Cloud Storage (ECS), Dell EMC’s object storage platform, was built to help organizations with precisely this challenge. After being in market for just under two years, the latest release, ECS 3.0 is being announced at Dell EMC World today. ECS is a next-generation storage platform that simplifies storage and management of your unstructured data, increases your agility, and most importantly, lowers your costs. Let’s take a look at some of the ways ECS can help modernize your datacenter, clearing the way for you to embrace Digital Transformation.

Simplify and Accelerate Cloud-Native Development

The success of companies like Uber and AirBnB has highlighted the transformative power of “cloud native” mobile and web apps. Enterprises everywhere are taking note – in the previously mentioned Dell Technologies survey, 72% of companies indicated that they are expanding their software development capabilities. Often, these software development efforts are directed towards “cloud-native” applications designed for the web and mobile devices.

ECS is designed for cloud-native applications that utilize the S3 protocol (or other REST-based APIs like OpenStack Swift). ECS natively performs many functions like geo-distribution, ensuring strong data consistency and data protection, freeing up application developers to focus on what moves their business forward. This greatly increases developer productivity, and reduces the time to market for new applications that can unlock greater customer satisfaction, as well as new sources of revenue.

Reduce storage TCO and complexity

Legacy storage systems that sit in most enterprise datacenters are struggling to keep up with the explosion in unstructured data. Primary storage platforms are constantly running out of capacity, and it is expensive to store infrequently accessed data on these platforms. Additionally, as many businesses operate on a global scale, data coming in from different corners of the world ends up forming silos, which increase management complexity and lower agility in responding to business needs.
ECS is compatible with a wide range of cloud-enabled tiering solutions for Dell EMC primary storage resources like VMAX, VNX, Isilon and Data Domain.  Additionally, ECS is certified on many 3rd party tiering solutions, which enable it to act as a low cost, global cloud-tier for 3rd party storage platforms. These solutions drive up primary storage efficiency and drive down cost by accessing a lower cost tier with ECS. Tiering to ECS is friction-free, which means that apps or users accessing primary storage don’t have to change any behavior at all.

image1

Tape Replacement

The new ECS dense compute rack D-series increases storage density by more than 60%, making it an ideal replacement for tape archives. The D-Series comes as an eight node system that provides the highest density configurations for ECS at 4.5PB (D-4500) and 6.2PB (D-6200) in a single rack.

These new configurations provide the low cost and scalability benefits of traditional tape solutions, but without the lack of agility, poor reliability, and operational difficulties associated with storing data on tape.  Additionally, ECS makes business data available to BUs in an on-demand fashion. This allows organizations to fully embrace Digital Transformation, which relies on insights mined from business data to create more compelling experiences for customers.

Legacy application modernization

ECS can serve as an ideal storage platform for organizations looking to modernize legacy LoB applications that utilize or generate a large amount of unstructured data. Modifying legacy apps to point to ECS using the S3 (or other REST-based APIs like OpenStack Swift) protocol can help reduce costs, simplify maintenance of the application, and allow them to scale to handle massive amounts of data.

Take the Next Step

Learn more about how ECS can enable your transformation , follow @DellEMCECS on Twitter, or try it out – for free!

 

 

Buckets, Apps & Digital Exhaust…All in a Day’s Work For a Dell EMC Splunk Ninja

Cory Minton

Principal Systems Engineer at EMC

Grab your hoodies, your witty black t-shirts, and maybe your capes…it’s time for another exciting Splunk .conf, the annual Splunk User Conference taking place this week at the Walt Disney Swan and Dolphin Resort.  All of us at EMC are excited to be sponsoring .conf for the third year in a row, and this year our presence will be bigger and better than ever before. Dell EMC is hosting two technical sessions this year, we’ll have more than 20 of the Dell EMC Splunk Ninjas running around learning and a large booth in the partner pavilion demonstrating our technology solutions.. For all the details, check out our .conf16 site.

This year marks the beginning of a great relationship between two awesome tech businesses: Dell EMC and Splunk.  We joined forces through a formal strategic alliance that started in February.  This alliance enables Dell EMC and its partners to sell Splunk’s industry leading platform. And, it allows Dell EMC unique access to Splunk technical resources for solution design, testing, and validation.  Most importantly, it creates a framework for these two technology powerhouses to collaborate more effectively for customer success.

Why Dell EMC for Splunk?


When we talk about customer success, we mean it in two distinct ways: deploying Splunk on Dell EMC platforms and, using Splunk to derive value from Dell EMC infrastructure.

First, we believe success is deploying Splunk on a flexible infrastructure that not only helps Splunk run fast and efficiently, but also one that can scale easily as the usage of Splunk evolves in a customer organization.  We believe that converged and hyper-converged technologies powered by Dell EMC’s robust portfolio of storage technologies delivers on this vision and provide additional enterprise capabilities:

  • Cost effective & Optimized Storage – Dell EMC delivers optimized and efficient storage by aligning the right storage to Splunk’s hot, warm, and cold data long retention and varying performance requirements.
  • Flexible & Scale-Out capacity consumption model – Scale-out infrastructure to meet capacity and compute requirements independently or as a single, converged platform as per your data growth.
  • Data Reduction & other data Powerful Enterprise Capabilities – including secure encryption, compression & deduplication of indexes, and fast, efficient zero-overhead copies for protection.
    Bottom-less cold bucket – Scale-Out storage platforms, whether on premise or in the cloud, obviates the need for a frozen bucket by providing a PB-scale cold bucket solution, simplifying data management and making data always searchable.

splunk2

 

Splunk and Dell EMC engineering teams have engaged in a strategic collaboration to ensure that all Dell EMC platforms have been validated by Splunk to “meet or exceed Splunk’s published reference server hardware” guidelines.  The Splunk team takes this validation process very seriously and customers can rest assured that if they are considering infrastructure for your Splunk deployment, we have done extensive testing. Whether you are looking at hyper-converged solutions like VXRail or VxRack, converged solutions like VBlock systems, or just storage from EMC like ScaleIO, XtremIO, VNX, Unity, Isilon, or ECS, you can be confident that the work has been done by both Splunk and Dell EMC to make sure it runs well.

Secondly, we believe Splunk is an incredibly powerful platform for capturing and deriving value from machine data.  As it turns out, Dell EMC products spin off a massive amount of “digital exhaust” that can be captured easily and used to drive operational intelligence in IT.  Dell EMC has made massive investments over the last few years to build apps for our platforms and make them available in Splunkbase for free.  We’ve built apps for XtremIO, Isilon  and VNX and expect to have many more in the works.  These apps make it simple to ingest data from Dell EMC platforms, and we offer useful, pre-built reports and dashboards to make monitoring these assets simple.  And it doesn’t stop there…once the data is extracted from your Dell EMC platforms, the underlying searches powering our reports or just the indexes themselves can be used in investigations across the entire IT service stack.  One of my favorite things to hear from our customers is the exciting ways they use the apps beyond just simple reporting and I hope to hear many more stories this year at .conf2016.

Dell EMC Splunk Ninjas And Our Top Ten List

 

splunk_ninja_resizeThe Dell EMC Splunk Ninja team are at the show in their Dell EMC blue Ninja Hunt shirts. The Dell EMC Splunk Ninja team is a group of more than 40 systems engineers from across Dell EMC who have been trained the same way Splunk trains its own systems engineers.  The Ninjas hold certifications ranging from SE1 all the way to SE3, we’ve got skills across not only using Splunk, but administering and architecting it at scale.  This is a global team not only available to talk to you at .conf, but also available in the field to have direct conversations with you when you head back to the office.

 

 

Our wise, passionate and zany Ninja team recently pulled together a list of Top Ten Best Practices for Splunk on Dell EMC. This list has been amassed based on years of lab testing and real world customer experience. You may say ‘Duh’ to some, but others may surprise you.

Happy Splunking!

Enterprise Strategy Group on ECS: Meet data growth challenges with software-defined object storage

“This new era of massive content storage environments requires a new storage architecture, object storage.” That’s the view of Scott Sinclair, Storage Analyst at Enterprise Strategy Group (ESG) in its October 2015 whitepaper: “EMC Elastic Cloud Storage Offers Resilient Scalability for the New Generation of Workloads”. Let’s explore why ESG believes object storage is an essential enterprise technology.

Identifying The Challenges Of Data Growth

Managing today’s ever-growing quantities of (mostly unstructured) data is a constant challenge for most enterprises – a fact that ESG underlines in its whitepaper. ESG asked 373 IT decision-makers: “What are your organization’s biggest challenges in terms of its storage environment?

emcecs_1

The rapid growth of data was cited as a top challenge by 26% of IT decision-makers, which ESG says should not be a surprise. However, what may be more surprising is that all the other top challenges – including increased hardware costs, data protection costs, and staffing costs – can also be considered symptoms of data growth.

Why The Industry Is Moving To Object Storage

ESG says that object-based storage offers a strong solution to meet the multiple challenges created by data growth. It represents an evolution in the ability to store unstructured data, with near limitless scalability. Object storage also offers automatic geo-dispersed data protection and the ability to leverage commodity hardware, making it an ideal storage environment for a new generation of IT workloads.

To discover more about what attracts IT decision-makers to object storage, ESG also asked: “Which factors are responsible for your organization’s initial deployment or consideration of object storage technology?”

emcecs_2

As ESG reveals, across the wide variety of potential use cases for object storage, organizations are turning to the technology to help control TCO in the wake of rising digital content levels. But of those potential use cases, more organizations are looking to object storage as the foundation for the next generation of modern and cloud-based workloads.

Evaluating ECS Object Storage Advantages

ESG says that EMC’s object storage solution Elastic Cloud Storage (ECS) delivers key features for object storage, such as:

  • Software-defined architecture leveraging commodity components
  • A strongly consistent, global scale-out namespace
  • In-place Hadoop analytics with HDFS support
  • Support for S3 and OpenStack APIs
  • Combined erasure-coded and replication-based protection
  • Built-in journaling, snapshots, and versioning
  • Multi-tenant architecture
  • Flexible deployment models
  • On-premises data security

Today’s Demanding Workloads Are Ripe For ECS

As ESG comments: The next generation of workloads is looking to be even more dependent on larger levels of digital content than ever before, and therefore needs the next generation of storage.” Highlighted workload areas where ECS can help improve TCO and ROI for organizations include:

  • Foundation for a cloud storage solution: ECS supports your deployment of a cloud infrastructure with its ability to dynamically allocate resources – and to report on how they are being leveraged. Its potential for nearly infinite scalability along with its ability to leverage commodity hardware help keep cloud infrastructure costs low.
  • Data lake for business analytics: ECS offers the ability to pool all your data into a single globally distributed repository for business analytics to derive new value, while its multi-protocol access reduces the need to move data back and forth for analysis.
  • Global content repository: Offering a single scalable, resilient, and cost-effective pool that can serve multiple application and content types, ECS enables all the content within the repository to be globally accessible by web, mobile, and cloud applications – at up to 65% lower cost than public cloud.
  • Universal object storage platform for Internet of Things (IoT) with in-place analytics: The geo-distributed strong consistency of ECS provides the ability to collect and store IoT sensor data in locations closer to the actual “things,” which improves performance and saves cost.
  • Modern application development: The scale and automatic geographic accessibility of ECS can provide significant benefits for developing your modern applications, especially those that require access to a large pool of read-only content.
  • Cold storage archive: ECS-based archiving controls the growth of unstructured data by migrating “cold” data off of high-performing and more expensive storage – while allowing for the data to remain online and accessible.

The Next-Generation Object Storage Platform

As ESG concludes: “Object storage is designed for and ideally suited for large content storage. EMC’s ECS solution, ultimately, offers a foundation upon which IT organizations can build out the next generation of applications and workloads. The next-generation datacenter will need a next-generation storage solution, like ECS.”

Read the full ESG Whitepaper for yourself: ”EMC Elastic Cloud Storage Offers Resilient Scalability for the New Generation of Workloads”, October 2015.

Learn more about object storage with EMC ECS.

EMC ECS software is available to download now and try free.

 

Follow Dell EMC

Categories

Archives

Connect with us on Twitter