Archive for the ‘Isilon’ Category

Converged Infrastructure + Isilon: Better Together

David Noy

VP Product Management, Emerging Technologies Division at EMC

You can’t beat Isilon for simplicity, scalability, performance and savings. We’re talking  world-class scale-out NAS that stores, manages, protects and analyzes your unstructured data with a powerful platform that stays simple, no matter how large your data environment. And Dell EMC already has the #1 converged infrastructure with blocks and racks. So bringing these two superstars together into one converged system is truly a case of one plus one equals three.

This convergence—pairing Vblock/VxBlock/VxRack systems and the Technology Extension for Isilon— creates an unmatched combination that flexibly supports a wide range of workloads with ultra-high performance, multi-protocol NAS storage. And the benefits really add up, too:

As impressive as these numbers are, it all boils down to value and versatility. These converged solutions give you more value for your investment because, quite simply, they store more data for less. And their versatility allows you to optimally run both traditional and nontraditional workloads These include video surveillance, SAP/Oracle/Microsoft applications, mixed workloads that generate structured and unstructured data, Electronic Medical Records and Medical Imaging and more – on infrastructure built and supported as one product.

With a Dell EMC Converged System, you’ll see better, faster business outcomes through simpler IT across a wide range of application workloads. For more information on modernizing your data center with the industry’s broadest converged portfolio, visit emc.com/ci or call your Dell EMC representative today.

 

Learn more about Converged Infrastructure and IsilonAlso, check out the full infographic

Going Broader and Deeper: Isilon InsightIQ 4.1

Patrick Lynch

Consultant Product Manager at EMC Isilon

Latest posts by Patrick Lynch (see all)

Since it was first released, InsightIQ has been used by a majority of our customers as a valuable tool to understand what is going on in their Isilon environment.  A year ago, InsightIQ was made a zero-cost offering resulting in more customers learning how this solution can be useful to them, both within the realms of storage and IT management as well as in sharing InsightIQ with others within the organization. With an over 80% adoption rate, customers reduce storage management costs from the reporting and insight delivered by InsightIQ.

As I stated in my blog for the release of InsightIQ 4.0 in February, InsightIQ plays a critical role in providing access to information about who’s doing what in an Isilon environment.  This month we are excited to release our latest version, InsightIQ4.1 with key enhancements in making the solution more easily accessible to users within your organization while also introducing a new report that sheds even more light on actions within your Isilon environment.

Enabling users to answer their own questions!

InsightIQ 4.1 makes it easier for users to run their own reports!  We added integrated support for LDAP authentication, which makes it easier to provide access to InsightIQ to user groups within your LDAP server.  LDAP groups and sub-groups can be configured to have read-only or administrator roles.  Providing easier access to a broader set of users means storage and IT admins can save time answering user questions that they can find for themselves.

image1

 

Learn which workloads need updated settings!

The new performance report in InsightIQ 4.1 is one that shows key metrics of performance consumed by the OneFS Jobs and Services.  Analyzing the results of this report, and especially correlating with other performance reports in InsightIQ, can help shed light on which jobs may benefit from a change to their settings or priorities.  This can lead to overall performance optimization and balanced resource consumption in the cluster.  In this first screenshot, a summary table is shown listing the Jobs and Services that generated the most Disk Writes in the past hour (the time range for the report can be configured to whatever you require).

image2

 

The flexible time series charts enable you to identify trends or patterns in resource consumption. The new report also includes time series charts for each performance metric, with the powerful breakout and filtering capabilities available in all InsightIQ reports. This is valuable in helping decide what scheduling or setting needs to be adjusted to better manage resource consumption.

 

image3

 

Get Started Now! 

Take advantage of the new InsightIQ 4.1 today and start enjoying the benefits of these latest improvements.

Your Data Lake Is More Powerful and Easier to Operate with New Dell EMC Isilon Products

Karthik Ramamurthy

Director Product Management
Isilon Storage Division at Dell EMC

Earlier this year Dell EMC released a suite of Isilon products designed to enable your company’s data lake journey. Together IsilonSD Edge, Isilon OneFS 8.0, and Isilon CloudPools transformed the way your organization stores and uses data by harnessing the power of the data lake. Today we are pleased to announce all three of these products have been updated and further enhanced to make your data lake even more powerful and easier to operate from edge to core to cloud.

Starting with the release of OneFS 8.0.1

OneFS 8.0.1 builds on the powerful platform provided by OneFS 8.0 released in February 2016. The intent of this newest release is to provide features important to unique customer datacenter workflows, enhance usability and manageability of OneFS clusters. In addition, OneFS 8.0.1 is the first release that takes full advantage of the non-disruptive upgrade and rollback framework introduced in OneFS 8.0.

Let’s review some of the most compelling features of this software release.

Improved Management, Monitoring, Security and Performance for Hadoop on Isilon

Expanding on the Data Lake, one of the focus areas of this new release was increasing the scope and usefulness of our integration with leading Hadoop management tools. OneFS 8.0.1 delivers support for and integration with Apache Ambari 2.4 and Ranger. A single management point now allows Ambari operators to seamlessly manage and monitor Hadoop clusters with OneFS as the HDFS storage layer. Ranger is an important security management tool for Hadoop.  These Ambari and Ranger integration features benefit all customers using Hortonworks and ODP-I compliant Hadoop distributions with OneFS.

Additionally OneFS 8.0.1 adds new features including Kerberos encryption to secure and encrypt data between HDFS clients and OneFS. In addition, Datanode load balancing avoids overloading nodes and increases cluster resilience. OneFS 8.0.1 also supports the following HFDS distributions: Hortonworks HDP 2.5, Cloudera CDH 5.8.0, and IBM Open Platform (IOP) 4.1.

Introducing Scale-Out NAS with SEC Compliance and Asynchronous Replication for Disaster Recovery

With OneFS 8.0.1, Isilon becomes the first and only Scale-Out NAS vendor that offers SEC-17a4 compliance via SmartLock Compliance Mode combined with the asynchronous replication to secondary or standby clusters via SyncIQ. This powerful combination means companies that must comply with SEC-17a4 are no longer caught in a choice between compliance and data recovery – with OneFS 8.0.1 they have both!

Storage Efficiency Designed for the Healthcare Diagnostic Imaging Needs

For many years PACS (Picture Archiving and Communication System) applications diagnostic imaging data was stored in large “container” files for maximum storage efficiency. In recent years, the way referring physicians’ access individual diagnostic images changed and, as a result, the methods used to store diagnostic imaging files had to change as well. OneFS 8.0.1 has a new storage efficiency feature specifically designed for the Healthcare PACS archive market to provide significantly improved storage efficiency for diagnostic imaging files.  Isilon customers can expect to see storage efficiency similar to OneFS’s large file storage efficiency for diagnostic imaging files when using this feature.   you leverage Isilon to store your PACS application data you will want to talk with your sales representative and learn more about this new feature.

Upgrade with Confidence

OneFS 8.0, released in February 2016, provided the framework for non-disruptive upgrades for all supported upgrades going forward and the addition of release rollback. OneFS 8.0.1 is the first OneFS release that you will be able to test and validate and, if needed, rollback to the previously installed 8.0.x release. This means that you can non-disruptively upgrade to 8.0.1, without impacting users or applications! You will be able to upgrade sets of nodes or the entire cluster for your testing and validation and then, once complete, you decide to commit the upgrade or rollback to the prior release. Once committed to OneFS 8.0.1, future upgrades will be even easier and more transparent with the ability to view an estimate of how long an upgrade will take to complete and transparency of the upgrade process. The WebUI was enhanced to make upgrade management even easier than before.

Manage Performance Resources like Never Before

Even more exciting is the new Performance Resource Management framework introduced in OneFS 8.0.1. This framework is the start of a revolutionary scale-out NAS performance management system. In OneFS 8.0.1 you will be able to obtain and view statistics on the performance resources (CPU, operations, data read, data written, etc.) for OneFS jobs and services. This will allow you to identify quickly if a particular job or service may be the cause of performance issues. These statistics are available via the CLI, Platform API and can be visualized with InsightIQ 4.1. In future releases these capabilities will be expanded to clients, IP addresses, users, protocols and !

These are just some of the new features OneFS 8.0.1 has to offer. OneFS 8.0.1 improves on our support for MAC OS clients, SMB, audit, NDMP and data migrations, to name a few other areas.  The white paper, Technical Overview of New and Improved Features of EMC Isilon OneFS 8.0., provides additional details on these and other new and improved features in OneFS 8.0.1

Isilon SD Edge Management Server version 1.0.1

This July EMC released a new version of IsilonSD Edge Management Server. Version 1.0.1 provides support for VMware ESX 6.0 in addition to previously supported ESX versions. This management server also enables monitoring of the IsilonSD Edge Clusters via EMC’s Secure Remote Support (ESRS) server and tools.

Isilon CloudPools Just Got Easier to Manage

OneFS 8.0.1 provides improved flexibility for CloudPools deployments in the enterprise with the introduction of proxy support. This allows administrators to specify one or more proxy servers between the Isilon cluster and your cloud provider of .

The Data Lake Journey is Just Beginning!

OneFS 8.0.1 is an important step on the data lake journey; however, you can rest assured we are not stopping here! Look forward to amazing new hardware and software features in coming releases as we build on the Performance Resource Management Framework, provide more workload specific enhancements to address our customers’ needs and deliver new levels of supportability, serviceability, scale and performance.   Don’t wait, upgrade .  Click here to download OneFS 8.0.1.

Announcing Isilon OneFS 8.0.1

David Noy

VP Product Management, Emerging Technologies Division at EMC

It’s really been an exhilarating last couple of months leading up to the recent historical merger between Dell and EMC! We just completed our first Dell EMC World and announced Isilon All-Flash last week.  While all that was in progress, the Isilon team was heads-down focused on the next update to the industry leading Scale-Out NAS OneFS operating system.

Today, we’re announcing the new OneFS 8.0.1 release with a strong focus on strengthening the Data Lake with features supporting the horizontals and vertical markets we serve. For the horizontal markets, we’ve added new and improved capabilities around Hadoop big data analytics, Isilon CloudPools, and IsilonSD Edge. For the vertical industries we support, we’ve focused on enhancing the needs of the Healthcare and Financial markets.

Customers continue to gain more value from their data with analytics.  Hadoop based solutions have always been a pillar for Isilon customers because of native support for HDFS protocol in the OneFS operating system. In OneFS 8.0.1, we’ve added support for Apache Ambari to proactively monitor key performance metrics and alerts which enables enterprise customers to have a single point for management of the entire Hadoop cluster. In addition, from a security perspective, not only have we integrated with Apache Ranger to deliver seamless authorization and access control, but we’ve also added support for end-to-end data in-flight encryption between Isilon nodes and the HDFS client.

Many of the Isilon enterprise customers continue to use OneFS because of its simplicity and ease of management at scale. We’ve added many new features for enterprises like CloudPools proxy support to increase security, reduce risk, and simplify management. For IsilonSD Edge software defined storage, we’ve added support for VMware ESX 6.0 and have seamlessly integrated with EMC Remote Support (ESRS) for remote monitoring, issue resolution and troubleshooting.

Other enterprise capabilities include seamless non-disruptive upgrades from OneFS 8.0, upgrade rollback support, a 5X improvement in audit performance and a completely re-written framework for performance resource management,  reporting and data insights.

Isilon deployments continue to add value for customers across verticals like Media & Entertainment, Healthcare, Life Sciences, EDA and others. In this release we have strengthened our solutions for the Healthcare and Finance verticals.  For Healthcare PACS workloads, we’ve added capabilities in OneFS 8.0.1 that increases the efficiency, optimizes the storage and significantly improves the storage utilization for PACS archive workloads. For the Financial industry, we’ve added seamless integration for compliance data with business continuity features by integrating SmartLock compliance mode with SyncIQ replication for push button failover and failback.

OneFS 8.0.1 – the first major upgrade to the OneFS 8.0 code base – it contains a number of features that many enterprises were waiting for. If you are looking to upgrade to the OneFS 8.0 code base because you generally want to wait for a subsequent “dot release”, today is the day, your wait is over!

The New Isilon All-Flash Scale-Out NAS: Revolutionary File Storage That’s All About the Software

David Noy

VP Product Management, Emerging Technologies Division at EMC

161001-isilon-bold_front_sm2The topic of flash in the data center is a hot one, and you may have your own views. But to truly get a handle on everything flash can do for you, it helps to understand what’s driving all the excitement. Because there’s more to it than you might realize.

Two things are going on. First, SSDs are replacing spinning disks, increasing reliability and lowering costs while density keeps climbing. Now you can get flash storage that has an 8x higher density than was possible not too long ago. Second, the ongoing data explosion causes storage requirements to nearly double every two years—and 80% of this new data is unstructured.

Increased performance demands from powerful, next-generation applications that use all this unstructured data mean that they too need flash technology. Billions of devices connected to the Internet of Things inundate companies of all sizes with unprecedented amounts of data to which they need fast, secure access. At the same time, innovation has expanded the term “mission-critical” in unforeseen ways. For example, in the media and entertainment sector, the need for lightning-quick access to data has grown enormously as changes in consumer behaviors drive changes in business models.

Now, with the introduction of Isilon All-Flash Scale-Out NAS, you have an unprecedented opportunity to take advantage of flash for all of your critical unstructured data workloads.

 

Going Beyond Performance

All-flash storage helps address the need for extreme performance. Unfortunately, most all-flash solutions available today are focused on support of block-based data applications, which represent just 20% of most businesses’ data. While some vendors have recently introduced all-flash NAS products, they’re typically early versions that lack the enterprise capabilities organizations need when it comes to data protection, security and management. The Dell EMC Isilon All-Flash solution is different. Very different.

What makes Isilon All-Flash truly unique isn’t hardware — the real difference is the software. Isilon All-Flash runs on the same Isilon OneFS operating system that today powers other Isilon platforms and is used successfully by thousands of organizations around the world. Now in its 8th-generation, Isilon OneFS, and its extensive enterprise capabilities, is the reason Isilon is recognized as the #1 scale-out NAS storage platform in the industry. Isilon All-Flash combines the extreme performance of flash with the massive scalability and other vital enterprise-grade capabilities that organizations need:

 

  • Extreme performance: To support your most demanding unstructured data workloads, Isilon All-Flash delivers up to 250,000 IOPS and 15 GB/s bandwidth per chassis, and a total cluster performance of up to 25M IOPS and 1.5 TB/s bandwidth.
  • Massive scalability: With Isilon All-Flash, you can scale storage capacity from 92 TB to 924 TB in a single 4U chassis, and up to 92.4 PB in a single Isilon cluster.
  • Operational flexibility: Because Isilon All-Flash is powered by the Isilon OneFS operating system with its extensive multi-protocol capabilities (including NFS, SMB, FTP, HDFS, REST, Swift, and HTTP), you can support a wide range of applications and workloads on a single platform.
  • Enterprise data protection: Unstructured data is critical to your business. Isilon All- Flash ensures its integrity and availability with up to N+4 redundancy as well as enterprise-grade backup and disaster recovery.
  • Robust security: Definitely don’t want to compromise here. Options include role-based access control (RBAC), secure access zones, SEC-compliant write once read many (WORM) data protection, file system auditing, and data encryption.
  • Unmatched efficiency: Isilon All-Flash delivers the lowest total cost of data. Storage utilization can exceed 80%, and SmartDedupe can increase effective capacity up to an additional 30%.

 

Better Economics with Automated Storage Tiering

Another distinct advantage of Isilon All-Flash is the ability to tier data automatically to the most appropriated storage resources. With Isilon SmartPools and CloudPools software, Isilon All-Flash storage solutions can take advantage of policy-based, automated storage tiering to move data automatically to lower-cost tiers—including a choice of cloud storage options—as data ages or becomes less valuable. This enables you to reduce capital expenses and optimize storage resources by reserving Isilon All-Flash storage for your most demanding applications.

160930-isilon-bold_pers_sm2

Start Your Transformation with Flash Technology for Unstructured Data

You know Dell EMC as the market leader in All-Flash storage and Isilon as the recognized leader in scale-out NAS. Now we’re providing you with the new Isilon All-Flash scale-out NAS storage platform that combines the extreme price/performance advantages of flash technology with the proven efficiency, flexibility and resiliency of Isilon OneFS, the #1 scale-out NAS storage platform in the industry.

Isilon All-Flash will be available in 2017. To receive updates on the launch, visit emc.com/isilon. To pre-order, call your Dell EMC representative today.

Population Boom, Energy Boom

Yasir Yousuff

Sr. Director, Global Geo Marketing at EMC Emerging Technologies Division

Latest posts by Yasir Yousuff (see all)

In its 2015 World Population Prospects report, the United Nations documented the global population at 7.3 billion with 60 percent attributed to rising Asia.

As with most, if not all emerging economies, energy consumption has witnessed exponential growth in recent decades, spurred by expanded economic activity that has done well to lift much of the masses into a more prosperous middle class. Living standards have improved as a consequence, further accelerating demand for energy to power luxuries like air-conditioning, consumer electronics, and automobiles, among others.

So what does this all mean? With global population set to climb to 9.7 billion by 2050m the strain on the world’s energy resources is expected to increase exponentially.

Hitting a Rocky Patch

oilandgas_resizeHere’s where Chuanqing Drilling Engineering (CDE), a Geophysical Prospecting Company of China National Petroleum Corporation, enters the fray. China is the biggest energy consumer in Asia and relies on companies like CDE to uncover new energy sources to feed its ever-growing appetite.

The services offered by CDE are extensive and high in demand both in China and the global stage. They include engineering and geological research, geophysical surveys, drilling engineering, downhole services, mud logging, well logging and perforating, oil and gas field engineering construction and development, civil works, as well as oil/gas field cooperative development.

Specialized these fields are, yet all derive their invaluable insights from seismic data processed by high-performance computing software. Unbeknownst to many, these industry applications are much more robust than the ones that run on any given PC. The algorithms and calculations that make sense of gargantuan raw data solicited from seismic explorations in varying geological environments are extremely complex, owing to the need for mechanical precision that can make or break any mission-critical task.

In this regard, it is not surprising that the few SAN storage systems deployed by CDE had issues handling the massive growth of data from its exploration activities. Reduced storage capacity resulted in diminished performance, which inadvertently made data analysis increasingly challenging.

A Well-Drilled Solution

CDE’s problem was overwhelming to say the least but its solution was one of relative simplicity: a highly scalable, high-performance platform to meet the demands of its exploration activities and data analysis. In essence, a change of CDE’s IT environment was long overdue and called for.

Following comprehensive consultations with EMC, CDE made the decision to implement a single cluster comprising EMC Isilon X410 with 23 nodes, providing scaling capacity up to 1.6 petabytes. With scale-out NAS deployed, the system possessed the further ability to scale up to 50 petabytes when the need eventually called for it.

Discovering Productivity

“EMC Isilon storage is far easier to manage and has resulted in considerable savings. We estimate that we’ve achieved a 33 percent reduction in costs,” says Tang Chengbing, Director of the Computer Center at CDE.

In an industry where financials are monitored in the billions, not millions, 33 percent represents a significant figure that can mean the different between a profitable or loss-making calendar year.

Storage aside, software such as EMC Isilon SmartQuotas and SmartDedupe have enabled CDE to simplify workflows and eliminate duplicates from a high accessible and secure single volume of storage. It is all part of an ecosystem of smarter allocation so working divisions never face a shortage of capacity nor wasteful surplus like they did with disparate storage solutions.

Future Ready Energy Exploration

Problem solved? Yes, but it is just the beginning.

“It is inevitable that data volumes will increase in the next few years, and with that in mind we need strong technical support from our IT partners,” adds Tang.

The diversity and intensity of seismic data analytics will only become more robust as innovation continues to take flight in this vital field. With EMC’s storage infrastructure firmly established in the company’s operating DNA, CDE can now adopt new solutions flexibly in tandem with fast-paced technological progress.

Read the Chuanqing Drilling Engineering Case Study to learn more.

 

Follow Dell EMC

Categories

Archives

Connect with us on Twitter