Posts Tagged ‘InsightIQ’

Going Broader and Deeper: Isilon InsightIQ 4.1

Patrick Lynch

Consultant Product Manager at EMC Isilon

Latest posts by Patrick Lynch (see all)

Since it was first released, InsightIQ has been used by a majority of our customers as a valuable tool to understand what is going on in their Isilon environment.  A year ago, InsightIQ was made a zero-cost offering resulting in more customers learning how this solution can be useful to them, both within the realms of storage and IT management as well as in sharing InsightIQ with others within the organization. With an over 80% adoption rate, customers reduce storage management costs from the reporting and insight delivered by InsightIQ.

As I stated in my blog for the release of InsightIQ 4.0 in February, InsightIQ plays a critical role in providing access to information about who’s doing what in an Isilon environment.  This month we are excited to release our latest version, InsightIQ4.1 with key enhancements in making the solution more easily accessible to users within your organization while also introducing a new report that sheds even more light on actions within your Isilon environment.

Enabling users to answer their own questions!

InsightIQ 4.1 makes it easier for users to run their own reports!  We added integrated support for LDAP authentication, which makes it easier to provide access to InsightIQ to user groups within your LDAP server.  LDAP groups and sub-groups can be configured to have read-only or administrator roles.  Providing easier access to a broader set of users means storage and IT admins can save time answering user questions that they can find for themselves.



Learn which workloads need updated settings!

The new performance report in InsightIQ 4.1 is one that shows key metrics of performance consumed by the OneFS Jobs and Services.  Analyzing the results of this report, and especially correlating with other performance reports in InsightIQ, can help shed light on which jobs may benefit from a change to their settings or priorities.  This can lead to overall performance optimization and balanced resource consumption in the cluster.  In this first screenshot, a summary table is shown listing the Jobs and Services that generated the most Disk Writes in the past hour (the time range for the report can be configured to whatever you require).



The flexible time series charts enable you to identify trends or patterns in resource consumption. The new report also includes time series charts for each performance metric, with the powerful breakout and filtering capabilities available in all InsightIQ reports. This is valuable in helping decide what scheduling or setting needs to be adjusted to better manage resource consumption.




Get Started Now! 

Take advantage of the new InsightIQ 4.1 today and start enjoying the benefits of these latest improvements.

InsightIQ 4.0 – the latest in Data Insights for Isilon

Patrick Lynch

Consultant Product Manager at EMC Isilon

Latest posts by Patrick Lynch (see all)

Isilon environments are large, powerful and efficient, but sometimes actions by users can negatively impact that performance and efficiency.  In these cases, storage admins need tools to quickly understand what’s going on and who’s doing what and how resources are being used.

We collectively call these needs “Data Insights” and have defined three vectors of innovation to address these needs:

  • Actionable Understanding: quick access to relevant data that helps to understand what’s going on and who’s doing what
  • Improved Storage Utilization: tools to track and manage how resources are being used
  • Personalized Dynamic Information: enabling customers to get exactly the information and value they need out of their Isilon environment

The “showcase application” for Data Insights in your Isilon environment is InsightIQ.  InsightIQ provides easy and powerful drill-down of thousands of real-time performance statistics to help admins quickly interpret and understand what’s going on in their Isilon clusters, and even who’s doing what type of activity.  The screenshot below shows just one example of breaking down a cluster’s network throughput by client.  Mind you this is just the first level of drill down.  You can also apply filters to explore more details about the activity of that top user.  Views like this are available for a wide range of real-time performance metrics including node performance, disk performance, cluster events and more.Insight IQ Dashboard

This week we released version 4.0 of InsightIQ which rolls up all the foundational improvements that were delivered throughout 2015 increasing performance and reliability as well as introducing new capabilities and support for the latest release of OneFS, version 8.0.

The exciting enhancements delivered in InsightIQ v4.0 include:

  • Capacity Utilization Forecast Tool (see screen capture below) at the cluster level that can also be broken out by tier and nodepool to help predict when and what type of resources will be needed to support the growth trends in your Isilon environment.
  • Improved management options for the data collected, stored and analyzed by InsightIQ.
  • Deliver fresher insights on the Isilon File System leveraging the improved FSA (File System Analytics) capability in OneFS 8.0 which was released earlier this month.

Insight IQ Reporting

Best of all, in October 2015, EMC made InsightIQ a zero-cost solution!  This move has encouraged more and more customers to take advantage of the great Data Insights capabilities of their Isilon environments, and positioned them to reap benefits throughout this year as we continue to make improvements to InsightIQ.

Try out InsightIQ today, if you haven’t already started using it!  If you have InsightIQ, upgrade to this newest release and start down the path of improving your Data Insights experience in your Isilon environment.

InsightIQ® 2.5: Driving Storage Performance Metrics to the Next Level

Flexible deployment + powerful data export tools = the perfect time to upgrade your customers

It is no secret that viewing and analyzing storage performance data can bring infinite value to your customers, which is why we took performance metrics to the next level with our latest release of EMC Isilon InsightIQ® 2.5, which now includes integration with third-party tools and flexible deployment options.

Today’s update is a direct result of feedback we received from our partners and customers who requested a simpler, more integrated product. They realize that EMC Isilon InsightIQ software is the perfect complement to EMC Isilon scale-out storage systems, so we added tools and options that will maximize the performance of their storage systems, simplify the process, and forecast their future needs. Your customers will reap great benefits, such as improved performance and deeper insight into their data analytics.

New data export tool

Previously, customers had to use other products in conjunction with InsightIQ to extract end-to-end performance data. With InsightIQ 2.5, there’s no need for another product, thanks to an included data export tool. This new tool allows users to access InsightIQ data in two ways:

  1. By using ad-hoc data extraction by simply clicking on “download” from the user interface and exporting it into in a spreadsheet.
  2. By using the command line interface, which enables customers to define the data to extract, and set up a regular schedule of data exports into their own analytics tool, such as Splunk.

Multiple deployment options

In addition, customers now have a choice on how to deploy InsightIQ. Previously shipped as a plug-and-play virtual appliance, customers simply launched it, entered a password, and connected to clusters. However, the underlying operating system, Linux Ubuntu, did not fit well into some customers’ data centers. While retaining the option to install InsightIQ as a virtual appliance, InsightIQ 2.5 also provides a new native installation option that allows customers to install InsightIQ on Red Hat Enterprise Linux or CentOS, and physical hardware. This not only improves performance, but also enables customers to run InsightIQ without configuring a virtualized environment.

Even easier upgrading

Previous upgrades to InsightIQ meant setting up a new virtual appliance, and then manually importing the configuration. But now, with InsightIQ 2.5, customers can simply apply the upgrade and retain all previous configurations—making upgrades non-disruptive.

As you can see, we listen to feedback that is given to us. If you’re an Isilon customer and have any questions or comments on InsightIQ, I encourage you to let me know.

How Granular Can You Get With InsightIQ?

Data is inherently important to business. But to make the best use of the data, you need to understand it: what is frequently accessed and what isn’t? Which applications demand higher throughput? Where are the bottlenecks in the system—not just the storage system, but also individual applications, clients, and the network? If you can get a grasp on how data flows through your entire workflow, you’ll be able to maximize use of your entire computing infrastructure.

Screen shot 2010-07-07 at 10.21.23 AM

Isilon’s new InsightIQ™ app makes it simple to analyze data storage, find trends and take action (click image to enlarge). InsightIQ takes a myriad of potentially overwhelming data—per-client throughput and I/O numbers, load balancing metrics across storage nodes, and network latencies (to name a few) and through a simple, compelling visual web application—turns it into useful information.

Screen shot 2010-07-07 at 10.29.21 AM

One of the most common requests that I get asked for is the ability to see exactly which clients and servers are hot at any moment’s notice—or even more interesting, which files and directories are. Of course, both of these capabilities are provided with InsightIQ (click image to enlarge).

Not only do you need the ability to see performance metrics in real-time, but you also need to understand the progression and composition of data within the workflow (click image to enlarge).

Screen shot 2010-07-07 at 10.44.00 AM

How much of your data is stale? What kind of data is more prevalent and at what rates is it growing?

InsightIQ gives you simple tools to easily understand your data flow – which enables you to take the next step, maximizing your environment. Leveraging SmartPools™, data can move automatically between price/performance tiers—or you can optimize different types of data for access pattern (sequential, random, or concurrent) without any data movement at all.

By tracking storage movement and system trends you’ll be able to better manage existing data, and be prepared for continued data growth.

For more info, check out the Flash demo on the InsightIQ product page.

How to Save Time and Money with SmartPools


Let’s say you have a variety of Isilon storage tiers in your cluster: a few NL-Series, a handful of X-Series, and a bucketful of S-Series. Rather than managing each tier separately, Isilon’s new SmartPools™ application allows you to aggregate it all into a single file system—meaning a single point of management for all the data and apps in your cluster (Click image to enlarge). Even further, policy-based data movement automatically moves data to the appropriate tier without complex links, stubs or manual data migration. You’ll get much higher utilization from your storage space, plus quicker access to the data that matters most.


SmartPools enables storage administrators to right-size and accelerate their working set while automatically and transparently moving inactive data to more cost-effective storage (click image to enlarge). In addition, SmartPools unlocks the ability for storage administrators to aggregate and consolidate applications—providing workflow isolation, higher utilization, and independent scalability—all from a single point of management.

How much space is left on your X-Series versus NL-Series tiers? Isilon’s InsightIQ™ app will tell you. Knowing where and how your data is accessed allows you to expand your cluster as cost-effectively as possible, but also quickly—in 60 seconds—because you’re adding it to the “smart” pool of storage.

For more info, check out the Flash demo on the SmartPools product page.

Great Coverage: OneFS 6.0, SmartPools and InsightIQ Launch

Sam Grocott

Senior Vice President, Marketing & Product Management at EMC ETD

Last week Isilon earned some great coverage of its sixth generation of the OneFS® scale-out storage operating system and two new data management software applications — SmartPools™ and InsightIQ™. Read what these key industry publications are saying about it: HDS, two vendors boost their cloud storage; Double-Take Flex for HPC delivers iSCSI SAN boot option

Chris Preimesberger, eWeek: Five Key Data Storage Trends at Mid-year

David Greenfield, Network Computing: Isilon Simplifies Data Management For Enterprise IT

Broadcast Engineering Magazine: Isilon rolls out next generation of OneFS 6.0, SmartPools, InsightIQ

Joseph F. Kovar, CRN: Isilon Adds Auto Tiering, Analytics To Its OneFS Storage OS

Image and Data Manager Magazine: Scale-out grows up with Isilon

Chris Preimesberger, eWeek: Isilon Spiffs Up Its OS, Adds New Management Tools



Connect with us on Twitter