Archive for the ‘DSSD’ Category

Dell EMC DSSD D5 And Toshiba Accelerate AI With Deep Learning Test Bed

Jason Tolu

Senior Product Marketing Manager | DSSD, Emerging Technologies Division at Dell EMC

Latest posts by Jason Tolu (see all)

DSSD D5 Rack-Scale Flash Storage Provides High Performance Storage To New Toshiba Deep Learning Test Bed For Facilities Management

With increasing computing power and the Internet of Things supplying ever increasing sources, types and amounts of data, the potential for new, innovative applications and products are limitless.   One way to organizations are taking advantage of this is through machine learning or deep learning, where computers learn from the data with the use of analytical models.  More and more complex algorithms are being applied to massive quantities of data to develop machine learning, AI driven applications such as self-driving cars or smart buildings. image1

Toshiba Corporation is at the head of the deep learning movement.  The Toshiba Smart Community Center in Kawasaki, Japan, which opened up in 2013, makes use of a wide variety of IoT sensor devices and is a key element in their vision to bring new innovations to market for smarter facility management. To make this vision possible, Toshiba and Dell Technologies have joined forces to develop a deep learning test bed to improve the management of IoT edge devices that provide data to enterprise networks.  The jointly developed solution has become the first deep learning platform to be approved by the Industrial Internet Consortium (ICC).

The test bed will be used in Toshiba’s Smart Community Center in Kawasaki, Japan and will utilize big data from a variety of sensors, including building management, air conditioning and building security, to provide more efficient machine control, reduce maintenance costs and improve the management for building facilities.

screen-shot-2016-11-14-at-1-53-46-pm

DSSD D5 Provides The Storage Performance For Machine Learning and AI

Toshiba will be providing the deep learning technology for analyzing and evaluating big data for the Deep Learning test bed. Dell EMC DSSD D5 will provide the high-speed storage – the low latency, along with the IOPS, bandwidth and the capacity required for rapid ingest and complex analytics on large data sets in near real-time.

In developing the solution, Toshiba utilized Hadoop to achieve record-breaking performance. Toshiba’s choice of DSSD D5 as the storage layer in this Deep Learning solution validates DSSD D5’s standing as the high performance storage of choice for next generation applications that are striving to take advantage of growing data and computational power.

Limitless Possibilities For Smart Facilities Management

With the integration of Toshiba Deep Learning and high performance storage from Dell EMC DSSD D5, Toshiba and Dell Technologies are accelerating the application of artificial intelligence to benefit multiple industries.  And, with the approval of ICC, the jointly developed solution is a major step in the advancement of IoT for industrial usage. The verification of the test bed at the Smart Community Center is expected to be concluded by September 2017.  Once the verification is complete, Toshiba intends to roll out the solution to hospitals, hotels, shopping malls, factories and airports.

If you would like to find out more about the Toshiba and Dell Technologies Deep Learning Solution:

A Co-Design of Hardware and Software: Part 3 – How Do You Connect to 18,000 NAND Die in Parallel‬?

Donald Wake

Consultant Technical Marketing Engineer at EMC | DSSD

DSSD D5 and the worlds largest and first NVMe over PCIe Mesh Fabric

In this third & final installment of our three part blog series titled “A Co-Design of Hardware and Software” we will literally open up the box and show you all the hardware that makes the D5 work.  In Part 1 of the seriesA Flood of Data Needs Flood Software” we discussed and linked to Mike Shapiro’s overview video that explains how the EMC DSSD D5 Rack-Scale Flash Solution delivers both extreme performance and the lowest possible latency using a radical new approach to Hardware and Software Co-Design.

emc_dssd_Paint_v2In Part 2 of the series, we discussed and linked to Jeff Bonwick’s video showcasing EMC DSSD’s patented Cubic RAID algorithm.  We learned how the Cubic RAID algorithm makes the DSSD D5 “The Safest Place In Flash For Your Data” while also being the fastest storage appliance on Earth!

In this final installment Chris Frank, Senior Director of Hardware at DSSD peels back the metal and shows you the inside of the world’s largest, fastest NVMe over PCIe Mesh Fabric.
As Chris shows, the EMC DSSD D5 is a quantum leap in Shared Flash Storage technology that took some incredible new hardware invention, including:Chris_DSSD_Paint_v2

  • The world’s densest flash modules with 512 distinct NAND Die per FM
  • Dual-ported Gen 3 PCIe x4 lane client cards that can be installed in up to 48 servers.
  • I/O modules that provide 48 PCIe connections each.
  • An ultra-dense PCIe connector and cable to connect each client port to a DSSD D5 IOM port.
  • Separation of control and data planes to prevent I/O bottlenecks

 

Along the way, Chris shows how these elements are sharable across servers—without traditional, high-latency networking technology.

 

A Co-Design of Hardware and Software: Part 2 – The Safest Place in Flash for your Data

Donald Wake

Consultant Technical Marketing Engineer at EMC | DSSD

DSSD D5 leapfrogs the competition 

We’ve already seen how DSSD D5 leapfrogs the competition by delivering extreme performance and the lowest possible latency in a single solution.  But that’s just part of the story. DSSD D5 also represents a quantum leap in reliability and resilience.

Jeff BonwickRealizing the full potential of Flash memory

The DSSD D5 Hardware and Software were co-designed from the beginning to extract the maximum performance and usable life possible from Flash memory.

Jeff explains in his video how the DSSD D5 architecture works to: limit memory wear, deal with flash performance degradation over time, ensure data retention and constantly protect data at the data fragment level.

(more…)

Rack-Scale Flash Converged Infrastructure

Rahul Pradhan

Product Management, Emerging Technologies at EMC² DSSD

Latest posts by Rahul Pradhan (see all)

These are exciting times to be part of EMC and DSSD for anyone who is passionate about working on cutting-edge, innovative technologies that deliver real business value to customers. Earlier this year – on leap day – DSSD launched an innovative Rack-Scale Flash product that broke all storage performance records and led to the creation of a new product category of Rack-Scale Flash for addressing ultra high-performance low latency use cases. With an innovative co-design of hardware and software, DSSD blurs the distinction between memory and persistent storage. This represents a new class of storage that offers the best of networked storage (shared access, enterprise reliability, and availability) and direct attached server storage (high performance, low latency) without the drawbacks of either approach. Applications can now have access to extremely large data sets at near memory speeds. This will significantly accelerate existing applications while opening up the possibilities for real-time analytics on larger in-flight data sets which weren’t previously possible.

Rack Scale Flash

Since the DSSD product launch, one of the top requests we hear from a lot of our customers as they start deploying Rack-scale Flash in production – is to consume it as a converged infrastructure that is engineered, validated, tested, managed and supported as an integrated system. This isn’t a surprise to us here at EMC since we have the leading converged infrastructure brand (VCE) in the world as part of EMC’s Converged Platform Division. Analysts predict that Converged Infrastructure is the direction that the majority of  IT infrastructure will be consumed as in the future.

In response to the customer demand and market trends, the teams at VCE and DSSD came together to engineer the industry’s first Rack-Scale Flash (RSF) converged infrastructure product on the market and today we announced a VxRack System with DSSD built for high-performance databases and data warehouses. As with all VCE converged systems, it will be engineered, manufactured, managed and supported as a single product.

Some of the highlights of the system include –

  • Industry’s first Rack-Scale Flash converged infrastructure system that delivers near memory like performance for dense shared flash that can be pooled and consumed by a rack of servers.
  • The world’s fastest all-flash converged system comprising of industry standard dense compute and high-performance networking connected to DSSD’s Rack-Scale Flash platform.
  • The system offers an aggregate of up to 288 compute cores with 2TB of RAM, up to 3.2 Tb/s of network switching capacity and up to 144TB of ultra-dense flash storage that delivers 10 Million IOPS, 100 GB/s of bandwidth at less than 100 microseconds of latency all in less than 20 RU which is less than half the size of other competitive all-flash solutions. The ability to stripe two DSSD D5 systems together for increased performance (2X the IOPS, bandwidth, and capacity) will also be available as part of the converged infrastructure offering.

Rack Scale CI System

The Rack Scale Flash Converged Infrastructure system is built to address customer challenges with current infrastructure for high-performance databases and data warehouses. We are experiencing an unprecedented growth in the number of users, devices and data due to trends in social, mobile and the Internet of Things. This is offering businesses a unique opportunity to gain insights and customer intimacy by analyzing this variety and volume of data from disparate data sources in real-time. However, this also puts a significant burden on the underlying infrastructure. Today, customers employ several workarounds in order to analyze the data – ranging from analyzing a smaller data set to reducing the scope of the analysis to splitting data across multiple data marts – all of which results in suboptimal processing and impacts decision making.

With EMC’s Rack Scale Flash Converged Infrastructure customers can significantly accelerate transactional workloads, shorten the Extract, Transform and Load (ETL) process and make Data Warehouses run faster while reducing operational expenses by consolidating different analytical and transactional workloads on one storage device. The high performance of the system across all vectors (Bandwidth, IOPS, Latency) and its density (compute and storage) makes it the best platform available for both transactional and data warehousing workloads.  It will enable customers to analyze more data in real-time, produce faster results to drive business decisions while providing consistent service levels at all times.  Some example use cases include – real-time business dashboards, large order processing systems, risk analytics and fraud detection, credit card transaction processing etc.

Rack Scale Converged Infrastructure

The product will be generally available later this year, in multiple configurations offering customers the flexibility to start small and grow as needed. It can be deployed as a standalone converged infrastructure or as an extension to existing VCE systems and will be managed by the same management software that VCE customers love and are familiar with. All components of the system will be tested, pre-installed, cabled and racked ready to be deployed in the customer environment. This will result in a faster time to deployment while dramatically reducing time to analysis and results. All databases and applications can be deployed as is on the RSF CI system and will run faster without any need for modifications of the application or rewrites of queries and stored procedures.

With this announcement, EMC customers now have a choice of deploying their Rack-Scale Flash platform either as a ‘do-it-yourself’ system based on our published server and network compatibility matrix or as an engineered Rack-Scale Flash converged infrastructure that will combine the unprecedented performance, reliability and flexibility of the DSSD Rack-Scale Flash architecture with VCE’s integrated management and support portfolio for increased system availability, reliability, and productivity.

DSSD Hero Numbers

DSSD D5 Rack-Scale Flash – Multiples not percentages faster

Jeff Bonwick

Co-Founder & CTO at EMC² DSSD

Latest posts by Jeff Bonwick (see all)

As part of the launch of the DSSD D5 Rack-Scale Flash appliance in recent weeks I’ve had the opportunity to meet with customers, partners, analysts and reporters in Munich, Vienna, London, New York, and Washington, DC.  I want to share a few highlights of these meetings to help illustrate what impact this new category of storage is having on the market.

“Problems that were previously unsolvable are now solvable.”

 10M IOPS
~100 microsecond latency
100GB/s of bandwidth

DSSD D5 Front

Scientist from major data processing company describes D5 as “BrilliantGenome
A major data processing company in Germany quietly powers much of the travel industry, including 430 airlines and 280,000 hotels.  As one familiar example, when you book a flight and get your six-letter confirmation code, that comes from this company’s product.  The problem might seem straightforward, but the scale is huge and meeting their 3ms SLA is challenging.  At the end of our meeting, the data scientist responsible for their entire IT architecture, described D5 as “brilliant”.

A research institute in Vienna solves some of the most difficult problems in life sciences
The research institute has been testing D5 via one of our EMC DSSD D5 solutions centers for some time.  The first “pipeline” (a series of data-intensive computations to solve a specific class of problem) that they tested ran 2x faster.  Encouraged by this, they tried another pipeline and found it ran 4.8x faster using the DSSD D5 versus their existing storage architecture.  All of this is without any tuning.  They are very pleased with the results they are seeing.

D5 Praise from Top Journalists in London
At the London launch event I met with several journalists including Chris Mellor of The Register. Summarizing D5 performance, he wrote:  “No other supplier has a storage array equivalent in performance to the D5; it stands alone.”

 Watch the DSSD D5 Keynote video of the launch. In “chapter 8” of the video, at approximately 14 minutes you will find the D5 demonstration.


Watch the DSSD D5 Keynote video of the launch. In “chapter 8” of the video, at approximately 14 minutes you will find the D5 demonstration.


Cloudera Announces D5’s Speed at Launch Event
At the New York Stock Exchange launch event, Mike Olson, founder of Cloudera, announced that in their testing, HBase running on D5 was 10 times faster than anything they’ve ever measured before.

NYSE

Performance Gains Measured in Multiples, Not Percentages
Most new products make incremental progress, offering modest performance gains.  But a colleague of mine once said, “I’m not interested in percentages — I want multiples.”  We’ve learned from our early access program that the D5 is 10-100x faster than any other product when running real customer workloads.  That is an incredible accomplishment, and one we are all very proud of at EMC DSSD.

The real significance of D5 is not so much in the raw numbers, but in what they enable. Reducing the time to sequence a tumor genome from a month to a day can literally save someone’s life.  D5 is going to change not only the storage market, but the world.  And we’re just getting started.  We can’t wait to see what people do with this game-changing new tool.

We have made a great effort to provide a rich set of resources for you to learn more about the DSSD D5.  Please visit www.emc.com/dssd to learn more and Follow us on twitter: @EMCDSSD

A Co-Design of Hardware and Software: Part 1 A Flood of Data Needs Flood Software

Donald Wake

Consultant Technical Marketing Engineer at EMC | DSSD

DSSD D5 Rack-Scale Flash Storage Appliance is Here

On February29, 2016, we launched the EMC DSSD D5 Rack-Scale Flash Storage Appliance.  That’s right, we did it on Leap Day—because the DSSD D5 Rack-Scale Flash Storage Appliance represents a quantum leap forward in innovation and performance for today’s data hungry applications. It took five years of hard work and some incredible engineering, but now it’s here: The D5 brings together the benefits of a shared All Flash Array and the speed of Server Attached Flash storage, while eliminating the compromises of each..

MIke

Tapping Into the Brilliant Minds of DSSD

As Technical Marketing Engineer at EMC | DSSD, my job is to spread to the word about this amazing technology. But you need not take my word for it. I sat down with the folks that created DSSD and co-designed the software and hardware that makes up the D5 appliance.

I asked them to put on clean shirts and talk for an hour or so, so I could put together these five- to seven-minute videos—no easy task! Clean shirts weren’t the challenge. They have plenty of those. It was getting a whole hour of their time. But they all agreed, and I was able to sit down with Jeff Bonwick, co-founder and CTO of DSSD, Mike Shapiro, co-founder and Vice President of Software at DSSD and Chris Frank, Senior Director of Hardware at DSSD.

With Jeff we discussed the differentiating technologies that had to be invented to protect data on thousands of DSSD Enterprise NAND die while also offering game changing performance and truly innovative Flash Physics control of the NAND.  Next I sat down with Chris Frank and he walked me through all of the details of the actual hardware and how it works together to present this massive 144 TB shared pool of flash storage to 48 redundantly connected client systems – all using NVMe over PCIe

Mike Breaks Down the Innovation of DSSD D5

To kick off the series, I turned to Mike Shapiro, Founder and Vice President of Software at DSSD. When you’re first hired here at DSSD, the first thing you’re told is, “Go watch Mike’s training videos.” Why? Because Mike has this uncanny ability to break down complex subjects into clear, understandable concepts.

Watch Mike work his magic as he explains the key innovations of the DSSD D5 and answer the following questions:

  • What is the D5, and how is it a co-design of hardware and software?
  • What is Flood?
  • How does the D5 go so fast?
  • How are DSSD Flash Modules different from an SSD?
  • Is the D5 ready for 3D NAND?
  • What about Next-Generation Non-Volatile Memory (NG-NVM)?

Now you can say you were trained by Mike too! 🙂

p.s. I think this is the coolest frog ever! –> Frog

 

Follow Dell EMC

Categories

Archives

Connect with us on Twitter