Posted by on
Tags:
Categories: Hadoop

Some scientists dream about big data. The dream bridges two divided realms. One realm holds lofty peaks of number-crunching scientific computation. Endless waves of big data analysis line the other realm. A deep chasm separates the two. Discoveries await those who cross these estranged lands. Unfortunately, data cannot move seamlessly between #Hadoop (HDFS) and #parallelfilesystems (PFS). Scientists who want to take advantage of the big data analytics available on Hadoop must copy data from parallel file systems. That can slow workflows to a crawl, especially those with terabytes of data.

https://www.hpcwire.com/off-the-wire/chameleon-speeds-development-portable-hadoop-reader-parallel-file-systems/

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.