Posted by on
Categories: Apache Bigdata Hadoop Hortonworks IoT

The ability to inexpensively collect massive amounts of #BigData using #Hadoop is one thing. Being able to manage all that data is another matter altogether. With that issue in mind, #Hortonworks today announced the upgrade of a Hortonworks DataFlow (HDF) streaming analytics platform with an eye toward addressing a broad range of enterprise management issues. HDF 2.0 now sports a revamped user interface that tightens the integration between the streaming analytics platform that is based on the #Apache NiFi data routing engine and Apache Kafka messaging software and Apache Ambari tools for managing Hadoop deployments. Apache #NiFi itself is based on streaming analytics software created by Onyara, which Hortonworks acquired last year. In addition, Hortonworks has announced that it has integrated HDF 2.0 with Apache Ranger software for securing access to data in Hadoop. Finally, Hortonworks revealed that it has developed Apache MiNiFi, an implementation of Apache NiFi that has been optimized to process streaming analytics on an Internet of Things ( #IoT ) gateway, while at the same time formally certifying over 150 third-party HDF 2.0 connectors. Jamie Engesser, vice president and general manager for emerging products at Hortonworks, says a truly comprehensive approach to Big Data requires an ability to process and manage data both in motion and at rest. HDF now extends the ability of Hortonworks to process data all the way out to the edge. That approach, adds Engesser, also serves to limit the amount of network bandwidth that needs to be allocated to an IoT project.

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.