Hello from the Metron PM and Engineering Team Over the last few months, you may have read a series of blogs written by the Metron Product Management and Engineering teams on CyberSecurity and Analytics and the role that Big Data / Hadoop / HDP plays in this space. In December 2015, James Sirota, Director of Security Solutions […]
The post Kicking off the Apache Metron Tech Preview 1 Blog Series appeared first on Hortonworks.
On Tuesday April 12th, we released the first of our multi-part Big Data Cybersecurity Analytics blog series titled Roots of Apache Metron, authored by the Hortonworks product management and engineering teams, to announce Apache Metron 0.1 release. Built with the Apache Community, Metron is a next generation cyber security application that detects and responds to […]
The post Apache Metron User Personas and Core Functional Themes appeared first on Hortonworks.
In Kicking Off the Apache Metron Tech Preview 1 Blog Series, we introduced the origins of the Apache Metron™ project. In Part 2, Apache Metron User Personas and Core Functional Themes, we covered how Metron helps organizations build capabilities in their people and processes to help bridge the cyber security talent gap. In this third part of […]
The post Apache Metron Tech Preview 1 – Come and Get It! appeared first on Hortonworks.
In Part 3 of the Apache Metron announcement series, Apache Metron Tech Preview 1 – Come and Get it! , we outlined Apache Metron 0.1 release’s new features and enhancements. Then we demonstrated how to deploy on a single node VM using vagrant and a cloud-based install for a complete 10 node Metron cluster using […]
The post Apache Metron Use Case: Finding the Needle in the Haystack appeared first on Hortonworks.
Accelerated Threat Triage and Expanded Deployment Options Two months ago, the Metron Engineering and PM team released Technical Preview 1 of Apache Metron based on the 0.1 release. We shared our vision for an open community based cybersecurity solution that provides real-time, cross-referenced and contextualized big data to combat cyber threats. Apache Metron Reference Architecture As the above […]
The post Apache Metron Tech Preview 2 Available Now! appeared first on Hortonworks.
As part of the product management leadership team at Hortonworks, there is nothing more valuable than talking directly with customers and learning about their successes, challenges, and struggles implementing their big data and analytics use cases with HDP and HDF. These conversations provide more insight than any analyst report, white paper, or market study. In […]
The post Part 1: Hortonworks Thoughts on Building a Successful Streaming Analytics Platform appeared first on Hortonworks.
In Part 1 of this series, we discussed how data-in-motion solutions require both flow management and stream analytics capabilities. Also, we introduced an exciting new technology that Hortonworks is in the process of releasing that helps users build streaming analytics apps faster and caters to three different personas in the enterprise: app developer, operations teams and the […]
The post Part 2 of HDF Blog Series: A Shared Schema Registry: What is it and Why is it Important? appeared first on Hortonworks.
This blog was co-authored by: George Vetticaden, Sriharsha Chintalapani, Jungtaek Lim, Sanket Shah Last week, in Part 3 of this blog series, we announced the GA of HDF 3.0 and let the cat out of the bag by introducing the new open source component called Streaming Analytics Manager (SAM), an exciting new technology that helps developers, […]
The post Part 4: SAM’s Stream Builder – Building Complex Stream Analytics Apps without Code appeared first on Hortonworks.
We are thrilled to announce the general availability of Hortonworks DataFlow (HDF) version 3.1 – introducing powerful new data-in-motion capabilities for edge analytics, flow management and streaming analytics, all powered and managed by a set of enterprise management services for governance, security and monitoring. The governing vision of HDF is to be the industry leading […]
The post Announcing the General Availability of Hortonworks DataFlow 3.1 appeared first on Hortonworks.
Last week, we announced the HDF 3.1 Release and commenced the HDF 3.1 Blog series. Earlier this week, in part 2 of the blog series, we introduced the new HDF component called Apache Nifi Registry which allows developers to version control flow artifacts to meet their SDLC enterprise requirements. Today, in this third part of […]
The post HDF 3.1 Blog Series Part 3: Kafka 1.0 Support with Powerful HDF Integrations appeared first on Hortonworks.
Last week, as part of the HDF 3.1 Blog Series, we talked about support for Apache Kafka 1.0 and the powerful HDF integrations including Apache NiFi’s Kafka processors, Apache Ambari for provisioning/management/monitoring and Ranger for access control policies and audit for Apache Kafka. Today, in this fourth part of the series, we discuss the innovations added […]
The post Hortonworks DataFlow (HDF) 3.1 Blog Series Part 4: Unit Testing and Continuous Integration & Delivery of Streaming Analytics Apps appeared first on Hortonworks.
IN HDF 3.1, we announced support for Apache Kafka 1.0 with powerful integrations with Apache Ambari, Apache Ranger, and Apache Atlas. In the last 12 months, we have seen Kafka emerge as a key component in many of our customers streaming architectures’. A common architecture looks something like the following: Different customers or even different groups within […]
The post Addressing Kafka Blindness appeared first on Hortonworks.
Last week, we discussed how the omnipresence of Kafka in application architectures has led to the Kafka Blindness afflicting DevOps/AppDev, Platform Operations and Security/Goverenance teams within the enterprise. These groups are struggling to effectively battle this blindness with the current tooling available. Over the last 12 months, the Hortonworks team has been working with these […]
The post Introducing Hortonworks Streams Messaging Manager (SMM) appeared first on Hortonworks.
Two weeks ago, we announced the GA of Streams Messaging Manager (SMM) 1.0 to cure enterprises of their Kafka Blindness. We discussed how SMM addresses the needs of three groups in the enterprise: Platform Operations, DevOps/Developers and Security/Governance teams. In this second installment of the SMM blog series, we focus on the DevOps/Developers persona and explain […]
The post Solving the Needs of DevOps / Developers with Streams Messaging Manager appeared first on Hortonworks.
With the release of Hortonworks Streams Messaging Manager (SMM) this year, we have focused on helping DevOps and Platform teams cure their Kafka Blindness. The Hortonworks product and engineering teams continue to invest in building powerful new capabilities in SMM with new upcoming features like alerting and topic lifecycle management. In addition to the SMM […]
The post Democratizing Analytics within Kafka with Three New Access Patterns appeared first on Hortonworks.
In an earlier blog post, Democratizing Analytics within Kafka With 3 Powerful New Access Patterns in HDP and HDF, we discussed different access patterns that provides application developers and BI analysts powerful new tools to implement diverse use cases where Kafka is key component of their application architectures. In this blog, we will discuss in detail […]
The post Kafka Streams – Is it the right Stream Processing engine for you? appeared first on Hortonworks.
With Hortonworks DataFlow (HDF) 3.3 now supporting Kafka Streams, we are truly excited about the possibilities of the applications that you can benefit from when combined with the rest of our platform. In this post, we will demonstrate how Kafka Streams can be integrated with Schema Registry, Atlas and Ranger to build set of microservices […]
The post Building Secure and Governed Microservices with Kafka Streams appeared first on Hortonworks.
In last week’s blog Secure and Governed Microservices with HDF/HDP Kafka Streams Support, we walked through how to build microservices with the new Kafka Streams support in HDF 3.3 and HDP 3.1 that is fully integrated with Ranger, Schema Registry and other platform services. This blog is all about monitoring these microservices with Hortonworks Streams Messaging […]
The post Monitoring Kafka Streams Microservices with Hortonworks Streams Messaging Manager (SMM) appeared first on Hortonworks.
Our last few blogs as part of the Kafka Analytics blog series focused on the addition of Kafka Streams to HDP and HDF and how to build, secure, monitor Kafka Streams apps / microservices. In this blog, we focus on the SQL access pattern for Kafka with the new Kafka Hive Integration work. Kafka SQL […]
The post Introducing Hive-Kafka integration for real-time Kafka SQL queries appeared first on Hortonworks.
