Improved Compute Performance With Acceldata Pulse 3.0
December 1, 2022
10 Min Read
We’re pleased to announce the general availability of Acceldata Pulse 3.0. This version offers a variety of new features and enhancements to help users improve data reliability, performance and efficiency of data processing at scale. Key updates include:
Support for Apache Oozie Workflow Scheduler for Hadoop
Pulse now supports and integrates Oozie and provides a dashboard and other vital metrics that shows the status of the Bundle jobs, Coordinator jobs, and Workflow jobs. It now also enables mapping of Oozie IDs to application details triggered by the Oozie scheduler. Users will also have the ability to debug Oozie workflows and view job definitions and requirements of SLA definitions.
Improved Dashboard Reporting Capabilities
New reporting capabilities in the Pulse dashboard allow users to schedule, enable, deactivate, and deliver insights for any metric as an attachment over email in Dashplots. You can get a better idea of how this works in Acceldata’s Visualization Dashboard.
Additionally, 3.0 includes a PULSE-AGENT-STATS dashboard that keeps track of the Pulse agent's CPU, memory, agent state, and configuration updates. There is also a new HIVE-SERVICE-SUMMARY Dashplot dashboard has been added to display all the critical Hive metrics.
Alert, Search, Trend, and Other New Data Observability Features
Pulse 3.0 provides new ways to derive and analyze insights from data environments. Including:
Application Log Link Alerts: The Application Log Link has been added to the alert notification. It connects the user to the Pulse Log section for the specific application. You can learn more about how Acceldata does this across all Notifications.
Redirection from Topic Details to Consumer Group: We’ve provided a way to derive deeper insights by adding a Group Details button on the Topic Details page which redirects to the Consumer Details page for the user selected consumer group. We have more information about how to identify and understand Consumer Group information in our Consumer Partition Details documentation.
Type in Search Option: The Top Consumer Group by Lag chart in the Kafka Dashboard now validates whether or not data is time-based, and it offers a type-in search option. You’ll see in our doc, Other Charts on the Kafka Dashboard, that there are a variety of ways that users can go deeper on Kafka insights.
Improved Search Behavior: The search behavior has now been improved to allow for detailed searches with a single click. For more information, see Alternate Search Option
Job Termination Based on Memory/Vcore Use: This is a new action that terminates a YARN application if it consumes more Memory or Vcore than the allocated threshold, has been added.
New Color-coded Capacity Trend: The offers the ability to visualize the HDFS Usage Trend in various colors based on capacity consumed has been added. For more information about how to optimize usage, check out our HDFS Dashboard documentation.