Reduce data volumes.
improve data quality.

Unlock the power of your data with Mezmo’s Telemetry Pipeline. Collect, profile, transform, reduce, and route data to improve productivity and manage costs.

START Telemetry Pipeline FOR FREEGet A DEMO

What is mezmo telemetry pipeline

MEZMO TELEMETRY PIPELINE

Mezmo helps you confidently harness value from your telemetry data. Using Understand, Optimize, and Respond approach, Mezmo Flow leverages AI capabilities to analyze telemetry data sources, identify noisy log patterns, and create a data-optimizing pipeline with a few simple clicks, that routes data to any observability platform to dramatically cut log volumes and improve data quality. When you have an incident, get an in-stream alert or automatically react using Mezmo’s responsive pipelines in incident mode to get you the telemetry data you need to accelerate time to resolution.

Control Data

Control data volume and costs by in as little as 15 minutes by using Mezmo Flow. Mezmo Flow will help with identifying unstructured telemetry data, removing low-value and repetitive data, and using sampling to reduce chatter. Employ intelligent routing rules to send certain data types to low-cost storage.

Filter: Use the Filter Processor to drop events that may not be meaningful or to reduce the total amount of data forwarded to a subsequent processor or destination.
Reduce: Take multiple log input events and combine them into a single event based on specified criteria. Use Reduce to combine many events into one over a specified window of time.
Sample: Send only the events required to understand the data.
Dedupe: Reduce “chatter” in logs. The overlap of data across fields is the key to having the Dedup Processor work effectively. This processor will emit the first matching record of the set of records that are being compared.
Route: Intelligently route data to any observability, analytics, or visualization platform.

Transform Data

Increase your data value and quality by transforming and enriching data. Reformat data as needed for compatibility with various end destinations. Scrub sensitive data, or encrypt it to maintain compliance standards.

Parse: Various parsing options available to create multiple operations such as convert string to integers or parse timestamps.
Aggregate Metrics: Metric data can have more data points than needed to understand the behavior of a system. Remove excess metrics to reduce storage without sacrificing value.
Encrypt: Use the Encrypt Processor when sending sensitive log data to storage, for example, when retaining log data containing account names and passwords.
Event to Metric: Create a new metric within the pipeline from existing events and log messages.

Deliver Insights

With Mezmo you can extract insights before the data reaches high-cost destinations. You can monitor the health of your data pipeline and run various tests before you deploy your solution.

Monitor the health of pipelines with OOB dashboards.
Derive metric data from Logs by parsing the log data to extract specific information.
Count specific events within the log data and use that count to create a metric.
Use simulation to test your pipelines before you deploy
Send to Mezmo Log Management for analysis and insights

Understand, optimize, and respond

Telemetry data is overwhelming, but mastering it can be transformative. You may be managing systems without complete context or resigning to substantial observability platform overage charges. Understanding your data gives you the power to streamline, optimize, and harness its full potential.

Mezmo Flow

Build your telemetry pipeline in minutes using an AI-enabled experience and implement log volume reduction preventing unnecessary charges, overages and spikes by only saving the most valuable data to your observability platforms.

Learn More

DATA PROFILER

Classify your telemetry data to understand volume by source and repetitive patterns. Profile new data sources immediately. Select recommended optimizations using Mezmo’s Processor Groups. Reduce data volume and costs by 50% or more.

Learn More

Stateful Alerts

Act and address issues while data is in stream so you reduce unexpected data volume changes before they become a wider spread problem.

Learn More

Responsive Pipelines

Stay ahead of problems by having your pipelines automatically change state when needed. Immediately adapt to an incident or event that requires focused analysis. Increase your response velocity to reduce time-to-resolution.

Mezmo Edge

Process telemetry data in your local environment, reducing egress costs and honoring enterprise compliance requirements. Deploy rapidly with a Helm chart while getting the advantages of a SaaS to manage the metrics and configurations.

Learn More

Mezmo Data Profiling

Clarify your telemetry data to understand volume by sources and repetitive patterns. Profile new data sources immediately. Select recommended optimizations using Mezmo’s Recipes. Reduce data volume and costs by as much as 50% or more.

Mezmo Recipes

Select pre-configured Pipelines for common data scenarios. Mezmo recommends Recipes based on your data profile. No need to spend time constructing and testing custom Pipelines. Use Mezmo’s expertise to avoid toil and build effective data optimization to reduce costs.

Mezmo Responsive Pipelines

Stay ahead of problems and telemetry data changes by having your pipelines automatically change states when needed. Immediately adapt to an incident or event that requires focused analysis. Increase your response velocity to reduce time-to-resolution.

Mezmo Edge

Process telemetry data in your own environment with the security risks and added egress costs. Deploy rapidly with a Helm Chart while getting the advantages of a SaaS to manage the metrics and configuration.

Pipelines s as Code

Optimize your pipelines as part of your development process. Archive and version for easy tracking and rollback. Collaborate for tailored release pipelines. Harness Terraform for scalable deployment. Boost your development speed and maintain accuracy.

Step-Up Your Observability Game!

Telemetry data is key to continuously improving operations and hitting your SLOs. Yet, in a recent survey from Gatepoint Research, 73% of respondents report struggling with getting telemetry data to the teams that need it. Positioning a telemetry pipeline in your observability architecture can dramatically reduce costs, help you discover new business insights and route the data to the teams that need it. Mezmo can help! Here are five easy steps to get started:

Filter for Efficiency

Efficiently filter events, eliminating duplicates, extraneous data, and non-insightful information; utilizing drop, sample, or suppress filters for optimal results.

Store Cost-Effectively

Send your "just in case" data to low-cost object storage for future retrieval. Low-cost pipelines and efficient retrieval are better than expensive analytics platforms.

Improve Data Structure

Optimize events by trimming unnecessary content or fields. Remove meaningless values and reformat to more efficient data structures such as JSON.

Find Critical Metrics

Condense logs into summary metrics, aggregating useful statistics. Process logs into numbers to surface previously unseen values or counts. Enhance efficiency and scalability while gaining better insight.

Make It Easy

Get the observability answers you need without the toil. Automatically scale the infrastructure and data retention as your requirements grow.

pipeline integrations

SOURCES

Sources provide support for ingesting pipeline log data from several popular sources.

+ Data from object contents in AWS S3 via SQS
+ Events from Azure Event Hub using Azure Kafka Endpoint
+ Events from Kafka-compatible brokers
+ Data from Fluent (Fluentd, Fluent Bit)
+ Datadog Agent
+ Logstash data
+ Detailed data from Mezmo Agent (Otel)
+ Splunk HEC
+ Data via OpenTelemetry OTLP
+ Metrics from Prometheus Remote-Write

DESTINATIONS

Send to existing Observability, Analytics, Security, or Long-Term Storage tools such as:

+ Cloud-based storage: AWS S3, GCP Cloud Storage, or Azure Blob Storage
+ Datadog logs + metrics
+ Elasticsearch
+ Kafka
+ Grafana Loki Logs
+ Sumo Logic
+ Mezmo Log Management
+ New Relic Logs + Metrics
+ Prometheus Remote-Write Metrics
+ Splunk HEC Connector
+ Apache Pulsar
+ HTTP Endpoint
+ Honeycomb
+ Amazon SQS/S3

Searching for a better observability solution.

"Mezmo helped the Sysdig team to achieve an 80 percent improvement in the time it takes to access and use log data." Read More.

Mark Breitung, Senior DevOps Engineer at Sysdig

View & Manage All Your Logs in One Place

"I like to be able to go to that point in time in the logs, getting the context before and after the line. It's great to be able to create a special "view" and view logs in real-time from a specific log file or server."

Guillermo H., CTO