Prometheus — Overview

Summary

Prometheus is an open-source monitoring and alerting tool that excels in collecting and querying metric data for dynamic environments, particularly within Kubernetes architectures.

Abstract

Prometheus is a powerful open-source tool designed for metrics-based monitoring and alerting. It operates by scraping metrics from applications via HTTP requests and storing them in a time-series database. With a robust data model and its own query language (PromQL), Prometheus enables detailed analysis of application and infrastructure performance. It is particularly well-suited for Kubernetes monitoring and can handle complex workloads by collecting millions of metrics per second. Prometheus is often paired with Grafana for enhanced visualization and is known for its reliability during outages. It is ideal for service-oriented architectures and microservices environments due to its support for multi-dimensional data collection and querying. However, it may not be the best choice for scenarios requiring 100% accuracy, such as per-request billing.

Opinions

Prometheus is considered a standout monitoring system, favored for its ease of use, versatility, and extensive integration options.
The pull-based approach of Prometheus, which involves scraping metrics from endpoints, is seen as superior to push-based mechanisms for its graceful handling of service failures and reduced overhead on client applications.
Prometheus' architecture, which includes a time-series database and a powerful query language, is praised for providing actionable metrics and facilitating quick diagnosis during outages.
The use of Prometheus is recommended for dynamic environments and complex workloads, where its ability to collect and process large volumes of metrics is particularly valuable.
While Prometheus is a strong fit for most monitoring needs, especially in cloud-native and containerized environments, it is acknowledged that it may not meet the requirements for billing-grade accuracy.
The article suggests that Prometheus, combined with Grafana, offers a comprehensive solution for monitoring and visualization needs.

Key Points

It is a very powerful tool for collecting and querying metric data.

It works by pulling(scraping) real-time metrics from applications on a regular cadence by sending HTTP requests on metrics endpoints of applications.

It gives the Client libraries that can be used to instrument custom applications including Go, Python, Ruby, Node.js, Java, .NET, Haskell, Erlang, and Rust.

It collects data from application services and hosts, then compresses and stores them in a time-series database.

It offers a simple yet powerful data model and a query language (PromQL), and can provide detailed and actionable metrics that lets you analyze how your applications and infrastructure are performing.

Properly tuned and deployed Prometheus cluster can collect millions of metrics every second that makes it well suited for complex workloads.

Prometheus is usually used along side Grafana. Grafana is a visualization tool that pulls Prometheus metrics and makes it easier to monitor.

Why Prometheus?

Prometheus doesn’t require us to install any custom software or configuration on servers, or even in container images to enable collecting metrics.

Prometheus doesn’t require our applications to use CPU cycles pushing metrics to some centralized collector.

Prometheus handles service failure/unavailability gracefully. If a target application goes down, Prometheus can record that it was unable to retrieve data.

For situations where pulling metrics is not feasible (e.g. short lived jobs) Prometheus provides a Pushgateway that allows applications to still push metric data if required.

All components of Prometheus can be run in Containers and offers better integration with Kubernetes.

When does it fit?

Use Prometheus to monitor your servers, VMs, databases, and to analyze the performance of your applications and infrastructure.

If you’re primarily collecting and evaluating metrics, Prometheus works well for recording any purely numeric time series.

It fits for both machine-centric monitoring as well as monitoring of highly dynamic service-oriented architectures.

In a world of microservices, its support for multi-dimensional data collection and querying is a particular strength.

Prometheus is designed for reliability, to be the system you go to during an outage to allow you to quickly diagnose problems. Each Prometheus server is standalone, not depending on network storage or other remote services.

Alternatives

Amazon CloudWatch

Azure Application Insights

NewRelic and many more

Most monitoring systems use a pushing mechanism where clients (applications /servers) are responsible for pushing their metric data to a centralized collection platform (server). In contrast to a “push” mechanic system, Prometheus is relying on targets (applications/servers) providing simple HTTP endpoints that its data retrieval workers can pull/scrape from.

Summary

Prometheus is a very powerful monitoring system, designed from the ground up to support and work with dynamic environments. Prometheus has gained a reputation as the de facto monitoring software in recent times. Its ease of use, versatility and literally endless integration options make it a favorite in the monitoring and alerting world.

Happy Learning!!!

Prometheus — Overview

TL;DR

Key Points

Why Prometheus?

When does it fit?

When does it not fit?

Alternatives

Summary