July 16, 2024

Embark on the Observability Journey

Key Takeaways

Ensure comprehensive observability across applications, infrastructure, and networks.
Create a robust observability framework by incorporating logs, metrics, and traces.
Obtain deeper insights and correlate data with enhanced observability using AIOps.

Contemporary monitoring

With the advent of byte code instrumentation (BCI) in 2008, application performance management took a giant leap in what is known as "inside-out monitoring," that is, monitoring from inside the application. Before that, application monitoring was largely limited to tracking CPU, memory, disk, and process availability. BCI offered new opportunities in terms of how applications could be monitored and what could be monitored from an application performance perspective. Use of BCI was pioneered by Wily Technology, which was acquired by CA/Broadcom. Wily included BCI as part of the Java language in JSR 199. This worked well for monitoring monolithic applications.

Starting in 2010, with cloud and microservices becoming popular, applications became significantly more complex. A single request could go through numerous services (including authentication, authorization, third-party, and so on). At the same time, there was a new paradigm for deploying applications: Teams began to deploy more frequently in a dynamic infrastructure, with the ability to scale up and down on demand.

With these changes, the traditional monitoring approach using BCI proved to be insufficient. Simply turning up more metrics only added to the noise. The volume, variety, and velocity of incoming data, popularly known as the “three Vs,” required a new approach.

What is observability?

Observability has been an IT buzzword for more than five years. According to Wikipedia, “Observability is a measure of how well internal states of a system can be inferred from knowledge of its external outputs. In control theory, the observability and controllability of a linear system are mathematical duals.”

Traditional monitoring helps teams answer questions for situations when they know there is a problem, that is, a known-known problem. This includes questions like “What is the CPU utilization of my process?” or “What is the latency of my request?” However, modern applications with complex request fulfillment paths touching numerous services and systems can have multiple points of failures and unknowns. Do we have the right data/tools to ask the right questions? Is the system observable enough to answer questions like “How is my system doing overall?” and “Why is it not working?” Observability allows teams to answer these types of questions and helps them interpret the data.

Three pillars of observability

There are three primary aspects of observability:

Logs: Logs have been around forever and produce interesting events that can assist in troubleshooting. The challenge with logs is volume and context. Scoping to ensure context is provided is the key to making sense of logs.
Metrics: Typically, metrics are time-series data that allows users to set alerting. Generally, metrics answer the "what" question. Per the Google SRE guide, latency, traffic, errors, and saturation are the four golden signals.
Traces: Traces show end-to-end request tracking. This helps reveal key information related to latencies and errors as a request crosses various system boundaries and can accurately pinpoint the class and method that are causing the issue.

Observability made easy with AIOps from Broadcom

AIOps and observability technologies from Broadcom provide full stack monitoring and observability of application, infrastructure, and network data. This solution can pull data from Broadcom monitoring solutions as well as third-party tools and open-source technologies. The solution can correlate different entities from these data sources and show metrics, logs, and traces in context and in a single pane of glass. This helps reveal some of the known problems and provides enough information to investigate the unknowns.

Tag(s): AIOps , DX OI , DX APM

Srikant Noorani

Srikant Noorani, Client Services Architect focusing on AIOps and Observability, has over 20 years experience working on complex technical challenges. A hands-on architect with a passion for guiding enterprises in their digital transformation journey, Srikant has worked on the largest APM deployments plus DevOps,...

Other resources you might be interested in

Course September 17, 2025

DX NetOps: Harness Syslog for Operational Visibility

Learn how to configure DX NetOps for robust syslog ingestion, gaining comprehensive operational visibility by displaying all external syslog messages directly within DX NetOps Portal.

Go to Training

Office Hours September 17, 2025

Rally Office Hours: September 4, 2025

In the latest edition of Rally office hours, learn how to view filter substitutions and then follow the weekly Q&A session with Rally product experts.

View Recording

Office Hours September 17, 2025

Rally Office Hours: September 11, 2025

Hear about recruiting MCP Server early adopters and ancestor filtering in Rally's Custom Lists, then follow the weekly Q&A session with Rally product experts.

View Recording

Blog September 16, 2025

Powering RAG Pipelines With Automic Automation

See how Automic Automation optimally equips you for the AI revolution, combining proven enterprise capabilities with the potential of generative AI.

Read Blog

Blog September 16, 2025

Unlock Real-Time AWS Observability With Streaming Ingestion in DX Operational Observability

With streaming ingestion capabilities, DX Operational Observability offers visibility into your AWS telemetry, enhancing insights and incident response.

Read Blog

Blog September 16, 2025

Observability and IT Monitoring Governance: Establishing Order (Part 3 of 4)

Find out how DX Unified Infrastructure Management (DX UIM) supports monitoring governance, enabling teams to manage configurations and track alarm policies.

Read Blog

Blog September 16, 2025

Observability and IT Monitoring Governance (Part 4 of 4)

This post shows how baselines, KPIs, and thresholds are essential for monitoring governance. See how IT can shift from reactive to proactive IT management.

Read Blog

Blog September 12, 2025

What's Really Happening in Your Branch Office Network?

Fragmented monitoring tools create critical visibility gaps in branch networks. Find out why you need network observability to pinpoint the cause of issues.

Read Blog

Office Hours September 12, 2025

Rally Office Hours: August 28, 2025

Learn about the general availability of the AI writing assistant in Rally, then follow the weekly Q&A session with Rally product experts.

View Recording