11 min read

Benefits of Real-Time Cloud Visualization

May 21, 2024

 

Accurate AWS, GCP or Azure network diagrams play a vital role in monitoring and internally communicating the operational status and design of well engineered AWS infrastructure, which is why serious AWS development teams appreciate the benefits of real-time cloud visualization.

If you are building or operating solutions hosted on these three cloud platforms, you probably already understand the value a good network architecture diagram provides. The problem has always been the time it takes to manually draw diagrams, especially when using drag and drop charting applications.

If you have a complex network or multiple applications and dev/test environments it can take days or even weeks to research and map out your network topology. When you have done all the hard work mapping out your cloud infrastructure you then need to spend even more time keeping the diagrams up to date.

We understand this because the team behind Hava are engineers that come from a cloud consulting and expert services background.

We were faced with the same problems you face. When you take on existing infrastructure as part of a role change, or need to deploy new infrastructure for a new application or maybe while on-boarding a new client the very first thing you need to establish is what does the existing infrastructure look like.  What resources do you have to work with, what VPCs exist, what availability zones are they in, what does the security set up look like.

When you know exactly what is running, then you can commence the design work to make the network faster, highly available and more secure, or work out how to integrate a new project or application feature without breaking anything already in production.

The thought of logging in to your AWS account console to start to manually mapping out your environments with a drag & drop diagramming tool is something nobody we know gets excited about, which is probably why accurate AWS infrastructure visualization  diagrams are rarely prioritised or readily available during an unexpected event.

Then of course, no sooner have you completed drawing your diagrams, something changes and you have to analyse the implications and update all of your diagrams to reflect the changes. With the numerous modern CI/CD approaches like deploying infrastructure as code, or getting AWS to autoscale various resources in response to traffic loads, this process can take days or even weeks for larger environments, especially if multiple AWS accounts and environments are involved.

Back when Hava engineers were providing  cloud consulting services, we would routinely take several days or weeks to establish an accurate picture of what a new client's AWS  network infrastructure looked like. Like you, we had to fire up the AWS management console, scour through all the services to establish exactly what was running, where it was running and how the security was configured that allowed traffic into the network.

We knew that the information we needed was available in the AWS config data and could be used to build an automated AWS diagram builder to reduce the process from days or weeks of tedious manual diagramming down to a few seconds or minutes for larger environments. What was once a tedious task nobody could get excited about was condensed into a simple process of generating a set of cross-account role credentials, connecting to Hava and letting the Hava application do the rest.

Initially getting the infrastructure mapped was the primary focus which was achieved with the Hava Infrastructure View.

Standard_AWS_Diagram_Layout_Showing_Subnets

The Infrastructure view built by the Hava AWS diagram builder lays out your AWS VPCs into separate diagram sets. Subnets within the VPC are grouped by availability zones. The AWS Deployment Diagram generated also display both internal and external resources. 

The diagrams generated from the Hava AWS diagram builder are interactive. Selecting any of the resources on the diagram changes the attribute panel on the right of the diagram canvas which allows you to take a deep dive into the resource settings like security groups, IP ingress/egress ports, connected storage and so on. The diagrams also display the estimated costs of each resource which are totalled for the entire environment when the environment is opened up.

We then thought about the relationships and connections between resources so created the ability to toggle on and off the ability to view connections.

Security_Group_Connections

Right from the beginning, we decided to keep the infrastructure diagrams clean and free from non essential resources like network interfaces that could flood the diagrams making them messy and confusing. 

Although these less important components are not visualized on the diagrams, we did need to know about these 'non-visualized' components, so we designed the Hava AWS diagram builder to also create a "List View". The List View is an extensive data set that lists all the resources discovered in your AWS configuration. This view lists both visualized and non-vizualized resources.

The listed resources also have an estimated cost detailed against them.

List_View_by_Price

 

One of the major benefits of the AWS list view is the ability to sort the list by descending costs. This surfaces what resources make up the bulk of your estimated cloud spend which should help when you are looking to save cloud costs or explain to management which important resources make up the bulk of your AWS bill.

We also added the ability for you to export this list of resources in CSV format which CFO's and accountants seem to enjoy. 

AWS Cloud Diagram Security View

The Security View was next diagram added to the Hava AWS diagram builder. We already had the configuration metadata and relationships coming back from AWS so our security team clients asked if we could visualize the security relationships the same way we were able to visualize infrastructure. The challenge was accepted and the AWS Security View was born.

AWS Security View 800x600

The security view report shows you all of your AWS security groups and will overlay the open ports to show how users traverse your network.  You can select a security group on the diagram to see all the connected resources in the attribute pane, as well as the ingress and egress port numbers and associated IP addresses related to that resource.

This high level view makes some security config issues obvious, like ports used for development or testing that have been left open.

The AWS security view is truly unique and is a result of a team of industry practitioners knowing exactly what information is important to enable effective visualized security monitoring.

One of the benefits of having a team of actual cloud engineers behind a product like hava.io as opposed to say a drag and drop flow chart drawing package solution, is that we are always close to the market and hundreds of front line cloud engineers. If we don't pick up new technologies and methodologies first, then our customers will, and are sure to send in feature requests which we endeavour to integrate into Hava as soon as possible.

This is evidenced by the rising popularity of AWS Container workloads.  As more development teams embrace containers to deploy applications and provide portability of software between environments we added a Container View to Hava.

AWS ECS Container View 800x600

The container view displays your ECS Services and the contained ECS tasks inside an ECS Cluster.

AWS ARCHITECTURE DIAGRAM VERSION COMPARISON

Hava continuously scans your AWS architecture and when changes are detected a new diagram set is automatically generated. The superseded diagrams are not discarded or overwritten. Instead they are moved into version history. Still fully interactive.

What this means is you can view your cloud architecture at any point in time and also leverage Hava's revision comparison (Diff Diagrams) to quickly identify what has been added or removed between the two diagram dates.

Diff_View-1 

So you can easily identify all the changes made since your last compliance audit, or see what changed yesterday that is causing unexpected network or application errors.

AWS ARCHITECTURE MONITORING

While diff diagrams are super helpful in diagnosing changes after the fact, you may want to keep on top of changes as they happen.

Hava's architecture monitoring alerts will let you know the minute a change is detected. You simply nominate the environment you wish to monitor and add a group of recipients to receive the alerts. When a change is detected like the addition or removal of a resource, Hava will send each recipient a diff diagram showing the changes.

Alerts_Detail

Now you and your security team can be across every change as it happens so you can assess and take action if required.

ENVIRONMENT DIAGRAM NOTES

For every architecture diagram generated you have the ability to add text comments. This serves as a rolling dialogue your team can contribute to that may better explain elements of the diagram or bigger picture concepts related to the diagram.

Notes are accessed from the accordion menu within the attribute pane.

Access_Environment_Notes

New notes are added to the top of the list so they are stored in chronological order.

Multiple_Notes

Whichever diagram or view makes the most sense or delivers the information your team needs to build and manage your environments, the upside to using a hands free automatic AWS Cloud Diagram Tool like hava.io is that your diagrams are sourced directly from your AWS configuration, so nothing is missed out and nothing can be added by mistake.

What you see is from the source of truth, always accurate and always up to date.

When your configuration changes, so do the diagrams. All hands-free, no human interaction required. The diagrams that are automatically replaced are archived in a version history. You can open up the historical diagrams at any time you like. They are fully interactive so you can compare old configurations to new ones to find out what changed in the event of a problem or compliance audit.

The diagrams generated by Hava are also exportable. You can produce an AWS architecture PDF or a JPG for inclusion in your reporting as well as CSV and JSON.

How to use the Hava AWS Diagram Builder

There are currently two options for using Hava to generate your cloud infrastructure diagrams.

Option 1: Hava SaaS

The SaaS option is by far the quickest and easiest way to start visualizing your AWS cloud infrastructure.

You simply create an AWS cross account role with read only permissions, then log into hava.io and connect your AWS account. Hava will read your AWS config data and render the diagrams and start to track any changes for audit purposes.

A 14 day fully functional trial is available (along with demo data) so you can try Hava for yourself. At the time of writing, no credit card is required to take the trial.

Option 2: Self Hosted

The self hosted option allows you to run Hava from within your own AWS infrastructure. If you have particular security or enterprise policies that prevent the connection of 3rd party applications to your cloud environments, then self-hosted may be the solution.

Both options are identical in functionality, but you will need to contact our support team to organise a self-hosted solution.

As well as using the application console to generate and view diagrams, Hava has a fully featured API that allows you to programmatically add and remove data sources, projects and diagrams.

 

We recommend requesting a one on one demo with our sales team if you would like to see Hava in action and explore the self-hosted option.

You can contact us via sales@hava.io or jump into a free trial here:

  

 

 

Topics: aws cloud
Alan Blackmore

Written by Alan Blackmore

Content Lead for Hava.io - Interests include AI Marketing Automation, Digital Marketing and Lead Generation.

Featured