11 min read

Cloud Visualisation

August 26, 2021

Cloud Visualization

There are many reasons why you would want to visualize your AWS, GCP and Azure environments. Knowing exactly what is running based on the actual resources running in your cloud environments is probably the number one reason to use an automated Cloud Visualization Tool over manually drawing your network diagrams.

Hava's automated cloud visualization process discovers exactly what is running. It discovers your  resources and the availability zones and regions they are running in. This enables you to provide the information and documentation to onboard new engineers faster or so you can get to grips with new client networks or report to management in an easily understood visual format.

Cloud Visualization Diagram Generator

Sitting down with a program like Visio and your cloud platform Icon template pack is a daunting prospect, especially if your AWS, Azure or GCP environment contains more than a handful of resources.

Not only do you need to manually lay out your projects or VPC's and resources which can be incredibly tedious, once you have drawn the diagrams, you then need to keep them up to date if they are going to be of any practical use.  Out of date diagrams are about as useful as no diagram at all. That's where using Hava's automated cloud visualization software comes into play.

AWS Network Topology Diagrams

There are a number of cloud visualization diagrams that can prove useful to your engineering, DevOps and security teams. These include an AWS Infrastructure diagram like this:

AWS_Environment_with_Attribute_Pane

The diagram shown above logically lays out all the resources discovered when an AWS account is connected to Hava's cloud visualization tool. The main VPC is depicted by the green outside border and is surrounded by associated resources like internet and VPN gateways, S3 Buckets, VPC endpoints, VPC peering connections and so forth.

Inside the VPC, your configured availability zones are set out in columns. These columns contain the individual subnets set up in those AZs.  All the resources contained in each subnet are visualized as are any load balancers that are routing traffic to the various subnets.

Having your diagrams automatically created from your AWS console configuration data enables interrogation of each of the resources to see the settings and associations related to them. By selecting any of the individually visualised resources, the attribute pane to the right hand side of the diagram displays all the known metadata related to the resource.  This is one aspect of Hava's cloud visualization diagrams that isn't possible with manually created drag-and-drop diagram makers.

Automating the diagram build using Hava also reveals resources you may not be aware of.  Long forgotten database instances and sometimes entire development, staging or test environments are regularly discovered by this automated cloud visualization process.

GCP Cloud Architecture Diagrams

Hava's cloud visualization diagram tool will connect to your GCP accounts and visualize your GCP networks, zones and subnets.

GCP_Environment_Cost_Estimates

Azure Cloud Architecture Diagrams

In addition to visualizing your AWS and GCP cloud environments, you can also import your Azure environments into Hava. Hava will create diagrams for each resource group discovered in Azure. The resource group will detail any virtual networks found in the resource group which in turn can contain multiple subnets and other resources like virtual machines, load balancers, peering connections and storage accounts.

Azure_Architecture_Diagram

Custom Cloud visualization

There is always a compromise when it comes to automatically generated documentation. The way that Hava discovers and generates network topology diagrams is based at a VPC or resource group level. If more than one VPC is detected in your Amazon cloud account for instance, then one diagram set per VPC is created.

You may however want to combine two or more VPCs onto a single diagram, or just diagram a subset of your resources.  This can be achieved using the custom query function built into Hava.

Custom Cloud Visualization Generator

custom_diagrams_multiple_vpc

This custom query would create a new custom diagram containing the two nominated AWS VPCs specified.  You would then have the ability to save this diagram so it is always present in your dashboard until you choose to delete it.  As with all other diagrams, your custom infrastructure diagram would keep itself up to date and retain a version history every time a resource change is detected.

Cloud resourceS List

In reality it is just not practical to include every single component detected in your cloud config onto a network topology diagram. Take for instance network interfaces, volumes or WAF rules. In a large network with hundreds or maybe thousands of these second tier components, trying to visualize every single component would make the diagram almost unreadable, or certainly too busy to easily recognise the core components.

Hava's cloud visualization tool solves this issue by providing detailed components list that details every single resource detected. This is known as the "List View"

List_View_New_UI

This is a comprehensive list of resources that can be sorted and exported along with estimated monthly costs so you can see at a glance what resources are costing you the most money. This detailed list view is also interactive. Selecting a resource on the diagram will reveal all the known settings and associations that resource has.

AWS Security Group Visualization

Another major benefit of using Hava to automate the discovery of your AWS environment diagrams is the ability to capture and visualize security group information. While only available for AWS currently, security views for Azure and GCP are on our development roadmap.

AWS Security Architecture Diagram

AWS_Security_Group_Diagram

With an AWS security group diagram you can view all of your configured security groups. All your open ports are overlaid on the visualization to enable an instant understanding of the traffic flow, ingress and egress points. The security view diagram is also interactive which ensures you can select any security group on the diagram and important information relating to the security group, like the connected resources, ingress and egress IP addresses and associated tags are revealed without having to exit out to your AWS console to investigate.

Cloud ARCHITECTURE DIAGRAM VERSION COMPARISON

Hava continuously scans your cloud architecture and when changes are detected a new diagram set is automatically generated. The superseded diagrams are not discarded or overwritten. Instead they are moved into version history. Still fully interactive.

What this means is you can view your cloud architecture at any point in time and also leverage Hava's revision comparison (Diff Diagrams) to quickly identify what has been added or removed between the two diagram dates.

Diff_View-1 

So you can easily identify all the changes made since your last compliance audit, or see what changed yesterday that is causing unexpected network or application errors.

Cloud ARCHITECTURE MONITORING

While diff diagrams are super helpful in diagnosing changes after the fact, you may want to keep on top of changes as they happen.

Hava's architecture monitoring alerts will let you know the minute a change is detected. You simply nominate the environment you wish to monitor and add a group of recipients to receive the alerts. When a change is detected like the addition or removal of a resource, Hava will send each recipient a diff diagram showing the changes.

Alerts_Detail

Now you and your security team can be across every change as it happens so you can assess and take action if required.

Automated Cloud Visualization Updates

Finally, your documentation is only useful if it is up to date. It is quite possible to spend weeks manually constructing network topology diagrams only to have them rendered useless by a minor change to your network configuration. Given the nature of services provided by the major cloud vendors like autoscaling that provision or remove resources in response to traffic demand, the chances are your cloud infrastructure is changing more often than you would first imagine.

Built into Hava is an automatic synchronisation function that polls connected cloud account data sources and automatically updates cloud visualization diagram sets when changes are detected.  This means your diagrams are always current and up to date. The superseded diagram sets aren't deleted or overwritten however. They are placed into Hava's version history. This audit trail of changes stores superseded diagrams which enables you to pull up and investigate older diagrams in the same fully interactive format as the live current diagram set.

This allows you to quickly identify changes to your cloud network topology either visually by placing diagrams side-by-side or by exporting them for programmatic comparison.

Versioning also allows you to demonstrate the status of your network to key stakeholders at any point in history. This can be invaluable during a PCI compliance audit, insurance or security audit should your network design ever be called into question.  

Exporting Cloud Visualizations

The native cloud architecture diagrams created by Hava are the nearest we've seen to the examples and recommendations provided by the major cloud platforms.  These are great to view and interrogate via the Hava application dashboard, however sometimes you might need to pull a set of diagrams for audit purposes or to incorporate into management or sales presentations.

The built-in diagram export function allows you to do this by providing these five export options

Export-diagram-formats

CSV, VSDX, JSON, PDF and PNG

When viewing any of your Hava diagrams, you can select the export function, tell Hava what format you would like and Hava will generate the export file for download. 

Editing your Cloud Visualization Diagrams

Should you want to manipulate or embellish your auto generated Hava diagrams, exporting to VSDX format and using Visio, draw.io or any VSDX compatible drawing package will allow you to edit your diagrams as required.  

Should you not have access to Visio but would like to try this out, try opening one of your exported VSDX files in draw.io (diagrams.net)

exported_hava_diagram_in_drawio

Getting Hava to do the bulk of the heavy lifting by initially generating accurate diagrams based on what is actually configured and running in your cloud environments enables you to access a base diagram ready to edit which will save you hours or possibly days preparing management reports.

ENVIRONMENT DIAGRAM NOTES

For every architecture diagram generated you have the ability to add text comments. This serves as a rolling dialogue your team can contribute to that may better explain elements of the diagram or bigger picture concepts related to the diagram.

Notes are accessed from the accordion menu within the attribute pane.

Access_Environment_Notes

New notes are added to the top of the list so they are stored in chronological order.

Multiple_Notes

In Conclusion.

There aren't too many cloud engineers, devops or project managers that would dispute the benefits of perpetually accurate network documentation.  Hava provides just this with:

  • Auto generation of documentation for your AWS, GCP & Azure networks
  • Keeps the diagram sets updated
  • Retains a full set of diagrams in version history every time a resource changes
  • Provides a comprehensive API to allow IaC build pipeline integration
  • Provides a unique AWS security view detailing security groups with visualized traffic ingress/egress
  • True 3d and separate compliance reporting  
  • Available as SaaS or fully self-hosted

 

testimonials

You can try Hava for free here:

 

Team Hava

Written by Team Hava

The Hava content team

Featured