AWS is one of three major cloud platforms that Hava generates automated cloud diagrams for. AWS offers a host of services that fall under several major service categories. In this post we'll take a look at the services available for you to build, manage and monitor applications on the AWS cloud platform.
Table of Contents
- AWS Analytics
- Amazon Athena - Serverless Query S3 using SQL
- Amazon Cloudsearch - Search Solution for Websites and Apps
- Amazon Elastic Search - Deploy and run ElasticSearch
- Amazon EMR - Big Data Platform and Analysis
- Amazon Kenesis - Real time streaming data capture and analysis
- Amazon Redshift - Data Warehouse Service
- Amazon QuickSight - Serverless ML BI Dashboards
- Amazon Data Exchange - Subscribe to 3rd Party Data Sets
- Amazon Data Pipeline - Transfer and process data
- Amazon Glue - Data discovery, enrichment and transfer
- AWS Lake Formation - Set up Data Lakes quickly
- AWS Application Integration Services
- AWS Step Functions - Serverless Function Orchestration
- Amazon AppFlow - Integrate 3rd party app data
- Amazon EventBridge - Serverless Event Bus
- Amazon MQ - Message Broker Service for Apache/Rabbit MQ
- Amazon SNS - Simple Notification Messaging System
- Amazon SQS - Simple Queue Service Inter Component Messaging
- Amazon AppSync - GraphQL API Service
- AWS Cost Management Services
- AWS Compute Services
- Container Services
- AWS Database Services
- Aurora - MySQL and PostgreSQL compatible database service
- DynamoDB - KeyValue / Document Database
- Elasticache - Scalable in-memory database
- Neptune - Graph database for highly connected data sets
- Amazon RDS - Relational Database (MySQL/Postgres/Maria etc)
- Timestream - Serverless time series db for IoT
- AWS Network and Content Delivery
- AWS VPC - logically isolated virtual private clouds
- API Gateway - Create and manage APIs
- CloudFront - Fast content delivery network CDN service
- Route53 - fast DNS service
- AWS PrivateLink - Connect your on-prem network to AWS
- AWS App Mesh - Service Mesh for inter compute instance comms
- AWS CloudMap - Resource discovery for app usage
- AWS Direct Connect - Fast connection from your equipment to AWS
- Global Accellerator - App traffic routing over the AWS network
- AWS Transit Gateway - Centralised VPC and on prem connectivity
- Elastic Load Balancing - Service to evenly distribute network traffic
- AWS Storage
- Amazon S3 - Widely used AWS object storage service
- EBS - Elastic Block Store, Persistent block
- EFS - Serverless Elastic File System
- FSx for Lustre - High performance file storage using Lustre
- FSx for Windows File System - AWS Windows file system
- S3 Glacier - Durable low cost archival storage
- AWS Backup - Policy driven data protection
- AWS Snow - Edge infrastructure for storage and compute
- AWS Storage Gateway - Hybrid on prem AWS storage
- CloudEndure - Disaster recovery service
AWS Services List by Category
AWS Analytics Services
Amazon Athena is a serverless query service that allows you to query and analyze data in your S3 buckets using standard SQL. Athena is easy to use. Simply point to your data in Amazon S3, define the schema, and start querying using standard SQL. Most results are delivered within seconds. With Athena, there’s no need for complex ETL jobs to prepare your data for analysis. This makes it easy for anyone with SQL skills to quickly analyze large-scale datasets.
Amazon CloudSearch is a managed service in the AWS Cloud that makes it simple and cost-effective to set up, manage, and scale a search solution for your website or application.
Amazon Elastic Search
AWS Elasticsearch Service is a fully managed service that makes it easy for you to deploy and run Elasticsearch cost effectively at scale. The service provides support for open source Elasticsearch APIs, managed Kibana, integration with Logstash and other AWS services, and built-in alerting and SQL querying.
Amazon EMR is a cloud based big data platform for processing vast amounts of data using open source tools such as Apache Spark, Apache Hbase, Apache Hive, Apache Flink, Apache Hudi, and Presto. AWS EMR makes it easy to set up, operate, and scale your big data environments.
Kinesis allows you to collect, process and analyze real-time streaming data at scale. Process video, audio, logs and telemetry data for instance as it arrives instead of batch processing.
Amazons Data Warehouse solution allows you to combine and query exabytes of structured and semi-structured data housed in data lakes and operational databases.
Amazon QuickSight is a scalable, serverless, embeddable, machine learning-powered business intelligence service built for the cloud. QuickSight lets you easily create and publish interactive BI dashboards that include Machine Learning-powered insights. QuickSight dashboards can be accessed from any device, and seamlessly embedded into your applications, portals, and websites.
AWS Data Exchange
Allows you to subscribe to over 1000 data providers such as Reuters Foursquare and Dun & Bradstreet and import datasets to S3 via API for analysis.
AWS Data Pipeline
AWS Data Pipeline is a web based service that helps you reliably process and move data between different AWS compute and storage services at specified intervals. With AWS Data Pipeline, you can regularly access your data where it’s stored, transform and process it at scale, and transfer the results to AWS services such as Amazon RDS, Amazon S3, Amazon DynamoDB, and Amazon EMR.
AWS Glue is a data integration service to help discover and combine data for analytics, ML or app development purposes. Glue helps to discover and extract data from various sources then enriching, combining or normalising data before transferring to databases or data lakes. Glue provides visual (Glue Studio) and programmatic access for data engineers and ETL developers to build and monitor ETL workflows.
AWS Lake Formation
AWS Lake Formation is a service that allows you to set up a secure data lake in days instead of months via dashboard. A data lake is a centralized, curated, and secured repository that stores all your data, both in its original form and prepared for analysis.
AWS Application Integration Services
AWS Step Functions
AWS Step Functions is a serverless function orchestrator that allows you to sequence AWS Lambda functions and multiple AWS services into business-critical applications. Through Step Function's visual interface, you can create and run a series of check-pointed and event-driven workflows that maintain the application state.
Amazon AppFlow is a fully managed integration service that enables you to securely transfer data between SaaS applications like Salesforce, Slack, Service Now, and Zendesk, and AWS services like S3 and Redshift.
Amazon EventBridge is a serverless event bus that makes it easier to build event-driven applications using events generated from your applications, integrated SaaS applications, and AWS services. EventBridge delivers a stream of real-time data from event sources such as Shopify to targets like AWS Lambda and other SaaS applications.
Amazon MQ is a managed message broker service for Apache ActiveMQ and RabbitMQ that allows you to set up and operate message brokers on AWS. Amazon MQ reduces your operational tasks and overheads by managing the provisioning, setup, and maintenance of message brokers for you.
Amazon Simple Notification Service is a fully managed messaging service for both application-to-application and application-to-person communication.
The A2A pub/sub functionality provides topics for high-throughput, push-based, many-to-many messaging between distributed systems, microservices, and event-driven serverless applications. Using Amazon SNS topics, your publisher systems can distribute messages to a large number of subscriber systems including Amazon SQS queues, AWS Lambda functions and HTTPS endpoints. The A2P functionality enables you to send messages to users at scale via SMS, mobile push, and email.
Amazon Simple Queue Service (SQS) is a fully managed message queuing service. Using SQS, you can send, store, and receive messages between software components at any volume, without losing messages or requiring other services to be available.
AWS AppSync is a fully managed service that allows you to develop GraphQL APIs by handling the heavy lifting of securely connecting to data sources like AWS DynamoDB, Lambda, and more. Developers build APIs with GraphQL because it helps them develop applications faster, due to the ability to query multiple databases, microservices, and APIs with a single GraphQL endpoint.
AWS Cost Management Services
AWS Cost Explorer
AWS Cost Explorer has a visual interface that lets you visualize, understand, and manage your AWS costs and usage over time.
AWS Budgets allows you to set custom budgets to track your AWS cost and usage from the simplest to the most complex use cases. With AWS Budgets, you can choose to be alerted by email or SNS notification when actual or forecasted cost and usage exceed your budget threshold.
AWS Cost and Usage Report
The AWS Cost & Usage Report contains a comprehensive set of AWS cost and usage data, including additional metadata about your AWS services, pricing, Reserved Instances, and Savings Plans.
Amazon Managed Blockchain
Amazon Managed Blockchain is a fully managed service that allows you to join public networks or create and manage scalable private networks using the popular open-source frameworks Hyperledger Fabric and Ethereum.
Amazon Quantum Ledger Database
Amazon QLDB is a fully managed ledger database that provides a transparent, immutable, and cryptographically verifiable transaction log owned by a central trusted authority. Amazon QLDB can be used to track each and every application data change and maintains a complete and verifiable history of changes over time.
Ledgers are typically used to record a history of economic and financial activity in an organization. Many organizations build applications with ledger-like functionality because they want to maintain an accurate history of their applications' data, for example, tracking the history of credits and debits in banking transactions.
Amazon Elastic Compute Cloud (Amazon EC2) is a web service that provides secure, resizable compute capacity in the cloud. There are close to 400 instance types that provide your choice of operating system (including MacOS), processor (Intel / Arm / AMD), storage, network configuration and is delivered across more that 24 regions and 77 availability zones that make up the AWS cloud globally.
Amazon EC2 Autoscaling
Amazon EC2 Auto Scaling helps you maintain application availability and allows you to automatically add or remove EC2 instances according to conditions you define. Autoscaling allows you to mitigate against faults and increase application availability during high traffic events.
Lightsail is an easy-to-use virtual private server (VPS) that offers you everything needed to build an application or website. Lightsail allows you to deploy web app tech stacks like LAMP, Nginx, MEAN and Node.js with a few clicks, or deploy preconfigured apps like Wordpress, Magento or Joomla.
AWS Elastic Beanstalk
AWS Elastic Beanstalk is a service for deploying and scaling web applications and services developed with Java, .NET, PHP, Node.js, Python, Ruby, Go, and Docker on familiar servers such as Apache, Nginx, Passenger, and IIS.
Elastic Beanstalk automatically handles the deployment, from capacity provisioning, load balancing, auto-scaling to application health monitoring.
AWS Lambda is a serverless compute service that lets you run code without provisioning servers, creating workload-aware cluster scaling logic, maintaining event integrations, or managing runtimes. With Lambda, you can run code for virtually any type of application or backend service. Simply upload your code as a ZIP file or container image, and Lambda automatically allocates compute execution power and runs your code based on the incoming request or event. Lambda functions support your favorite language (Node.js, Python, Go, Java, and more) and you can use both serverless and container tools, such as AWS SAM or Docker CLI, to build, test, and deploy your functions. Lambda functions are triggered via external requests or events like a resource lifecycle event, or a cloudwatch alert.
Amazon ECR (Elastic Container Registry)
ECR is a fully managed container registry that allows you to store, manage, share, and deploy your container images and artifacts anywhere. Amazon ECR removes the need to operate your own container repositories or worry about the underlying infrastructure. Amazon ECR hosts your images in a highly available and high-performance architecture, allowing you to reliably deploy images for your container applications.
Amazon ECS (Elastic Container Service)
Amazon Elastic Container Service (Amazon ECS) is a scalable, fast container management service that allows you to run, stop, and manage containers on a cluster. Your containers are defined in a task definition that you use to run individual tasks or tasks within a service. In this context, a service is a configuration that enables you to run and maintain a specified number of tasks simultaneously in a cluster. You can run your tasks and services on a serverless infrastructure that is managed by AWS Fargate. Alternatively, for more control over your infrastructure, you can run your tasks and services on a cluster of Amazon EC2 instances that you manage.
Amazon EKS (Elastic Kubernetes Service)
Amazon Elastic Kubernetes Service (Amazon EKS) gives you the flexibility to start, run, and scale Kubernetes applications in the AWS cloud or on-premises. Amazon EKS helps you provide highly-available and secure clusters and automates key tasks such as patching, node provisioning, and updates.
AWS Copilot is a command line interface (CLI) that enables you to quickly launch and easily manage containerized applications on AWS. AWS Copilot provides a simple declarative set of commands, including examples and guided experiences built in to help you deploy applications quickly.
AWS Fargate is a serverless compute engine for containers that works with both ECS and EKS. Fargate removes the need to provision and manage servers, lets you specify and pay for resources per application, and improves security through application isolation by design.
AWS Database Services
Amazon Aurora is a MySQL and PostgreSQL-compatible relational database built for the cloud, that combines the performance and availability of traditional enterprise databases with the simplicity and cost-effectiveness of open source databases.
Amazon DynamoDB is a key-value and document database that delivers single-digit millisecond performance at any scale. It's a fully managed, multi-region, multi-active, durable database with built-in security, backup and restore, and in-memory caching for internet-scale applications.
Amazon ElastiCache allows you to seamlessly set up, run, and scale popular open-source compatible in-memory data stores in the cloud. Build data-intensive apps or boost the performance of your existing databases by retrieving data from high throughput and low latency in-memory data stores.
Amazon Neptune is a fast, reliable, fully managed underwater graph database service that makes it easy to build and run applications that work with highly connected datasets. The core of Amazon Neptune is a purpose-built, high-performance graph database engine optimized for storing billions of relationships and querying the graph with milliseconds latency.
Amazon RDS (Relational Database Service)
Amazon Relational Database Service (Amazon RDS) makes it easy to set up, operate, and scale a relational database in the cloud.
Amazon RDS is available on several database instance types - optimized for memory, performance or I/O - and provides you with six familiar database engines to choose from, including Amazon Aurora, PostgreSQL, MySQL, MariaDB, Oracle Database, and SQL Server.
Amazon Timestream is a fast, scalable, and serverless time series database service for IoT and operational applications that makes it easy to store and analyze trillions of events per day.
AWS Network and Content Delivery Services
Amazon Virtual Private Cloud (Amazon VPC) is a service that lets you launch your AWS resources in a logically isolated virtual network that you define. You have complete control over your virtual networking environment, including selection of your own IP address range, creation of subnets, and configuration of route tables and network gateways across the various regions and availability zones provided by the AWS cloud. You can customize the network configuration by creating a public-facing subnet for your web servers that has access to the internet. Place your backend systems, such as databases or application servers, in a private-facing subnet.
Amazon API Gateway
Amazon API Gateway is a fully managed service that allows developers to create, publish, maintain, monitor, and secure APIs at any scale. Using API Gateway, you can create RESTful APIs and WebSocket APIs that enable real-time two-way communication applications. API Gateway supports containerized and serverless workloads, as well as web applications. API Gateway handles all the tasks involved in accepting and processing hundreds of thousands of concurrent API calls, including traffic management, CORS support, authorization and access control, throttling, monitoring, and API version management.
Amazon CloudFront is a fast content delivery network (CDN) service that securely delivers data, videos, applications, and APIs to your application users globally with low latency, high transfer speeds, all within a developer-friendly environment.
Amazon Route 53
Amazon Route 53 is a highly available and scalable cloud DNS web service. It is designed to give developers and businesses an extremely reliable and cost effective way to route end users to Internet applications by translating names like www.hava.io into the numeric IP addresses like 18.104.22.168 that computers use to connect to each other. Amazon Route 53 is fully compliant with IPv6.
AWS PrivateLink provides private connectivity between your VPCs, AWS services, and your on-premises networks, without exposing your traffic to the public internet. AWS PrivateLink allows you to connect services across different accounts and VPCs to simplify your network architecture.
AWS App Mesh
AWS App Mesh is a service mesh that provides application-level networking to make it easy for your services to communicate with each other across multiple types of compute infrastructure. App Mesh gives end-to-end visibility and high-availability for your applications.
AWS Cloud Map
AWS Cloud Map is a cloud resource discovery service. With Cloud Map, you can define custom names for your application resources, and it maintains the updated location of these dynamically changing resources. Cloud Map constantly monitors the health of every IP-based component of your application and dynamically updates the location of each micro-service as it is added or removed. This ensures that your applications only discover the most up-to-date location of its resources.
AWS Direct Connect
AWS Direct Connect is a cloud service solution that makes it easy to establish a dedicated network connection from your premises to AWS. Using AWS Direct Connect, you establish a private connection between AWS and your datacenter, office, or colocation environment. This can increase bandwidth throughput and provide a more consistent network experience than internet-based connections.
AWS Global Accellerator
AWS Global Accelerator is a network performance service that sends your application user traffic through Amazon Web Service’s global network infrastructure, improving internet user performance by up to 60%. When the internet is congested, Global Accelerator’s automatic routing optimization will help keep your packet loss, jitter, and latency consistently low.
With Global Accelerator, you are provided two global static customer facing IPs to simplify traffic management. On the back end, add or remove your AWS application origins, such as Network Load Balancers, Application Load Balancers, Elastic IPs, and EC2 Instances, without making user facing changes. To mitigate endpoint failure, Global Accelerator automatically re-routes your traffic to your nearest healthy available endpoint.
AWS Transit Gateway
AWS Transit Gateway connects VPCs and on-premises networks through a central hub. This simplifies your network and puts an end to complex peering relationships. It acts as a cloud router – each new connection is only made once.
AWS Elastic Load Balancing
Elastic Load Balancing automatically distributes incoming application traffic across multiple targets, such as Amazon EC2 instances, containers, IP addresses, Lambda functions, and virtual appliances. It can handle the varying load of your application traffic in a single Availability Zone or across multiple Availability Zones.
Amazon Storage Services
Amazon Simple Storage Service (Amazon S3) is a widely used object storage service that offers industry-leading scalability, data availability, security, and performance. Use it to store and protect any amount of data for a range of use cases, such as data lakes, websites, mobile applications, backup and restore, archive, enterprise applications, IoT devices, and big data analytics. Amazon S3 provides management features so you can organize your data and configure finely-tuned access controls to meet your specific business, organizational, and compliance requirements.
Amazon Elastic Block Store (EBS) is a high-performance, persistent block-storage service designed for use with Amazon EC2 for both throughput and transaction intensive workloads at any scale.
Amazon EFS (Elastic File System)
Amazon Elastic File System (Amazon EFS) provides a serverless, set-and-forget, elastic file system that lets you share file data without provisioning or managing storage. This cloud native datastore can be used with AWS Cloud services and on-premises resources, and is built to scale on demand to petabytes without disrupting applications.
Amazon FSx for Lustre
Amazon FSx for Lustre is a fully managed service that provides cost-effective, high-performance, scalable storage for compute workloads. Powered by Lustre, the world's most popular high-performance file system, FSx for Lustre offers sub-millisecond latencies, up to hundreds of gigabytes per second of throughput, and millions of IOPS.
Amazon FSx for Windows File System
Amazon FSx for Windows File Server provides fully managed, highly reliable, and scalable file storage that is accessible over SMB protocol. It is built on Windows Server, delivering a wide range of administrative features such as user quotas, end-user file restore, and Microsoft Active Directory (AD) integration.
Amazon S3 Glacier
Amazon S3 Glacier and S3 Glacier Deep Archive are a secure, durable, and extremely low-cost Amazon S3 cloud storage classes for data archiving and long-term backup.
AWS Backup enables you to centralize and automate data protection across AWS services. AWS Backup offers a fully managed, policy-based service that further simplifies data protection at scale. Together with AWS Organizations, AWS Backup enables you to centrally deploy data protection policies to configure, manage, and govern your backup activity across your organization’s AWS accounts and resources, including EC2 instances, EBS volumes, RDS databases (including Amazon Aurora clusters), DynamoDB tables, EFS, FSx for Lustre and Windows File Server, and AWS Storage Gateway volumes.
AWS Snow Family
AWS provides edge infrastructure and software that moves data processing and analysis as close as necessary to where data is created in order to deliver intelligent, real-time responsiveness and streamline the amount of data transferred. The AWS Snow Family helps customers that need to run operations in austere, non-data center environments, and in locations where there's lack of consistent network connectivity. The Snow Family, comprised of AWS Snowcone, AWS Snowball, and AWS Snowmobile, offers a number of physical devices and capacity points, most with built-in computing capabilities.
AWS Storage Gateway
AWS Storage Gateway is a hybrid cloud storage service that gives you on-premises access to virtually unlimited cloud storage. Organizations use Storage Gateway to simplify storage management and reduce costs for key hybrid cloud storage use cases.
Cloud Endure Disaster Recovery
CloudEndure Disaster Recovery minimizes downtime and data loss by providing fast, reliable recovery of physical, virtual, and cloud-based servers into AWS Cloud. CloudEndure Disaster Recovery continuously replicates your machines (including operating system, system state configuration, databases, applications, and files) into a low-cost staging area in your target AWS account and preferred Region. In the case of a disaster, you can instruct the service to automatically launch thousands of your machines in their fully provisioned state in minutes.
So there you have it, most of the major services provided by AWS to build, deploy and monitor your applications and data in the AWS cloud. These are the most popular services used for the bulk of applications developed by organisations. There are a lot more services provided by AWS in specialised areas like Media, IoT, Quantum computing, robotics, machine learning and VR which we haven't covered here.
In upcoming posts we'll take a look at Developer tools and the many AWS management and governance tools provided by AWS.
If you are working with AWS, GCP or Azure for that matter and value your time and sanity, Hava fully automates the generation and updating of your network topology diagrams and AWS well-architected compliance reporting.
We'd love it if you took a free trial to see Hava in action with your infrastructure.