Skip to content

Create a Logs Service


Overview

CloudAEye SaaS provides centralized logs service. It is a managed service that makes logs collection, parsing, storing and analytics easier. It enables operating and analyzing logs from distributed cloud applications at scale in a highly cost effective manner. It is built on fully open-source search and analytics engine.

This topic describes how user may create this service.

Create

From left navigation menu, select Services > Logs. You will see list of logs services that are already created. The table will be empty if there are no logs services being created.

To create a new logs service, click on CREATE on the top right corner. A new form will appear under Logs > Create.

Provide the following informaiton:

  • Name: Name of the logs service. This is usually an alpha-numeric string. For example, orders-app-logs.
  • Groups: Pick the Service Group this service should be part of. Learn more about Service Groups here.
  • Labels: Optional Key/Value information that may be added to this logs service. This enables you to categorize the resources in flexible ways. Use the + symbol to add additional labels.

Click SUBMIT to create the logs service.

User may create a logs service by calling create on logs command.

caeops logs create --name demo-logs-service

User may provide appropriate name for the logs service in --name option.

The output may look like the following:

{
   "serviceName": demo-logs-service",
   "serviceRegion": "",
   "serviceEndpoint": "",
   "serviceType": "logs-service",
   "groupName": "",
   "labels": {},
   "createdAt": 1629905422321,
   "updatedAt": 1629905422321
}

List All Logs Service(s)

To see list of already created logs services, select Services > Logs from the left navigation. You will see a list of logs services that are already created.

Details of a Logs Service

To see details of a specific logs service, click on the name of the logs service under Service Name column. A new page will appear under Logs > <Name-of-logs-service>.

This page shows the following information:

  • Name: Name of the logs service
  • Region: Name of the region where your service is running. Public cloud providers have the concept of a region, which is a physical locaiton around the world that consists of multilple, isolated and physically seperate availability zone within a geographic area. Availability zone is a logical grouping of data centers.
  • Date created: Date when this service was created.
  • Date updated: Date when this service was last updated.
  • Dashboard: Dashboard to view and search the logs. Click on the OPEN button that opens the Kibana (now OpenSearch) dashboard.

On the top right side section, the following information is shown:

  • Group name: Name of the Service Group.
  • Labels: Key/Value information associated with this service.

2nd section shows the following information:

  • Endpoint: URL of the Elasticsearch (now OpenSearch) endpoint associated with this service.

3rd section has the following information:

  • This section shows the instructions to setup the agent for logs streaming.

The create command will initiate creation of server-side infrastructure including Logstash for sophisticated logs parsing, Elastisearch for indexing, storing parsed and searchable logs. It will setup dashboard for log viewing. After the logs service creation is complete in few (about 5-6) minutes, you may run the list command to see the details. For example,

caeops logs list
[
  {
    "serviceName": "demo-logs-service",
    "serviceRegion": "us-east-2",
    "serviceEndpoint": "https://demo-logs-service-km4s7fd5kydgbhfcug43nygbuq.us-east-2.es.amazonaws.com",
    "serviceType": "logs-service",
    "groupName": "",
    "labels": {},
    "createdAt": 1629641060239,
    "updatedAt": 1629643171344
  },
  {
    "serviceName": "demo-logs-service-2",
    "serviceRegion": "us-east-2",
    "serviceEndpoint": "https://demo-logs-service-2-lh4x54iutc7e2xnv6aoiwhsfuy.us-east-2.es.amazonaws.com",
    "serviceType": "logs-service",
    "groupName": "",
    "labels": {},
    "createdAt": 1629905422321,
    "updatedAt": 1629906273640
  }
]

Next Steps

User may setup logs streaming from application environment to CloudAEye SaaS for centralized logging and viewing.