Skip to main content

Check out Interactive Visual Stories to gain hands-on experience with the SSE product features. Click here

Skyhigh Security

Cloud Connector Prerequisites

This topic details the requirements for the Virtual Machine where you install Skyhigh Cloud Connector (CC). It also includes information about required ports and network connectivity.

Before you Begin

The following are required to be installed and properly configured before proceeding on a Windows VM:

  • Microsoft Visual C++ 2015 Redistributable 64-bit version (or later) 

Server or Virtual Machine

The following configuration guidelines are based on observations from our most successful deployments. While your configuration is not required to match the suggestions below, they improve performance and provide the best possible experience when using Cloud Connector.

Operating System

Supported Windows Or Unix versions:

  • Windows Server 2016
  • Windows Server 2019
  • Windows Server 2022
  • Microsoft Visual C++ 2015 Redistributable 64-bit version (or later) must be installed properly for a CC to function on Windows VMs.
    (Download from https://www.microsoft.com/en-us/download/details.aspx?id=48145.)
  • Linux 64-bit (Ubuntu, CentOS, or RHEL)
    • Ubuntu - 18.04 LTS - Bionic, 19.04 - Disco, 20.04 LTS
    • CentOS - 8
    • Red Hat Enterprise Linux (RHEL) v7.x, v8.x

NOTE: Cloud Connector supported current java version is v1.8.0.x.

Number of Cores

Minimum 8, though more cores will improve performance.

  • CC spawns multiple threads on different cores to split large files, as CC is designed to process large files faster.
  • By design, one file at a time is picked for processing. So, it is possible to divide a large file across multiple cores, with one thread per core for faster processing.

File Size Provided for Processing

We recommend that files be between 1 GB-2 GB for best performance.

  • Large files (larger than 5 GB) does not improve performance.
  • Small files impact performance drastically, as CC picks up one file at a time for processing, which doesn't allow all available cores to be used.
    • Concatenate small files to 1 GB-2 GB.

Allocated RAM

For systems with the following amount of available system memory, Skyhigh Cloud Connector is allocated the following amounts:

Operating System 8 GB RAM 16 GB RAM 32 GB RAM
Windows 64-bit 8000 MB 12288 MB 24576 MB
Linux 8000 MB 12288 MB 24576 MB

IMPORTANT: The Skyhigh Cloud Connector  now dynamically allocates memory depending on the total RAM. 

If RAM is less than equal to 16 GB, it occupies 50 to 62.5 percent of the memory (8 to 10 GB).
If RAM is between 16 to 20 GB,  it occupies 70 percent of the memory (11 to 14 GB).
If RAM is greater than 20 GB, it occupies 75 percent of the memory (15 GB).

When using Syslog to ingest log files, an additional 2 GB RAM is required. 

Allocated Disk Space

Minimum of 250 GB. Calculate this based on the inflow rate of logs, so that two days of logs can be persisted if:

  • Increased load for processing, providing sufficient time to Skyhigh CASB Support to reply with VM configuration recommendations.
  • Providing sufficient time to Skyhigh CASB Support to debug, should CC have an issue in processing.

Supported Web Browsers

Network Connectivity

Cloud Connector must communicate with the following URLs over TCP 443:

Open firewall ports (if needed) from the system or VM running CC. Administrators should connect to the CC user interface (default TCP 8443) for detokenization and administrative reasons.

If CC is installed in a LAN, no additional configuration is required on the firewall. But if CC is installed in a DMZ, AWS, or Azure environment, the TCP port 8443 should be open in the following direction: LAN > (DMZ/AWS/Azure).

Communication between Skyhigh Cloud Connector and Log Collector is supported by both TLS v1.2 and TLS v1.3 protocols. For details, see Communication Between Cloud Connector and Log Collector.

Accounts

  • Admin Account Access. Cloud Connector needs admin access to install, execute, and access your log files. The applications that need access to the log files are the shnlps and shnlpcli executables.
  • Local System Admin Account. If you store log files locally by Syslog or by nightly export, you can use a local system admin account to install CC.
  • Network Admin Account. If you store log files on a network drive, you need a network admin account, because CC needs to process these files and modify them after processing.
  • Skyhigh Cloud Connector User Role. Any user that needs to configure or change Skyhigh Cloud Connector must be granted the Skyhigh Cloud Connector User role. For details, see About User Roles and Access Levels. The integration account should be a basic auth account. Skyhigh CASB does not support an account with a SAML-only login or a user account with multi-factor authentication enabled.

Number of Open Files in the System

The number of open files in the system should not be unlimited. Run the following command to reset the setting:

ulimit -n 1024

Logs

Log Sources

Before deploying, identify your log sources (firewalls and proxies) and provide a 1,000 line sample from all distinct log sources. If the logs are being aggregated to a SIEM device, provide a sample that covers all distinct log feeds.

Log File Types

Skyhigh Cloud Connector supports the following log file types:

Uncompressed
  • TXT
  • CSV
Compressed
  • Archive format: ZIP, GZIP, TAR, BZIP2, 7Z (Make sure that Process Zip Files is set to True in the EC Configuration Log Processing tab.)
  • Compression Techniques: Normal
  • Compression Method: Deflate, BZip2
  • Compression Level: Store for tar

Log File Name Limitation

For the Cloud Connector log processor to pick up and process log files, file names cannot use double periods: "..".
For example, the following log file would not be processed:

Skyhigh_Assessment_1708301430-2610.30.2000.111..137.log

Log Fields

The following fields are the most valuable: 

  • c-ip
  • source_ip (mandatory)
  • cs(User-Agent) 
  • cs-bytes
  • source_bytes (or bytes sent; mandatory)
  • cs-method
  • cs-mime-type or rs(Content-Type)
  • mime_type
  • cs-uri
  • cs-uri-path
  • cs-uri-query
  • d-port
  • cs-version
  • cs-username
  • s-ip
  • sc-bytes
  • sc-http-status
  • sc-result-code
  • cs(X-Forward-For) 
  • egress action (permit or deny; mandatory)
  • destination (URL or IP; mandatory)
  • timestamp (mandatory)

Performance Benchmarking

The following benchmarks provide observed performance changes based on the recommended VM configuration:

File processing, file sizes of 1 GB each:

  • Windows. 9 MB/s (~750 GB/day)
  • Linux. 7 MB/s (~600 GB/day)

Syslog messages to EC (using built-in Syslog server):

  • Windows and Linux. 20 K messages/sec max to be ingested for one CC.
  • Was this article helpful?