Updated on: 16 September 2022

VMware Skyline Health Diagnostics version 3.5.0

Release date: 16 September 2022

NOTE: These Release Notes do not provide the terms applicable to your license. Consult the VMware Product Guide and VMware End User License Agreement for the license metrics and other license terms applicable to your use of VMware Skyline Health Diagnostics.

About VMware Skyline Health Diagnostics

VMware Skyline Health Diagnostics is VMware's Self-Service diagnostic and health platform. It helps you with the following:

  • Diagnose any failures/known issues and resolve
  • Run health checks
  • Understand applicability of VMware Security Advisories and related resolutions
  • Identify issues which might impact the update or upgrade of the product

It uses product logs, configuration information, and various other information to detect problems and provide recommendations in the form of KB articles or steps to remediate them.
A vSphere Administrator can use this tool to troubleshoot the issue before contacting the VMware Global Support Service. This platform detects and provides remediation to problems in the vSphere product line. The platform provides recommendations in the form of Knowledge Base articles or steps to remediate the issues. It can work in offline mode or a disconnected environment. It uses product logs to detect issues. vSphere Administrator can use this tool for troubleshooting, before contacting the VMware Global Support Service. Your operation staff or support engineers can save a significant amount of time to detect the problem, identifying a cause, and getting a quick resolution, for VMware vSphere, using the Skyline Health Diagnostics.

For more information, see VMware Skyline Health Diagnostics Installation, Configuration and Operations Guide.

Supported vSphere Releases

  • VMware ESXi version 6.5, 6.7 and 7.0
  • VMWare vCenter version 6.5, 6.7 and 7.0

Supported vSAN Releases

  • VMware vSAN version 6.5, 6.7 and 7.0

Supported VMware Cloud Foundation Releases (Technical Preview Mode)

  • VMware Cloud Foundation version 4.0, 4.1, 4.2 and 4.3

Supported Browsers 

Microsoft Window 10

Browser Version
Microsoft Internet Explorer 11 and later
Mozilla Firefox version 56 and later
Mozilla Firefox version 56 and later
Google Chrome version 62 and later
Microsoft Edge: 44.18362.449.0
Safari version 12.1 and later

MAC OS

Browser Version
Mozilla Firefox version 56 and later
Google Chrome version 62 and later
Safari version 12.1 and later

 

What's New in 3.5.0, September 2022 Release

  • VMware vCenter Server Upgrade Pre-checks
    • VMware vCenter Server upgrade pre-checks added for version 6.5 & 6.7, nearing EOGS.
    • VMware vCenter Server Health checks are implicitly included as part of upgrade pre-checks
    • New reporting structure to present the upgrade pre-check analysis result.
    • API swagger documentation link has been added into the Health and Diagnostics client.
  • Extended VMware vCenter Server Health checks
    • Added new VMware vCenter Server Health checks for extend the coverage from previously supported list.
    • Users can now provide ‘root’ user vCenter credentials for running extensive health checks from SHD.
  • Public API Support for Offline analysis
    • Now users can invoke the analysis, monitoring and result generation, workflows using SHD APIs
    • User can use SHD API to perform offline (log bundle) analysis from local or remote servers
    • APIs added to support authentication, run analysis, monitor tasks, fetch result and download the HTML reports data.
    • Inbuilt swagger interface for API documentation and to try out the API from user interface
  • Skyline Health Diagnostics plugin registration on vSphere Client
    • Support to integrate health and diagnostics plugin with vSphere Client having version >= 7.x .
    • Users can now trigger analysis & view reports from VMware vSphere Client itself, using Skyline Health and Diagnostics remote plugin.
  • Support Log bundle analysis from Remote server
    • Partners & customers can now upload the log bundles from remote servers, no need to download it on local machine first and then upload to SHD for analysis
    • Supports major protocols like FTP, FTPs, SFTP, HTTP & HTTPs
  • SSH Client settings have been updated to accept only strong ciphers.
  • Default SSHD configuration changes
    • SSH Server on SHD appliance only supports strong Ciphers and hashing algorithms.
    • Only AES 128/192/256 bit ctr/gcm based Ciphers are now supported by SSH Server
  • New Plugins Added
    • vSphere: 80

    • VMware Security Advisory : 03
    • vSAN: 12

    • VMware Cloud Foundation : 3

Feature list for version 3.5.0, September 2022 Release

Collect logs and Analyze

Connect to VMware vCenter Server or VMware ESXi host or VMware Cloud Foundation SDDC Manager. Select the Diagnostics or Security analysis plug-in or Health Checks. Select the VMware vCenter Server or VMware ESXi hosts or VMware Cloud Foundation SDDC Manager workload domains. Tag the specific analysis run for a faster search in the reports afterward. Collect the logs from selected targets and analyze the log bundles for problems. Finally, get the report of the identified problems and remediation.

Collect logs for Disconnected Hosts

The VMware Skyline Health Diagnostics provides a log collection from the disconnected hosts.

Upload and Analyze logs

Upload the logs from the VMware vCenter Server or VMware ESXi host or VMware Cloud Foundation SDDC Manager workload domain and analyze the log bundle for issues. Get the report of the identified issues and remediation.

VMware Security Advisory Scanning

Scan your infrastructure to know whether deployed VMware products have any security threat and to know the version of the product that has the fix for this threat, using VMware Security Advisory recommendations. This involves lightweight data collection for analysis, without the need to collect the entire log bundle.

Show Reports

See the list of the last reports, download, and view it.

Scheduler

Schedule periodic health check to monitor the health status and ensure healthy and reliable infrastructure. 

Settings

Upgrade and Download History

  • Upgrade History: See that the last five upgrades carried out with Source, Target version, start and end time, time is taken.

  • Download History: See the last five download version, start and end time, time is taken.

Customer Experience Improvement Program

  • Enable or disable the CEIP to share the data about the success or failure of the plug-ins and usage details with VMware.

  • View the sample data collected.

  • See Internet connectivity.

User Management

  • You can add new users with the Operator role.

  • As an shd-admin, you can reset the password or update user details like the name and the email ID.

Configuration

  • You can now improve the performance of the analyze operation by modifying the timeout and indexer settings from Skyline Health Diagnostics user interface.

  • You can now change the password expiration, lockout and allowed authentication failures count by modifying the respective settings from Skyline Health Diagnostics user interface.

  • You can now limit the time duration of logs to analyze to the last few days from the log collection date, by using the configuration settings.

Email Notification Support

  • You can now receive the report of Scheduled Health Check run over email using Notification Settings. Configure notification setting with SMTP server details to use this feature.
  • Create distribution list by adding one or more users to get notified.
  • Select one or more distribution list while adding the new run with notification enabled option.

Reset Password

  • You can update the existing password before it expires, provide a current password and a new password.

Proxy Settings

If VMware Skyline Health Diagnostics deployment is behind the proxy, provide the proxy details to enable Internet access. You need to be connected to the Internet to download the latest signatures.

Help and Support

  • Tools usage: Allow you to see the data Skyline Health Diagnostics collects under the CEIP program to improve the tool, you can see the data. If you are satisfied, either you can enable the CEIP data sharing with VMware or share the report through email with VMware.

About

  • Product version information

  • Release date

Signatures Added for Detecting Issues 

vCenter Server Diagnostics

  • vCenter server un-availability due to service failure

  • vCenter Services un-availability 

  • Certificate validation including PSC, Machine, STS, and Service

  • Appliance space-related issues

  • Password expiry

  • VMware Compatibility validation for driver, firmware, and IO devices

  • IO Device compatibility check for vSAN

  • vCenter server Install/Upgrade/Migrate failures - partial

ESXi Diagnostics

  • ESXi PSOD

  • ESXi storage

  • Hostd issues

  • Networking related issues

  • Path trashing

  • Storage latency

  • File system corruption

  • CPU Microcode checks that require updates

  • Deprecation check - Driver Compatibility on ESXi 6.x with respect to 7.0

  • upgrade failure checks

  • time sync related anomalies

  • Host disconnect coverage – partial

  • Host Upgrade failure – partial

vSAN Health Checks

VMware Cloud Foundation Health Checks using SDDC Manager.

Report on VMware Compatibility Guide

When the ESXi logs are analyzed the VCG plug-ins automatically detect the hardware and driver versions. Based on this version information it runs the analysis. The analysis report provides details about the existing hardware & driver versions, the latest available versions, and support status.

Note: The disk compatibility analysis is not covered in this version.

Report on VMware Security Guide

The new report layout now has a section "VMSA Finding" to provide a summary of security issues and recommendations using VMware Security Advisor.

Report on Diagnostics

The new report layout now has a section "Diagnostics Finding" to provide a summary of diagnostics problems and recommendations.

Report on Health Checks

The new report layout now has a section "Health Check Findings" to provide a summary of health issues.

Performance Improvements

The Skyline Health Diagnostics has improvements in user interface and performance optimization.

Other Improvements

  • Improved error messages and display on the UI for the failed downloads from external sites (Updates, VCG Data).
  • Reports will display the summary section even if there were no findings, conveying the same.

Unsupported Scenarios

VMware Skyline Health Diagnostics will address the following scenarios in future releases:

  1. To collect the log bundle for disconnected encrypted ESXi hosts.

  2. Analyse the crash dump for the encrypted ESXi hosts. 

  3. Firmware validation in VMware Compatibility Guide Report.

  4. VMware vCenter Servers in enhanced linked mode.

Known Limitations

  1.  Only shd-admin can download the tools update.

  2. Concurrent "Collect Logs & Analyze" the operation are limited to four.

  3. The maximum number for targets (VMware ESXi hosts and VMware vCenter server) for each "Collect Logs & Analyze" operation is sixty-five (sixty-four ESXi hosts and one vCenter Server).

  4. Uninstallation of the tool removes all historical data.

  5. The maximum no. of reports shown is the last fifty.

VMware Compatibility Guide Report

VMware compatibility guide report is available as a fully functional feature. Manual verification is suggested. The following are known limitations:

  1. To download the VCG and Tool Update, Internet connectivity is a must. No offline patches.

  2. vSAN HCL checks are limited only to storage I/O device used with VMware vSAN

  3. Firmware versions are not validated for VCG.

Resolved Issues

  • Running Analysis workflow with only 'vSAN Health Check Plug-in' selected may show report with no VSAN Summary section.

    Running Analysis workflow with only 'vSAN Health Check Plug-in' selected may show a report with no VSAN Summary section in case no plug-ins matched. There is a functional issue caused by this issue.

    This issue is fixed in 2.5.1 release and onwards.

  • Old reports may not be seen categorized

    Once you click on SHow Reports -> Filter to Products or components may not work on old reports. This is due to the new filtering changes that can not be applied to old reports.

    This issues is fixed in 2.5.1 release and onwards.

  • Auto update may fail with the error.

    This is seen in scenarios where the update check is done again before the downloaded update package is applied.

    Fix : This issue is fixed in 2.5.1 release and onwards.

    Workaround: Download the updates again and reboot the VM immediately

  • You might want to run multiple logs analysis in parallel, against the same or multiple vCenter using the same SHD instance. This operation might fail sometimes. 

    This issue is fixed for 2.5.1 release and onwards.

    None

  • Log bundle collecting from direct ESXi connect might fail in some scenarios.

    In some scenarios where you are connecting to ESXi for diagnostics, the workflow can fail at the first stage of the log bundle generation. This issue is fixed for the 2.0.2 release and onwards.

  • Proxy server configuration with authentications mat not work as expected.

    Navigate to Proxy Setting under the Settings tab. Provide Proxy authentication details. Try to download VCG signature,  the operation will fail.

    The log files under /opt/vmware-shd/vmware-shd/log/vmware-shd-support* , may show following error.

    SHD logs show following error : Cannot connect to proxy.', OSError('Tunnel connection failed: 407 Proxy Authentication Required')

    The issue is fixed for the 2.0.2 release and onwards.

  • Using FQDN to connect to vCenter Server or ESXi host failed with the "Lookup timed out" error.

    To collect log bundle for analysis of the issue, you may provide a vCenter Server or ESXi host FQDN. But the operation will fail as the DNS name resolution was timing out. This will fail the  FQDN based connection to vCenter Server or ESXi host. This issue also caused failures for checking and downloading updates. This issue is fixed for the 2.0.2 release and onwards.

  • The operation to update VMware Compatibility Guide (VCG) might fail.

    VCG update was failing due to the high number of parallel requests to download the VCG information.  This issue is fixed for the 2.0.2 release and onwards.

  • VMware Compatibility Guide(VCG) /Software Updates failed in case of the proxy server with MITM configuration is used.

    VCG and Software updates failed in cases proxy server with MITM (SSL termination at Proxy). This issue is resolved in the 2.0.4 version and onwards.

    None

  • VMware Compatibility Guide Update resulted in failure of compatibility checks

    The VCG Update resulted in invalid data being updated to the database due to server-side issues. This issue is resolved in version 2.0.5 and onwards.

  • The VMware Compatibility Guide Update failures did not correctly propagate the error to the user.

    The VCG update failures with error descriptions were not getting propagated to the user. This issue has been fixed in version 2.0.5 and onwards.

  • When you are Changing the password age (account or passage), it does not correctly reset the expiry date for the existing passwords.

    When you are Changing the password age (account or passage). The change in password age was not correctly updated in the user record. This issue has been fixed in version 2.0.5 and later.

  • You might observe the Analysis workflow stalled when multiple log bundles are downloaded from ESXi or vCenter.

    This issue is resolved in version 2.0.5 and later.

  • While collecting the log bundle from the ESXi host over SSH, the Connections to ESXi might not timeout in case of failures.

    This issue has been fixed in the release 2.0.5 and later.

  • The Product names appearing in the report were inconsistent.

    Product name in the report appeared differently depending on the data source available.

    The issue is fixed for the 2.50 release and onwards.

  • vCenter Server build/release detection could fail in a few cases thus raising false match.

    vCenter release detection was incorrect for some vCenter builds

    The issue is fixed in the 2.5.0 release and onwards.

  • VCG Check incorrectly tagged NVMe of FC devices.

    NVMe Over FC devices were not correctly validated.

    The issue is resolved in the 2.5.0 release and onwards.

  • The vSAN HCL check failed in cases due to case sensitive search.

    A case-sensitive search for a device on the HCL could fail to match the device.

    The issue is resolved in the 2.5.0 release and onwards.

  • Online update of SHD failed with "Read Manifest failed" error

    In some cases, the online update of SHD failed due to a conflict between check and update.

    The issue is fixed in the 2.5.0 release and onwards.

  • Parallel vCenter Server Appliance analysis could fail.

    Running more than one vCenter Server Appliance diagnostics resulted in failure of all or one workflow

    The issue fixed in the  2.5.0  release and onwards.

  • Running Diagnostics on some ESXi servers fails either at Log Collection or Analysis phase

    On servers running ESXi Server 6.5, diagnostics workflow may fail. These servers did no product unique filenames for log bundle which caused the failure. This issue has been fixed with release.

    This issue has been fixed in version 3.0 and above.

  • VCG Compatibility check might show supported hardware as “Not Supported” for ESXi Server 7.0 Update 3

    Due to inconsistency in VCG data, a supported server/IO device  would have shown as “Not Supported” for ESXi Server 7.0 Update 3.

    This issue has been resolved in version 3.0 and above.

  • Certain devices might have been appearing as not supported/not checked.

    Certain devices might have been appearing as not supported/not checked due to error in VCG Data.

    This issue has been fixed in version 3.0.1 and above.

  • SSH Server/Client Hardening settings were missing from 3.0.0 release when online/offline patching was used.

    SSH Server was configured to accept only strong Ciphers with release of version 3.0.0. Using offline/online updates did not update the settings on the existing installation. This issue is resolved with this release

    This issue has been fixed in version 3.0.1 and above

  • Generating Analysis report at Log Directory/Bundle level failed

    Generating analysis report at Log Directory/Bundle level failed due to incorrect handling of input parameters.

    This issue has been resolved in 3.0.1 and above.

  • Skyline Health Diagnostics user interface does not display the buttons on Diagnostic Run Wizard and user can not schedule the diagnostics run.

    When you update to Skyline Health Diagnostics to version 3.0.1 and try to execute the diagnostics or heath run. The wizard does not display the button to submit the run. This is happening due to the changes in the User interface style sheet ( CSS ) in Clarity Design Package V 13.0.3 released on March 18, 2022.Skyline Health Diagnostics consumes this version and hence got impacted.

    This issue is resolved in Skyline Health Diagnostics version 3.0.2. You are advised to update to version 3.0.2

Known Issues

  • Longer Analysis Time

    The host having non-default log configurations (with respect to size and number of files) might see a longer analysis time due to the number of logs.

    Workaround: None

  • Analyzing vCenter Server as a target might not progress beyond the Generate Log Bundle stage. 

    Collect Logs and Analyze --> Run Diagnostics with vCenter Server as a target might not progress beyond the Generate Log Bundle stage. The issue occurs due to the corresponding "Generate Log Bundles" task on the vCenter server is not completing.

    Workaround:

    (1) You can restart the Skyline Health Diagnostics appliance to cancel this pending analysis task and retry after some time.

    (2) You can use the timeout setting under VMware Skyline Health Diagnostics UI --> Settings Tab -->Configuration-->Log Generation Timeout; so that you can control the time duration of log collection.

     

  • For some Internet Explorer browser versions, the header content might not be aligned properly.

    Skyline health diagnostics supports the limited browsers and versions, please refer the section in release notes for supported browsers.

    Workaround : None

  • Skyline Health Diagnostics user interface might show a generic error [Object Object]

    Skyline Health Diagnostics user interface might show a generic error [Object Object] while downloading the online update bundle for few cases while updating from 2.5.0 to 2.5.1, user can ignore it and proceed.

    None. You can ignore it and proceed.

check-circle-line exclamation-circle-line close-line
Scroll to top icon