You can use the esxcli software vib command to add a third-party extension released as a VIB package to the system.

When you use this command, the VIB system updates the firewall rule set and refreshes the host daemon after you reboot the system.

Otherwise, you can use a firewall configuration file to specify port rules for host services to enable for the extension. The vSphere Security documentation discusses how to add, apply, and refresh a firewall rule set and lists the esxcli network firewall commands.