VCF9.1 HomeLab

This guide walks through the complete deployment of VMware Cloud Foundation (VCF) 9.1 using the consolidated architecture in full HA mode. The goal is to build a lab or test environment that emulates as many production features and capabilities as possible while strictly following production-grade rules.

This blog entry is to support deployment of entire VMware Cloud Foundation 9.1 consolidated infrastructure in HA mode. To test and emulate all functionality available. The production rules will be as follows:

  • HA Mode for all components
  • Two VDS setup (2x system traffic, 2x workload traffic

 

this post is work in progress

Hypervisor

Used a large ESX host with PCIe NVMe drives; deployed 4 vritual machine with the following settings to emulate production as much as possible:

  • 256 GB Memory
  • 24 vCPU (enabled: Expose hardware assisted virtualization to Guest OS). The Management worker nodes need at least 24 vCPU.
  • 40GB “boot” drive
  • Created additional NVMe Controller
  • Created additional 600GB drive allocated to NVMe Controller
  • Created 4x vNIC: 2x System Traffic + 2x Workload Traffic
  • The system traffic port group is a vlan trunk
  • The workload traffic port group is a vlan trunk

After the ESXi 9.1 host image has bee installed on the four nested ESXi hosts, make sure to perform the following initial configuration of each host:

  • On management interface define the ESXi management VLAN
  • On management interface select only one system traffic port
  • On management interface configure ip address gateway
  • Define DNS servers
  • Enable SSH under troubleshooting (will be disabled by VCF bringup later on)

On each nested ESX host configure FQDN properly:

# esxcli system hostname set --fqdn=<esxhostname.testlab.cyberfront.org>Code language: HTML, XML (xml)

On each nested ESX host generate new ssl certificates which match fqdn hostname:

# /sbin/generate-certificates
validate certificates with
# openssl x509 -in /etc/vmware/ssl/rui.crt -noout -textCode language: PHP (php)

On each nested ESX host enable NTP service

# chkconfig ntpd on
Code language: PHP (php)

On each nested ESX host enable specific  vm nested virtualization (required for the VCF Management Services workers nodes)

# echo 'vhv.allow = "TRUE"' >> /etc/vmware/configCode language: PHP (php)

Reboot each nested ESX host:

# rebootCode language: PHP (php)

Offline Depot

If you don’t have an active VCF subscription and only wnat to deploy a 90 day trial, you will require an offline depot. VCF9 does not allow online depot if you do not have an active subscription. You will need a broadcom download token in order to seed the offline depot.

Follow the online available procedures to configure a offline depot:

  • Linux VM
  • Install Apache webserver
  • eanble ssl and headers and rewrite modules
  • Generate SSL certificates
  • Download vcf-download-tool under the tools section of the VCF9.1 section and extract somewhere on server
  • Generate a download token on broadcom site

List the versions available using the token:

# bin/vcf-download-tool releases list --depot-download-token-file=/home/adminusr/download-token.txt
*********Welcome to VCF Download Tool***********

Version: 9.1.0.0.25371089
Validating depot credentials.
Depot credentials are valid.
Downloading unified release manifest file.
Successfully downloaded unified release manifest file.
9.1.0.0
9.0.2.0
9.0.1.0
9.0.0.0
5.2.3.0
5.2.2.0
5.2.1.0
5.2.0.0
5.1.1.0
5.1.0.0
5.0.0.1
5.0.0.0
4.5.2.0
4.5.1.0
4.5.0.0
4.4.1.1
4.4.1.0Code language: PHP (php)

Seed the software depot with the appropriate version:

 

bin/vcf-download-tool binaries download --vcf-version 9.1.0.0 --automated-install --type INSTALL --depot-store=/var/www/html --depot-download-token-file=/home/adminusr/download-token.txt
*********Welcome to VCF Download Tool***********

Version: 9.1.0.0.25371089
Validating depot credentials.
Depot credentials are valid.
Downloading unified release manifest file.
Successfully downloaded unified release manifest file.
Downloading product version catalog file.
Successfully downloaded product version catalog file.
Downloading vSAN HCL file.
Successfully downloaded vSAN HCL file.
Downloading compatibility data.
Successfully downloaded compatibility data.
Downloading unified compatibility data.
Successfully downloaded unified compatibility data.
Downloading vCenter upgrade info file.
Successfully downloaded vCenter upgrade info file.
Binaries to be downloaded:
------------------------------------------------------------------------------------------------------------------------------------------------------------
ID                                   | Component                         | Component Full Name      | Version          | Release Date | Size       | Type
------------------------------------------------------------------------------------------------------------------------------------------------------------
cfdc3829-f065-50ec-8c4e-2c2fc85ccc56 | TELEMETRY_ACCEPTOR                | Telemetry                | 9.1.0.0.25181946 | 05/11/2026   |   98.3 MiB | INSTALL
2a4a0cfa-c823-5999-a831-f12dc522b95f | VROPS                             | VCF Operations           | 9.1.0.0.25346025 | 05/11/2026   |    3.1 GiB | INSTALL
581cfc8b-6d2e-51e1-8412-528c4506e419 | VCENTER                           | VMware vCenter           | 9.1.0.0.25370922 | 05/11/2026   |   12.0 GiB | INSTALL
2549d171-774b-5662-8a40-a40f8cb2cf11 | DEPOT_SERVICE                     | Software depot           | 9.1.0.0.25371105 | 05/11/2026   |  547.8 MiB | INSTALL
043bbcda-7ec2-5874-84e4-0f51472f3d5c | NSX_T_MANAGER                     | VMware NSX               | 9.1.0.0.25318225 | 05/11/2026   |    7.5 GiB | INSTALL
1e7fd7e4-042c-5c6c-a7ba-a2c926a90f4f | VCF_SALT_RAAS                     | Salt RaaS                | 9.1.0.0.25346036 | 05/11/2026   |  429.2 MiB | INSTALL
0911b05e-e5c1-5036-867f-7a12066c8d06 | VIDB                              | Identity broker          | 9.1.0.0.25368698 | 05/11/2026   |    1.0 GiB | INSTALL
75c2165f-ac1e-55da-8c96-d394bf441f56 | VCF_SDDC_LCM                      | SDDC lifecycle           | 9.1.0.0.25371107 | 05/11/2026   |  810.9 MiB | INSTALL
9599b55f-952b-5b2f-a96a-7529a9e904ae | VCF_OPS_CLOUD_PROXY               | Cloud proxy              | 9.1.0.0.25346033 | 05/11/2026   |    2.8 GiB | INSTALL
fe5daf52-a3e1-5487-8ec4-25270533bb23 | SDDC_MANAGER_VCF                  | SDDC Manager             | 9.1.0.0.25371088 | 05/11/2026   |    2.3 GiB | INSTALL
ad3f0777-a0c9-509c-86cd-86001cebcf8f | VCF_FLEET_LCM                     | Fleet lifecycle          | 9.1.0.0.25371109 | 05/11/2026   |  751.3 MiB | INSTALL
62f68bab-de0c-5d96-8222-577c3ac4270e | VCF_LICENSE_SERVER                | License server           | 9.1.0.0.25346031 | 05/11/2026   |  667.1 MiB | INSTALL
aa88f811-700a-5384-b86e-c40191985348 | VSP                               | VCF services runtime     | 9.1.0.0.25370367 | 05/11/2026   |   17.3 GiB | INSTALL
1998d24e-9fa4-5a13-b795-472537e224d2 | VCF_SERVICE_VCD_MIGRATION_BACKEND | Migration service engine | 9.1.0.0.25370929 | 05/11/2026   |  521.7 MiB | INSTALL
8adb94df-7a39-5c96-a924-215cce4a605c | VRA                               | VCF Automation           | 9.1.0.0.25370929 | 05/11/2026   |   14.9 GiB | INSTALL
3092fe38-b997-5f2f-b397-6776c6601880 | VCF_SALT                          | Salt master              | 9.1.0.0.25346036 | 05/11/2026   |  332.4 MiB | INSTALL
------------------------------------------------------------------------------------------------------------------------------------------------------------
16 elements
------------------------------------------------------------------------------------------------------------------------------------------------------------
Validating available free space.
Required disk space: 67510.4, available disk space : 92377.9
Successfully validated available free space.
Starting binaries download.
Download Progress of : Operations-Appliance-9.1.0.0.25346025.ova : 16.2 MB, Average Speed: 35.18 Mbps
Download Progress of : VMware-VCSA-all-9.1.0.0.25370922.iso : 62.0 MB, Average Speed: 86.65 Mbps
Download Progress of : telemetry-acceptor-9.1.0.0.25181946.tgz : 24.2 MB, Average Speed: 55.47 Mbps
Download Progress of : Operations-Appliance-9.1.0.0.25346025.ova : 68.7 MB, Average Speed: 27.91 Mbps
Download Progress of : VMware-VCSA-all-9.1.0.0.25370922.iso : 125.3 MB, Average Speed: 46.12 Mbps
Download Progress of : vcf-fleet-depot-9.1.0.0.25371105.tgz : 17.8 MB, Average Speed: 49.18 Mbps
Download Progress of : vcf-fleet-depot-9.1.0.0.25371105.tgz : 154.3 MB, Average Speed: 65.33 Mbps
Download Progress of : Operations-Appliance-9.1.0.0.25346025.ova : 205.0 MB, Average Speed: 31.71 Mbps
Download Progress of : VMware-VCSA-all-9.1.0.0.25370922.iso : 262.9 MB, Average Speed: 39.13 Mbps
Download Progress of : vcf-fleet-depot-9.1.0.0.25371105.tgz : 308.8 MB, Average Speed: 48.53 Mbps
Download Progress of : Operations-Appliance-9.1.0.0.25346025.ova : 481.2 MB, Average Speed: 33.27 Mbps
Download Progress of : VMware-VCSA-all-9.1.0.0.25370922.iso : 524.0 MB, Average Speed: 35.60 Mbps
Download Progress of : nsx-unified-appliance-9.1.0.0.25318227.ova : 17.8 MB, Average Speed: 42.46 Mbps
Download Progress of : nsx-unified-appliance-9.1.0.0.25318227.ova : 148.2 MB, Average Speed: 61.25 Mbps
Download Progress of : nsx-unified-appliance-9.1.0.0.25318227.ova : 295.1 MB, Average Speed: 45.96 Mbps
Download Progress of : Operations-Appliance-9.1.0.0.25346025.ova : 1198.4 MB, Average Speed: 39.34 Mbps
Download Progress of : VMware-VCSA-all-9.1.0.0.25370922.iso : 1080.2 MB, Average Speed: 35.16 Mbps
Download Progress of : nsx-unified-appliance-9.1.0.0.25318227.ova : 552.7 MB, Average Speed: 38.33 Mbps
Download Progress of : nsx-unified-appliance-9.1.0.0.25318227.ova : 1184.8 MB, Average Speed: 38.94 Mbps
Download Progress of : Operations-Appliance-9.1.0.0.25346025.ova : 2217.9 MB, Average Speed: 35.50 Mbps
Download Progress of : VMware-VCSA-all-9.1.0.0.25370922.iso : 2342.7 MB, Average Speed: 37.35 Mbps
Download Progress of : nsx-unified-appliance-9.1.0.0.25318227.ova : 2341.6 MB, Average Speed: 37.51 Mbps
Download Progress of : salt-raas-9.1.0.0.25346036.tgz : 13.6 MB, Average Speed: 30.40 Mbps
Download Progress of : salt-raas-9.1.0.0.25346036.tgz : 167.9 MB, Average Speed: 68.55 Mbps
Download Progress of : vidb-9.1.0.0.25368698.tgz : 21.9 MB, Average Speed: 48.29 Mbps
Download Progress of : vidb-9.1.0.0.25368698.tgz : 206.4 MB, Average Speed: 84.10 Mbps
Download Progress of : vidb-9.1.0.0.25368698.tgz : 612.7 MB, Average Speed: 94.93 Mbps
Download Progress of : VMware-VCSA-all-9.1.0.0.25370922.iso : 4554.9 MB, Average Speed: 37.12 Mbps
Download Progress of : vidb-9.1.0.0.25368698.tgz : 983.3 MB, Average Speed: 68.02 Mbps
Download Progress of : vcf-sddc-lcm-9.1.0.0.25371107.tgz : 23.4 MB, Average Speed: 51.07 Mbps
Download Progress of : vcf-sddc-lcm-9.1.0.0.25371107.tgz : 217.4 MB, Average Speed: 88.42 Mbps
Download Progress of : vcf-sddc-lcm-9.1.0.0.25371107.tgz : 564.7 MB, Average Speed: 87.42 Mbps
Download Progress of : nsx-unified-appliance-9.1.0.0.25318227.ova : 4469.1 MB, Average Speed: 36.50 Mbps
Download Progress of : vcf-sddc-lcm-9.1.0.0.25371107.tgz : 711.1 MB, Average Speed: 49.17 Mbps
Download Progress of : Operations-Cloud-Proxy-9.1.0.0.25346033.ova : 16.0 MB, Average Speed: 47.61 Mbps
Download Progress of : Operations-Cloud-Proxy-9.1.0.0.25346033.ova : 115.3 MB, Average Speed: 49.33 Mbps
Download Progress of : Operations-Cloud-Proxy-9.1.0.0.25346033.ova : 297.2 MB, Average Speed: 46.89 Mbps
Download Progress of : Operations-Cloud-Proxy-9.1.0.0.25346033.ova : 659.5 MB, Average Speed: 45.99 Mbps
Download Progress of : VMware-VCSA-all-9.1.0.0.25370922.iso : 6882.0 MB, Average Speed: 37.66 Mbps
Download Progress of : Operations-Cloud-Proxy-9.1.0.0.25346033.ova : 1225.3 MB, Average Speed: 40.38 Mbps
Download Progress of : nsx-unified-appliance-9.1.0.0.25318227.ova : 6674.1 MB, Average Speed: 36.59 Mbps
Download Progress of : Operations-Cloud-Proxy-9.1.0.0.25346033.ova : 2451.5 MB, Average Speed: 39.32 Mbps
Download Progress of : VCF-SDDC-Manager-Appliance-9.1.0.0.25371088.ova : 47.4 MB, Average Speed: 65.22 Mbps
Download Progress of : VCF-SDDC-Manager-Appliance-9.1.0.0.25371088.ova : 250.6 MB, Average Speed: 91.85 Mbps
Download Progress of : VMware-VCSA-all-9.1.0.0.25370922.iso : 9277.5 MB, Average Speed: 38.22 Mbps
Download Progress of : VCF-SDDC-Manager-Appliance-9.1.0.0.25371088.ova : 634.3 MB, Average Speed: 94.26 Mbps
Download Progress of : VCF-SDDC-Manager-Appliance-9.1.0.0.25371088.ova : 1075.1 MB, Average Speed: 72.99 Mbps
Download Progress of : VCF-SDDC-Manager-Appliance-9.1.0.0.25371088.ova : 2000.9 MB, Average Speed: 65.11 Mbps
Download Progress of : vcf-fleet-lcm-9.1.0.0.25371109.tgz : 18.3 MB, Average Speed: 43.47 Mbps
Download Progress of : vcf-fleet-lcm-9.1.0.0.25371109.tgz : 104.0 MB, Average Speed: 42.71 Mbps
Download Progress of : vcf-fleet-lcm-9.1.0.0.25371109.tgz : 216.7 MB, Average Speed: 33.58 Mbps
Download Progress of : vcf-fleet-lcm-9.1.0.0.25371109.tgz : 529.4 MB, Average Speed: 36.59 Mbps
Download Progress of : VMware-VCSA-all-9.1.0.0.25370922.iso : 11924.1 MB, Average Speed: 39.39 Mbps
Download Progress of : Vcf-License-Server-9.1.0.0.25346031.ova : 22.4 MB, Average Speed: 42.00 Mbps
Download Progress of : Vcf-License-Server-9.1.0.0.25346031.ova : 109.9 MB, Average Speed: 43.15 Mbps
Download Progress of : Vcf-License-Server-9.1.0.0.25346031.ova : 355.4 MB, Average Speed: 54.27 Mbps
Download Progress of bundle tar : vmsp-platform-9.1.0.0.25370367.tar : 39.4 MB, Average Speed: 80.82 Mbps, Total Size:  : 7020.7 MB
Download Progress of bundle tar : vmsp-platform-9.1.0.0.25370367.tar : 165.0 MB, Average Speed: 66.30 Mbps, Total Size:  : 7020.7 MB
Download Progress of bundle tar : vmsp-platform-9.1.0.0.25370367.tar : 405.5 MB, Average Speed: 62.48 Mbps, Total Size:  : 7020.7 MB
Download Progress of bundle tar : vmsp-platform-9.1.0.0.25370367.tar : 877.9 MB, Average Speed: 60.58 Mbps, Total Size:  : 7020.7 MB
Download Progress of bundle tar : vmsp-platform-9.1.0.0.25370367.tar : 1782.7 MB, Average Speed: 58.46 Mbps, Total Size:  : 7020.7 MB
Download Progress of bundle tar : vmsp-platform-9.1.0.0.25370367.tar : 3568.2 MB, Average Speed: 57.10 Mbps, Total Size:  : 7020.7 MB
Download Progress of : vcd-migrator-9.1.0.0.25370929.tgz : 0.8 MB, Average Speed: 3.44 Mbps
Download Progress of : vcd-migrator-9.1.0.0.25370929.tgz : 103.3 MB, Average Speed: 46.48 Mbps
Download Progress of : vcd-migrator-9.1.0.0.25370929.tgz : 345.4 MB, Average Speed: 55.49 Mbps
Download Progress of bundle tar : vcfa-bundle-9.1.0.0.25370929.tar : 30.3 MB, Average Speed: 59.73 Mbps, Total Size:  : 15295.0 MB
Download Progress of bundle tar : vcfa-bundle-9.1.0.0.25370929.tar : 153.1 MB, Average Speed: 61.03 Mbps, Total Size:  : 15295.0 MB
Download Progress of bundle tar : vcfa-bundle-9.1.0.0.25370929.tar : 401.4 MB, Average Speed: 61.67 Mbps, Total Size:  : 15295.0 MB
Download Progress of bundle tar : vcfa-bundle-9.1.0.0.25370929.tar : 834.8 MB, Average Speed: 57.53 Mbps, Total Size:  : 15295.0 MB
Download Progress of bundle tar : vmsp-platform-9.1.0.0.25370367.tar : 6791.9 MB, Average Speed: 55.45 Mbps, Total Size:  : 7020.7 MB
Download Progress of : vcf-services-platform-template-9.1.0.0.25370367.ova : 31.9 MB, Average Speed: 68.36 Mbps
Download Progress of : vcf-services-platform-template-9.1.0.0.25370367.ova : 227.3 MB, Average Speed: 92.12 Mbps
Download Progress of : vcf-services-platform-template-9.1.0.0.25370367.ova : 626.4 MB, Average Speed: 96.77 Mbps
Download Progress of bundle tar : vcfa-bundle-9.1.0.0.25370929.tar : 1495.8 MB, Average Speed: 49.02 Mbps, Total Size:  : 15295.0 MB
Download Progress of : vcf-services-platform-template-9.1.0.0.25370367.ova : 845.0 MB, Average Speed: 58.35 Mbps
Download Progress of : vcf-services-platform-template-9.1.0.0.25370367.ova : 1332.1 MB, Average Speed: 43.70 Mbps
Download Progress of bundle tar : vcfa-bundle-9.1.0.0.25370929.tar : 2559.7 MB, Average Speed: 40.94 Mbps, Total Size:  : 15295.0 MB
Download Progress of : vcf-services-platform-template-9.1.0.0.25370367.ova : 2776.4 MB, Average Speed: 44.43 Mbps
Download Progress of bundle tar : vcfa-bundle-9.1.0.0.25370929.tar : 4641.8 MB, Average Speed: 37.88 Mbps, Total Size:  : 15295.0 MB
Download Progress of : vcf-services-platform-template-9.1.0.0.25370367.ova : 4806.5 MB, Average Speed: 39.24 Mbps
Download Progress of bundle tar : vcfa-bundle-9.1.0.0.25370929.tar : 7038.2 MB, Average Speed: 38.56 Mbps, Total Size:  : 15295.0 MB
Download Progress of : vcf-services-platform-template-9.1.0.0.25370367.ova : 7191.7 MB, Average Speed: 39.41 Mbps
Download Progress of bundle tar : vcfa-bundle-9.1.0.0.25370929.tar : 9259.6 MB, Average Speed: 38.18 Mbps, Total Size:  : 15295.0 MB
Download Progress of : vcf-services-platform-template-9.1.0.0.25370367.ova : 9539.1 MB, Average Speed: 39.33 Mbps
Download Progress of : vmsp-cli-9.1.0.0.25370367.tar.gz : 33.5 MB, Average Speed: 72.89 Mbps
Download Progress of bundle tar : vcfa-bundle-9.1.0.0.25370929.tar : 11870.4 MB, Average Speed: 39.24 Mbps, Total Size:  : 15295.0 MB
Download Progress of : salt-9.1.0.0.25346036.tgz : 31.0 MB, Average Speed: 77.31 Mbps
Download Progress of : salt-9.1.0.0.25346036.tgz : 154.1 MB, Average Speed: 64.16 Mbps
Binary Download Summary:
------------------------------------------------------------------------------------------------------
Component                         | Component Full Name      | Version          | Image Type | Status
------------------------------------------------------------------------------------------------------
TELEMETRY_ACCEPTOR                | Telemetry                | 9.1.0.0.25181946 | INSTALL    | SUCCESS
DEPOT_SERVICE                     | Software depot           | 9.1.0.0.25371105 | INSTALL    | SUCCESS
VROPS                             | VCF Operations           | 9.1.0.0.25346025 | INSTALL    | SUCCESS
VCF_SALT_RAAS                     | Salt RaaS                | 9.1.0.0.25346036 | INSTALL    | SUCCESS
VIDB                              | Identity broker          | 9.1.0.0.25368698 | INSTALL    | SUCCESS
VCF_SDDC_LCM                      | SDDC lifecycle           | 9.1.0.0.25371107 | INSTALL    | SUCCESS
VCF_OPS_CLOUD_PROXY               | Cloud proxy              | 9.1.0.0.25346033 | INSTALL    | SUCCESS
SDDC_MANAGER_VCF                  | SDDC Manager             | 9.1.0.0.25371088 | INSTALL    | SUCCESS
VCF_FLEET_LCM                     | Fleet lifecycle          | 9.1.0.0.25371109 | INSTALL    | SUCCESS
VCF_LICENSE_SERVER                | License server           | 9.1.0.0.25346031 | INSTALL    | SUCCESS
NSX_T_MANAGER                     | VMware NSX               | 9.1.0.0.25318225 | INSTALL    | SUCCESS
VCF_SERVICE_VCD_MIGRATION_BACKEND | Migration service engine | 9.1.0.0.25370929 | INSTALL    | SUCCESS
VCENTER                           | VMware vCenter           | 9.1.0.0.25370922 | INSTALL    | SUCCESS
VCF_SALT                          | Salt master              | 9.1.0.0.25346036 | INSTALL    | SUCCESS
VRA                               | VCF Automation           | 9.1.0.0.25370929 | INSTALL    | SUCCESS
VSP                               | VCF services runtime     | 9.1.0.0.25370367 | INSTALL    | SUCCESS
------------------------------------------------------------------------------------------------------
0 CANCELLED | 16 SUCCESS | 0 FAILED | 0 ALREADY_DOWNLOADED
------------------------------------------------------------------------------------------------------
Successfully downloaded 16 binaries.

Code language: JavaScript (javascript)

Cloud Installer

Deploy the cloud installer OVA following regular procedures.

One of the issues i ran into is that i had to upload the appropriate depot CA certificates to the store:

First get the Cloud Build Certificate store password:
# KEY=$(cat /etc/vmware/vcf/commonsvcs/trusted_certificates.key)

Add the certificate to the keystore
#keytool -importcert -trustcacerts -alias depot-ca-cyberfront -file /tmp/depot-ca.crt -keystore /etc/vmware/vcf/commonsvcs/trusted_certificates.store -storepass $KEY -noprompt
Code language: PHP (php)

Had to increase timeout values as this is nested deployment as well force the cloud builder to ignore vSAN HCL incompatibility. Edit file /etc/vmware/vcf/domainmanager/application-prod.properties and add the following:

vsan.esa.sddc.managed.disk.claim=true
ovf.deployment.timeout.period.in.minutes=180
vcsa.deployment.timeout.minutes=180Code language: JavaScript (javascript)

My recommendation is reboot the cloud builder host, but you could also restart the services:

# /opt/vmware/vcf/operationsmanager/scripts/cli/sddcmanager_restart_services.shCode language: PHP (php)

Cloud “Bring Up”

Start the cloud builder deployment wizard, select High Availability and medium deployment type (lab):