Step 1

Step 1 — Network / DNS / NTP / AD Plan (one page)

Lock this before filling any other workbook page. If you only have time for one meeting with the network + AD/PKI teams, run it on this page. Everything in the workbook flows from these decisions.

Prefer a spreadsheet? Download the blank fillable planning templates (IP/DNS, VLAN/subnet, NTP/AD/CA, BGP) — capture the plan in CSV, then transfer to the workbook or Coscia’s planner. For the firewall flows these networks depend on, see Firewall & Ports.

Want a generated starting point? Coscia’s VCF 9.1 Network Planner produces a complete starter network design — VLAN plan, appliance IPs + FQDNs, VIPs, with validation and XLSX/JSON export — from a handful of inputs (scenario, host count, storage, NSX config, DNS prefix/suffix). Generate there, then walk it through this page: the sizing minimums, the VM-Management carve-out, and the hand-off order (network team owns the subnets, you assign from them) still need a human decision per row.

Convention used in the templates below: site code sfo, instance m01, rack r01. Replace consistently when copying for a real deployment. VLAN IDs and CIDRs are placeholders.


A. VLAN / Subnet plan

Fill one row per traffic type. The same table covers Mgmt Domain and the first WLD — duplicate it for additional WLDs / clusters.

#TrafficVLAN IDCIDR (IPv4)CIDR (IPv6, optional)MTUGatewayNotes
1ESX Management/241500ESXi host mgmt VMKs. The VCF Installer must be able to reach / route to this network to commission the hosts (it does not live here)
2VM Management/241500Largest subnet — appliances + two reserved blocks; see carve-out below. The VCF Installer deploys here using the SDDC Manager IP + FQDN — see note below
3VCF Management (optional)/241500Only if separating VCF services from VM-mgmt
4vMotion/249000Jumbo required
5vSAN/249000Jumbo required; skip if NFS/FC only
6ESX Host Overlay (TEP)/249000Jumbo; MTU inherited from the vDS; static TEP pool recommended (DHCP scope supported)
7NSX Edge Overlay (TEP)/249000Jumbo
8NSX Edge Uplink-01/29 or /309000Point-to-point to ToR-A; BGP peer
9NSX Edge Uplink-02/29 or /309000Point-to-point to ToR-B; BGP peer
10NFS (optional)/249000Only if principal storage = NFS
11Transit Gateway external (Distributed only)/249000External / north-south network for the Distributed Transit Gateway (DTGW): the VLAN + gateway CIDR every ESX host attaches to, replacing the Edge uplinks (rows 8–9). Only when connectivity = Distributed (intake A10 / H4). Also plan the routable external IP block (north-south NAT / VIPs) advertised upstream — see §B
12Public / upstream peering uplink (optional)/29 or /309000Point-to-point to a public / upstream / DMZ router, separate from the ToR fabric. Only if you run a distinct public peering (intake B22); BGP session details in §B. Most fleets don’t need this

Overlay MTU: host and edge TEP networks carry GENEVE and need MTU ≥ 1600; set 9000 on the distributed switch. The host-overlay VMK inherits its MTU from the vDS rather than a per-network field.

VCF Installer = SDDC Manager identity. When you deploy the VCF Installer on one of the management-domain ESX hosts (the usual greenfield case), you give it the IP and FQDN you plan for SDDC Manager — the appliance switches into SDDC Manager mode after bring-up, so there is no throwaway / temporary IP. Reserve that single IP + FQDN as SDDC Manager (intake E7); the Installer just needs routed reachability to the ESX Management network to commission the hosts. (Only an Installer deployed outside the management infrastructure uses a separate temporary address.) Per Broadcom TechDocs.

Port group VLAN gotcha: on the host you deploy it on, place the Installer on a port group carrying the VM Management VLAN. A fresh ESXi host’s default VM Network port group is untagged (VLAN 0), so if VM Management is a tagged VLAN, set the VLAN ID on it (or use a tagged port group) first — otherwise the appliance comes up with no management connectivity.

IP range carve-out (per subnet)

Inside each /24 reserve contiguous ranges so static pools / DHCP scopes don’t collide with appliance IPs.

Host-facing subnets — one IP per host VMK, sized here for up to 16 mgmt hosts:

SubnetReserved forRange example
ESX MgmtHost mgmt VMK.11–.30
vMotionHost vMotion VMK.101–.116
vSANHost vSAN VMK.101–.116
ESX OverlayHost TEPs (×2 per host)Static pool (recommended), e.g. .101–.132; DHCP scope supported
Edge OverlayEdge TEPs (×2 per edge node)IP Pool (start–end) or per-node static list — size 2 × edge nodes, e.g. .11–.14 for a 2-edge cluster (no DHCP option)

TEP addressing: prefer a static IP pool, entered in the VCF Installer — no external DHCP dependency, and no per-AZ scopes in stretched designs. Per Broadcom TechDocs either a static IP pool or a DHCP server on the Host Overlay VLAN satisfies the prerequisite; pools can also be created per cluster later (Create an IP Pool for Tunnel Endpoint IP Addresses).

VM Management subnet — the crowded one. A VCF 9.1 management domain packs a lot onto this network: ~32–50 IPs. Size it generously (a /24 is normal — do not try to squeeze it into a /27). On top of discrete appliance IPs it needs two dedicated contiguous blocks: a /29 for VCF Automation and a /28/27 for the VCF management-services runtime. Each additional VI Workload Domain also lands its vCenter (1) + NSX Manager cluster (4) on this subnet — +5 IPs per WLD — so leave headroom. The full per-component FQDN/IP list is on TechDocs: VCF Components FQDNs and IP addresses.

ComponentIPsBlockNotes
vCenter1Management domain vCenter
NSX Manager43 cluster nodes + 1 cluster VIP
SDDC Manager1
VCF Operations53 analytics nodes (primary / replica / data) + cloud proxy + license server
VCF Operations VIP1Optional: external load balancer for an HA deployment
NSX Edge nodes (if deployed)2Centralized connectivity only — mgmt-domain edge cluster; matches en01/en02 in the DNS table below
Virtual Network Appliances (VNA)2Distributed connectivity only (the alternative to the Edge nodes above — a domain has one or the other). 2 appliances minimum for HA, each with an FQDN + static IP; matches vna01/vna02 in the DNS table below. Intake H4 / A10
VCF Automation nodes5/29 (see note)3 node IPs + 2 buffer for automatic redeploy of failed nodes / rolling updates (TechDocs); allocate a contiguous /29 on 9.1.0.09.1.0.300 — from 9.1.0.400 TechDocs asks only for “5 unique IP addresses”, no contiguous block. This is the VCF services runtime nodes CIDR the Add VCF Automation wizard asks for. IP-only — no DNS records. Must not overlap the management-services runtime block below
VCF Automation FQDN1Discrete IP outside the /29 above — the wizard: “VCF Automation FQDN and VCF services runtime FQDN must resolve to IP addresses that fall outside of the provided CIDR”
VCF Automation services runtime1Automation’s own services runtime — a second FQDN, also on a discrete IP outside the /29. Not the same component as the fleet runtime below; TechDocs lists “VCF services runtime — 1 FQDN” under both. Intake E10
VCF management-services runtime12–30/28/27Dedicated contiguous block: /28 = 12 (minimum), /27 = 30 (recommended) — the headroom absorbs Day-N Log Management and real-time metrics worker nodes (rows below). Has its own FQDN (intake E14)
Avi Controller cluster (optional)4 per NSX instance3 controller nodes + cluster VIP — only if Avi is the chosen LB (e.g. Supervisor LB choice / optionally fronting VCF Automation / tenant LB). Controllers always run here in the management domain, even when they serve a workload domain, and a set is scoped to the NSX instance — WLDs sharing an NSX instance share one set; a WLD with its own NSX adds another +4. (Service Engines are separate: per cluster, in the WLD.) See prerequisites.md
License Hub (optional)~9Only if vDefend or Avi is in scope — the licensing appliance the SSP Installer deploys, and not the License Server two rows up (they coexist). One subnet, two IP pools: installer 1, controller + worker nodes 4, License Hub services 4. The node and service pools cannot be changed after deployment — size for scale-out now. See prerequisites.md
VCF Operations for Networks (optional)2 (+2 if Large)Platform node + collector node — lands here when the Day-2 placement is the Shared Management Network (a Large platform is a 3-node cluster: +2); see 05-day2-deployments.md
Log Management (optional)— (from runtime block)Day-N: 1 FQDN + 6 IPs, +2 per additional replica — allocated from the services-runtime block above, not extra subnet IPs (TechDocs FQDN/IP list); size the block /27 if Log Management is planned. See 05-day2-deployments.md
Real-time metrics (optional)— (from runtime block)Day-N: 6 IPs, also allocated from the services-runtime block (TechDocs FQDN/IP list)
Identity BrokerFQDN only — served from the services-runtime block above, no extra VM Mgmt IP
Approx. total~32–50A /24 VM Mgmt subnet leaves ample room (+4 per NSX instance if the Avi LB is in scope, +9 if the License Hub is too, +2–4 if Ops for Networks shares this subnet; Log Management / real-time metrics come out of the runtime block — size it /27)

Separate internal networks — keep off the VM Mgmt subnet. The VCF services runtime uses an internal container CIDR, 198.18.0.0/15 by default (change to 240.0.0.0/15 or 250.0.0.0/15 if it clashes) — and VCF Automation uses the same kind of internal cluster CIDR, with the same default and alternatives (the cluster CIDR captured in intake B21; see 05-day2-deployments.md section D). These are internal to the platform, not routed appliance IPs — just make sure the blocks do not overlap anything you actually route.


B. North-south connectivity plan

Pick one model per domain (intake A10 for the management domain, H4 per workload domain) and fill in only that model’s table:

  • Centralized — a Centralized Transit Gateway (CTGW): NSX Edge cluster + Tier-0, BGP-peered to the ToRs. Fill in B.1.
  • Distributed — a Distributed Transit Gateway (DTGW): the transit gateway maps onto a VLAN every ESX host attaches to, no Edge VMs. Fill in B.2.

“Distributed” is not the same thing as “VPC”. VPCs run on either transit-gateway type — the choice below is about how north-south traffic leaves the fabric (Edge VMs vs. straight off the hosts), not about whether you use VPCs. Likewise, a VNA cluster is not a small Edge cluster: it gives a DTGW stateful services (NAT/SNAT), and no Tier-0 or Tier-1 runs on it.

B.1 BGP plan (Centralized connectivity only)

ItemValueNotes
NSX Edge AS (your side)Private ASN, e.g. 65001
ToR-A ASPrivate ASN, e.g. 65010
ToR-B ASSame as ToR-A if iBGP within fabric, else distinct
ToR-A peer IP (Uplink-01)
ToR-B peer IP (Uplink-02)
BGP MD5 password (optional)Optional — only if you enable BGP MD5 authentication; per peer. Not required by NSX (neighbor IP + remote AS are the only required settings)
BFD enabledY/NRecommended on point-to-points
ECMPYesRequired on Edge↔ToR
Prefix-list / route-mapTBDOften advertise default in / Tier-0 subnets out
Public / upstream peering (optional)Separate BGP session for public / north-south routes (internet edge, DMZ, or upstream provider), distinct from the internal ToR fabric peering above. If used, capture its peer AS, peer IP, MD5, and advertised/received prefixes — plus a dedicated uplink subnet if it does not share the Edge uplinks. Most fleets don’t need this; the ToR uplinks already carry north-south.

Multi-AZ: whether the Edge uplinks and this peering are stretched across AZs or per-AZ depends on the NSX connectivity model — stretched under Centralized, per-AZ under Distributed (intake A10). See 03-multi-az-prep.md section D.

TechDocs: the Edge cluster / Tier-0 / BGP peering this plan feeds is set up per Set up Centralized Connectivity with Edge Clusters — neighbor IP + remote AS are the only required BGP settings (MD5 and BFD are optional).

B.2 Distributed Transit Gateway plan (Distributed connectivity only)

No BGP, no Edge uplinks: the DTGW attaches to one external VLAN that every ESX host in the domain can reach, and the physical gateway on that VLAN routes for it. Stateful services (NAT/SNAT) come from a VNA cluster.

ItemValueNotes
External VLAN IDThe DTGW’s external connection — VLAN 11 in the table above. Every ESX host in the domain must attach to it
External gateway CIDRThe subnet + gateway IP on that VLAN, routed by the physical fabric (the ToR SVI does the routing NSX would otherwise do on a Tier-0)
External IP blockRoutable block for north-south — NAT/SNAT addresses and load-balancer VIPs — advertised upstream by the fabric. Sized for your workloads, not for the appliances
Private transit-gateway blockPrivate IPs for the transit-gateway subnets, not advertised northbound. 9.1: must be a /16 (a /24 worked in 9.0 and never completes in 9.1) — see prerequisites.md → vSphere Supervisor
VNA appliance 1 — FQDN + IPESX Mgmt subnet; needed only for stateful services (NAT/SNAT) on the DTGW
VNA appliance 2 — FQDN + IP2 nodes minimum for HA
Default outbound NATY/NEnabled on the transit gateway against the VNA cluster + external IP block

Routing is the fabric’s job here. Because there is no Tier-0, the physical network must route the external VLAN and advertise the external IP block — confirm with the network team that this is in place before the domain is built, exactly as you would confirm BGP for the Centralized model.

TechDocs: Configure Distributed Network Connectivity and Transit Gateways (“You can also add NAT rules for a DTGW … by creating a virtual network appliance (VNA)”).


C. DNS

Two DNS servers (resolver IPs to put into appliances)

Two is not just the recommendation — the VCF Installer’s General Information screen accepts a maximum of 2 DNS servers at bring-up. If you run more, pick the two the VCF appliances will use.

#FQDN / hostnameIPv4
1
2

Required A + PTR records (Mgmt Domain — minimum)

Every FQDN below needs both an A and a PTR. Add WLD/cluster hosts in the same shape.

Lowercase only. The TechDocs FQDN/IP list marks the fleet-services family with “Do not use capital letters in the FQDN”: VCF Automation, VCF services runtime, fleet components, instance components, Identity Broker, Log Management, real-time metrics. DNS itself is case-insensitive but the appliances are not always — the practical rule: create every VCF FQDN lowercase.

Two “VCF services runtime” FQDNs — not one. The TechDocs FQDN/IP list carries the row “VCF services runtime — 1 FQDN” twice: once under VCF Automation and once under VCF Management Services. The workbook repeats the same field label the same way. They are separate components with separate FQDNs — the fleet one resolves into the management-services runtime block; the Automation one gets a discrete VM Mgmt IP. Plan and create both A + PTR records; see intake E10 (Automation) and E14 (fleet).

Both Automation FQDNs go outside the /29. The Add VCF Automation wizard takes the /29 as its VCF services runtime nodes CIDR and warns: “VCF Automation FQDN and VCF services runtime FQDN must resolve to IP addresses that fall outside of the provided CIDR.” So the /29 is for the nodes only (IP-only, no DNS records) and the two Automation FQDNs each need their own discrete VM Mgmt IP on top of it — budget /29 + 2.

Contiguity depends on your target version. TechDocs (Upgrade to VCF Automation): for 9.1.0.09.1.0.300, “verify that you have a dedicated CIDR … For example, a /29 subnet mask as VCF Automation requires 5 IP addresses”; for 9.1.0.400 and later, “verify that you have dedicated 5 unique IP addresses” — the contiguous-block requirement is gone. Planning a /29 is still the tidier choice and is valid on every version.

Never reuse the fleet runtime’s addressing. TechDocs: “The IP addresses and FQDN for the VCF services runtime instance for VCF Automation must be unique. You cannot reuse the CIDR block and FQDN from the VCF services runtime instance for VCF management services.” The two runtime ranges must not overlap.

RoleSample FQDNIP source
ESXi host 1..Nsfo01-m01-r01-esx0N.sfo.example.ioESX Mgmt subnet
vCentersfo-m01-vc01.sfo.example.ioVM Mgmt subnet
NSX Manager VIPsfo-m01-nsx01.sfo.example.ioVM Mgmt subnet
NSX Manager node 1sfo-m01-nsx01a.sfo.example.ioVM Mgmt subnet
NSX Manager node 2sfo-m01-nsx01b.sfo.example.ioVM Mgmt subnet
NSX Manager node 3sfo-m01-nsx01c.sfo.example.ioVM Mgmt subnet
SDDC Managersfo-vcf01.sfo.example.ioVM Mgmt subnet
VCF Operations LB VIP (optional — external LB only)sfo-vcfops01.sfo.example.ioVM Mgmt subnet — no built-in cluster/floating IP; without an LB use the node FQDNs
VCF Operations node 1–3sfo-vcfops01{a,b,c}.sfo.example.ioVM Mgmt subnet
Cloud Proxysfo-cp01.sfo.example.ioVM Mgmt subnet
License Serversfo-lic01.sfo.example.ioVM Mgmt subnet
Identity Brokersfo-idb01.sfo.example.ioservices-runtime block
Fleet componentssfo-fc01.sfo.example.ioVM Mgmt subnet
Instance componentssfo-ic01.sfo.example.ioVM Mgmt subnet
VCF services runtime (VCF Management Services)sfo-svcs01.sfo.example.ioservices-runtime block — the fleet runtime. Intake E14
VCF Automation VIPsfo-vcfauto01.sfo.example.ioVM Mgmt subnet — outside the Automation /29
VCF services runtime (VCF Automation)sfo-autosvcs01.sfo.example.ioVM Mgmt subnet — outside the Automation /29. Automation’s own runtime, a second, separate FQDN. Intake E10
NSX Edge 1 (Centralized only)sfo-m01-en01.sfo.example.ioVM Mgmt subnet
NSX Edge 2 (Centralized only)sfo-m01-en02.sfo.example.ioVM Mgmt subnet
Virtual Network Appliance 1 (Distributed only)sfo-m01-vna01.sfo.example.ioESX Mgmt subnet — the VNA cluster that gives a Distributed Transit Gateway its stateful services (NAT); not a replacement for an Edge cluster (no Tier-0/Tier-1 runs on it)
Virtual Network Appliance 2 (Distributed only)sfo-m01-vna02.sfo.example.ioESX Mgmt subnet — 2 nodes minimum for HA
Avi Controller cluster FQDN (optional)sfo-m01-avi01.sfo.example.ioVM Mgmt subnet — the 3 controller nodes are IP-only (no DNS records)
Supervisor API FQDN (optional — per Supervisor-enabled WLD)sfo-w01-super01.sfo.example.ioWLD mgmt network — points at the control plane’s floating IP (or the LB VIP); FQDN login is required, see prerequisites.md → vSphere Supervisor
Log Management VIP (optional)sfo-vcflogs01.sfo.example.ioservices-runtime block (integrated LB; the 6+ worker nodes need IPs, not FQDNs)

DNS settings checklist

  • Forward + reverse zones for the parent domain
  • Forward + reverse zones for any child / site domains (e.g. sfo.example.io)
  • Dynamic updates: Nonsecure and secure
  • Zone replication scope: All DNS servers in this forest
  • Every FQDN unique; every PTR present
  • No CNAME for any VCF appliance hostname (must be A)
  • All FQDNs lowercase (required for the fleet-services family; recommended everywhere)

D. NTP

#FQDNResolves toNotes
A-1ntpserver.sfo.example.ioA-record, source #1
A-2ntpserver.sfo.example.ioA-record, source #2 (same name, round-robin)
CN-1ntp.sfo.example.ioCNAME → aboveThis is what goes in every appliance
A-3ntp0.sfo.example.ioOptional, direct mgmt of source #1
A-4ntp1.sfo.example.ioOptional, direct mgmt of source #2
  • Sources must sync to different upstream NTP (avoid common-mode failure).
  • AD DCs configured to sync to the same external sources.
  • Two NTP entries on every appliance (use the CNAME and a backup A-record).
  • The VCF Installer accepts a maximum of 3 NTP servers at bring-up.

E. Active Directory

ItemValue
AD forest roote.g. example.io
Site/child domaine.g. sfo.example.io (or N/A)
DC FQDNs
LDAPS port reachableY/N
Service account for SSO bindDN + password owner
SDDC admin groupDN
SDDC operator groupDN
SDDC viewer groupDN
Users to pre-createper Active Directory Inputs sheet

TechDocs: AD is bound fleet-wide via the VCF Identity Broker — Configure an Identity Provider; prep details + gotchas in prerequisites.md.


F. Certificates

ItemValue
Internal CA typeMicrosoft CA or OpenSSL (fleet cert management). External CA is CSR-based only — VCF won’t import an externally-created cert+key
CA root + intermediate CRTPath / how delivered
CSR submission methodWeb Enrollment (basic auth) / DCE-RPC / Other
Template namee.g. VMware
Wildcard allowed?Y/N (workbook expects per-host SAN certs)

TechDocs: Configure a Certificate Authority for VMware Cloud Foundation — CA prerequisites (Microsoft CA Web Enrollment / OpenSSL) in prerequisites.md.


G. SMTP / SFTP / Proxy

ServiceFQDN / IPPortNotes
SMTP relay25Allowlist mgmt subnet
SFTP backup22Account + path for NSX / SDDC Mgr backups
Proxy (opt.)443Only if online depot needs proxy

Sign-off

Once A–G are filled and signed by the network/AD/PKI owners, move on to 02-intake.md to capture platform-side answers (hosts, sizing, passwords). The intake doc references this page rather than asking the same questions twice.