A tier-0 gateway has downlink connections to tier-1 gateways and external connections to physical networks.

If you are adding a tier-0 gateway from Global Manager in NSX Federation, see Add a Tier-0 Gateway from Global Manager.

You can configure the HA (high availability) mode of a tier-0 gateway to be active-active or active-standby. The following services are only supported in active-standby mode:
  • NAT
  • Load balancing
  • Stateful firewall
  • VPN
Tier-0 and tier-1 gateways support the following addressing configurations for all interfaces (external interfaces, service interfaces and downlinks) in both single tier and multi-tiered topologies:
  • IPv4 only
  • IPv6 only
  • Dual Stack - both IPv4 and IPv6
To use IPv6 or dual stack addressing, enable IPv4 and IPv6 as the L3 Forwarding Mode in Networking > Networking Settings > Global Networking Config.

You can configure the tier-0 gateway to support EVPN (Ethernet VPN). For more information about configuring EVPN, see Ethernet VPN (EVPN).

If you configure route redistribution for the tier-0 gateway, you can select from two groups of sources: tier-0 subnets and advertised tier-1 subnets. The sources in the tier-0 subnets group are:
Source Type Description
Connected Interfaces and Segments These include external interface subnets, service interface subnets and segment subnets connected to the tier-0 gateway.
Static Routes Static routes that you have configured on the tier-0 gateway.
NAT IP NAT IP addresses owned by the tier-0 gateway and discovered from NAT rules that are configured on the tier-0 gateway.
IPSec Local IP Local IPSEC endpoint IP address for establishing VPN sessions.
DNS Forwarder IP Listener IP for DNS queries from clients and also used as source IP used to forward DNS queries to upstream DNS server.
EVPN TEP IP This is used to redistribute EVPN local endpoint subnets on the tier-0 gateway.
The sources in the advertised tier-1 subnets group are:
Source Type Description
Connected Interfaces and Segments These include segment subnets connected to the tier-1 gateway and service interface subnets configured on the tier-1 gateway.
Static Routes Static routes that you have configured on the tier-1 gateway.
NAT IP NAT IP addresses owned by the tier-1 gateway and discovered from NAT rules that are configured on the tier-1 gateway.
LB VIP IP address of the load balancing virtual server.
LB SNAT IP IP address or a range of IP addresses used for source NAT by the load balancer.
DNS Forwarder IP Listener IP for DNS queries from clients and also used as source IP used to forward DNS queries to upstream DNS server.
IPSec Local Endpoint IP address of the IPSec local endpoint.

Proxy ARP is automatically enabled on a tier-0 gateway when a NAT rule or a load balancer VIP uses an IP address from the subnet of the tier-0 gateway external interface. By enabling proxy-ARP, hosts on the overlay segments and hosts on a VLAN segment can exchange network traffic together without implementing any change in the physical networking fabric.

For a detailed example of a packet flow in a proxy ARP topology, see the NSX-T Reference Design Guide on the VMware Communities portal.

Before NSX-T Data Center 3.2, proxy ARP is supported on a tier-0 gateway in only an active-standby configuration, and it responds to ARP queries for the external and service interface IPs. Proxy ARP also responds to ARP queries for service IPs that are in an IP prefix list that is configured with the Permit action.

Starting in NSX-T Data Center 3.2, proxy ARP is also supported on a tier-0 gateway in an active-active configuration. However, all the Edge nodes in the active-active tier-0 configuration must have directly reachability to the network on which proxy ARP is required. In other words, you must configure the external interface and the service interface on all the Edge nodes that are participating in the tier-0 gateway for the proxy ARP to work.

Prerequisites

Procedure

  1. With admin privileges, log in to NSX Manager.
  2. Select Networking > Tier-0 Gateways.
  3. Click Add Tier-0 Gateway.
  4. Enter a name for the gateway.
  5. Select an HA (high availability) mode.
    The default mode is active-active. In the active-active mode, traffic is load balanced across all members. In active-standby mode, all traffic is processed by an elected active member. If the active member fails, a new member is elected to be active.
  6. If the HA mode is active-standby, select a failover mode.
    Option Description
    Preemptive If the preferred node fails and recovers, it will preempt its peer and become the active node. The peer will change its state to standby.
    Non-preemptive If the preferred node fails and recovers, it will check if its peer is the active node. If so, the preferred node will not preempt its peer and will be the standby node.
  7. (Optional) Select an NSX Edge cluster.
  8. (Optional) To add DHCP, click Set DHCP Configuration.
  9. (Optional) Click Additional Settings.
    1. In the Internal Transit Subnet field, enter a subnet.
      This is the subnet used for communication between components within this gateway. The default is 169.254.0.0/24.
    2. In the T0-T1 Transit Subnets field, enter one or more subnets.
      These subnets are used for communication between this gateway and all tier-1 gateways that are linked to it. After you create this gateway and link a tier-1 gateway to it, you will see the actual IP address assigned to the link on the tier-0 gateway side and on the tier-1 gateway side. The address is displayed in Additional Settings > Router Links on the tier-0 gateway page and the tier-1 gateway page. The default is 100.64.0.0/16.
    3. In the Forwarding Up Timer field, enter a time.
      Forwarding up timer defines the time in seconds that the router must wait before sending the up notification after the first BGP session is established. This timer (previously known as forwarding delay) minimizes downtime in case of fail-overs for active-active or active-standby configurations of logical routers on NSX Edge that use dynamic routing (BGP). It should be set to the number of seconds an external router (TOR) takes to advertise all the routes to this router after the first BGP/BFD session. The timer value should be directly proportional to the number of northbound dynamic routes that the router must learn. This timer should be set to 0 on single edge node setups.
  10. Click Route Distinguisher for VRF Gateways to configure a route distinguisher admin address.
    This is only needed for EVPN in Inline mode.
  11. (Optional) Add one or more tags.
  12. Click Save.
  13. For IPv6, under Additional Settings, you can select or create an ND Profile and a DAD Profile.
    These profiles are used to configure Stateless Address Autoconfiguration (SLAAC) and Duplicate Address Detection (DAD) for IPv6 addresses.
  14. (Optional) Click EVPN Settings to configure EVPN.
    1. Select an EVPN mode.
      The options are:
      • Inline - In this mode, EVPN handles both data plane and control plane traffic.
      • Route Server - Available only if this gateway's HA mode is active-active. In this mode, EVPN handles control plane traffic only.
      • No EVPN
    2. If EVPN mode is Inline, select an EVPN/VXLAN VNI pool or create a new pool by clicking the menu icon (3 dots).
    3. If EVPN mode is Route Server, select an EVPN Tenant or create a new EVPN tenant by clicking the menu icon (3 dots).
    4. In the EVPN Tunnel Endpoint field click Set to add EVPN local tunnel endpoints.
      For the tunnel endpoint, select an Edge node and specify an IP address.
      Optionally, you can specify the MTU.
      Note: Ensure that the external interface has been configured on the NSX Edge node that you select for the EVPN tunnel endpoint.
  15. To configure route redistribution, click Route Redistribution and Set.
    Select one or more of the sources:
    • Tier-0 subnets: Static Routes, NAT IP, IPSec Local IP, DNS Forwarder IP, EVPN TEP IP, Connected Interfaces & Segments.

      Under Connected Interfaces & Segments, you can select one or more of the following: Service Interface Subnet, External Interface Subnet, Loopback Interface Subnet, Connected Segment.

    • Advertised tier-1 subnets: DNS Forwarder IP, Static Routes, LB VIP, NAT IP, LB SNAT IP, IPSec Local Endpoint, Connected Interfaces & Segments.

      Under Connected Interfaces & Segments, you can select Service Interface Subnet and/or Connected Segment.

  16. To configure interfaces, click Interfaces and Set.
    1. Click Add Interface.
    2. Enter a name.
    3. Select a type.
      If the HA mode is active-standby, the choices are External, Service, and Loopback. If the HA mode is active-active, the choices are External and Loopback.
    4. Enter an IP address in CIDR format.
    5. Select a segment.
    6. If the interface type is not Service, select an NSX Edge node.
    7. (Optional) If the interface type is not Loopback, enter an MTU value.
    8. (Optional) If the interface type is External, you can enable multicast by setting PIM (Protocol Independent Multicast) to Enabled.
      You can also configure the following:
      • IGMP Join Local - Enter one or more IP addresses. IGMP join is a debugging tool used to generate (*,g) join to Rendezvous Point (RP) and get traffic forwarded to the node where the join is issued. For more information, see About IGMP Join.
      • Hello Interval (seconds) - Default is 30. The range is 1 - 180. This parameter specifies the time between Hello messages. After the Hello Interval is changed, it takes effect only after the currently scheduled PIM timer expires
      • Hold Time (seconds) - The range is 1 - 630. Must be greater than Hello Interval. The default is 3.5 times Hello Interval. If a neighbor does not receive a Hello message from this gateway during this time interval, the neighbor will consider this gateway unreachable.
    9. (Optional) Add tags and select an ND profile.
    10. (Optional) If the interface type is External, for URPF Mode, you can select Strict or None.
      URPF (Unicast Reverse Path Forwarding) is a security feature.
    11. (Optional) After you create an interface, you can download the aggregate of ARP proxies for the gateway by clicking the menu icon (three dots) for the interface and selecting Download ARP Proxies.

      You can also download the ARP proxy for a specific interface by expanding a gateway and then expanding Interfaces. Click an interface and click the menu icon (three dots) and select Download ARP Proxy.

      Note: You cannot download the ARP proxy for loopback interfaces.
  17. (Optional) If the HA mode is active-standby, click Set next to HA VIP Configuration to configure HA VIP.
    With HA VIP configured, the tier-0 gateway is operational even if one external interface is down. The physical router interacts with the HA VIP only. HA VIP is intended to work with static routing and not with BGP.
    1. Click Add HA VIP Configuration.
    2. Enter an IP address and subnet mask.
      The HA VIP subnet must be the same as the subnet of the interface that it is bound to.
    3. Select two interfaces from two different Edge nodes.
  18. Click Routing to add IP prefix lists, community lists, static routes, and route maps.
  19. Click Multicast to configure multicast routing.
  20. Click BGP to configure BGP.
  21. Click OSPF to configure OSPF.
    This feature is available starting with NSX-T Data Center 3.1.1.
  22. (Optional) To download the routing table or forwarding table, do the following:
    1. Click the menu icon (three dots) and select a download option.
    2. Enter values for Transport Node, Network, and Source as required.
    3. Click Download to save the .CSV file.
  23. (Optional) To download the ARP table from a linked tier-1 gateway, do the following:
    1. From the Linked Tier-1 Gateways column, click the number.
    2. Click the menu icon (3 dots) and select Download ARP Table.
    3. Select an edge node.
    4. Click Download to save the .CSV file.

Results

The new gateway is added to the list. For any gateway, you can modify its configurations by clicking the menu icon (3 dots) and select Edit. For the following configurations, you do not need to click Edit. You only need to click the expand icon (right arrow) for the gateway, find the entity and click the number next to it. Note that the number must be non-zero. If it is zero, you must edit the gateway.
  • In the Interfaces section: External and Service Interfaces.
  • In the Routing section: IP Prefix Lists, Static Routes, Static Route BFD Peer, Community Lists, Route Maps.
  • In the BGP section: BGP Neighbors.

If NSX Federation is configured, this feature of reconfiguring a gateway by clicking on an entity is applicable to gateways created by the Global Manager (GM) as well. Note that some entities in a GM-created gateway can be modified by the Local Manager, but others cannot. For example, IP Prefix Lists of a GM-created gateway cannot be modified by the Local Manager. Also, from the Local Manager, you can edit existing External and Service Interfaces of a GM-created gateway but you cannot add an interface.