Internet-Draft EVPN Secure MAC December 2021
Thubert, et al. Expires 6 June 2022 [Page]
Workgroup:
BESS
Published:
Intended Status:
Standards Track
Expires:
Authors:
P. Thubert, Ed.
Cisco Systems
A. Przygienda
Juniper Networks, Inc
J. Tantsura
Microsoft

Secure EVPN MAC Signaling

Abstract

This specification adds attributes to EVPN to carry IPv6 address metadata learned from RFC 8505 and RFC 8928 so as to maintain a synchronized copy of the 6LoWPAN ND registrar at each EVPN router and perform locally a unicast IPv6 ND service for address lookup and duplicate address detection.

Status of This Memo

This Internet-Draft is submitted in full conformance with the provisions of BCP 78 and BCP 79.

Internet-Drafts are working documents of the Internet Engineering Task Force (IETF). Note that other groups may also distribute working documents as Internet-Drafts. The list of current Internet-Drafts is at https://datatracker.ietf.org/drafts/current/.

Internet-Drafts are draft documents valid for a maximum of six months and may be updated, replaced, or obsoleted by other documents at any time. It is inappropriate to use Internet-Drafts as reference material or to cite them other than as "work in progress."

This Internet-Draft will expire on 6 June 2022.

Table of Contents

1. Introduction

"Registration Extensions for IPv6 over 6LoWPAN Neighbor Discovery" [RFC8505] (ND) provides a zeroconf routing-agnostic Host-to-Router Link-Local interface for Stateful Address Autoconfiguration. "Address-Protected Neighbor Discovery for Low-Power and Lossy Networks" [RFC8928] (AP-ND) adds a zeroconf anti-theft protection that protects the ownership of the autoconfigured address with autoconfigured proof of ownership called a Registration Ownership Verifier (ROVR).

[RFC8505] enables the host to claim an IPv6 address and obtain reachability services for that address. It is already used to inject host routes in RPL [RFC9010] and RIFT "Routing in Fat Trees" [RIFT], and to maintain a proxy-ND state in a backbone router [RFC8929]; this specification extends its applicability to the case of Ethernet Virtual Private Network (eVPN).

[RFC8505] specifies a unicast address registration mechanism that enables the host called a 6LowPAN Node (6LN) to install a ND binding state in the 6LowPAN Router (6LR) that can serve as Neighbor Cache Entry (NCE), though it is not operated as a cache. The protocol provides the means to reject the registration in case of address duplication. It also enables to discriminate mobility from multihoming. [RFC8928] adds the capability to verify the ownership of the address and prevent an attacker from stealing and/or impersonating an address.

[RFC8505] defines the 6LoWPAN Border Router (6LBR) as an abstract address registrar that provides authoritative service for Address Registration and duplicate detection. The 6LBR stores address metadata that is obtained during the Address Registration, including an owner ID and a sequence counter. As part of the process of a new Address Registration, the 6LR queries the 6LBR for existing metadata related to the address being registered. This enables in particular to detect a duplication and reject the registration. This specification extends the 6LBR abstract data model to store the Link Layer Address (LLA) of the Registering Node. This enables the 6LBR to perform locally, and using unicast communication, the IPv6 ND services of address lookup and duplicate address detection.

The [RFC8505] address registrar can be centralized, but it can also be distributed and maintained synchronized using a routing protocol. This specification adds attributes to EVPN to carry the IPv6 address metadata learned from [RFC8505] so as to maintain a synchronized copy of the 6LBR abstract data at each EVPN router.

2. Terminology

2.1. Requirements Language

The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT", "SHOULD", "SHOULD NOT", "RECOMMENDED", "NOT RECOMMENDED", "MAY", and "OPTIONAL" in this document are to be interpreted as described in BCP 14 [RFC2119] [RFC8174] when, and only when, they appear in all capitals, as shown here.

2.2. Glossary

This document uses the following acronyms:

6CIO
Capability Indication Option [RFC7400]
6LN:
6LoWPAN Node (the Host) [RFC6775]
6LR:
6LoWPAN router (the router) [RFC6775]
6LBR:
6LoWPAN Border router [RFC6775]
AMC:
Address Mapping Confirmation [UNICAST-LOOKUP]
AMR:
Address Mapping Request [UNICAST-LOOKUP]
ARO
Address Registration Option [RFC6775]
CIPO:
Crypto-ID Parameters Option
DAD:
Duplicate Address Detection [RFC4862]
ICMPv6:
Internet Control Message Protocol for IPv6
DAC
Duplicate Address Confirmation [RFC6775]
DAR
Duplicate Address Request [RFC6775]
EDAC
Extended Duplicate Address Confirmation [RFC8505]
EDAR
Extended Duplicate Address Request [RFC8505]
EARO:
Extended Address Registration Option [RFC8505]
EVPN:
Ethernet VPN [RFC7432]
LLA:
Link-Layer Address (the MAC address on Ethernet)
LLN
Low-Power and Lossy Network [RFC6550]
NA:
Neighbor Advertisement [RFC4861]
NCE:
Neighbor Cache Entry [RFC4861]
ND:
Neighbor Discovery [RFC4861]
NDPSO:
Neighbor Discovery Protocol Signature Option
NS:
Neighbor Solicitation [RFC4861]
RA:
Router Advertisement [RFC4861]
ROVR:
Registration Ownership Verifier [RFC8505]
TID:
Transaction ID (a sequence counter in the EARO) [RFC8505]
SLAAC:
Stateless Address Autoconfiguration [RFC4862]
SLLAO:
Source Link-Layer Address Option [RFC4861]
TLLAO:
Target Link-Layer Address Option [RFC4861]
ROVR MAC:
MAC obtained from a host meeting requirements in Section 5
Validated ROVR MAC:
ROVR MAC validated by procedures specified in [RFC8928]
ROVR Node:
EVPN node capable of advertising ROVR MACs
non-ROVR Node:
EVPN node not supporting extensions defined in this document.
VPN:
Virtual Private Network

2.3. References

This document uses the terms Clos fabric and Fat Tree interchangeably, to refer to a folded spine-and-leaf topology as defined in the terminology section of "RIFT: Routing in Fat Trees" [RIFT].

The term "leaf" represents the access switch that connects the servers to the Fat Tree. The leaf is typically a Top-of-Rack (ToR) switch.

This specification uses the terms 6LN, 6LR and 6LBR to refer specifically to nodes that implement the said roles in [RFC8505] and does not expect other functionality such as 6LoWPAN Header Compression:

  • In the context of this document, the 6LN is a server that advertises an address mapping using [RFC8505], and optionally protects its ownership with [RFC8928].
  • The 6LR and 6LBR function are collapsed at the leaf and its state is synchronized with that of the EVPN functional support using an internal interface that is out of scope. That interface could be "pull" meaning that the 6LBR fetches the EVPN information when it needs it, or "push", meaning that any information that EVPN distributes is immediately fed in all the 6LBRs in all the leaves. Note that this is pure control plane and is not subject to abbreviating optimization as the FIB may be.

In this document, readers will encounter terms and concepts that are discussed in the following documents:

EVPN:
"BGP MPLS-Based Ethernet VPN" [RFC7432] and "Network Virtualization Overlay Solution" [RFC8365],
Classical IPv6 ND:
"Neighbor Discovery for IP version 6" [RFC4861] and "IPv6 Stateless Address Autoconfiguration" [RFC4862],
6LoWPAN ND:
Neighbor Discovery Optimization for Low-Power and Lossy Networks [RFC6775], "Registration Extensions for 6LoWPAN Neighbor Discovery" [RFC8505], "Address Protected Neighbor Discovery for Low-power and Lossy Networks" [RFC8928], and "IPv6 Backbone Router" [RFC8929].

3. 6LoWPAN Neighbor Discovery

6LoWPAN Neighbor Discovery defines a stateful address autoconfiguration mechanism for IPv6. 6LoWPAN ND enables to divorce the L3 abstractions for link and subnet from the characteristics of the L2 link and broadcast domain. It is applicable beyond its original field of IoT to any environment where the broadcast nature of the underlaying network should not be exploited, e.g., in the case of a wireless link where broadcast uses an excessive amount of spectrum, and a distributed cloud, where it may span too widely.

In contrast to Stateless Address Autoconfiguration (SLAAC) [RFC4862] which relies on broadcast for duplicate address detection (DAD) and address lookup, 6LoWPAN ND installs and maintains a state in the neighbors for the duration of their interaction. Though it is also called a Neighbor Cache Entry (BCE) in [RFC6775], and in contrast with the the BCE in SLAAC, that state is not a cache that can be casually flushed and rebuilt. It must be installed proactively and refreshed periodically to maintain the connectivity and enable unicast-only operations.

The typical abstraction for an IP Link with 6LoWPAN ND is point-to-point (P2P) between a node and a router. An IP interface bundles multiple links between this node and peers in the same subnet, aka point-to-multipoint (P2MP). The subnet is a not-on-link L3-connected collection of such nodes and links, which means that the any-to-any connectivity across the subnet is ensured through L3 routing as opposed to transitive (any-to-any) reachability from L2.

This section goes through the 6LoWPAN ND mechanisms that this specification leverages, as a non-normative reference to the reader. The relevant normative text is to be found in [RFC6775], [RFC8505], and [RFC8928].

3.1. RFC 6775 Address Registration

The classical "IPv6 Neighbor Discovery (IPv6 ND) Protocol" [RFC4861] [RFC4862] was defined for serial links and transit media such as Ethernet. It is a reactive protocol that relies heavily on multicast operations for Address Discovery (aka Lookup) and Duplicate Address Detection (DAD).

"Neighbor Discovery Optimizations for 6LoWPAN networks" [RFC6775] adapts IPv6 ND for operations over energy-constrained LLNs. The main functions of [RFC6775] are to proactively establish the Neighbor Cache Entry (NCE) in the 6LR and to prevent address duplication. To that effect, [RFC6775] introduces a new unicast Address Registration mechanism that contributes to reducing the use of multicast messages compared to the classical IPv6 ND protocol.

[RFC6775] defines a new Address Registration Option (ARO) that is carried in the unicast Neighbor Solicitation (NS) and Neighbor Advertisement (NA) messages between the 6LoWPAN Node (6LN) and the 6LoWPAN router (6LR). It also defines the Duplicate Address Request (DAR) and Duplicate Address Confirmation (DAC) messages between the 6LR and the 6LBR. In a Low-Power and Lossy Network (LLN), the 6LBR is the central repository of all the Registered Addresses in its domain and the authoritative source of truth for uniqueness and ownership.

3.2. RFC 8505 Extended Address Registration

"Registration Extensions for 6LoWPAN Neighbor Discovery" [RFC8505] updates RFC 6775 into a generic Address Registration mechanism that can be used to access services such as routing and ND proxy. To that effect, [RFC8505] defines the Extended Address Registration Option (EARO), shown in Figure 1:

   0                   1                   2                   3
   0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1
  +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
  |     Type      |     Length    |    Status     |    Opaque     |
  +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
  |  Rsvd | I |R|T|     TID       |     Registration Lifetime     |
  +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
  |                                                               |
 ...             Registration Ownership Verifier                 ...
  |                                                               |
  +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
Figure 1: EARO Option Format

3.2.1. R Flag

[RFC8505] introduces the R Flag in the EARO. The Registering Node sets the R Flag to indicate whether the 6LR should ensure reachability for the Registered Address. If the R Flag is set to 0, then the Registering Node handles the reachability of the Registered Address by other means. In an EVPN network, this means that either it is a RAN that injects the route by itself or that it uses another EVPN router for reachability services.

This document specifies how the R Flag is used in the context of EVPN. An EVPN Host that implements the 6LN functionality from [RFC8505] requires reachability services for an IPv6 address if and only if it sets the R Flag in the NS(EARO) used to register the address to a 6LR acting as an EVPN border router. Upon receiving the NS(EARO), the EVPN router generates a BGP advertisement for the Registered Address if and only if the R flag is set to 1.

[RFC9010] specifies that the 'R' flags is set in the responded NA messages if and only if the route was installed. This specification echoes that behavior.

3.2.2. TID, "I" Field and Opaque Fields

When the T Flag is set to 1, the EARO includes a sequence counter called Transaction ID (TID), that is needed to format the MAC Mobility Extended Community. This is the reason why the support of [RFC8505] by the Host, as opposed to only [RFC6775], is a prerequisite for this specification); this requirement is fully explained in Section 5.1. The EARO also transports an Opaque field and an associated "I" field that describes what the Opaque field transports and how to use it.

This document specifies the use of the "I" field and the Opaque field by a Host.

3.2.3. Status

The values of the EARO status are maintained by IANA in the Address Registration Option Status Values subregistry [IANA-EARO-STATUS] of the Internet Control Message Protocol version 6 (ICMPv6) Parameters registry.

[RFC6775] and [RFC8505] defined the original values whereas [RFC9010] reduced range to 64 values and reformatted the octet field to enable to transport an external error, e.g., coming form a routing protocol.

This specification uses the format expressed in [RFC9010]. The value of 0 denotes an unqualified success, 1 indicates an address duplication, 3 a TID value that is outdated, and 4 is used in an asynchronous NA to indicate that 6LN should remove that address and possibly form new ones.

3.2.4. Route Ownership Verifier

Section 5.3 of [RFC8505] introduces the Registration Ownership Verifier (ROVR) field of variable length from 64 to 256 bits. The ROVR is a replacement of the EUI-64 in the ARO [RFC6775] that was used to identify uniquely an Address Registration with the Link-Layer address of the owner but provided no protection against spoofing.

"Address Protected Neighbor Discovery for Low-power and Lossy Networks" [RFC8928] leverages the ROVR field as a cryptographic proof of ownership to prevent a rogue third party from registering an address that is already owned. The use of ROVR field enables the 6LR to block traffic that is not sourced at an owned address.

This specification does not address how the protection by [RFC8928] could be extended for use in EVPN. On the other hand, it adds the ROVR to the BGP advertisement to share the state with the other routers via the Reflector (see Section 6.2), which means that the routers that are aware of the Host route are also aware of the ROVR associated to the Target Address, whether it is cryptographic and should be verified.

3.2.5. Anycast and Multicast Addresses

"IPv6 Neighbor Discovery Multicast Address Registration" [I-D.thubert-6lo-multicast-registration] updates [RFC8505] to enable the address registration of IPv6 anycast and multicast addresses. From the host perspective, the registration is very similar to that of unicast addresses, but for a flag in the EARO that signals that the address is multicast or anycast.

This procedure can be used as a replacement to "Multicast Listener Discovery Version 2 (MLDv2) for IPv6" [RFC3810] for source-independant multicast operation. As for unicast, the method saves the need for the host to listen to pollings from the router, and allows the host to sleep for periods of time.

3.3. RFC 8505 Extended DAR/DAC

[RFC8505] updates the DAR/DAC messages to EDAR/EDAC messages to carry the ROVR field. The EDAR/EDAC exchange takes place between the 6LR to which the node registers an address, and the abstract 6LBR that stores the reference value for the ROVR and the TID associated to that address. It is triggered by an NS(EARO) message from a 6LN to the 6LR, to create, refresh, compare and delete the corresponding state in the 6LBR.

In the status returned with the EDAC message, the 6LBR indicates if the registration is accepted, should be challenged, or is duplicate. The status of 0 (success) indicates that the address is either new or that the current registration matches, and in particular that the ROVR at the 6LBR and the one in the EDAR message are identical.


   6LN               6LR                6LBR
    |                 |                   |
    |   IP Link       |    subnetwork     |
    |                 |                   |
    |  NS(EARO)       |                   |
    |---------------->|                   |
    |                 |                   |
    |                 |    EDAR           |
    |                 |------------------>|
    |                 |                   |
    |                 |      EDAC(status) |
    |                 |<------------------|
    |                 |                   |
    |       NA(EARO)  |                   |
    |<----------------|                   |
    |                 |                   |

Figure 2: EDAR/EDAC flow

The EDAR/EDAC exchange is protected by the retry mechanism specified in Section 8.2.6 of [RFC6775], though in a data center, a duration significantly shorter than the default value of the Retransmission Timer [RFC4861] of 1 second may be sufficient to cover the round-trip delay between the 6R and the 6LBR.

With this specification, the 6LBR is distributed across the leaves, and all the leaves where an address is currently registered maintain a full 6LBR state for the address, aka local state in the following text. The specification leverages the EDAR/EDAC exchange to ensure that a leaf (acting as a 6LR) that needs to create a 6LBR state for a new registration has the same value for the ROVR as any 6LBR already serving that address on another leaf. At the same time, the specification avoids placing full ROVR information in BGP so 1) it is not observable by a potential attacker and 2) the new attributes remain reasonably small.

3.4. RFC 7400 Capability Indication Option

"6LoWPAN-GHC: Generic Header Compression for IPv6 over Low-Power Wireless Personal Area Networks (6LoWPANs)" [RFC7400] defines the 6LoWPAN Capability Indication Option (6CIO) that enables a node to expose its capabilities in router Advertisement (RA) messages.

[RFC8505] defines a number of bits in the 6CIO, in particular:

L:
Node is a 6LR.
E:
Node is an IPv6 ND Registrar -- i.e., it supports registrations based on EARO.
P:
Node is a Routing Registrar, -- i.e., an IPv6 ND Registrar that also provides reachability services for the Registered Address.
    0                   1                   2                   3
    0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1
   +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
   |     Type      |   Length = 1  |     Reserved      |D|L|B|P|E|G|
   +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
   |                           Reserved                            |
   +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
Figure 3: 6CIO flags

A 6LR that provides reachability services for a Host in an EVPN network as specified in this document includes a 6CIO in its RA messages and set the L, P and E flags to 1 as prescribed by [RFC8505].

4. Extending 6LoWPAN ND

4.1. Use of the R flag in NA

This document extends [RFC8928] and [RFC8505] as follows

This document also updates the behavior of a 6LR acting as EVPN router and of a 6LN acting as Host in the 6LoWPAN ND Address Registration as follows:

  • The use of the R Flag is extended to the NA(EARO) to confirm whether the route was installed.

4.2. Distributing the 6LBR

This specification enables to distribute the 6LBR at the edge of the EVPN network and collapse the 6LBR function with that of the EVPN support. In that model, the EVPN to 6LBR interaction becomes an internal interface, where each side informs the other in case of new information concerning an IP to Link-Layer Address (LLA) mapping. Since this is an internal interface, this specification makes no assumption on whether the 6LBR stores its own representation of the full EVPN state, which means that the EVPN support informs the 6LBR in case of any change on the EVPN side (this is called the push model, see Figure 10), or if the 6LBR queries the EVPN support when it does not have a mapping to satisfy a request (pull model, see Figure 9).

This specification leverages [RFC8929] that augments the abstract data model of the 6LBR to store the LLA associated with the registered address. Based on that additional state, the 6LBR in a leaf can communicate the mapping to the collocated EVPN function and respond to unicast address mapping lookups from the server side.

In an environment where the server ranges from a classical host to a more complex platform that runs a collection of virtual hosts interconnected by a virtual switch, but where the host-to-leaf interface remains at layer 2, the 6LR and the 6LBR functions can be collapsed in the leaf. The 6LR to 6LBR interaction also becomes an internal interface, and there is no need for EDAR/EDAC messages.

In that case, the MAC address associated to the Registered Address is indicated in the Target Link-Layer Address Option (TLLAO) in the NS message used for the registration, as shown in Figure 4. In the case of a pull model, if the 6LBR does not have a local state for the mapping, it queries the EVPN support to obtain the EVPN state if any. If a mapping is known then the 6LR/6LBR evaluates the registration for address duplication and other possible issues per [RFC8505]. Else (this is for a new mapping), if the registration is accepted, then the 6LBR notifies the EVPN support to inject a route type 2 in the fabric.


        Server              Leaf
  +--------------+   +-------------------+
  |              |   |                   |
   6LN                6LR/6LBR       EVPN
    |                    |            |
    | <vSwitch> Ethernet | <call I/F> |
    |                    |            |
    |  NS(EARO)          |            |
    |------------------->|            |
    |                    |            | ^
    |                    |   query    | |
    |                    |----------->| | if pull
    |                    |  response  | | model
    |                    |<-----------| |
    |                                 | v
    |            Evaluation (DAD)     |
    |                                 |
    |                    |new mapping |
    |                    | indication |
    |                    |----------->|
    |                                 | Inject/maintain
    |         store a mapping state   | EVPN route type 2
    |                                 | ------------------>
    |       NA(EARO)     |            | [via BGP signaling]
    |<-------------------|            |
    |                    |            |

Figure 4: Direct Registration

In another type of deployment, the 6LR may be a virtual router in the server whereas the 6LBR runs in the leaf node. To address that case, the EDAR/EDAC may be used to communicate as shown in figure 5 of [RFC8505]. This draft leverages the capability to insert IPv6 ND options in the EDAR and EDAC messages introduced in [RFC8929] to place a TLLAO that carries the MAC address associated to the Registered address in the EDAR and EDAC messages as shown in Figure 5:


        Server                       Leaf
  +----------------+          +----------------+
  |                |          |                |
   6LN          6LR            6LBR        EVPN
    |            |              |            |
    | <vSwitch>  |  Ethernet    | <call I/F> |
    |            |              |            |
    |  NS(EARO)  |              |            |
    |----------->|              |            |
    |            |  EDAR(TLLAO) |            |
    |            |------------->|            |
    |            |              |            | ^
    |            |              |   query    | |
    |            |              |----------->| | if pull
    |            |              |  response  | | model
    |            |              |<-----------| |
    |            |                           | v
    |            |    Evaluation (DAD)       |
    |            |                           |
    |            |              |new mapping |
    |            |              | indication |
    |            |              |----------->|
    |            |                           | Inject/maintain
    |            |   store a mapping state   | EVPN route type 2
    |            |                           | ------------------>
    |            |  EDAC(TLLAO) |            | [via BGP signaling]
    |            |<-------------|            |
    |  NA(EARO)  |              |            |
    |<-----------|              |            |
    |            |              |            |

Figure 5: leveraging EDAR

[RFC8505] updates the DAR/DAC messages into the Extended DAR/DAC to carry the ROVR field. With this specification, the abstract 6LBR is distributed in all the Leaf nodes and synchronized with EVPN. When a server successfully registers an address to a leaf, the 6LR on that leaf becomes 6LBR for that address. It stores the full state for that address including the ROVR and the TID. When the address registration moves to another leaf, an EDAR/EDAC flow between the 6LR in the new leaf and the 6LBR in the old leaf confirms that the ROVR in the NS(EARO) received at the new leaf is correct, in which case the 6LR in the new leaf becomes 6LBR.

When the address is already registered to the local leaf, the EDAR/EDAC exchange is either local between a virtual router in the server and the leaf, or internal to the leaf between a collapsed 6LR and 6LBR. Based on its local state, the 6LBR in the leaf checks whether the proposed address/route is new and legit, and can reject it otherwise.

It results that duplicate addresses and address impersonation attacks can be filtered at the level of IPv6 ND by the 6LBR before the information reaches EVPN.

4.3. Unicast Address Lookup with the 6LBR

A classical IPv6 ND stack in the server that treats the subnet prefix as on-link (more in section 4.6.2. of [RFC4861]), will resolve an unknown LLA mapping with a multicast NS(lookup) message addressed to the solicited node multicast address (SNMA) associated with the destination address being resolved. The RECOMMENDED operation in that case is for the 6LBR that has a mapping state to forward the packet as a unicast MAC to the LLA that is stored for the IPv6 address as expected by [RFC6085]. The actual owner of the address can then answer unicast with a NA message, setting the override (O) bit to 1, as shown in Figure 6.


  Local             Local                   Remote
  Server            Leaf                    Server
  +----+          +--------+                +----+
  |    |          |        |                |    |
   6LN             6LR/6LBR                  6LN
    |                 |                       |
    |    Ethernet     |                       |
    |                 |     [via EVPN    ]    |
    |    multicast    |     [Data Tunnels]    |
    |    NS(lookup)   |                       |
    |---------------->|                       |
    |                 |    forward unicast    |
    |                 |     NS(lookup)        |
    |                 |---------------------->|
    |                 |                       |
    |                 |         NA(O)         |
    |                 |<----------------------|
    |      NA(O)      |                       |
    |<----------------|                       |
    |                 |                       |

Figure 6: Forwarding legacy NS (Lookup)

Section 3.1. of [RFC8929] adds the capability to insert IPv6 ND options in the EDAR and EDAC messages. This enables the 6LBR to store the link-layer address associated with the Registered Address and to serve as a mapping server. [UNICAST-LOOKUP] leverages that state to define a new unicast address lookup operation, extending the EDAR and EDAC messages as the Address Mapping Request (AMR) and Confirmation (AMC) with a different Code Prefix [RFC8505].

In that model, the router advertises the subnet prefix as not on-link by setting the L flag to 0 in the Prefix Information Option (PIO), more in section 4.6.2. of [RFC4861]. The expected behavior is that the host that communicates with a peer in the same subnet refrains from resolving the address mapping and passes the packets directly to the router.

In the case where the router is a virtual 6LR running in the server, and the source and destination are in the same subnet served by EVPN, the router then resolves the address mapping on behalf of the host. To that effect, the router sends a unicast AMR message to the 6LBR. The message contains the SLLAO of the router to which the 6LBR will reply. If the binding is found, the 6LBR replies with an AMC message that contains the TLLOA with the requested MAC address, as shown in Figure 7.


        Local                 Local             Remote
        Server                 Leaf             Server
  +----------------+       +---------+          +----+
  |                |       |         |          |    |
   6LN          6LR         6LBR/EVPN            6LN
    |            |              |                 |
    |            |              |  [via EVPN    ] |
    | <vSwitch>  |  Ethernet    |  [Data Tunnels] |
    |            |              |                 |
    |            |              |                 |
    |  RA(PIO)   |              |                 |
    | not onlink |              |                 |
    |<-----------|              |                 |
    |            |              |                 |
    |  Packet    |              |                 |
    |----------->|              |                 |
    |            |              |                 |
    |            | AMR (SLLAO)  |                 |
    |            |------------->|                 |
    |            |              |                 |
    |            | AMC (TLLAO)  |                 |
    |            |<-------------|                 |
    |            |              |                 |
    |    NCE in STALE state     |                 |
    |            |                                |
    |            |            Packet              |
    |            |------------------------------->|
    |            |                                |
    |    NCE in DELAY state     |                 |
    |            |              |                 |

Figure 7: Unicast Lookup from the virtual Host

If it is not found, [UNICAST-LOOKUP] provides the capability to indicate immediately that the mapping is not known with a "not found" status in the AMC, as opposed to waiting for an NS(lookup) and retries to time out per [RFC4861].

In a fully stateful subnet where all nodes register all their addresses with [RFC8505], this means that the looked up address is not present in the network; in that case the packet is dropped and an ICMP error type 1 "Destination Unreachable" code 3 "Address unreachable" [RFC4443] is returned as shown in Figure 8.



           Local                 Local
           Server                 Leaf
     +----------------+       +---------+
     |                |       |         |
      6LN          6LR         6LBR/EVPN
       |            |              |
       |            |              |
       | <vSwitch>  |  Ethernet    |
       |            |              |
       |            |              |
       |   RA(PIO   |              |
       |not on-link)|              |
       |<-----------|              |
       |            |              |
       |  Packet    |              |
       |----------->|              |
       |            |              |
       |            | AMR (SLLAO)  |
       |            |------------->|
       |            |              |
       |            | AMC(status=  |
       |            | "Not Found") |
       |            |<-------------|
       |ICMPv6 Error|              |
       | "Address   |              |
       |Unreachable"|              |
       |<-----------|              |
       |         Drop Packet       |
       |            |              |

Figure 8: Unicast Lookup failure

Note that the figures above make no assumption on the pull vs. push model. In the case of pull model, the 6LBR queries the EVPN support when it does not have the mapping information to satisfy a request. Figure 9 illustrates a successful pull model lookup flow, when the route type 2 for the mapping is already known on the EVPN side.


        Server                       Leaf
  +----------------+          +----------------+
  |                |          |                |
   6LN          6LR            6LBR        EVPN
    |            |              |            |
    | <vSwitch>  |  Ethernet    | <call I/F> |
    |            |              |            |
    |            |              |            |
    |            |              |            | Receive EVPN
    |            |              |            | route type 2 for
    |            |              |            | remote address A'
    |            |              |            | [via BGP signaling]
    |            |              |            |<-----------------
    |            |              |     store a mapping state
    |            |              |            |
    |Packet for A'              |            |
    |----------->|              |            |
    |            |AMR(lookup A')|            |
    |            |------------->|            |
    |            |              |Query addr A'
    |            |              |----------->|
    |            |              |            |
    |            |              | return LLA |
    |            |              |<-----------|
    |            |              |            |
    |            |AMC(A''s TLLA)|            |
    |            |<-------------|            |
    |            |              |            |
    |            |            Packet for A'  |
    |            |            [via EVPN    ] |
    |            |            [Data Tunnels] |
    |            |----------------------------------->
    |            |              |            |

Figure 9: Pull model

In the case of push model, the EVPN support synchronizes its state upon a route type 2 with the 6LBR, and the 6LBR maintains an abstract data structure for all information known to EVPN. This way, the 6LBR already has the mapping information to satisfy any request for an existing mapping and it can answer right away. Figure 10 illustrates a successful push model lookup flow, when the 6LBR is already in possession of the mapping.


        Server                       Leaf
  +----------------+          +----------------+
  |                |          |                |
   6LN          6LR            6LBR        EVPN
    |            |              |            |
    | <vSwitch>  |  Ethernet    | <call I/F> |
    |            |              |            |
    |            |              |            |
    |            |              |            |
    |            |              |            | Receive EVPN
    |            |              |            | route type 2 for
    |            |              |            | remote address A'
    |            |              |            | [via BGP signaling]
    |            |              |            |<-----------------
    |            |              |     store a mapping state
    |            |              |            |
    |            |              |indicate LLA|
    |            |              |<-----------|
    |            |    store a mapping state  |
    |            |              |            |
    |Packet to A'|              |            |
    |----------->|              |            |
    |            |AMR(lookup A')|            |
    |            |------------->|            |
    |            |              |            |
    |            |AMC(A's TLLA) |            |
    |            |<-------------|            |
    |            |              |            |
    |            |            Packet to A'   |
    |            |            [via EVPN    ] |
    |            |            [Data Tunnels] |
    |            |----------------------------------->
    |            |              |            |

Figure 10: Push model

In a mixed environment, a lookup failure (the mapping is not found though the address is present in the network) may be caused by a legacy node that was node discovered (aka a silent node). In that case, it is an administrative decision for the 6LR to broadcast an NS(lookup) or to return an error as shown in Figure 8.

5. Requirements on the EVPN-Unaware Host

This document describes how EVPN routing can be extended to reach a Host. This section specifies the minimal EVPN-independent functionality that the Host needs to implement to obtain routing services for its addresses.

5.1. Support of 6LoWPAN ND

A host sees a prefix as not on-link (e.g., it learned that prefix in a PIO in a RA with the L flag not set) should not attempt to resolve an address within that prefix using a multicast NS(lookup). Instead, it must pass its packets to a router, preferably one that advertises that prefix in a PIO; it must register the address that it uses as source to that router to enable source address validation using [RFC8505]. It is recommended that the Host also implements [RFC8928] to prove its ownership of its addresses.

The Host is expected to request routing services from a router only if that router originates RA messages with a 6CIO that has the L, P, and E flags all set to 1 as discussed in Section 3.4, unless configured to do so. To obtain routing services for one of its addresses, the host must register the address to a router that advertises the prefix, setting the "R" and "T" flags in the EARO to 1 as discussed in Section 3.2.1 and Section 3.2.2, respectively.

This document echoes the behavior specified in [RFC9010] whereby, when the R Flag set to 1 in a NS(EARO) is not echoed in the NA(EARO), the host must understand that the route injection failed, and if the R flag is reset later in an asynchronous NA(EARO), the host must understand that routing service has failed.

The host may attach to multiple 6LRs and is expected to prefer those that provide routing services. The abstract model for this is a P2MP interface that wraps together as many P2P IP Links the host has adjacencies to 6LRs over that interface. The IPv6 address and the subnet are associated to that interface. The interface may be virtual and it may bundle multiple physical Ethernet interfaces that connect to the individual 6LRs over point to point wires, possibly via a software switch. It can also be associated to one physical interface to an external switch, either way the PI Links can be associated to sub-interface of the interface.

The Host needs to register to all the 6LRs from which it desires routing services. The multiple Address Registrations to several 6LRs should be performed in a rapid sequence, using the same EARO for the same Address. Gaps between the Address Registrations will invalidate some of the routes till the Address Registration finally shows on those routes. The routers recognize the same (ROVR, TID) as the signal of a multihomed address and maintain all the routes. In the case of EVPN, the Ethernet Segment must also be the same. The flow for a successful multihomed registration is illustrated in Figure 14.

[RFC8505] introduces error Status values in the NA(EARO) which can be received synchronously upon an NS(EARO) or asynchronously. The Host needs to support both cases and refrain from using the address when the Status value indicates a rejection.

This specification can be used to register Anycast and Multicast IPv6 addresses as discussed in Section 3.2.5 and replace MLDv2. To benefit from that capability, both the host and the 6LR MUST support the "A" and "M" flags that indicate Anycast and Multicast Addresses respectively. Those flags are defined in [I-D.thubert-6lo-multicast-registration] for use in the EARO and in the EDAR and EDAC messages.

6. Enhancements to EVPN

This section addresses the necessary changes to EVPN formats and behavior to support address registration security per [RFC8928] and mobility per [RFC8505] while retaining interoperability with traditional nodes. Basically the MAC Mobility Extended Community [RFC7432] and the ARP/ND Extended Community [RFC9047] are extended to advertise the sequencing and ownership validation information received in the EARO. With 6LR injecting not only MACs via packet sources and TLLAO options but also ROVR into MAC Mobility and ARP/ND Extended Community, their semantics will be somewhat extended. Specifically following issues have to be addressed:

EVPN signaling is not used to carry ROVR since without challenge per [RFC8928] they do not represent any difference over using the IP/MAC combination. Instead, the full ROVR is verified upon a movement or a multi-homed advertisement using an EDAR/EDAC exchange. Additionally, backwards compatibility could not be preserved given comparing routes based on ROVR would present a change in primary key of NLRIs which non-ROVR routers do not implement. An indication from a ROVR node that a MAC has been validated by proof of ownership is enough to convey the necessary information. Only a small hash of the ROVR is carried to speed up the identification of an address duplication.

6.1. ARP/ND Extended Community

The ARP/ND Extended Community defined in [RFC9047] is a transitive EVPN Extended Community (Type field value of 0x06) with a Sub-Type of 0x08. It is advertised along with EVPN MAC/IP Advertisement routes that carry an IPv4 or IPv6 address. Extending the ARP/ND Extended Community to transport fields from the EARO is natural since the EARO is an extension to IPv6 ND.

ROVR nodes MUST set the "H" flag in Mobility Extended Community to indicate that the advertisement is a ROVR MAC in case the host followed the according procedures. ROVR MACs use (instead of increasing the normal sequence number) the TID in the high bits of the sequence number field to "override" any normal MAC advertisement (further considerations will be provided in Section 6.3).

ROVR nodes MUST set the "V" flag if the address assignment passed proof of ownership per [RFC8928]. Such "validated" ROVR MAC addresses will be preferred by ROVR nodes over non validated ROVR MACs.

In case a ROVR node configures the address as "sticky" (since the sticky bit semantics have been changed to the point a ROVR cannot tell whether address is really sticky unless advertised as such by non-ROVR node) a new "X" flag called "super sticky" is introduced.


  0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1
 +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
 | Type=0x06     | Sub-Type=0x08 |    Flags (2 octet)            |
 +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
 | Reserved = 0  |                 ROVR Hash                     |
 +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+

    Flags field:
  0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5
 +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
 |       |I| |O|R|   |M|U|M|X|V|H|
 +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
Figure 11: Updated ARP/ND Extended Community

Flags:

U:
Unreachable, indicating that the IP address is not reachable via that EVPN next hop, but is advertised for the purpose of protecting the value of the ROVR until a first 6LBR that can reach the address becomes available.
M:
Multicast, indicating that the IP address duplication should be ignored. When this bit is set, TID should be ignored in comparison of EVPN advertisements, i.e. all ROVR MACs at same level of validation MUST be considered having same TID.
V:
ROVR Validated indicates that the MAC passed proof of ownership per [RFC8928]. Presence of this bit implies the "R" bit being set irregardless of its value.
X:
Super Sticky indicates that the ROVR MAC is sticky and should follow procedures of sticky per [RFC7432].
H:
ROVR Capable indicates that the advertisement is originated after processing signaling from host meeting the requirements in Section 5. This indicates a ROVR MAC.
ROVR Hash:
Hash of ROVR used to generate the according ROVR MAC. Hash is built by XOR'ing ROVR bytes in network order into the least significant byte and rotating the two bytes result after every byte by one bit to the left.

6.2. ROVR MAC Mobility Extended Community

Extending MAC Mobility Extended Community to transport the TID allows to design a solution that, while backwards compatible, allows to introduce ROVR MAC as "more trusted" entities. Figure 12 presents the according extensions that will however necessitate some further explanation.

To introduce a "precedence" of ROVR MACs over normal EVPN MACs ROVR MACs are advertised to look like "sticky" MACs for non-ROVR nodes. As defined in the glossary, for simplicity reasons such nodes will be called non-ROVR nodes vs. ROVR nodes. The "sticky" bit will force non-ROVR nodes to disregard the sequence number and accept any IP/MAC route provided.

  0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1
 +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
 | Type=0x06     | Sub-Type=0x00 |  Flags = 0  |S|  Reserved = 0 |
 +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
 |T| Flags = 0   |       TID     |     Reserved = 0              |
 +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
Figure 12: Modified MAC Mobility Extended Community

This specification updates the Sequence Number field defined in [RFC7432]. The field is split in 3 parts, one 8-bit flags field, the TID, and a reserver 2-byte field. The unspecified flags and the reserved fields MUST be set to 0 by the sender and ignored by the receiver.

The "S" flag is defined in [RFC7432]. The following new fields are defined:

T:
1-bit flag. MUST be set to 1 when this specification is used. This ensures that the TID always wins vs. the sequence counter defined in [RFC7432]
TID:
contains the ROVR MAC TID per [RFC8505]. This MUST NOT be zero, i.e. a ROVR

6.3. Extended ROVR MAC Procedures

In case a non-ROVR node advertises a sticky MAC by setting the "S" bit and a ROVR node sees an ROVR address registration for the same MAC it MUST follow procedures per [RFC7432].

In case a non-ROVR node advertises a sequence number larger than the one generated by TID on a ROVR node, the ROVR node SHOULD advertise a Sequence Number consisting of all bits being set to force a "roll-over" on all nodes and then fall back to advertising the TID generated sequence number again. In case a non-ROVR node persists in increasing the sequence number after that it is indication of violation of [RFC7432] on its part.

A ROVR node advertising a ROVR MAC that has not been validated and receiving same type-2 route that has been validated MUST immediately withdraw its advertisement.

A ROVR node advertising a ROVR MAC and receiving an equivalent ROVR MAC from other node with a higher TID MUST immediately withdraw its advertisement. This will allow the non-ROVR nodes to correctly interpret the sequence as MAC move despite ignoring the sequence number due to presence of "S" bit.

A ROVR node that receives a ROVR MAC with "super sticky" indication and seeing the MAC locally MUST follow analogous procedures to [RFC7432].

Multi-homing a MAC on mix of ROVR and non-ROVR nodes will lead to operational notifications since per [RFC7432] the non-ROVR node will interpret the situation as a sticky MAC that has shown up on its local interface unless an implementation is somewhat clever and understands that the presence of the same ESI on all the routes indicates that this situation does not represent a sticky MAC being moved.

7. Protocol Operations

Following section illustrates several situations and resulting signaling in EVPN from the point of view of a ROVR node.

Figure 13 illustrates the registration flow of a new address protected by [RFC8928]. The ROVR in the EARO is a Crypto-ID that derives from a public address through hashing with some other terms. The router challenges the host with a status of 5 (validation requested).

The host performs the NS again, passing the parameters that enable to build the Crypto-ID in a Crypto-ID Parameters Option (CIPO), and signing that set of parameters together with a pair of Nonce values, one from each side, in a resulting Neighbor Discovery Protocol Signature Option (NDPDO). The 6LR first verifies that the Crypto-ID can be rebuilt based on the public key, then verifies that the signature in the NDPSO was effectively performed with the associated public key. When that is the case, the registration flow can continue, else the registration is rejected with a status of 10 (Validation Failed) in the NA(EARO).

With this specification, the 6LBR communicates internally with the collocated eVPN router to inject the route in eVPN. Since the [RFC8928] validation was performed, the V flag is set. Once this is done, the local 6LBR installs a local state associated to the NCE and becomes owner of the registration, whereas the remote leaves optionally install a remote state for the address with the indication of the 6LBR that owns the registration. The local 6LBR MUST be signalled as EVPN Next Hop for the route.

   Local            Local              Route           Remote
   Server           Leaf             Reflector         Leaf
  +-------+       +---------+        +-------+        +---------+
  |       |       |         |        |       |        |         |
     6LN           6LBR/EVPN            BGP            EVPN/6LBR
      |                |                 |                |
      |    Ethernet    |      [via BGP signaling]         |
      |                |                 |                |
      |                |                 |                |
      |  NS(EARO(      |                 |                |
      |       R set))  |                 |                |
      |--------------->|                 |                |
      |   ROVR in EARO is cryptographic  |                |
      |                |                 |                |
      |     NA(EARO(   |                 |                |
      |   R not set,   |                 |                |
      |   status = 5), |                 |                |
      |        Nonce1) |                 |                |
      |<---------------|                 |                |
      |                |                 |                |
      |   NS(EARO(     |                 |                |
      |        R set), |                 |                |
      |      CIPO,     |                 |                |
      |      Nonce2,   |                 |                |
      |      NDPSO)    |                 |                |
      |--------------->|                 |                |
      |        Proof verified            |                |
      |     no state for that address    |                |
      |      install local state         |                |
      |                |                 |                |
      |                |  ROVR MAC Route A'               |
      |                |---------------->|                |
      |        route injected            |                |
      |                |                 |                |
      |     NA(EARO(   |                 |                |
      |   R set,       |                 |                |
      |   status = 0)) |                 |                |
      |<---------------|                 |                |
      |                |                 | ROVR MAC Route A'
      |                |                 |--------------->|
      |                |                 |    install remote state
      |                |                 |                |

Figure 13: Host Registration

Figure 14 presents the same flow but for a multihomed address; here and in the following flows, the proof of ownership section is not shown, but its use is RECOMMENDED. The interesting piece is that when the node registers to the second 6LBR, that second 6LBR find that there is a first 6LBR that already own the registration. Using and EDAR / EDAC flow, the second 6LBR validates that the ROVR and TID are identical, in which case it accepts the registration and becomes another 6LBR owner of the registration. The result is that the 2 6LBRs are synchronized and any of the 2 can now be used, e.g., if the address is registered a third time.

    Local            Local          Local
    Server           Leaf 1         Leaf 2           Reflector
  +-------+       +---------+    +---------+       +---------+
  |       |       |         |    |         |       |         |
     6LN           6LBR/EVPN      6LBR/EVPN             |
      |                |              |                 |
      |    Ethernet    |              |                 |
      |                |              |       [via BGP signaling]
      |                |              |                 |
      |   NS(EARO)     |              |                 |
      |--------------->|              |                 |
      |      install local state      |                 |
      |                |                                |
      |                |------ROVR MAC Route A'   ----->|
      |   NA(EARO)     |              |                 |
      |<---------------|              |                 |
      |                |              |<----------------|
      |                |    install remote state        |
      |                |              |                 |
      | NS(same address, ES and EARO) |                 |
      |------------------------------>|                 |
      |                |              |                 |
      |                |        Same ES and ROVR Hash   |
      |                |   EDAR       |                 |
      |                |<-------------|                 |
      |                |              |                 |
      |       ROVR match, TID OK      |                 |
      |                |              |                 |
      |                |EDAC(status=0)|                 |
      |                |------------->|                 |
      |                |    install local state         |
      |                |              |                 |
      |                |       ROVR MAC Route A'        |
      |                |              |---------------->|
      |                |<-------------------------------|
      |        install remote state   |                 |
      |                |              |                 |
      |     NA(EARO(status = 0))      |                 |
      |<------------------------------|                 |
      |                |              |                 |
Figure 14: Multihoming

The registration is associated with a lifetime, and it must be renewed with an incremented TID. The new TID is propagated in eVPN as illustrated in Figure 15.


   Local            Local              Route           Remote
   Server           Leaf             Reflector         Leaf
  +-------+       +---------+        +-------+        +---------+
  |       |       |         |        |       |        |         |
     6LN           6LBR/EVPN            BGP            EVPN/6LBR
      |                |                 |                |
      |    Ethernet    |      [via BGP signaling]        |
      |                |                 |                |
      |                |                 |                |
      |  NS(EARO(      |                 |                |
      |    TID+1))     |                 |                |
      |--------------->|                 |                |
      |   renew lifetime locally         |                |
      |                |                 |                |
      |                |  ROVR MAC Route A'(TID+1)        |
      |                |---------------->|                |
      |   NA(EARO      |                 |--------------->|
      |   status = 0)) |                 |     update remote state
      |<---------------|                 |                |
      |                |                 |                |
      |                |                 |                |
Figure 15: Host Registration Renewal

Figure 16 illustrates the case where a second host registers the same address, creating a potential address duplication situation. in most cases, the ROVR hash will be different, and the local 6LBR can reject the registration is a status of 1 (duplicate) right away.

   Local            Local              Route           Remote
   Server           Leaf             Reflector         Leaf
  +-------+       +---------+        +-------+        +---------+
  |       |       |         |        |       |        |         |
     6LN           6LBR/EVPN            BGP            EVPN/6LBR
      |                |                 |                |
      |    Ethernet    |                 |                |
      |                |        [via BGP signaling]      |
      |                |                 |                |
      |                |                 |         Local state for A'
      |                |                 |                |
      |                |          ROVR MAC Route A'       |
      |                |              ROVR Hash G         |
      |                |                 |<---------------|
      |                |<----------------|                |
      |      Create remote state for A'  |                |
      |                |                 |                |
      |   NS(EARO)     |                 |                |
      |--------------->|                 |                |
      |         compute ROVR Hash F      |                |
      |                |                 |                |
      |   NA(EARO(     |                 |                |
      |   status = 1)) |                 |                |
      |<---------------|                 |                |
      |                |                 |                |
      |                |                 |                |
Figure 16: Duplicate Addresses

Figure 17 illustrates the case of an address duplication situation where by chance, the ROVR hashes are the same. In that case, the local 6LR checks with the 6LBR that owns the registration using an EDAR/EDAC message exchange. As opposed to the ROVR hash, the full ROVRs do not collide and the registration is also rejected.

   Local            Local              Route           Remote
   Server           Leaf             Reflector         Leaf
  +-------+       +---------+        +-------+        +---------+
  |       |       |         |        |       |        |         |
     6LN           6LBR EVPN            BGP            EVPN/6LBR
      |              |   |               |               |   |
      |    Ethernet  |   |               |               |   |
      |              |   |        [via BGP signaling]    |   |
      |              |   |               |               |   |
      |              |   |               |     Local state for A'
      |              |   |               |               |   |
      |              |   |        ROVR MAC Route A'      |   |
      |              |   |            ROVR Hash G        |   |
      |              |   |               |<--------------|   |
      |              |   |<--------------|               |   |
      |      Create remote state for A'  |               |   |
      |              |   |                               |   |
      |              |                                       |
      |              |       [[out of band signaling]]       |
      |   NS(EARO)   |                                       |
      |------------->|                                       |
      |         compute ROVR Hash G                          |
      |              |                                       |
      |              |      EDAR to EVPN Next Hop            |
      |              |-------------------------------------->|
      |              |                                       |
      |              |               EDAC (status = 1)       |
      |              |<--------------------------------------|
      |              |                                       |
      |  NA(EARO(    |                                       |
      |  status = 1))|                                       |
      |<-------------|                                       |
      |              |                                       |
Figure 17: Duplicate Addresses, ROVR Hash Collision

Figure 18 shows a rare case where the registration has already moved elsewhere with an incremented TID when the local registration is received after being delayed in the network. In that case, the registration is rejected with a status of 3 (moved).

   Local            Local              Route           Remote
   Server           Leaf             Reflector         Leaf
  +-------+       +---------+        +-------+        +---------+
  |       |       |         |        |       |        |         |
     6LN           6LBR/EVPN            BGP            EVPN/6LBR
      |                |                 |                |
      |    Ethernet    |                 |                |
      |                |        [via BGP signaling]       |
      |                |                 |                |
      |                |          ROVR MAC Route A'       |
      |                |         ESI X', Hash F, TID Z    |
      |                |                 |<---------------|
      |                |<----------------|                |
      |         create remote start A'   |                |
      |       ESI X', ROVR Hash F, TID Z |                |
      |                |                 |                |
      |   NS(EARO(     |                 |                |
      |     TID=Z-1))  |                 |                |
      |--------------->|                 |                |
      |           computes as            |                |
      |           ROVR Hash F            |                |
      |           ESI X'', TID Z-1       |                |
      |   NA(EARO)     |                 |                |
      |   status = 3)) |                 |                |
      |<---------------|                 |                |
      |                |                 |                |
Figure 18: Address Already Moved

Address move differs from multi-homing by the ESI being different as visualized by Figure 19. In case of different ESI BGP signalling happens immediately, in case of multi-homing we can reasonably expect for the signalling to catch up on the other leg with a new, higher TID. However, since ESI matches TID doesn't matter strictly speaking and the new remote state can be installed as is. However, if 6LN is not refreshing it registration we can expect elapsed lifetime to create scenario Figure 22 over time.


   Local            Local              Route           Remote
   Server           Leaf             Reflector         Leaf
  +-------+       +---------+        +-------+        +---------+
  |       |       |         |        |       |        |         |
     6LN           6LBR/EVPN            BGP            EVPN/6LBR
      |                |                 |                |
      |    Ethernet    |                 |                |
      |                |        [via BGP signaling]       |
      |   NS(EARO)     |                 |                |
      |--------------->|                 |                |
      |        Create local state        |                |
      |                |        ROVR MAC Route A'         |
      |                |     ESI X', ROVR Hash F, TID Z   |
      |                |---------------->|                |
      |                |                 |--------------->|
      |                |                 |     Create remote state

Same ES (multihomed):
      |                |                 |                |<--
      |                |                 | New local state A' created
      |                |                 |                |
      |                |          ROVR MAC Route A'       |
      |                |         ESI X', Hash F, TID Z+1  |
      |                |                 |<---------------|
      |                |<----------------|                |
      |        Create remote state       |                |
      |       Keep local expect renew    |                |
      |                |                 |                |

Different ES (movement):
      |                |                 |                |<--
      |                |                 | New local state A' created
      |                |                 |                |
      |                |          ROVR MAC Route A'       |
      |                |    ESI X'', ROVR Hash F, TID Z+1 |
      |                |                 |<---------------|
      |                |<----------------|                |
      |        Create remote state       |                |
      |                |                 |                |
      |   NA(EARO(     |                 |                |
      |   status = 4)) |                 |                |
      |<---------------|                 |                |
      |                | Withdraw ROVR MAC Route A'       |
      |                |---------------->|                |
      |                |                 |--------------->|
      |     remove local state           |                |
      |                |                 |                |

Figure 19: Address Move

The host that registered the address may cancel the registration at any time, e.g., if the address is removed fmor its own interface. This is done by registering with a lifetime if 0 as shown in Figure 20. The Leaf may respond with a status of 0 to indicate success, but a status of 4 (removed) is preferred for this situation.

   Local            Local              Route           Remote
   Server           Leaf             Reflector         Leaf
  +-------+       +---------+        +-------+        +---------+
  |       |       |         |        |       |        |         |
     6LN           6LBR/EVPN            BGP            EVPN/6LBR
      |                |                 |                |
      |    Ethernet    |                 |                |
      |                |        [via BGP signaling]       |
      |                |                 |                |
      | NS(EARO,       |                 |                |
      |    lifetime=0) |                 |                |
      |--------------->|                 |                |
      |                |                 |                |
      |                | Withdraw ROVR MAC Route A'       |
      |                |---------------->|                |
      |                |                 |--------------->|
      |   NA(EARO(     |                 |                |
      |   status = 4)) |                 |                |
      |<---------------|                 |                |
      |                |                 |                |
      |     remove local state           |                |
      |                |                 |                |
Figure 20: Address Removal

The host that registered the address may withdraw the route but maintain the NCE, e.g., in the case where it is multihomed but does not want to use one interface for the traffic back as this time. This is done by registering with the R flag set to 0 as shown in Figure 21.

    Local            Local              Route           Remote
   Server           Leaf             Reflector         Leaf
  +-------+       +---------+        +-------+        +---------+
  |       |       |         |        |       |        |         |
     6LN           6LBR/EVPN            BGP            EVPN/6LBR
      |                |                 |                |
      |    Ethernet    |                 |                |
      |                |        [via BGP signaling]       |
      |                |                 |                |
      | NS(EARO,       |                 |                |
      |    R reset)    |                 |                |
      |--------------->|                 |                |
      |                |                 |                |
      |                | Withdraw ROVR MAC Route A'       |
      |                |---------------->|                |
      |                |                 |--------------->|
      |   NA(EARO(     |                 |                |
      |   R reset,     |                 |                |
      |   status = 0)) |                 |                |
      |<---------------|                 |                |
      |                |                 |                |
      |     retain only NCE              |                |
      |                |                 |                |
Figure 21: Route Type 2 Removal

When the lifetime elapses, the 6LBR requires the collocated eVPN router to withdraw the route.

    Local            Local              Route           Remote
   Server           Leaf             Reflector         Leaf
  +-------+       +---------+        +-------+        +---------+
  |       |       |         |        |       |        |         |
     6LN           6LBR/EVPN            BGP            EVPN/6LBR
      |                |                 |                |
      |    Ethernet    |                 |                |
      |                |        [via BGP signaling]       |
      |                |                 |                |
      |     lifetime Expired             |                |
      |                |                 |                |
      |                | Withdraw ROVR MAC Route A'       |
      |                |---------------->|                |
      |                |                 |--------------->|
      |   NA(EARO(     |                 |                |
      |   status = 4)) |                 |                |
      |<---------------|                 |                |
      |                |                 |                |
      |     remove local state           |                |
      |                |                 |                |
Figure 22: Lifetime Elapse

8. Security Considerations

TBD

9. IANA Considerations

10. Acknowledgments

The authors wish to thank you for reading that far. We acknowledge and express gratitude to Wen Lin, Stephane Litkowski, Eric Levy-Abegnoli, Lukas Krattiger, Jerome Tollet, and Ali Sajassi, for their help and support.

11. Normative References

[RFC2119]
Bradner, S., "Key words for use in RFCs to Indicate Requirement Levels", BCP 14, RFC 2119, DOI 10.17487/RFC2119, , <https://www.rfc-editor.org/info/rfc2119>.
[RFC3810]
Vida, R., Ed. and L. Costa, Ed., "Multicast Listener Discovery Version 2 (MLDv2) for IPv6", RFC 3810, DOI 10.17487/RFC3810, , <https://www.rfc-editor.org/info/rfc3810>.
[RFC4443]
Conta, A., Deering, S., and M. Gupta, Ed., "Internet Control Message Protocol (ICMPv6) for the Internet Protocol Version 6 (IPv6) Specification", STD 89, RFC 4443, DOI 10.17487/RFC4443, , <https://www.rfc-editor.org/info/rfc4443>.
[RFC4861]
Narten, T., Nordmark, E., Simpson, W., and H. Soliman, "Neighbor Discovery for IP version 6 (IPv6)", RFC 4861, DOI 10.17487/RFC4861, , <https://www.rfc-editor.org/info/rfc4861>.
[RFC4862]
Thomson, S., Narten, T., and T. Jinmei, "IPv6 Stateless Address Autoconfiguration", RFC 4862, DOI 10.17487/RFC4862, , <https://www.rfc-editor.org/info/rfc4862>.
[RFC6775]
Shelby, Z., Ed., Chakrabarti, S., Nordmark, E., and C. Bormann, "Neighbor Discovery Optimization for IPv6 over Low-Power Wireless Personal Area Networks (6LoWPANs)", RFC 6775, DOI 10.17487/RFC6775, , <https://www.rfc-editor.org/info/rfc6775>.
[RFC6085]
Gundavelli, S., Townsley, M., Troan, O., and W. Dec, "Address Mapping of IPv6 Multicast Packets on Ethernet", RFC 6085, DOI 10.17487/RFC6085, , <https://www.rfc-editor.org/info/rfc6085>.
[RFC7400]
Bormann, C., "6LoWPAN-GHC: Generic Header Compression for IPv6 over Low-Power Wireless Personal Area Networks (6LoWPANs)", RFC 7400, DOI 10.17487/RFC7400, , <https://www.rfc-editor.org/info/rfc7400>.
[RFC7432]
Sajassi, A., Ed., Aggarwal, R., Bitar, N., Isaac, A., Uttaro, J., Drake, J., and W. Henderickx, "BGP MPLS-Based Ethernet VPN", RFC 7432, DOI 10.17487/RFC7432, , <https://www.rfc-editor.org/info/rfc7432>.
[RFC8174]
Leiba, B., "Ambiguity of Uppercase vs Lowercase in RFC 2119 Key Words", BCP 14, RFC 8174, DOI 10.17487/RFC8174, , <https://www.rfc-editor.org/info/rfc8174>.
[RFC8505]
Thubert, P., Ed., Nordmark, E., Chakrabarti, S., and C. Perkins, "Registration Extensions for IPv6 over Low-Power Wireless Personal Area Network (6LoWPAN) Neighbor Discovery", RFC 8505, DOI 10.17487/RFC8505, , <https://www.rfc-editor.org/info/rfc8505>.
[RFC8365]
Sajassi, A., Ed., Drake, J., Ed., Bitar, N., Shekhar, R., Uttaro, J., and W. Henderickx, "A Network Virtualization Overlay Solution Using Ethernet VPN (EVPN)", RFC 8365, DOI 10.17487/RFC8365, , <https://www.rfc-editor.org/info/rfc8365>.
[RFC8928]
Thubert, P., Ed., Sarikaya, B., Sethi, M., and R. Struik, "Address-Protected Neighbor Discovery for Low-Power and Lossy Networks", RFC 8928, DOI 10.17487/RFC8928, , <https://www.rfc-editor.org/info/rfc8928>.
[RFC9047]
Rabadan, J., Ed., Sathappan, S., Nagaraj, K., and W. Lin, "Propagation of ARP/ND Flags in an Ethernet Virtual Private Network (EVPN)", RFC 9047, DOI 10.17487/RFC9047, , <https://www.rfc-editor.org/info/rfc9047>.
[UNICAST-LOOKUP]
Thubert, P. and E. Levy-Abegnoli, "IPv6 Neighbor Discovery Unicast Lookup", Work in Progress, Internet-Draft, draft-thubert-6lo-unicast-lookup-02, , <https://datatracker.ietf.org/doc/html/draft-thubert-6lo-unicast-lookup-02>.
[I-D.thubert-6lo-multicast-registration]
Thubert, P., "IPv6 Neighbor Discovery Multicast Address Registration", Work in Progress, Internet-Draft, draft-thubert-6lo-multicast-registration-02, , <https://datatracker.ietf.org/doc/html/draft-thubert-6lo-multicast-registration-02>.

12. Informative References

[RFC6550]
Winter, T., Ed., Thubert, P., Ed., Brandt, A., Hui, J., Kelsey, R., Levis, P., Pister, K., Struik, R., Vasseur, JP., and R. Alexander, "RPL: IPv6 Routing Protocol for Low-Power and Lossy Networks", RFC 6550, DOI 10.17487/RFC6550, , <https://www.rfc-editor.org/info/rfc6550>.
[RFC8929]
Thubert, P., Ed., Perkins, C.E., and E. Levy-Abegnoli, "IPv6 Backbone Router", RFC 8929, DOI 10.17487/RFC8929, , <https://www.rfc-editor.org/info/rfc8929>.
[RFC9010]
Thubert, P., Ed. and M. Richardson, "Routing for RPL (Routing Protocol for Low-Power and Lossy Networks) Leaves", RFC 9010, DOI 10.17487/RFC9010, , <https://www.rfc-editor.org/info/rfc9010>.
[RIFT]
Sharma, A., Thubert, P., Rijsman, B., and D. Afanasiev, "RIFT: Routing in Fat Trees", Work in Progress, Internet-Draft, draft-ietf-rift-rift-13, , <https://datatracker.ietf.org/doc/html/draft-ietf-rift-rift-13>.
[IANA-EARO-STATUS]
IANA, "Address Registration Option Status Values", <https://www.iana.org/assignments/icmpv6-parameters/icmpv6-parameters.xhtml#address-registration>.

Authors' Addresses

Pascal Thubert (editor)
Cisco Systems, Inc
France
Tony Przygienda
Juniper Networks, Inc
Switzerland
Jeff Tantsura
Microsoft