Network Working Group F. Templin, Ed.
Internet-Draft Boeing Research & Technology
Obsoletes: rfc5320, rfc5558, rfc5720, September 07, 2016
rfc6179, rfc6706 (if
approved)
Intended status: Standards Track
Expires: March 11, 2017

Asymmetric Extended Route Optimization (AERO)
draft-templin-aerolink-71.txt

Abstract

This document specifies the operation of IP over tunnel virtual links using Asymmetric Extended Route Optimization (AERO). Nodes attached to AERO links can exchange packets via trusted intermediate routers that provide forwarding services to reach off-link destinations and redirection services for route optimization. AERO provides an IPv6 link-local address format known as the AERO address that supports operation of the IPv6 Neighbor Discovery (ND) protocol and links IPv6 ND to IP forwarding. Admission control, address/prefix provisioning and mobility are supported by the Dynamic Host Configuration Protocol for IPv6 (DHCPv6), and route optimization is naturally supported through dynamic neighbor cache updates. Although DHCPv6 and IPv6 ND messaging are used in the control plane, both IPv4 and IPv6 are supported in the data plane. AERO is a widely-applicable tunneling solution especially well suited to mobile Virtual Private Networks (VPNs) and other applications as described in this document.

Status of This Memo

This Internet-Draft is submitted in full conformance with the provisions of BCP 78 and BCP 79.

Internet-Drafts are working documents of the Internet Engineering Task Force (IETF). Note that other groups may also distribute working documents as Internet-Drafts. The list of current Internet-Drafts is at http://datatracker.ietf.org/drafts/current/.

Internet-Drafts are draft documents valid for a maximum of six months and may be updated, replaced, or obsoleted by other documents at any time. It is inappropriate to use Internet-Drafts as reference material or to cite them other than as "work in progress."

This Internet-Draft will expire on March 11, 2017.

Copyright Notice

Copyright (c) 2016 IETF Trust and the persons identified as the document authors. All rights reserved.

This document is subject to BCP 78 and the IETF Trust's Legal Provisions Relating to IETF Documents (http://trustee.ietf.org/license-info) in effect on the date of publication of this document. Please review these documents carefully, as they describe your rights and restrictions with respect to this document. Code Components extracted from this document must include Simplified BSD License text as described in Section 4.e of the Trust Legal Provisions and are provided without warranty as described in the Simplified BSD License.


Table of Contents

1. Introduction

This document specifies the operation of IP over tunnel virtual links using Asymmetric Extended Route Optimization (AERO). The AERO link can be used for tunneling to neighboring nodes over either IPv6 or IPv4 networks, i.e., AERO views the IPv6 and IPv4 networks as equivalent links for tunneling. Nodes attached to AERO links can exchange packets via trusted intermediate routers that provide forwarding services to reach off-link destinations and redirection services for route optimization [RFC5522].

AERO provides an IPv6 link-local address format known as the AERO address that supports operation of the IPv6 Neighbor Discovery (ND) [RFC4861] protocol and links IPv6 ND to IP forwarding. Admission control, address/prefix provisioning and mobility are supported by the Dynamic Host Configuration Protocol for IPv6 (DHCPv6) [RFC3315], and route optimization is naturally supported through dynamic neighbor cache updates. Although DHCPv6 and IPv6 ND messaging are used in the control plane, both IPv4 and IPv6 can be used in the data plane.

AERO is applicable to a wide variety of use cases. For example, it can be used to coordinate the Virtual Private Network (VPN) links of mobile devices (e.g., cellphones, tablets, laptop computers, etc.) that connect into a home enterprise network via public access networks. AERO can also be applied to aviation applications for both manned and unmanned aircraft where the aircraft is treated as a mobile host or router that can connect an Internet of Things (IoT). Numerous other use cases are also in scope. The remainder of this document presents the AERO specification.

2. Terminology

The terminology in the normative references applies; the following terms are defined within the scope of this document:

[RFC3315].

AERO link

a Non-Broadcast, Multiple Access (NBMA) tunnel virtual overlay configured over a node's attached IPv6 and/or IPv4 networks. All nodes on the AERO link appear as single-hop neighbors from the perspective of the virtual overlay even though they may be separated by many underlying network hops. AERO can also operate over native multiple access link types (e.g., Ethernet, WiFi etc.) when a tunnel virtual overlay is not needed.
AERO interface

a node's attachment to an AERO link. Since the addresses assigned to an AERO interface are obtained from the unique prefix delegations it receives, AERO interfaces do not require Duplicate Address Detection (DAD) and therefore set the administrative variable DupAddrDetectTransmits to zero [RFC4862].
AERO address

an IPv6 link-local address constructed as specified in Section 3.3 and assigned to a Client's AERO interface.
AERO node

a node that is connected to an AERO link and that participates in IPv6 ND and DHCPv6 messaging over the link.
AERO Client ("Client")

a node that issues DHCPv6 messages to receive IP Prefix Delegations (PDs) from one or more AERO Servers. Following PD, the Client assigns an AERO address to the AERO interface for use in DHCPv6 and IPv6 ND exchanges with other AERO nodes.
AERO Server ("Server")

a node that configures an AERO interface to provide default forwarding and DHCPv6 services for AERO Clients. The Server assigns an administratively provisioned IPv6 link-local unicast address to support the operation of DHCPv6 and the IPv6 ND protocol. An AERO Server can also act as an AERO Relay.
AERO Relay ("Relay")

a node that configures an AERO interface to relay IP packets between nodes on the same AERO link and/or forward IP packets between the AERO link and the native Internetwork. The Relay assigns an administratively provisioned IPv6 link-local unicast address to the AERO interface the same as for a Server. An AERO Relay can also act as an AERO Server.
AERO Forwarding Agent ("Forwarding Agent")

a node that performs data plane forwarding services as a companion to an AERO Server.
ingress tunnel endpoint (ITE)

an AERO interface endpoint that injects tunneled packets into an AERO link.
egress tunnel endpoint (ETE)

an AERO interface endpoint that receives tunneled packets from an AERO link.
underlying network

a connected IPv6 or IPv4 network routing region over which the tunnel virtual overlay is configured.
underlying interface

an AERO node's interface point of attachment to an underlying network.
link-layer address

an IP address assigned to an AERO node's underlying interface. When UDP encapsulation is used, the UDP port number is also considered as part of the link-layer address; otherwise, UDP port number is set to the constant value '0'. Link-layer addresses are used as the encapsulation header source and destination addresses.
network layer address

the source or destination address of the encapsulated IP packet.
end user network (EUN)

an internal virtual or external edge IP network that an AERO Client connects to the rest of the network via the AERO interface.
AERO Service Prefix (ASP)

an IP prefix associated with the AERO link and from which more-specific AERO Client Prefixes (ACPs) are derived.
AERO Client Prefix (ACP)

an IP prefix derived from an ASP and delegated to a Client, where the ACP prefix length must be no shorter than the ASP prefix length and must be no longer than 64 for IPv6 or 32 for IPv4.

Throughout the document, the simple terms "Client", "Server" and "Relay" refer to "AERO Client", "AERO Server" and "AERO Relay", respectively. Capitalization is used to distinguish these terms from DHCPv6 client/server/relay

The terminology of DHCPv6 [RFC3315] and IPv6 ND [RFC4861] (including the names of node variables and protocol constants) applies to this document. Also throughout the document, the term "IP" is used to generically refer to either Internet Protocol version (i.e., IPv4 or IPv6).

The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT", "SHOULD", "SHOULD NOT", "RECOMMENDED", "MAY", and "OPTIONAL" in this document are to be interpreted as described in [RFC2119]. Lower case uses of these words are not to be interpreted as carrying RFC2119 significance.

3. Asymmetric Extended Route Optimization (AERO)

The following sections specify the operation of IP over Asymmetric Extended Route Optimization (AERO) links:

3.1. AERO Link Reference Model

                           .-(::::::::)
                        .-(:::: IP ::::)-.
                       (:: Internetwork ::)
                        `-(::::::::::::)-'
                           `-(::::::)-' 
                                |
    +--------------+   +--------+-------+   +--------------+
    |AERO Server S1|   | AERO Relay R1  |   |AERO Server S2|
    |  Nbr: C1; R1 |   |   Nbr: S1; S2  |   |  Nbr: C2; R1 |
    |  default->R1 |   |(P1->S1; P2->S2)|   |  default->R1 |
    |    P1->C1    |   |      ASP A1    |   |    P2->C2    |
    +-------+------+   +--------+-------+   +------+-------+
            |                   |                  |
    X---+---+-------------------+------------------+---+---X
        |                  AERO Link                   |
  +-----+--------+                            +--------+-----+
  |AERO Client C1|                            |AERO Client C2|
  |    Nbr: S1   |                            |   Nbr: S2    |
  | default->S1  |                            | default->S2  |
  |    ACP P1    |                            |    ACP P2    |
  +--------------+                            +--------------+
        .-.                                         .-.
     ,-(  _)-.                                   ,-(  _)-.
  .-(_   IP  )-.                              .-(_   IP  )-.
 (__    EUN      )                           (__    EUN      )
    `-(______)-'                                `-(______)-'
         |                                           |
     +--------+                                  +--------+
     | Host H1|                                  | Host H2|
     +--------+                                  +--------+

Figure 1: AERO Link Reference Model

Figure 1 presents the AERO link reference model. In this model:

Each AERO node maintains an AERO interface neighbor cache and an IP forwarding table. For example, AERO Relay R1 in the diagram has neighbor cache entries for Servers S1 and S2 as well as IP forwarding table entries for the ACPs delegated to Clients C1 and C2. In common operational practice, there may be many additional Relays, Servers and Clients. (Although not shown in the figure, AERO Forwarding Agents may also be provided for data plane forwarding offload services.)

3.2. AERO Link Node Types

AERO Relays provide default forwarding services to AERO Servers. Relays forward packets between neighbors connected to the same AERO link and also forward packets between the AERO link and the native IP Internetwork. Relays present the AERO link to the native Internetwork as a set of one or more AERO Service Prefixes (ASPs) and serve as a gateway between the AERO link and the Internetwork. AERO Relays maintain an AERO interface neighbor cache entry for each AERO Server, and maintain an IP forwarding table entry for each AERO Client Prefix (ACP). AERO Relays can also be configured to act as AERO Servers.

AERO Servers provide default forwarding services to AERO Clients. Each Server also peers with each Relay in a dynamic routing protocol instance to advertise its list of associated ACPs. Servers configure a DHCPv6 server function to facilitate Prefix Delegation (PD) exchanges with Clients. Each delegated prefix becomes an ACP taken from an ASP. Servers forward packets between AERO interface neighbors, and maintain an AERO interface neighbor cache entry for each AERO Relay. They also maintain both neighbor cache entries and IP forwarding table entries for each of their associated Clients. AERO Servers can also be configured to act as AERO Relays.

AERO Clients act as requesting routers to receive ACPs through DHCPv6 PD exchanges with AERO Servers over the AERO link. Each Client MAY associate with a single Server or with multiple Servers, e.g., for fault tolerance, load balancing, etc. Each IPv6 Client receives at least a /64 IPv6 ACP, and may receive even shorter prefixes. Similarly, each IPv4 Client receives at least a /32 IPv4 ACP (i.e., a singleton IPv4 address), and may receive even shorter prefixes. AERO Clients maintain an AERO interface neighbor cache entry for each of their associated Servers as well as for each of their correspondent Clients.

AERO Forwarding Agents provide data plane forwarding services as companions to AERO Servers. Note that while Servers are required to perform both control and data plane operations on their own behalf, they may optionally enlist the services of special-purpose Forwarding Agents to offload data plane traffic.

3.3. AERO Addresses

An AERO address is an IPv6 link-local address with an embedded ACP and assigned to a Client's AERO interface. The AERO address remains stable as the Client moves between topological locations, i.e., even if its link-layer addresses change.

For IPv6, the AERO address begins with the prefix fe80::/64 and includes in its interface identifier (i.e., the lower 64 bits) the base prefix taken from the Client's IPv6 ACP. The base prefix is determined by masking the ACP with the prefix length. For example, if the AERO Client receives the IPv6 ACP:

it constructs its AERO address as:

[RFC4291] formed from the ACP and with a Prefix Length of 96 plus the ACP prefix length. For example, for the IPv4 ACP 192.0.2.32/28 the IPv4-mapped IPv6 address is:

For IPv4, the AERO address is based on an IPv4-mapped IPv6 address

The Client then constructs its AERO address with the prefix fe80::/64 and with the lower 64 bits of the IPv4-mapped IPv6 address in the interface identifier as:

NOTE: In some cases, prospective neighbors may not have advanced knowledge of the Client's ACP length and may therefore send initial IPv6 ND messages with an AERO destination address that matches the ACP but does not correspond to the base prefix. For example, if the Client receives the IPv6 ACP 2001:db8:1000:2000::/56 then subsequently receives an IPv6 ND message with destination address fe80::2001:db8:1000:2001, it accepts the message as though it were addressed to fe80::2001:db8:1000:2000.

3.4. AERO Interface Characteristics

AERO interfaces use encapsulation (see: Section 3.10) to exchange packets with neighbors attached to the AERO link.

AERO interfaces maintain a neighbor cache, and AERO nodes use both DHCPv6 and IPv6 ND control messaging to manage the creation, modification and deletion of neighbor cache entries.

AERO Clients send DHCPv6 Solicit, Rebind, Renew and Release messages to AERO Servers, which respond with DHCPv6 Reply messages. AERO nodes use unicast IPv6 ND Neighbor Solicitation (NS), Neighbor Advertisement (NA), Router Solicitation (RS) and Router Advertisement (RA) messages the same as for any IPv6 link.

AERO interfaces use two IPv6 ND redirection message types -- the first known as a Predirect message and the second being the standard Redirect message (see Section 3.17).

AERO interface ND messages include one or more Source/Target Link-Layer Address Options (S/TLLAOs) formatted as shown in Figure 2:

      0                   1                   2                   3
      0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1
     +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
     |      Type     |   Length = 5  |          Reserved1            |
     +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
     |   Reserved2   | Interface ID  |        UDP Port Number        |
     +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
     |                                                               |
     +                                                               +
     |                                                               |
     +                          IP Address                           +
     |                                                               |
     +                                                               +
     |                                                               |
     +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
     |P00|P01|P02|P03|P04|P05|P06|P07|P08|P09|P10|P11|P12|P13|P14|P15|
     +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
     |P16|P17|P18|P19|P20|P21|P22|P23|P24|P25|P26|P27|P28|P29|P30|P31|
     +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
     |P32|P33|P34|P35|P36|P37|P38|P39|P40|P41|P42|P43|P44|P45|P46|P47|
     +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
     |P48|P49|P50|P51|P52|P53|P54|P55|P56|P57|P58|P59|P60|P61|P62|P63|
     +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+

Figure 2: AERO Source/Target Link-Layer Address Option (S/TLLAO) Format

In this format:

  • Type is set to '1' for SLLAO or '2' for TLLAO the same as for IPv6 ND.
  • Length is set to the constant value '5' (i.e., 5 units of 8 octets).
  • Both Reserved fields are set to the value '0' on transmission and ignored on receipt.
  • Interface ID is set to an integer value between 0 and 255 corresponding to an underlying interface of the AERO node.
  • UDP Port Number and IP Address are set to the addresses used by the AERO node when it sends encapsulated packets over the underlying interface. When UDP is not used as part of the encapsulation, UDP Port Number is set to the value '0'. When the encapsulation IP address family is IPv4, IP Address is formed as an IPv4-mapped IPv6 address as specified in Section 3.3.
  • P[i] is a set of 64 Preference values that correspond to the 64 Differentiated Service Code Point (DSCP) values [RFC2474]. Each P(i) is set to the value '0' ("disabled"), '1' ("low"), '2' ("medium") or '3' ("high") to indicate a preference level for packet forwarding purposes.

AERO interfaces may be configured over multiple underlying interfaces. For example, common mobile handheld devices have both wireless local area network ("WLAN") and cellular wireless links. These links are typically used "one at a time" with low-cost WLAN preferred and highly-available cellular wireless as a standby. In a more complex example, aircraft frequently have many wireless data link types (e.g. satellite-based, cellular, terrestrial, air-to-air directional, etc.) with diverse performance and cost properties.

If a Client's multiple underlying interfaces are used "one at a time" (i.e., all other interfaces are in standby mode while one interface is active), then IPv6 ND messages include only a single S/TLLAO with Interface ID set to a constant value.

If the Client has multiple active underlying interfaces, then from the perspective of IPv6 ND it would appear to have multiple link-layer addresses. In that case, IPv6 ND messages MAY include multiple S/TLLAOs -- each with an Interface ID that corresponds to a specific underlying interface of the AERO node.

3.5. AERO Link Registration

When an administrative authority first deploys a set of AERO Relays and Servers that comprise an AERO link, they also assign a unique domain name for the link, e.g., "linkupnetworks.example.com". Next, if administrative policy permits Clients within the domain to serve as correspondent nodes for Internet mobile nodes, the administrative authority adds a Fully Qualified Domain Name (FQDN) for each of the AERO link's ASPs to the Domain Name System (DNS) [RFC1035]. The FQDN is based on the suffix "aero.linkupnetworks.net" with a prefix formed from the wildcard-terminated reverse mapping of the ASP [RFC3596][RFC4592], and resolves to a DNS PTR resource record. For example, for the ASP '2001:db8:1::/48' within the domain name "linkupnetworks.example.com", the DNS database contains:

'*.1.0.0.0.8.b.d.0.1.0.0.2.aero.linkupnetworks.net. PTR linkupnetworks.example.com'

This DNS registration advertises the AERO link's ASPs to prospective correspondent nodes.

3.6. AERO Interface Initialization

3.6.1. AERO Relay Behavior

When a Relay enables an AERO interface, it first assigns an administratively provisioned link-local address fe80::ID to the interface. Each fe80::ID address MUST be unique among all AERO nodes on the link, and MUST NOT collide with any potential AERO addresses nor the special addresses fe80:: and fe80::ffff:ffff:ffff:ffff. (The fe80::ID addresses are typically taken from the available range fe80::/96, e.g., as fe80::1, fe80::2, fe80::3, etc.) The Relay then engages in a dynamic routing protocol session with all Servers on the link (see: Section 3.7), and advertises its assigned ASPs into the native IP Internetwork.

Each Relay subsequently maintains an IP forwarding table entry for each ACP covered by its ASP(s), and maintains a neighbor cache entry for each Server on the link. Relays exchange NS/NA messages with AERO link neighbors the same as for any AERO node, however they typically do not perform explicit Neighbor Unreachability Detection (NUD) (see: Section 3.18) since the dynamic routing protocol already provides reachability confirmation.

3.6.2. AERO Server Behavior

When a Server enables an AERO interface, it assigns an administratively provisioned link-local address fe80::ID the same as for Relays. The Server further configures a DHCPv6 server function to facilitate DHCPv6 PD exchanges with AERO Clients. The Server maintains a neighbor cache entry for each Relay on the link, and manages per-ACP neighbor cache entries and IP forwarding table entries based on control message exchanges. Each Server also engages in a dynamic routing protocol with each Relay on the link (see: Section 3.7).

When the Server receives an NS/RS message from a Client on the AERO interface it returns an NA/RA message. The Server further provides a simple link-layer conduit between AERO interface neighbors. In particular, when a packet sent by a source Client arrives on the Server's AERO interface and is destined to another of the Server's Clients, the Server forwards the packet at the link layer without ever disturbing the network layer and without ever leaving the AERO interface.

3.6.3. AERO Client Behavior

When a Client enables an AERO interface, it uses the special address fe80::ffff:ffff:ffff:ffff to obtain one or more ACPs from an AERO Server via DHCPv6 PD. Next, it assigns the corresponding AERO address(es) to the AERO interface and creates a neighbor cache entry for the Server, i.e., the DHCPv6 PD exchange bootstraps autoconfiguration of unique link-local address(es). The Client maintains a neighbor cache entry for each of its Servers and each of its active correspondent Clients. When the Client receives Redirect/Predirect messages on the AERO interface it updates or creates neighbor cache entries, including link-layer address information.

3.6.4. AERO Forwarding Agent Behavior

When a Forwarding Agent enables an AERO interface, it assigns the same link-local address(es) as the companion AERO Server. The Forwarding Agent thereafter provides data plane forwarding services based solely on the forwarding information assigned to it by the companion AERO Server.

3.7. AERO Routing System

The AERO routing system is based on a private instance of the Border Gateway Protocol (BGP) [RFC4271] that is coordinated between Relays and Servers and does not interact with either the public Internet BGP routing system or the native IP Internetwork interior routing system. Relays advertise only a small and unchanging set of ASPs to the native routing system instead of the full dynamically changing set of ACPs.

In a reference deployment, each AERO Server is configured as an Autonomous System Border Router (ASBR) for a stub Autonomous System (AS) using an AS Number (ASN) that is unique within the BGP instance, and each Server further peers with each Relay but does not peer with other Servers. Similarly, Relays do not peer with each other, since they will reliably receive all updates from all Servers and will therefore have a consistent view of the AERO link ACP delegations.

Each Server maintains a working set of associated ACPs, and dynamically announces new ACPs and withdraws departed ACPs in its BGP updates to Relays. Clients are expected to remain associated with their current Servers for extended timeframes, however Servers SHOULD selectively suppress BGP updates for impatient Clients that repeatedly associate and disassociate with them in order to dampen routing churn.

Each Relay configures a black-hole route for each of its ASPs. By black-holing the ASPs, the Relay will maintain forwarding table entries only for the ACPs that are currently active, and all other ACPs will correctly result in destination unreachable failures due to the black hole route. Relays do not send BGP updates for ACPs to Servers, but instead originate a default route. In this way, Servers have only partial topology knowledge (i.e., they know only about the ACPs of their directly associated Cliens) and they forward all other packets to Relays which have full topology knowledge.

Scaling properties of the AERO routing system are limited by the number of BGP routes that can be carried by Relays. Assuming O(10^6) as a reasonable maximum number of BGP routes, this means that O(10^6) Clients can be serviced by a single set of Relays. A means of increasing scaling would be to assign a different set of Relays for each set of ASPs. In that case, each Server still peers with each Relay, but the Server institutes route filters so that each set of Relays only receives BGP updates for the ASPs they aggregate. For example, if the ASP for the AERO link is 2001:db8::/32, a first set of Relays could service the ASP segment 2001:db8::/40, a second set of Relays could service 2001:db8:0100::/40, a third set could service 2001:db8:0200::/40, etc.

Assuming up to O(10^3) sets of Relays, the AERO routing system can then accommodate O(10^9) ACPs with no additional overhead for Servers and Relays (for example, it should be possible to service 4 billion /64 ACPs taken from a /32 ASP and even more for shorter ASPs). In this way, each set of Relays services a specific set of ASPs that they advertise to the native routing system, and each Server configures ASP-specific routes that list the correct set of Relays as next hops. This arrangement also allows for natural incremental deployment, and can support small scale initial deployments followed by dynamic deployment of additional Clients, Servers and Relays without disturbing the already-deployed base.

Note that in an alternate routing arrangement each set of Relays could advertise the aggregated ASP for the link into the native routing system even though each Relay services only a segment of the ASP. In that case, a Relay upon receiving a packet with a destination address covered by the ASP segment of another Relay can simply tunnel the packet to the correct Relay. The tradeoff then is the penalty for Relay-to-Relay tunneling compared with reduced routing information in the native routing system.

Finally, Realys can express preferences for ACPs learned from multiple Servers by assigning a BGP weight to each Server's peering configuration. In this way Relays can choose the Serevr with the highest weight as the preferred path, and then fail over to a Server with lower weight in case of ACP withdrawl or Server failure.

3.8. AERO Interface Neighbor Cache Maintenace

Each AERO interface maintains a conceptual neighbor cache that includes an entry for each neighbor it communicates with on the AERO link, the same as for any IPv6 interface [RFC4861]. AERO interface neighbor cache entires are said to be one of "permanent", "static" or "dynamic".

Permanent neighbor cache entries are created through explicit administrative action; they have no timeout values and remain in place until explicitly deleted. AERO Relays maintain a permanent neighbor cache entry for each Server on the link, and AERO Servers maintain a permanent neighbor cache entry for each Relay. Each entry maintains the mapping between the neighbor's fe80::ID network-layer address and corresponding link-layer address.

Static neighbor cache entries are created through DHCPv6 PD exchanges as specified in Section 3.15 and remain in place for durations bounded by prefix lifetimes. AERO Servers maintain static neighbor cache entries for the ACPs of each of their associated Clients, and AERO Clients maintain a static neighbor cache entry for each of their associated Servers. When an AERO Server sends a Reply message response to a Client's Solicit, Rebind or Renew message, it creates or updates a static neighbor cache entry based on the Client's DHCP Unique Identifier (DUID) as the Client identifier, the AERO address(es) corresponding to the Client's ACP(s) as the network-layer address(es), the prefix lifetime as the neighbor cache entry lifetime, the Client's encapsulation IP address and UDP port number as the link-layer address and the prefix length(s) as the length to apply to the AERO address(es). When an AERO Client receives a Reply message from a Server, it creates or updates a static neighbor cache entry based on the Reply message link-local source address as the network-layer address, the prefix lifetime as the neighbor cache entry lifetime, and the encapsulation IP source address and UDP source port number as the link-layer address.

Dynamic neighbor cache entries are created or updated based on receipt of a Predirect/Redirect message as specified in Section 3.17, and are garbage-collected when keepalive timers expire. AERO Clients maintain dynamic neighbor cache entries for each of their active correspondent Client ACPs with lifetimes based on IPv6 ND messaging constants. When an AERO Client receives a valid Predirect message it creates or updates a dynamic neighbor cache entry for the Predirect target network-layer and link-layer addresses plus prefix length. The node then sets an "AcceptTime" variable in the neighbor cache entry to ACCEPT_TIME seconds and uses this value to determine whether packets received from the correspondent can be accepted. When an AERO Client receives a valid Redirect message it creates or updates a dynamic neighbor cache entry for the Redirect target network-layer and link-layer addresses plus prefix length. The Client then sets a "ForwardTime" variable in the neighbor cache entry to FORWARD_TIME seconds and uses this value to determine whether packets can be sent directly to the correspondent. The Client also sets a "MaxRetry" variable to MAX_RETRY to limit the number of keepalives sent when a correspondent may have gone unreachable.

It is RECOMMENDED that FORWARD_TIME be set to the default constant value 30 seconds to match the default REACHABLE_TIME value specified for IPv6 ND [RFC4861].

It is RECOMMENDED that ACCEPT_TIME be set to the default constant value 40 seconds to allow a 10 second window so that the AERO redirection procedure can converge before AcceptTime decrements below FORWARD_TIME.

It is RECOMMENDED that MAX_RETRY be set to 3 the same as described for IPv6 ND address resolution in Section 7.3.3 of [RFC4861].

Different values for FORWARD_TIME, ACCEPT_TIME, and MAX_RETRY MAY be administratively set, if necessary, to better match the AERO link's performance characteristics; however, if different values are chosen, all nodes on the link MUST consistently configure the same values. Most importantly, ACCEPT_TIME SHOULD be set to a value that is sufficiently longer than FORWARD_TIME to allow the AERO redirection procedure to converge.

When there may be a Network Address Translator (NAT) between the Client and the Server, or if the path from the Client to the Server should be tested for reachability, the Client can send periodic RS messages to the Server to receive RA replies. The RS/RA messaging will keep NAT state alive and test Server reachability without disturbing the DHCPv6 server.

3.9. AERO Interface Sending Algorithm

IP packets enter a node's AERO interface either from the network layer (i.e., from a local application or the IP forwarding system), or from the link layer (i.e., from the AERO tunnel virtual link). Packets that enter the AERO interface from the network layer are encapsulated and admitted into the AERO link, i.e., they are tunnelled to an AERO interface neighbor. Packets that enter the AERO interface from the link layer are either re-admitted into the AERO link or delivered to the network layer where they are subject to either local delivery or IP forwarding. Since each AERO node may have only partial information about neighbors on the link, AERO interfaces may forward packets with link-local destination addresses at a layer below the network layer. This means that AERO nodes act as both IP routers/hosts and sub-IP layer forwarding nodes. AERO interface sending considerations for Clients, Servers and Relays are given below.

When an IP packet enters a Client's AERO interface from the network layer, if the destination is covered by an ASP the Client searches for a dynamic neighbor cache entry with a non-zero ForwardTime and an AERO address that matches the packet's destination address. (The destination address may be either an address covered by the neighbor's ACP or the (link-local) AERO address itself.) If there is a match, the Client uses a link-layer address in the entry as the link-layer address for encapsulation then admits the packet into the AERO link. If there is no match, the Client instead uses the link-layer address of a neighboring Server as the link-layer address for encapsulation.

When an IP packet enters a Server's AERO interface from the link layer, if the destination is covered by an ASP the Server searches for a neighbor cache entry with an AERO address that matches the packet's destination address. (The destination address may be either an address covered by the neighbor's ACP or the AERO address itself.) If there is a match, the Server uses a link-layer address in the entry as the link-layer address for encapsulation and re-admits the packet into the AERO link. If there is no match, the Server instead uses the link-layer address in a permanent neighbor cache entry for a Relay selected through longest-prefix-match as the link-layer address for encapsulation.

When an IP packet enters a Relay's AERO interface from the network layer, the Relay searches its IP forwarding table for an entry that is covered by an ASP and also matches the destination. If there is a match, the Relay uses the link-layer address in the corresponding neighbor cache entry as the link-layer address for encapsulation and admits the packet into the AERO link. When an IP packet enters a Relay's AERO interface from the link-layer, if the destination is not a link-local address and does not match an ASP the Relay removes the packet from the AERO interface and uses IP forwarding to forward the packet to the Internetwork. If the destination address is a link-local address or a non-link-local address that matches an ASP, and there is a more-specific ACP entry in the IP forwarding table, the Relay uses the link-layer address in the corresponding neighbor cache entry as the link-layer address for encapsulation and re-admits the packet into the AERO link. When an IP packet enters a Relay's AERO interface from either the network layer or link-layer, and the packet's destination address matches an ASP but there is no more-specific ACP entry, the Relay drops the packet and returns an ICMP Destination Unreachable message (see: Section 3.14).

When an AERO Server receives a packet from a Relay via the AERO interface, the Server MUST NOT forward the packet back to the same or a different Relay.

When an AERO Relay receives a packet from a Server via the AERO interface, the Relay MUST NOT forward the packet back to the same Server.

When an AERO node re-admits a packet into the AERO link without involving the network layer, the node MUST NOT decrement the network layer TTL/Hop-count.

When an AERO node forwards a data packet to the primary link-layer address of a Server, it may receive Redirect messages with an SLLAO that include the link-layer address of an AERO Forwarding Agent. The AERO node SHOULD record the link-layer address in the neighbor cache entry for the neighbor and send subsequent data packets via this address instead of the Server's primary address (see: Section 3.16).

AERO nodes may have multiple underlying interfaces and/or neighbor cache entries for Clients with multiple Interface ID registrations (see Section 3.4). The AERO node uses the packet's DSCP value to select the outgoing underlying interface based on its own Interface ID preference values and to select the destination link-layer address based on the neighbor's Interface ID with the highest preference value. If multiple Interface IDs have a preference of "high", the AERO node sends one copy of the packet to each of the link-layer addresses (i.e., it replicates the packet); otherwise, the node sends a single copy of the packet.

3.10. AERO Interface Encapsulation and Re-encapsulation

AERO interfaces encapsulate IP packets according to whether they are entering the AERO interface from the network layer or if they are being re-admitted into the same AERO link they arrived on. This latter form of encapsulation is known as "re-encapsulation".

The AERO interface encapsulates packets per the Generic UDP Encapsulation (GUE) encapsulation procedures in [I-D.ietf-nvo3-gue][I-D.herbert-gue-fragmentation], or through an alternate encapsulation format (see: Appendix A). For packets entering the AERO link from the IP layer, the AERO interface copies the "TTL/Hop Limit", "Type of Service/Traffic Class" [RFC2983], "Flow Label"[RFC6438].(for IPv6) and "Congestion Experienced" [RFC3168] values in the packet's IP header into the corresponding fields in the encapsulation IP header. For packets undergoing re-encapsulation within the AERO link, the AERO interface instead copies the "TTL/Hop Limit", "Type of Service/Traffic Class", "Flow Label" and "Congestion Experienced" values in the original encapsulation IP header into the corresponding fields in the new encapsulation IP header, i.e., the values are transferred between encapsulation headers and *not* copied from the encapsulated packet's network-layer header.

When GUE encapsulation is used, the AERO interface next sets the UDP source port to a constant value that it will use in each successive packet it sends, and sets the UDP length field to the length of the encapsulated packet plus 8 bytes for the UDP header itself plus the length of the GUE header (or 0 if GUE direct IP encapsulation is used). For packets sent to a Server, the AERO interface sets the UDP destination port to 8060, i.e., the IANA-registered port number for AERO. For packets sent to a correspondent Client, the AERO interface sets the UDP destination port to the port value stored in the neighbor cache entry for this correspondent. The AERO interface then either includes or omits the UDP checksum according to the GUE specification.

For IPv4 encapsulation, the AERO interface sets the DF bit as discussed in Section 3.13.

3.11. AERO Interface Decapsulation

AERO interfaces decapsulate packets destined either to the AERO node itself or to a destination reached via an interface other than the AERO interface the packet was received on. Decapsulation is per the procedures specified for the appropriate encapsulation format.

3.12. AERO Interface Data Origin Authentication

AERO nodes employ simple data origin authentication procedures for encapsulated packets they receive from other nodes on the AERO link. In particular:

  • AERO Servers and Relays accept encapsulated packets with a link-layer source address that matches a permanent neighbor cache entry.
  • AERO Servers accept authentic encapsulated DHCPv6 messages from Clients, and create or update a static neighbor cache entry for the Client based on the specific DHCPv6 message type.
  • AERO Clients and Servers accept encapsulated packets if there is a static neighbor cache entry with a link-layer address that matches the packet's link-layer source address.
  • AERO Clients, Servers and Relays accept encapsulated packets if there is a dynamic neighbor cache entry with an AERO address that matches the packet's network-layer source address, with a link-layer address that matches the packet's link-layer source address, and with a non-zero AcceptTime.

Note that this simple data origin authentication is effective in environments in which link-layer addresses cannot be spoofed. In other environments, each AERO message must include a signature that the recipient can use to authenticate the message origin.

3.13. AERO Interface Packet Size Issues

The AERO interface is the node's attachment to the AERO link. The AERO interface acts as a tunnel ingress when it sends a packet to an AERO link neighbor and as a tunnel egress when it receives a packet from an AERO link neighbor. AERO interfaces observe the packet sizing considerations for tunnels discussed in [I-D.ietf-intarea-tunnels] and as specified below.

IPv6 specifies a minimum link Maximum Transmission Unit (MTU) of 1280 bytes [RFC2460]. Although IPv4 specifies a smaller minimum link MTU of 68 bytes [RFC0791], AERO interfaces also observe the IPv6 minimum for IPv4 even if the packet may incur fragmentation in the network.

IPv6 specifies a minimum Maximum Reassembly Unit (MRU) of 1500 bytes [RFC2460], while the minimum MRU for IPv4 is only 576 bytes [RFC1122] (note that IPv6 over IPv4 tunnels assume a larger MRU than the IPv4 minimum).

Original sources expect that IP packets will either be delivered to the final destination or a suitable Packet Too Big (PTB) message returned. However, PTB messages may be crafted for malicious purposes such as denial of service, or lost in the network [RFC2923] resulting in failure of the IP Path MTU Discovery (PMTUD) mechanisms [RFC1191][RFC1981]. For these reasons, AERO links employ operational procedures that avoid all interactions with PMTUD.

AERO Servers advertise an MTU that MUST be no smaller than 1280 bytes, MUST be no larger than the minimum MRU among all nodes on the AERO link minus the encapsulation overhead ("ENCAPS"), and SHOULD be no smaller than 1500 bytes. AERO Servers advertise a Maximum Fragment Unit (MFU) as the maximum size for the fragments of an encapsulated packet that require fragmentation. The MFU value MUST NOT be larger than (MTU+ENCAPS) and MUST NOT be larger than 1280 bytes unless there is operational assurance that a larger size can traverse the link along all paths without fragmentation.

AERO Clients set the AERO interface MTU/MFU based on the values advertised by their Server, and configure an MRU large enough to reassemble packets up to (MTU+ENCAPS) bytes.

All AERO nodes on the link MUST configure the same MTU/MFU values for reasons cited in [RFC3819][RFC4861] (in particular, multicast support requires a common MTU value among all nodes on the link).

All AERO nodes on the link MUST configure a minimum MRU of (1500+ENCAPS) bytes, and SHOULD be capable of setting a larger MRU accoding to the Server's advertised MTU.

In accordnace with these requirements, the ingress accommodates packets of various sizes as follows:

[RFC6864][RFC4963]. For AERO links over both IPv4 and IPv6, studies have also shown that IP fragments are dropped unconditionally over some network paths [I-D.taylor-v6ops-fragdrop]. In environments where IP fragmentation issues could result in operational problems, the ingress SHOULD employ intermediate-layer fragmentation (see: [RFC2764] and [I-D.herbert-gue-fragmentation]) before appending the outer encapsulation headers to each fragment.

  • First, for each original IPv4 packet that is larger than the AERO interface MTU and with the DF bit set to 0, the ingress uses IPv4 fragmentation to break the packet into a minimum number of non-overlapping fragments where the first fragment is no larger than (MFU-ENCAPS) bytes and the remaining fragments are no larger than the first.
  • Next, for each original IP packet or fragment that is no larger than (MFU-ENCAPS) bytes, the ingress encapsulates the packet and admits it into the tunnel. For IPv4 AERO links, the ingress sets the Don't Fragment (DF) bit to 0 so that these packets will be delivered to the egress even if some fragmentation occurs in the network.
  • For all other original IP packets or fragments, if the packet is larger than the AERO interface MTU, the ingress drops the packet and returns a PTB message to the original source. Otherwise, the ingress encapsulates the packet and fragments the encapsulated packet into a minimum number of non-overlapping fragments where the first fragment is no larger than MFU bytes and the remaining fragments are no larger than the first. The ingress then admits the fragments into the tunnel, and for IPv4 sets the DF bit to 0 in the IP encapsulation header. These fragmented encapsulated packets will be delivered to the egress, which reassembles them into a whole packet.

Several factors must be considered when fragmentation of the encapsulated packet is needed. For AERO links over IPv4, the IP ID field is only 16 bits in length, meaning that fragmentation at high data rates could result in data corruption due to reassembly misassociations

Since the encapsulation fragment header reduces the room available for packet data, but the original source has no way to control its insertion, the ingress MUST include the fragment header length in the ENCAPS length even for packets in which the header is absent.

3.14. AERO Interface Error Handling

When an AERO node admits encapsulated packets into the AERO interface, it may receive link-layer (L2) or network-layer (L3) error indications.

An L2 error indication is an ICMP error message generated by a router on the path to the neighbor or by the neighbor itself. The message includes an IP header with the address of the node that generated the error as the source address and with the link-layer address of the AERO node as the destination address.

The IP header is followed by an ICMP header that includes an error Type, Code and Checksum. Valid type values include "Destination Unreachable", "Time Exceeded" and "Parameter Problem" [RFC0792][RFC4443]. (AERO interfaces ignore all L2 IPv4 "Fragmentation Needed" and IPv6 "Packet Too Big" messages since they only emit packets that are guaranteed to be no larger than the IP minimum link MTU.)

The ICMP header is followed by the leading portion of the packet that generated the error, also known as the "packet-in-error". For ICMPv6, [RFC4443] specifies that the packet-in-error includes: "As much of invoking packet as possible without the ICMPv6 packet exceeding the minimum IPv6 MTU" (i.e., no more than 1280 bytes). For ICMPv4, [RFC0792] specifies that the packet-in-error includes: "Internet Header + 64 bits of Original Data Datagram", however [RFC1812] Section 4.3.2.3 updates this specification by stating: "the ICMP datagram SHOULD contain as much of the original datagram as possible without the length of the ICMP datagram exceeding 576 bytes".

The L2 error message format is shown in Figure 3:

     +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
     ~                               ~
     |        L2 IP Header of        |
     |         error message         |
     ~                               ~
     +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
     |         L2 ICMP Header        |
     +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ ---
     ~                               ~   P
     |   IP and other encapsulation  |   a
     | headers of original L3 packet |   c
     ~                               ~   k
     +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+   e
     ~                               ~   t
     |        IP header of           |   
     |      original L3 packet       |   i
     ~                               ~   n
     +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+   
     ~                               ~   e
     |    Upper layer headers and    |   r
     |    leading portion of body    |   r
     |   of the original L3 packet   |   o
     ~                               ~   r
     +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ ---

Figure 3: AERO Interface L2 Error Message Format

  • When an AERO node receives an L2 Parameter Problem message, it processes the message the same as described as for ordinary ICMP errors in the normative references [RFC0792][RFC4443].
  • When an AERO node receives persistent L2 IPv4 Time Exceeded messages, the IP ID field may be wrapping before earlier fragments have been processed. In that case, the node SHOULD begin including integrity checks and/or institute rate limits for subseqent packets.
  • When an AERO Client receives persistent L2 Destination Unreachable messages in response to tunneled packets that it sends to one of its dynamic neighbor correspondents, the Client SHOULD test the path to the correspondent using Neighbor Unreachability Detection (NUD) (see Section 3.18). If NUD fails, the Client SHOULD set ForwardTime for the corresponding dynamic neighbor cache entry to 0 and allow future packets destined to the correspondent to flow through a Server.
  • When an AERO Client receives persistent L2 Destination Unreachable messages in response to tunneled packets that it sends to one of its static neighbor Servers, the Client SHOULD test the path to the Server using NUD. If NUD fails, the Client SHOULD delete the neighbor cache entry and attempt to associate with a new Server.
  • When an AERO Server receives persistent L2 Destination Unreachable messages in response to tunneled packets that it sends to one of its static neighbor Clients, the Server SHOULD test the path to the Client using NUD. If NUD fails, the Server SHOULD cancel the DHCPv6 PD for the Client's ACP, withdraw its route for the ACP from the AERO routing system and delete the neighbor cache entry (see Section 3.18 and Section 3.19).
  • When an AERO Relay or Server receives an L2 Destination Unreachable message in response to a tunneled packet that it sends to one of its permanent neighbors, it discards the message since the AERO routing system is likely in a temporary transitional state that will soon re-converge. In case of a prolonged outage, however, the AERO routing system will compensate for Relays or Servers that have fallen silent.

When an AERO Relay receives an L3 packet for which the destination address is covered by an ASP, if there is no more-specific routing information for the destination the Relay drops the packet and returns an L3 Destination Unreachable message. The Relay first writes the IP source address of the original L3 packet as the destination address of the L3 Destination Unreachable message and determines the next hop to the destination. If the next hop is reached via the AERO interface, the Relay uses the IPv6 address "::" or the IPv4 address "0.0.0.0" as the IP source address of the L3 Destination Unreachable message and forwards the message to the next hop within the AERO interface. Otherwise, the Relay uses one of its non link-local addresses as the source address of the L3 Destination Unreachable message and forwards the message via a link outside the AERO interface.

When an AERO node receives an encapsulated packet for which the reassembly buffer it too small, it drops the packet and returns an L3 Packet To Big (PTB) message. The node first writes the IP source address of the original L3 packet as the destination address of the L3 PTB message and determines the next hop to the destination. If the next hop is reached via the AERO interface, the node uses the IPv6 address "::" or the IPv4 address "0.0.0.0" as the IP source address of the L3 PTB message and forwards the message to the next hop within the AERO interface. Otherwise, the node uses one of its non link-local addresses as the source address of the L3 PTB message and forwards the message via a link outside the AERO interface.

When an AERO node receives any L3 error message via the AERO interface, it examines the destination address in the L3 IP header of the message. If the next hop toward the destination address of the error message is via the AERO interface, the node re-encapsulates and forwards the message to the next hop within the AERO interface. Otherwise, if the source address in the L3 IP header of the message is the IPv6 address "::" or the IPv4 address "0.0.0.0", the node writes one of its non link-local addresses as the source address of the L3 message and recalculates the IP and/or ICMP checksums. The node finally forwards the message via a link outside of the AERO interface.

3.15. AERO Router Discovery, Prefix Delegation and Address Configuration

AERO Router Discovery, Prefix Delegation and Address Configuration are coordinated by the DHCPv6 control messaging protocol as discussed in the following Sections.

3.15.1. AERO DHCPv6 Service Model

Each AERO Server configures a DHCPv6 server function to facilitate PD requests from Clients. Each Server is provisioned with a database of ACP-to-Client ID mappings for all Clients enrolled in the AERO system, as well as any information necessary to authenticate each Client. The Client database is maintained by a central administrative authority for the AERO link and securely distributed to all Servers, e.g., via the Lightweight Directory Access Protocol (LDAP) [RFC4511] or a similar distributed database service.

Therefore, no Server-to-Server DHCPv6 PD state synchronization is necessary, and Clients can optionally hold separate PDs for the same ACPs from multiple Servers. In this way, Clients can associate with multiple Servers, and can receive new PDs from new Servers before deprecating PDs received from existing Servers. This provides the Client with a natural fault-tolerance and/or load balancing profile.

AERO Clients and Servers exchange configuration information using an AERO Vendor-Specific Information Option (AVSIO) formatted as follows:

      0                   1                   2                   3
      0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1
     +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
     |      OPTION_VENDOR_OPTS       |            option-len         |
     +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
     |                   enterprise-number = 45282                   |
     +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
     .                                                               .
     .                          option-data                          .
     .                                                               .
     +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+

Figure 4: AERO Vendor-Specific Information Option (AVSIO)

AERO Clients MUST include an AVSIO in DHCPv6 Solicit and Rebind messages to manage the Server's cached link-layer addresses and preferences. AERO Servers MUST include an AVSIO in DHCPv6 Reply messages that correspond to a Client's DHCPv6 message that also included an AVSIO option.

The following sections specify the Client and Server behavior in more detail.

3.15.2. AERO Client Behavior

AERO Clients discover the link-layer addresses of AERO Servers via static configuration (e.g., from a flat-file map of Server addresses and locations), or through an automated means such as DNS name resolution. In the absence of other information, the Client resolves the FQDN "linkupnetworks.[domainname]" where "linkupnetworks" is a constant text string and "[domainname]" is a DNS suffix for the Client's underlying network (e.g., "example.com"). After discovering the link-layer addresses, the Client associates with one or more of the corresponding Servers.

To associate with a Server, the Client acts as a requesting router to request ACPs through a two-message (i.e., Solicit/Reply) DHCPv6 PD exchange [RFC3315][RFC3633]. The Client's includes fe80::ffff:ffff:ffff:ffff as the IPv6 source address of the Solicit message, 'All_DHCP_Relay_Agents_and_Servers' as the IPv6 destination address, an underlying interface address of the Client (i.e., the link-layer address) as the link-layer source address and the link-layer address of the Server as the link-layer destination address. The Client also includes a Rapid Commit option, a Client Identifier option with the Client's DUID, and an Identity Association for Prefix Delegation (IA_PD) option. If the Client is pre-provisioned with ACPs associated with the AERO service, it MAY also include the ACPs in the IA_PD to indicate its preferences to the DHCPv6 server.

The Client also includes an AVSIO option with one or more AERO Client Link-Layer Address Options (ACLLAOs) to register its link-layer address(es) with the Server. The first ACLLAO MUST be specific to the underlying interface over which the Client will send the Solicit. The Client MAY include additonal ACLLAOs specific to other underlying interfaces, but if so it MUST have assurance that there will be no NATs on the paths to the Server via those interfaces. (Otherwise, the Client MAY issue subsequent Rebind messages after the initial Solicit/Reply exchange to register additional link-layer addresses). The Server will echo the ACLLAOs in the corresponding Reply message as specified in Section 3.15.3.

      0                   1                   2                   3
      0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1
     +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
     | opt-code = OPTION_ACLLAO (0)  |           option-len          |
     +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
     .                                                               .
     .                 AERO Client Link-Layer Address                .
     .                                                               .
     +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+

Figure 5: AERO Client Link-Layer Address Option (ACLLAO)

The format for the ACLLAO is shown in Figure 5:

In the above format, the Client sets 'opt-code' to 0 ("OPTION_ACLLAO") and sets 'option-len' to 36 (i.e., the length of the option following this field). The Client then includes an "AERO Client Link-Layer Address" in the same format as for S/TLLAOs in Figure 2 beginning with the 'Reserved2' field and extending to the end of the S/TLLAO. The Client then sets 'Reserved2', 'Interface ID', 'UDP Port Number', 'IP address' and 'P(i)' values for the specific underlying interface the same as for S/TLLAO options (see Section 3.4). The Client finally includes any additional DHCPv6 options (including any necessary authentication options to identify itself to the DHCPv6 server), and sends the encapsulated Solicit message via the underlying interface corresponding to the Interface ID of the first ACLLAO.

When the Client attempts to perform a DHCPv6 PD exchange with a Server that is too busy to service the request, the Client may receive an error status code such as "NoPrefixAvail" in the Server's Reply [RFC3633] or no Reply at all. In that case, the Client SHOULD discontinue DHCPv6 PD attempts through this Server and try another Server.

When the Client receives a Reply from the AERO Server with an AVSIO option and no error status codes, it can compare the UDP Port Number and IP Address values in the first ACLLAO with the values the Client provided in its request. If the values are different, the Client can infer that there is a NAT on the path to the Server via that underlying interface. If the AVSIO option also includes an ALINFO sub-option, the Client also assigns the MTU/MFU values in the ALINFO option to its AERO interface, then caches any ASPs included in the ALINFO option as ASPs to associate with the AERO link (see Section 3.15.3). This configuration information applies to the AERO link as a whole, and all Clients will receive the same information.

The Client next creates a static neighbor cache entry with the Server's link-local address as the network-layer address and the Server's encapsulation address as the link-layer address. Next, the Client autoconfigures an AERO address for each of the delegated ACPs, assigns the address(es) to the AERO interface and sub-delegates the ACPs to its attached EUNs and/or the Client's own internal virtual interfaces. The Client can then configure as many addresses as it wants from /64 prefixes taken from the ACPs and assign them to either an internal virtual interface ("weak end-system") or to the AERO interface itself ("strong end-system") [RFC1122] while black-holing the remaining portions of the /64s. Finally, the Client assigns a default IP route to the AERO interface with the link-local address of the Server as the next hop and with the PD lifetime as the default router lifetime.

After the initial Solicit/Reply exchange, the Client SHOULD begin using the AERO address as the source address for further DHCPv6 messaging. The Client subsequently renews its ACP delegations through each of its Servers by sending Renew messages with the link-layer address of a Server as the link-layer destination address. The Client MAY subsequently issue Rebind messages with additional ACLLAOs if it wishes to register additional Interface IDs and/or update the link-layer address information for existing Interface IDs. In that case, the Rebind message MUST be sent over the underlying interface corresponding to the first ACLLAO in the message, i.e., the same as for Solicits.

After an AERO Client registers its Interface IDs and their associated 'P(i)' values with the AERO Server, the Client may wish to change one or more Interface ID registrations, e.g., if an underlying interface becomes unavailable, if cost profiles change, etc. To do so, the Client prepares a Rebind message to send over any available underlying interface. The Rebind MUST include the ACLLAO specific to the selected avaialble underlying interface as the first ACLLAO and MAY include any additional ACLLAOs specific to other underlying interfaces. The Client includes fresh 'P(i)' values in each ACLLAO to update the Server's neighbor cache entry. If the Client wishes to disable some or all DSCPs for an underlying interface, it includes an ACLLAO with 'P(i)' values set to 0 ("disabled").

If the Client wishes to discontinue use of a Server it issues a Release to delete the Server's neighbor cache entry.

3.15.3. AERO Server Behavior

AERO Servers configure a DHCPv6 server function on their AERO links. AERO Servers arrange to add their encapsulation layer IP addresses (i.e., their link-layer addresses) to a static map of Server addresses for the link and/or the DNS resource records for the FQDN "linkupnetworks.[domainname]" before entering service.

When an AERO Server receives a prospective Client's Solicit on its AERO interface, and the Server is too busy to service the message, it SHOULD return a Reply with status code "NoPrefixAvail" per [RFC3633]. Otherwise, the Server authenticates the message. If authentication succeeds, the Server determines the correct ACPs to delegate to the Client by searching the Client database.

When the Server delegates the ACPs, it also creates IP forwarding table entries so that the AERO BGP-based routing system will propagate the ACPs to all Relays that aggregate the corresponding ASP (see: Section 3.7). Next, the Server prepares a Reply message to send to the Client while using fe80::ID as the IPv6 source address, the link-local address taken from the Client's Solicit as the IPv6 destination address, the Server's link-layer address as the source link-layer address, and the Client's link-layer address as the destination link-layer address. The Server also includes IA_PD options with the delegated ACPs. For IPv4 ACPs, the prefix included in the IA_PD option is in IPv4-mapped IPv6 address format and with prefix length set as specified in Section 3.3. For AERO links where a Client may experience a fault that prevents it from issuing a Release before departing from the network, Servers should set a short prefix lifetime (e.g., 40 seconds) so that stale PD state can be flushed out of the network.

For Replies to Client DHCPv6 messages that include an AVSIO, the Server prepares a new AVSIO to include in the Reply. The Server first copies the ACLLAOs in the body of the Client's AVSIO into the AVSIO that the Server will supply in the Reply message. For the initial ACLLAO, the Server sets 'UDP Port Number' and 'IP address' to the values observed in the outer encapsulating headers of the Client's DHCPv6 message, i.e., even if these values are different than the ones included by the Client.

The Server next copies an ALINFO option into the body of the AVSIO (i.e., following the ACLLAO options) formatted as shown in Figure 6:

      0                   1                   2                   3
      0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1
     +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
     |  opt-code = OPTION_ALINFO (1) |           option-len          |
     +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
     |Maximum Transmission Unit (MTU)|   Maximum Fragment Unit (MFU) |
     +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
     | Prefix Len #1 |  AERO Service Prefix (ASP) #1 (1 to 8 bytes)  |
     +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
     | Prefix Len #2 |  AERO Service Prefix (ASP) #2 (1 to 8 bytes)  |
     +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
     | Prefix Len #3 |  AERO Service Prefix (ASP) #3 (1 to 8 bytes)  |
     +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
     ~                                                               ~
     ~                                                               ~

Figure 6: AERO Link Information (ALINFO) Option

Section 3.13. The Server finally includes one or more ASPs with 'Prefix Len' set to the ASP prefix length (between 0 and 64), and 'AERO Service Prefix' set to the ASP (between 1 and 8 bytes).

When the Server sends the Reply message, it creates or updates a static neighbor cache entry for the Client based on the DUID and AERO addresses with lifetime set to no more than the PD lifetimes and updates the Client's link-layer addresses according to the ACLLAOs. The Server then uses the Client link-layer addresses as the link-layer addresses for encapsulation and uses the 'P(i)' values included in ACLLAOs as preference levels for each DSCP value.

After the initial DHCPv6 PD Solicit/Reply exchange, the AERO Server maintains the neighbor cache entry for the Client until the PD lifetimes expire. If the Client issues a Rebind, the Server uses any included ACLLAOs to update the link-layer information in the Client's neighbor cache entry. If the Client issues a Renew, the Server extends the PD lifetimes. If the Client issues a Release, or if the Client does not issue a Renew before the lifetime expires, the Server deletes the neighbor cache entry for the Client and withdraws the IP routes from the AERO routing system.

3.15.3.1. Lightweight DHCPv6 Relay Agent (LDRA)

AERO Clients and Servers are always on the same link (i.e., the AERO link) from the perspective of DHCPv6. However, in some implementations the DHCPv6 server and AERO interface driver may be located in separate modules. In that case, the Server's AERO interface driver module can act as a Lightweight DHCPv6 Relay Agent (LDRA)[RFC6221] to relay DHCPv6 messages to and from the DHCPv6 server module.

When the LDRA receives a DHCPv6 message from a client, it prepares an AVSIO (including any ACLLAO and ALINFO options as described above) and copies the option into a DHCPv6 Relay-Supplied Option Option (RSOO) [RFC6422]. The LDRA then incorporates the RSOO into the Relay-Forward message and forwards the message to the DHCPv6 server.

When the DHCPv6 server receives the Relay-Forward message, it caches the AVSIO included in the RSOO and discards the AVSIO included within the Client's message itself. Next, the server authenticates the Client's message and prepares a Reply message if authentication succeeds.

When the DHCPv6 server prepares a Reply message, it then includes the relay-supplied AVSIO in the body of the message along with any other options, then wraps the message in a Relay-Reply message. The DHCPv6 server then delivers the Relay-Reply message to the LDRA, which discards the Relay-Reply wrapper and delivers the DHCPv6 message to the Client.

3.16. AERO Forwarding Agent Behavior

AERO Servers MAY associate with one or more companion AERO Forwarding Agents as platforms for offloading high-speed data plane traffic. When an AERO Server receives a Client's Solicit/Renew/Rebind/Release message, it services the message then forwards the corresponding Reply message to the Forwarding Agent. When the Forwarding Agent receives the Reply message, it creates, updates or deletes a neighbor cache entry with the Client's AERO address and link-layer information included in the Reply message. The Forwarding Agent then forwards the Reply message back to the AERO Server, which forwards the message to the Client. In this way, Forwarding Agent state is managed in conjunction with Server state, with the Client responsible for reliability.

When an AERO Server receives a data packet on an AERO interface with a network layer destination address for which it has distributed forwarding information to a Forwarding Agent, the Server returns a Redirect message to the source neighbor (subject to rate limiting) then forwards the data packet as usual. The Redirect message includes a TLLAO with the link-layer address of the Forwarding Engine.

When the source neighbor receives the Redirect message, it SHOULD record the link-layer address in the TLLAO as the encapsulation addresses to use for sending subsequent data packets. However, the source MUST continue to use the primary link-layer address of the Server as the encapsulation address for sending control messages.

3.17. AERO Link Route Optimization

When a source Client forwards packets to a prospective correspondent Client within the same AERO link domain (i.e., one for which the packet's destination address is covered by an ASP), the source Client MAY initiate an AERO link route optimization procedure. It is important to note that this procedure is initiated by the Client; if the procedure were initiated by the Server, the Server would have no way of knowing whether the Client was actually able to contact the correspondent over the route-optimized path.

The procedure is based on an exchange of IPv6 ND messages using a chain of AERO Servers and Relays as a trust basis. This procedure is in contrast to the Return Routability procedure required for route optimization to a correspondent Client located in the Internet as described in Section 3.22. The following sections specify the AERO link route optimization procedure.

3.17.1. Reference Operational Scenario

Figure 7 depicts the AERO link route optimization reference operational scenario, using IPv6 addressing as the example (while not shown, a corresponding example for IPv4 addressing can be easily constructed). The figure shows an AERO Relay ('R1'), two AERO Servers ('S1', 'S2'), two AERO Clients ('C1', 'C2') and two ordinary IPv6 hosts ('H1', 'H2'):