Logo slack_icon Join Slack
Link Aggregation (LAG) — Netris Documentation

General Information

  • Introduction to Netris
  • Netris Supported Functionality & Platforms Matrix
    • Switch Fabric Management Functions
    • Host Networking
    • Monitoring & Telemetry
    • External Routing Functions
    • Cloud Networking Functions & Constructs
    • Overlay Network Functions
    • AI Specific Functions
    • Compute Platform Integrations
    • Security
    • Netris Controller Administration
    • Management Interfaces
  • Netris and NOS versions compatibility matrix
  • Hardware Requirements
    • Netris Controller
    • Netris SoftGate HS (Multi-VPC version)
  • Supported Switch Hardware
    • Nvidia
    • Dell
    • EdgeCore
    • Arista
  • Netris Architecture
    • Netris Controller
    • Netris Switch Agent
    • Netris SoftGate
  • Definitions

Try & Learn Netris

  • Lab Scenario: GPU-as-a-Service network with NVIDIA Spectrum-X architecture
    • Initialize the Netris controller
    • Start a simulation
    • Monitoring Dashboard
    • Topology
    • SSH to Switches
    • SSH to GPU servers
    • NHN (Netris host networking plugin)
    • Server Cluster Template
    • Server Cluster
    • Checking the connectivity
    • Cleanup the Controller
  • Learn Netris Operations with Kubernetes
    • Intro
    • Install Netris Operator
    • Deploy an Application with an On-Demand Netris Load Balancer
    • Using Netris Custom Resources
      • Introduction to Netris Custom Resources
      • L4LB Custom Resource
      • Importing Existing Resources from Netris Controller to Kubernetes
      • Reclaim Policy

Detailed Installation

  • Controller Installation
    • Installing HA Netris Controller in Air-Gapped Environments
      • Why Air-Gapped Installation?
      • Why a High Availability (HA) Cluster?
      • Prerequisites
      • Obtain the Installation File
      • Steps to Install
        • 1. Preparing Each Node
        • 2. Install K3s on All Nodes
        • 3. Import Necessary Container Images
        • 4. Configure kube-vip for KubeAPI High Availability
        • 5. Add Helm Chart Packages to K3s
        • 6. Verify and Scale Core K3s Components
        • 7. Deploy Kube-VIP Cloud Controller
        • 8. Install Traefik Proxy
        • 9. Deploy the Netris Controller
        • 10. (Optional) Enable SSL with cert-manager
        • 11. Set Up the Local Netris Repository
        • 12. Validate Your Deployment
      • After Installation
      • How to consume local repository
    • Upgrading HA Netris Controller in Air-Gapped Environments
      • Obtain the Upgrade File
      • 1. Preparing Each Node
        • 1.1 Transfer the File to the Servers
        • 1.2 Extract the Tarball
        • 1.3 Navigate to the Installation Directory
      • 2. Steps to Upgrade Controller
        • 2.1 Import Necessary Container Images
        • 2.2 Add Helm Chart Packages Upgrades to K3s
        • 2.3 Database backup
        • 2.4 Upgrade Netris Controller
      • 3. Steps to Upgrade the Local Netris Repository
    • Maintenance Procedures
      • Node Maintenance Best Practices
        • Individual Node Maintenance (Recommended Approach)
        • Full Cluster Maintenance (When All Nodes Need Simultaneous Maintenance)
      • Verifying MariaDB Cluster Health
      • Maintenance Best Practices
    • Helm Chart Installation
      • Requirements
      • Get Repo Info
      • Installing the Chart
      • Uninstalling the Chart
      • Chart Configuration
    • Netris Local Repository Setup
      • When & Why to Use the Local Repository?
      • How to Enable the Local Repository on the Netris Controller?
      • How to consume local repository
      • Upgrade Local-Repo Cache
  • Network Switch Initial Setup
    • Nvidia Cumulus v5.9+ Switch Initial Setup
    • Nvidia Cumulus v5 Switch Initial Setup
    • Ubuntu SwitchDev Switch Initial Setup
    • EdgeCore SONiC Switch Initial Setup
    • Dell SONiC Switch Initial Setup
    • Nvidia Cumulus v3.7 Switch Initial Setup
  • SoftGate HS
    • Overview
      • Services Provided by SoftGate
      • What SoftGate does not do
      • Hardware Requirements
    • Performance
    • Architecture Overview
      • SoftGate physical connectivity
      • SoftGate logical connectivity
      • SoftGate node Control Plane
      • SoftGate node Data Plane
      • SoftGate Roles and Flavors
    • Installation and Initial Deployment
      • Prerequisites
      • Installation Guide
    • Upstream/Border Routers (EBGP)
      • Configuring upstream BGP
      • BGP route exchange between SoftGates, upstream routers, and downstream switches
    • High Availability and Load Distribution
      • Netris VPC originated traffic routing
      • Internet originated traffic routing
      • Failover behavior
    • Observability and Operations
  • Netris Host Networking
    • Overview
    • How It Works
    • Before You Begin
      • System Requirements
      • Dependencies
      • Recommended NVIDIA Component Versions
        • Spectrum-X v1.2.0
        • Spectrum-X v1.3.0
      • Permissions
    • Installation Overview
    • Installation
    • Configuration
      • 1. Review the Configuration File
      • 2. Configure BlueField3 NICs
      • 3. Verify BlueField3 NICs Parameters
      • 4. Start the NHN daemon
    • Operating the NHN plugin
      • Starting NHN
      • Monitoring NHN
      • Stopping NHN
    • Using the bf3-config
      • Command-Line Options
      • Examples
    • Using the Verifier
      • Command-Line Options
      • Examples
    • Network Configuration Formats
      • Network Manager Auto-Detection
      • Netplan (systemd-networkd)
      • Ifupdown (Ubuntu interfaces)

Fabric Management

  • Netris Site
  • Inventory
    • Adding Switches
    • Adding SoftGates
  • Topology Manager
    • Adding Links
  • Netris VPC
    • Adding new VPC
  • IP Address Management
    • Allocations and Subnets
    • IPAM Tree View
    • Add an Allocation
    • Add a Subnet
  • BGP
    • Basic BGP
    • Advanced BGP
    • BGP Objects
      • IPv4 Prefix
      • IPv6 Prefix
      • Community
    • BGP route-maps
    • eBGP Importing Non-Default Routes into a VPC
      • How to Import Non-Default Prefixes
  • Static Routing
  • NAT
    • Enabling NAT
    • Defining NAT rules
  • Looking Glass
  • VPC Peering
  • Switch Ports
  • Link Aggregation (LAG)
    • Automatic LAG with EVPN Multi-homing
    • Custom LAG
  • Graph Boards
    • Graph Boards
    • API Logs
    • Dashboard
  • Maintenance Mode
    • Overview
    • Maintenance Mode for Softgate - What’s happening behind the scenes?
    • Maintenance Mode for Switch - What’s happening behind the scenes?
  • Upgrade and Rollback
    • Netris upgrade Procedure
      • Backup current database
      • Stop Netris Agents
      • Check your current version
      • Upgrade the Controller
      • Check the upgraded version
      • Upgrade Switches and SoftGate nodes
    • Rollback Procedure
      • Stop Netris Agents
      • Restore The Database
      • Downgrade the Controller Software
      • Downgrade Netris Agent Software

Services

  • V-Net
    • Introduction
    • L2VPN V-Nets
      • DHCP
      • DHCP Relay
        • Example:
      • V-Net Fields explained
      • Advanced V-Net Fields explained
      • Multisite V-Nets
      • Link Aggregation and Multihoming
        • Ethernet VPN Multi-Homing (EVPN-MH)
        • MC-LAG
      • Labels
        • How labels work
        • Rules and limits
        • When to use labels
    • L3VPN
      • Creating an L3VPN V-Net
      • Rules and limits
    • Verification Tools
      • UI Tools
  • Server Cluster
    • Introduction
    • Server Cluster Template
      • Server Cluster Template Examples:
        • Ethernet-only Fabric Example
        • Infiniband Fabric Example
        • NVLink (NVL72 or NVL144) Fabric Example
        • IPv6 Example
      • Template Fields Explained:
      • Adding a Server Cluster Template
      • Advanced Uses
        • Non-overlapping subnets
        • Specify gateway
    • Creating Server Cluster
      • Adding a Server Cluster
      • Shared Endpoints
        • Untagged VLAN on Shared Endpoints
      • Server Cluster Fields Explained:
  • L4 Load Balancer (L4LB)
    • Enabling L4LB service
    • Consuming L4LB service
  • Access Control Lists (ACL)
    • ACL Default Policy
    • ACL Rules
    • ACL Approval Workflow
    • ACL Processing Order

Netris Integrations

  • NVIDIA UFM (InfiniBand) Integration Plugin for Netris Controller
    • Overview
      • Key Benefits
    • Architecture
    • Prerequisites
    • UFM Configuration Requirements
    • Installation
      • Option 1: Deploy within an existing Netris Controller Kubernetes cluster
      • Option 2: Deploy as a standalone Docker container
    • Configuration Parameters
      • Netris Controller Configuration
      • NVIDIA UFM Configuration
      • Agent Configuration
    • Usage Guide
      • 1. Server Configuration in Netris
      • 2. Create a Server Cluster Template
      • 4. Create Server Clusters
      • 3. Verification
      • 4. Monitoring Integration Status
    • Functional Workflow
    • InfiniBand Security (Recommended)
      • What is MKey Protection?
      • Impact on Netris Integration
      • Configuration Steps
        • 1. Set the MKey Value
        • 2. Enable MKey Protection Level
        • 3. Enable VSKey (Vendor Specific Key)
        • 4. Restart UFM Service
        • 5. Verification
    • Monitoring and Troubleshooting
      • Viewing Logs
      • Common Issues and Solutions
        • Connection Issues to Netris Controller or UFM
        • PKey Assignment Issues
        • SHARP Reservation Issues
        • Synchronization Delays
    • Version Compatibility
    • Getting Started Guide
      • Quick Setup Example
    • Additional Resources
  • NVIDIA NMX-C (NVLink) Integration Plugin for Netris Controller
    • Overview
      • Key Benefits
    • Architecture
      • High-Level Workflow
    • Prerequisites
    • Installation
      • Installing the plugin
      • Loading GPU inventory
      • Netris-NMX Plugin Configuration Parameters
    • Verification
    • Maintenance and Deprovisioning
    • Additional Resources
  • Kubernetes Integration
    • Install Netris Operator
      • Helm Chart Method
      • Regular Manifest Method
    • Using Type ‘LoadBalancer’
    • Using Netris Custom Resources
      • Introduction to Netris Custom Resources
      • L4LB Custom Resource
      • V-Net Custom Resource
      • BGP Custom Resource
      • Importing existing resources from Netris Controller to Kubernetes
      • Reclaim Policy
    • Calico CNI Integration
      • Disabling Netris-Calico Integration
  • Netris-CloudStack Integration
    • High-Level Concept of Integration
      • How It Works
      • Challenges Addressed
      • Benefits
      • Use Cases
    • Compute and Network Architecture
      • Diagram Overview
      • Network Flow
    • Prerequisites
      • Step-by-Step Configuration Instructions for the Netris Controller
      • IPAM Setup
        • Create an Allocation
        • Create Subnets
      • Inventory Setup
        • Adding Servers
        • Creating Servers’ Links
        • Optimize BGP Overlay for Hypervisor
        • Adding Subnets for CloudStack Cluster
        • Enabling Internet Connectivity for ACS Servers
        • Enabling Access to CloudStack Management GUI
        • Creating CloudStack Networks
    • Server Configuration and Software Installation
      • Configuring Network on CloudStack Management Server (Server 1)
        • Understanding the Network Layout
        • Netplan Configuration
      • Install Netris-CloudStack Agent on Hypervisor Servers
        • Bringing Up NICs Before Installation
        • Pre-Installation Steps (For Deployments Without OOB)
        • Key Functions of the Netris-CloudStack Agent
        • Installation Steps
        • Example Successful Output of One-Liner Script
        • Verification Steps
        • Checking Network Connectivity
        • Finalizing the Network Setup
        • Keeping the Temporary OOB VNet for Emergency Access
        • Managing Additional NICs on the Server
      • Install CloudStack Management Service
        • Installation Steps
    • Configuring CloudStack for Netris Integration
      • Enabling the Netris Plugin in CloudStack
      • Initializing CloudStack Setup
        • Steps to Initialize CloudStack
    • Using CloudStack with Netris Isolation Method
      • Creating a VPC
      • Creating a Network Tier
      • Port Forwarding
        • Seamless Integration Between CloudStack and Netris
        • Step-by-Step Process for Configuring Port Forwarding in CloudStack with Netris
        • Key Notes:
      • Configuring Static NAT in CloudStack
        • How Static NAT Works with CloudStack and Netris
        • Steps to Configure Static NAT:
        • How CloudStack and Netris Work Together
        • Final Notes
  • Terraform: Netris provider
    • Install Terraform
    • Create a directory for Terraform files
    • Configure a provider
    • Prepare an infrastructure plan
    • Create resources
    • Delete resources
  • EVPN on Host
    • Overview
      • Supported Operating Systems
    • Use Cases
      • Managed Kubernetes
      • Other Uses
    • How It Works
      • Bare Metal GPU Nodes
      • Shared Nodes
      • Underlay Configuration
      • Packet Flow
      • Management Plane
    • Prerequisites
      • 1. Management V-Net
      • 2. Server Objects
      • 3. Server Networking Configuration
      • 4. Netris Controller
    • Installation
      • Install the EVPN-on-Host agent
      • Enable Underlay
      • Verification
    • Provisioning Tenants
      • Verification

Monitoring & Observability

  • Topology & Wiring Validation
    • Switch-to-switch and Switch-to-SoftGate
    • Switch-to-Server
  • NVIDIA NetQ Integration
    • Topology Blueprint Activation
  • Netris Healthchecks

Tutorials

  • Getting Started with Switch-Fabric Manager & VPC
  • Netris-CloudStack Integration
    • High-Level Concept of Integration
      • How It Works
      • Challenges Addressed
      • Benefits
      • Use Cases
    • Compute and Network Architecture
      • Diagram Overview
      • Network Flow
    • Prerequisites
      • Step-by-Step Configuration Instructions for the Netris Controller
      • IPAM Setup
        • Create an Allocation
        • Create Subnets
      • Inventory Setup
        • Adding Servers
        • Creating Servers’ Links
        • Optimize BGP Overlay for Hypervisor
        • Adding Subnets for CloudStack Cluster
        • Enabling Internet Connectivity for ACS Servers
        • Enabling Access to CloudStack Management GUI
        • Creating CloudStack Networks
    • Server Configuration and Software Installation
      • Configuring Network on CloudStack Management Server (Server 1)
        • Understanding the Network Layout
        • Netplan Configuration
      • Install Netris-CloudStack Agent on Hypervisor Servers
        • Bringing Up NICs Before Installation
        • Pre-Installation Steps (For Deployments Without OOB)
        • Key Functions of the Netris-CloudStack Agent
        • Installation Steps
        • Example Successful Output of One-Liner Script
        • Verification Steps
        • Checking Network Connectivity
        • Finalizing the Network Setup
        • Keeping the Temporary OOB VNet for Emergency Access
        • Managing Additional NICs on the Server
      • Install CloudStack Management Service
        • Installation Steps
    • Configuring CloudStack for Netris Integration
      • Enabling the Netris Plugin in CloudStack
      • Initializing CloudStack Setup
        • Steps to Initialize CloudStack
    • Using CloudStack with Netris Isolation Method
      • Creating a VPC
      • Creating a Network Tier
      • Port Forwarding
        • Seamless Integration Between CloudStack and Netris
        • Step-by-Step Process for Configuring Port Forwarding in CloudStack with Netris
        • Key Notes:
      • Configuring Static NAT in CloudStack
        • How Static NAT Works with CloudStack and Netris
        • Steps to Configure Static NAT:
        • How CloudStack and Netris Work Together
        • Final Notes
  • Netris Host Networking
    • Overview
    • How It Works
    • Before You Begin
      • System Requirements
      • Dependencies
      • Recommended NVIDIA Component Versions
        • Spectrum-X v1.2.0
        • Spectrum-X v1.3.0
      • Permissions
    • Installation Overview
    • Installation
    • Configuration
      • 1. Review the Configuration File
      • 2. Configure BlueField3 NICs
      • 3. Verify BlueField3 NICs Parameters
      • 4. Start the NHN daemon
    • Operating the NHN plugin
      • Starting NHN
      • Monitoring NHN
      • Stopping NHN
    • Using the bf3-config
      • Command-Line Options
      • Examples
    • Using the Verifier
      • Command-Line Options
      • Examples
    • Network Configuration Formats
      • Network Manager Auto-Detection
      • Netplan (systemd-networkd)
      • Ifupdown (Ubuntu interfaces)

Miscellaneous

  • Accounts
    • Users
    • Tenants
    • Permission Groups
    • User Roles
  • Learn Netris Operations with Kubernetes
    • Intro
    • Install Netris Operator
    • Deploy an Application with an On-Demand Netris Load Balancer
    • Using Netris Custom Resources
      • Introduction to Netris Custom Resources
      • L4LB Custom Resource
      • Importing Existing Resources from Netris Controller to Kubernetes
      • Reclaim Policy
  • Custom NVUE Configuration Snippets

Release Notes

  • Release Notes
    • Netris 4.6.0 (Feb/10/2026)
      • What’s new in Netris 4.6.0?
      • Features
      • Enhancements
      • Bug fixes
      • References
    • Netris 4.5.3 (August/27/2025)
      • What’s new in Netris 4.5.3?
      • Features
      • Bug fixes
      • References
    • Netris 4.3.0 (July/31/2024)
      • What’s new in Netris 4.3.0?
      • Features
      • Bug fixes
      • References
    • Netris 4.2.0 (May/1/2024)
      • What’s new in Netris 4.2.0?
      • Features
      • Bug fixes
      • References
    • Netris 4.1.1 (Jan/31/2024)
      • What’s new in Netris 4.1.1?
      • Features
      • Bug fixes
      • References
    • Netris 4.0.0 (Jul/25/2023)
      • What’s new in Netris 4.0.0?
      • Features
      • Bug fixes
      • References
    • Netris 3.5.0 (Oct/24/2023)
      • What’s new in Netris 3.5.0?
      • Features
      • Bug fixes
      • References
    • Netris 3.4.4 (Sep/29/2023)
      • What’s new in Netris 3.4.4?
      • Features
      • Bug fixes
      • References
    • Netris 3.4.3 (Nov/09/2023)
      • What’s new in Netris 3.4.3?
      • Bug fixes
      • References
    • Netris 3.4.0 (Mar/06/2023)
      • What’s new in Netris 3.4.0?
      • New Platform Integration
      • Features
      • Bug fixes
      • References
    • Netris 3.3.0 (Dec/05/2022)
      • What’s new in Netris 3.3.0?
      • Features
      • Bug fixes
      • Various improvements and bug fixes
      • References
    • Netris 3.2.1 (Oct/05/2022)
      • What’s new in Netris 3.2.1?
      • Bug fixes
      • References
    • Netris 3.2.0 (Sep/22/2022)
      • What’s new in Netris 3.2.0?
      • Features
      • Bug fixes
      • References
    • Netris 3.1.0 (Aug/1/2022)
      • What’s new in Netris 3.1.0?
      • Features
      • Bug fixes
      • References
    • Netris 3.0.0 (Oct/6/2021)
      • What’s new in Netris 3.0.0?
      • References
    • Netris 2.9.0 (Mar/5/2021)
      • What’s new in Netris 2.9.0?
      • References
    • Netris 2.8.0 (May/13/2020)
      • What’s new in Netris 2.8.0?
      • Features
      • Bug fixes
      • References
Netris docs
  • Link Aggregation (LAG)
  • Edit on GitHub
Previous Next

Link Aggregation (LAG)

Link Aggregation (LAG), also known as link bundling, Ethernet/network/NIC bonding, or port teaming, is a method of combining (aggregating) multiple network connections in parallel to increase throughput beyond what a single connection could sustain and to provide redundancy in case one of the links fails.

LAG diagram

The Link Aggregation Control Protocol (LACP) is a key component of LAG. It’s a protocol for the collective handling of multiple physical ports that can be seen as a single channel for network traffic.

Netris supports Automatic and Custom modes of configuring LAGs, each described below.

Automatic LAG with EVPN Multi-homing

If LACP is configured on the server side, then Netris will automatically identify the corresponding switch port pairs and form a LAG with EVPN Multihoming enabled for any switch ports participating in a V-Net service.

EVPN Multi-Homing (EVPN-MH) offers robust support for an all-active redundancy model for servers. This means that all connections from a server to multiple switches are concurrently active and operational, ensuring high availability, load balancing, and seamless failover capabilities. As a result, EVPN-MH enhances network resilience and continuity of service.

EVPN-MH diagram

Note: Active Active Multi-homing is currently limited to:

  • Switch OS Cumulus 5.3 or higher.

  • Netris 4.0 or higher.

  • One port per switch (can be overcome in Custom LAG).

  • Only two switches in EVPN-MH domain with ASIC Spectrum A1.

When you add switch ports to a V-Net service, Netris agents automatically configure LAG and apply LACP with EVPN-MH and LACP fallback. If Active-Active Multi Homing is not supported on your hardware, Active-Standby LACP LAG will be configured.

Both in Active-Active and Active-Standby cases LACP should be configured on the server side. If the server does not have LACP configured, the LAG will fallback into non LACP mode and one of two links will still remain active.

To create a V-Net with EVPN-MH go to Service → V-Net → +Add

Add LAG to V-Net

Custom LAG

There are several use cases when you may need a Custom (manually configured) LAG.

  • Aggregate more than one port per each switch (with or without EVPN).

  • LACP fallback is not sufficient and needs to be unconditionally disabled on the switch side. EVPN-MH will be deactivated in this case.

Custom LAG diagram

Please note that a Custom LAG can only be created with one switch. However, if you add two or more Custom LAGs to a V-Net, EVPN-MH will be automatically activated.

To create a Custom LAG go to Network → Network Interfaces.

Add Custom LAG

Add a new LAG.

Add Custom LAG

Set necessary options.

Add Custom LAG
Previous Next

© Copyright 2022, Netris.

Built with Sphinx using a theme provided by Read the Docs.
Alternate Versions v: 4.6

Free theme by Read the Docs.