Networking
Switch Bandwidth or Fabric Uplink Capacity: Read the Oversubscription Boundary
A switch-wide bandwidth figure and the capacity of its installed leaf-to-spine uplinks describe different boundaries. Calculate nominal leaf oversubscription by dividing the populated access-port capacity by the relevant uplink capacity, using the same units and direction. A large switch bandwidth label can coexist with an uplink arrangement that has less capacity than the attached access ports.
Identify what the bandwidth number describes
An offer may place a switch bandwidth figure beside a port count and describe the package as high capacity. Before comparing it with another offer, separate four quantities: the vendor's switch-wide bandwidth label, each port's operating rate, the sum of the active links crossing the boundary being examined, and throughput measured for an actual workload. A number from one category cannot silently replace a number from another.
Cisco's N9300-FX3 datasheet, updated October 9, 2026, illustrates the distinction. For the N93180YC-FX3 it lists 48 SFP28 downlink ports supporting 1/10/25 Gb/s and six QSFP28 uplink ports supporting 40/100 Gb/s. It separately states 3.6 Tbps of switch bandwidth. That headline does not say how many uplinks an offered installation actually populates or what traffic they will carry.
Use the port inventory to examine the proposed connection arrangement. Keep the switch bandwidth label attached to its vendor definition; do not present it as one-way application traffic or substitute it for the leaf's northbound link sum.
References: [C1]
Keep direction and units consistent
Choose a direction through the leaf. For server-to-spine traffic, the access side receives traffic from servers and the uplink side transmits it toward the spines. Compare the sum of those access receive rates with the sum of those uplink transmit rates. Use Gb/s on both sides, or convert both to Tb/s; 1 Tb/s equals 1,000 Gb/s. Preserve the distinction between bits per second and bytes per second when a separate application report is introduced.
Full-duplex communication permits simultaneous transmission and reception. For a link specified at 100 Gb/s in each direction, the northbound contribution is 100 Gb/s. Adding its reverse direction produces a two-direction total, not 200 Gb/s toward the spine. Doubling only the uplink side while leaving the access side one-directional would make the ratio look better without adding a link.
If an offer quotes a bidirectional aggregate, ask for the corresponding directional definition before comparing it with a one-direction port sum. The calculation here uses one direction consistently and does not derive a forwarding result from the 3.6 Tbps label.
Compare two populations on the same port inventory
Fictional comparison EX-OS188 uses the documented N93180YC-FX3 port inventory. Stipulate that every counted connection is active at the stated rate and that all six uplinks serve the same leaf-to-spine boundary. These are illustrative populations, not an existing installation, an approved topology or measured results.
Population A connects 48 access links at 25 Gb/s and six uplinks at 100 Gb/s. The one-direction access sum is 48 x 25 = 1,200 Gb/s. The corresponding uplink sum is 6 x 100 = 600 Gb/s. Nominal access-to-uplink oversubscription is therefore 1,200:600, or 2:1.
Population B connects only 24 access links at 25 Gb/s while keeping the same six uplinks. Its access sum is 24 x 25 = 600 Gb/s, so the comparison is 600:600, or 1:1. The unused access positions contribute no capacity to this populated-port calculation. A calculation for the fully populated chassis would answer a different question and should be labelled separately.
The useful buying result is that an unchanged switch model and unchanged uplink package can describe different ratios. Expanding B to A doubles the populated access capacity while leaving northbound capacity unchanged. Spare access positions provide connection growth; they do not preserve the original ratio as those positions are filled.
References: [C1]
Separate local traffic from traffic that leaves the leaf
The ratio compares nominal capacities, not a forecast that every attached endpoint will transmit at full rate simultaneously. If the forwarding path between two endpoints stays inside the leaf, their traffic does not consume its leaf-to-spine links. Traffic between endpoints on different leaves must traverse the intervening fabric. Traffic placement therefore changes demand on the uplinks even when the populated-port ratio is unchanged.
For Population A, an assumption that all access links simultaneously send northbound at their nominal rate presents twice the nominal capacity available at that exit. A higher switch-wide bandwidth label does not enlarge those six outgoing links. Temporary buffering can absorb a burst, but it cannot create sustained outgoing capacity. The actual response depends on the traffic and network behavior.
Population B removes that particular aggregate rate mismatch under the stipulated population. It still does not establish utilization, even traffic distribution across links, routing behavior, head-of-line blocking, losslessness or RDMA suitability. Nor does either ratio allocate an equal throughput share to every endpoint. Those questions require the actual design and operating evidence.
Use the uplinks in the offered arrangement
A chassis maximum is potential capacity. The denominator for a populated arrangement is the sum of the active uplinks assigned to the boundary under discussion at their stated operating rates. An empty cage, an unconnected assembly or a port assigned to another network contributes nothing to that sum. A reserved expansion link belongs in a separately identified future arrangement.
Keep the comparison per leaf when reviewing this boundary. Adding spare uplink capacity on another leaf does not increase the exit capacity of the leaf carrying the traffic. Likewise, a sum across all links in a fabric does not explain the capacity of a particular leaf-to-spine boundary. A separate spine-to-super-spine comparison may reveal another constraint further along the path.
Cisco's November 12, 2024 MSDC white paper demonstrates why the actual arrangement matters. Its design example 1 uses a different leaf model, the Nexus 93400LD-H1, with 48 x 25 Gb/s downlinks and eight x 100 Gb/s uplinks. The stated 1.5:1 ratio follows from 1,200:800. Those eight uplinks must not be imported into the six-uplink N93180YC-FX3 example.
State the operating condition too. A normal arrangement and an arrangement with an unavailable link have different denominators. If the buyer needs a comparison for a specified outage condition, have the network owner identify which connections remain usable for that traffic and calculate that condition separately.
Make the buying comparison explicit
Ask each offer to state the exact switch model, populated access connections and rates, uplink connections and rates, and the network boundary those uplinks serve. Have the supplier distinguish the equipment's maximum port inventory from the connections included in the proposed arrangement. The network owner should confirm supported port modes and the intended paths.
Then compare the initial population and the proposed growth population against the same traffic assumptions. Does the workload communicate mainly within a leaf, between leaves or beyond this fabric? Which simultaneous demands matter to the buyer? If one offer assumes local traffic and another assumes all traffic leaves the leaf, their capacity judgments are answering different questions even if their ratios are calculated correctly.
Treat a requirement for a particular nominal ratio as one selection criterion. Keep application performance and acceptance criteria explicit and separately assessed. The linked NCCL bandwidth guide explains why a collective benchmark metric cannot be replaced by a switch specification or a sum of nominal port rates. A justified purchase connects the populated arrangement to the intended workload without declaring that a ratio alone proves performance.
Translate the selected arrangement into physical connections
Once the equipment and network owners approve the arrangement, the physical package needs the actual leaf and spine port identifiers, supported assemblies, patching relationships, routes and labels. The leaf-spine cabling guide explains that translation from logical relationships to traceable physical links. Keep a future uplink reservation distinct from a connection included in the current installation.
Leviathan's structured cabling service can discuss agreed fiber and copper installation, routing, dressing, labeling and physical handoff records against the customer-approved equipment and connection plan. Network sizing, switch configuration and workload qualification remain with the appointed technical owners. Any instrument testing needs confirmed personnel, equipment, methods and acceptance criteria.
Use the project inquiry to share the approved endpoint schedule, specified materials and supply responsibilities, site constraints, work window and requested physical records. Those inputs allow a useful scope discussion for the selected connections.
References: [L1]
Primary sources
- [C1] Cisco N9300-FX3 Series Switches Data SheetChecked 2026-10-20. Updated October 9, 2026. Tables 2 and 3 and the N93180YC-FX3 description establish the named port inventory and separate bandwidth label. The two populated arrangements and their ratios are original stipulated arithmetic.
- [C2] Cisco Massively Scalable Data Center Network Fabric Design and Operation White PaperChecked 2026-10-20. Updated November 12, 2024. Design example 1 and Table 1 provide the separate Nexus 93400LD-H1 example with eight uplinks and a stated 1.5:1 leaf ratio. Only that comparison is used.
- [C3] Cisco Catalyst 4500 Software Configuration Guide 7.5: Ethernet and Fast Ethernet SwitchingChecked 2026-10-20. Archival Release 7.5 explanation of simultaneous transmission and reception in full-duplex communication. Used for direction terminology, not Nexus hardware support or configuration.
- [L1] Leviathan Structured Cabling & Fiber InstallationChecked 2026-10-20. Public physical installation scope: agreed routes, endpoint identification, labels and handoff records. Instrument testing requires project-specific equipment, personnel, methods and criteria.