Cisco has been adding lots of new features and capabilities to NX-OS over the last couple of years. So much in fact that it appears the original 4GB of memory that came standard on the Nexus 7010 SUP (N7K-SUP1) now needs to be upgraded to 8GB.
The new N7K-SUP1′s from Cisco come with 8GB standard now, but those of us who have had ours for a couple of years are finding ourselves in need of an upgrade.
The 8GB upgrade requirement is based on the NX-OS version, particularly NX-OS 5.1(1) or later. It’s important to note however that not everyone planning to run NX-OS 5.1(1) or later HAS to upgrade the ram to 8GB just yet. The document Cisco Nexus 7000 Series NX-OS Release Notes, Release 5.1 explains the current situations that would require one to upgrade to 8GB. They are:
• If you are running Cisco NX-OS Release 5.1(x) and you have created more than three VDCs, or if XL mode is enabled in more than one VDC, then you must upgrade the memory to 8 GB.
• If you are running Cisco NX-OS Release 5.1(x), 8 GB of memory is required if FabricPath or FEX features are enabled in more than two VDCs of a Cisco Nexus 7000 Series system.
It is my personal opinion however that even if you do not currently match any of these requirements on your Nexus 7010 and especially if you have (AND YOU SHOULD!) dual SUPs then you should go ahead and get the memory upgrade done now before you run into a situation down the road where your running NX-OS 5.1(1) or higher and you go and create a third VDC or you try to enable FabricPath or FEX and potentially run into a memory issue.
Ok, so you decide you want or need the 8GB memory upgrade. I suggest the first thing you do is confirm that your SUPs are one’s that currently have just 4GB. You can do that with the “show system resources” command.
NXD02# show system resources
Load average: 1 minute: 0.94 5 minutes: 0.48 15 minutes: 0.35
Processes : 331 total, 2 running
CPU states : 0.5% user, 3.0% kernel, 96.5% idle
Memory usage: 4115740K total, 1606288K used, 2509452K free
As you can see the “Memory usage: 4115740K total” indicates this SUP currently has just the 4GB of memory.
Now that you have confirmed you do in fact have just 4GB of memory your going to need to order the 8 GB memory upgrade kit from Cisco, “N7K-SUP1-8GBUPG=”. Currently the list price for this is $4,000 per kit. I sure hope you have a good discount with Cisco. Oh and remember you need one kit for each Nexus 7010 SUP (N7K-SUP1)!
After placing your order with Cisco and likely waiting your 20+ day lead time you will finally be greeted with your fresh new 8GB memory upgrade kits! Yay!


So now your ready to do your upgrade. Before you do I have a couple of recommendations to make. Also its important to note that all that I am writing about is based on the fact that my particular Nexus 7010′s both have dual sups. Without the dual sups well your probably going to want and need to do a little more planning of course.
So about my recommendations. First, if you have others that have access to the Nexus 7010′s I’d suggest informing them of your intentions to do this upgrade and to not be making any changes on the systems at this time. Second, take a few minutes to go and copy your running config before you get started. Finally, just as an FYI, if your running dual sups and do everything I’ve suggested thus far you should know its pretty easy and seemingly safe to do the upgrade any time really. I know I know… scheduled maintenance, but seriously I’ve yet to have a problem doing any upgrades both software and hardware even during business hours. Yes, I LOVE the Nexus platform.
With that said I’d still recommend you backup your config, show run and copy paste into txt file. I never do any work without at least doing that.
Copy running config:
NXD02# copy run start
[########################################] 100%
Copy complete, now saving to disk (please wait)...
NXD02#
Ok, so you’ve copied the running configs, you have your txt file backups and you’re ready to get going.
Next step is check the status of the sups and redundancy:
NXD02# sh redundancy status
Redundancy mode
---------------
administrative: HA
operational: HA
This supervisor (sup-5)
-----------------------
Redundancy state: Active
Supervisor state: Active
Internal state: Active with HA standby
Other supervisor (sup-6)
------------------------
Redundancy state: Standby
Supervisor state: HA standby
Internal state: HA standby
System start time: Fri May 15 18:21:42 2009
System uptime: 695 days, 2 hours, 26 minutes, 8 seconds
Kernel uptime: 11 days, 13 hours, 1 minutes, 49 seconds
Active supervisor uptime: 11 days, 12 hours, 38 minutes, 41 seconds
NXD02#
This confirms that Sup-5 is active and that Sup-6 is your standby and is going to be the first one we upgrade.
You can also tell by looking at the indicator lights, hard to tell in the pic but the “Active” light is amber:

From the above pic you can also see the “Ejector” buttons on the SUP, at this point go ahead and unscrew the two screws and press the ejector buttons to release the levers so you can remove the SUP.
We now have a poor lonely active sup patiently waiting for it’s friend to return:

Here is the SUP with the current 4GB of memory. You can see the existing 4GB of memory in the bottom right of the photo. There are two slots for memory and we will be adding a second 4GB into the second slot right above the existing slot.

Now go ahead and get your new memory modules ready:

Now you can go ahead and insert the new memory module into the second slot. Make sure the latches click into place to secure the new memory module in place:

Once the memory module has been inserted it’s time to now do what I found to be the hardest part of the whole process, adding the darn little “8GB” sticker to the front of the SUP. Took me more time to get that little sticker on straight then anything else.

Once the hardware upgrade is done its time to reinsert the SUP back into the Nexus 7010.
Now your going to want to watch the progress of the SUP coming back online. For me I basically follow along with a few “show redundancy status” commands issued at various times as well as the console output of course.
As soon as you reinsert the SUP you will notice the first thing is it will be “At BIOS”:
NXD02# sh redundancy status
Redundancy mode
---------------
administrative: HA
operational: None
This supervisor (sup-5)
-----------------------
Redundancy state: Active
Supervisor state: Active
Internal state: Active with no standby
Other supervisor (sup-6)
------------------------
Redundancy state: At BIOS
Supervisor state: N/A
Internal state: N/A
Then the SUP is going to initialize:
NXD02# sh redundancy status
Redundancy mode
---------------
administrative: HA
operational: None
This supervisor (sup-5)
-----------------------
Redundancy state: Active
Supervisor state: Active
Internal state: Active with no standby
Other supervisor (sup-6)
------------------------
Redundancy state: Initializing
Supervisor state: N/A
Internal state: N/A
Right after that you should see “assuming your consoled in of course”:
2011 Apr 4 09:16:31 NXD02 %SYSMGR-2-ACTIVE_LOWER_MEM_THAN_STANDBY: Active supervisor in slot 5 is running with less memory than standby supervisor in slot 6.
2011 Apr 4 09:17:12 NXD02 %IDEHSD-STANDBY-2-MOUNT: slot0: online
2011 Apr 4 09:17:20 NXD02 %BOOTVAR-5-NEIGHBOR_UPDATE_AUTOCOPY: auto-copy supported by neighbor supervisor, starting...
Now the SUP is up and it will begin sync’ing with Active SUP:
NXD02# sh redundancy status
Redundancy mode
---------------
administrative: HA
operational: None
This supervisor (sup-5)
-----------------------
Redundancy state: Active
Supervisor state: Active
Internal state: Active with HA standby
Other supervisor (sup-6)
------------------------
Redundancy state: Standby
Supervisor state: HA standby
Internal state: HA synchronization in progress
Once the sync is complete the SUP should be ready in standby mode. You should see this within the console session:
2011 Apr 4 09:18:24 NXD02 %MODULE-5-STANDBY_SUP_OK: Supervisor 6 is standby
You can also confirm the status yourself:
NXD02# sh redundancy status
Redundancy mode
---------------
administrative: HA
operational: HA
This supervisor (sup-5)
-----------------------
Redundancy state: Active
Supervisor state: Active
Internal state: Active with HA standby
Other supervisor (sup-6)
------------------------
Redundancy state: Standby
Supervisor state: HA standby
Internal state: HA standby
Once things have settled and the SUP is back online and is in sync with the Active SUP your going to want to do a “system switchover” which will now make your Standby SUP (the one we just upgraded) the Active SUP.
After the switchover occurs (remember to move your console cable to the now Active SUP) you can check the system resources and confirm that you now have your 8GB of memory.
NXD02# sh system resources
Load average: 1 minute: 0.94 5 minutes: 1.49 15 minutes: 0.85
Processes : 329 total, 1 running
CPU states : 2.0% user, 3.0% kernel, 95.0% idle
Memory usage: 8254672K total, 1560576K used, 6694096K free
Well there you have it. Your Nexus 7010 is now running and active on the upgraded SUP and you’ve got your 8GB of memory installed.
Now you can move on to upgrading the second (now standby SUP) as well.
Good luck!