|
|
c2d36b |
# Problem #1: Multiple IB fabrics needing a subnet manager
|
|
|
c2d36b |
#
|
|
|
c2d36b |
# In the event that a machine has more than one IB subnet attached,
|
|
|
c2d36b |
# and that machine is an opensm server, by default, opensm will
|
|
|
c2d36b |
# only attach to one port and will not manage the fabric on the
|
|
|
c2d36b |
# other port. There are two ways to solve this problem:
|
|
|
c2d36b |
#
|
|
|
c2d36b |
# 1) Start opensm on multiple machines and configure it to manage
|
|
|
c2d36b |
# different fabrics on each machine
|
|
|
c2d36b |
# 2) Configure opensm to start multiple instances on a single
|
|
|
c2d36b |
# machine
|
|
|
c2d36b |
#
|
|
|
c2d36b |
# Both solutions to this problem require non-standard configurations.
|
|
|
c2d36b |
# In other words, you would normally have to modify /etc/rdma/opensm.conf
|
|
|
c2d36b |
# and once you do that, the file will no longer be updated for new
|
|
|
c2d36b |
# options when opensm is upgraded. In an effort to allow people to
|
|
|
c2d36b |
# have more than one subnet managed by opensm without having to modify
|
|
|
c2d36b |
# the system default opensm.conf file, we have enabled two methods
|
|
|
c2d36b |
# for modifying the default opensm config items needed to enable
|
|
|
c2d36b |
# multiple fabric management.
|
|
|
c2d36b |
#
|
|
|
c2d36b |
# Method #1: Create multiple opensm.conf files in non-standard locations
|
|
|
c2d36b |
# Copy /etc/rdma/opensm.conf to /etc/rdma/opensm.conf.<number>
|
|
|
c2d36b |
# (do this once for each instance you want started)
|
|
|
c2d36b |
# Edit each copy of the opensm.conf file to reflect the necessary changes
|
|
|
c2d36b |
# for a multiple instance startup. If you need to manage more than
|
|
|
c2d36b |
# one fabric, you will have to change the guid option in each file
|
|
|
c2d36b |
# to specify the guid of the specific port you want opensm attached
|
|
|
c2d36b |
# to.
|
|
|
c2d36b |
#
|
|
|
c2d36b |
# The advantage to method #1 is that, on the off chance you want to do
|
|
|
c2d36b |
# really special custom things on different ports, like have different
|
|
|
c2d36b |
# QoS settings depending on which port you are attached to, you have the
|
|
|
c2d36b |
# freedom to edit any and all settings for each instance without those
|
|
|
c2d36b |
# changes affecting other instances or being lost when opensm upgrades.
|
|
|
c2d36b |
#
|
|
|
c2d36b |
# Method #2: Specify multiple GUIDS variable entries in this file
|
|
|
c2d36b |
# Uncomment the below GUIDS variable and enter each guid you need to attach
|
|
|
c2d36b |
# to into the list. If using this method you need to enter each
|
|
|
c2d36b |
# guid into the list as we won't attach to any default ports, only
|
|
|
c2d36b |
# those specified in the list.
|
|
|
c2d36b |
#
|
|
|
c2d36b |
#GUIDS="0x0002c90300048ca1 0x0002c90300048ca2"
|
|
|
c2d36b |
#
|
|
|
c2d36b |
# The obvious advantage to method #2 is that it's simple and doesn't
|
|
|
c2d36b |
# clutter up your file system, but it is far more limited in what you
|
|
|
c2d36b |
# can do. If you enable method #2, then even if you create the files
|
|
|
c2d36b |
# referenced in method #1, they will be ignored.
|
|
|
c2d36b |
#
|
|
|
c2d36b |
# Problem #2: Activating a backup subnet manager
|
|
|
c2d36b |
#
|
|
|
c2d36b |
# The default priority of opensm is set so that it wants to be the
|
|
|
c2d36b |
# primary subnet manager. This is great when you are only running
|
|
|
c2d36b |
# opensm on one server, but if you want to have a non-primary opensm
|
|
|
c2d36b |
# instance for failover, then you have to manually edit the opensm.conf
|
|
|
c2d36b |
# file like for problem #1. This carries with it all the problems
|
|
|
c2d36b |
# listed above. If you wish to enable opensm as a non-primary manager,
|
|
|
c2d36b |
# then you can uncomment the PRIORITY variable below and set it to
|
|
|
c2d36b |
# some number between 0 and 15, where 15 is the highest priority and
|
|
|
c2d36b |
# the primary manager, with 0 being the lowest backup server. This method
|
|
|
c2d36b |
# will work with the GUIDS option above, and also with the multiple
|
|
|
c2d36b |
# config files in method #1 above. However, only a single priority is
|
|
|
c2d36b |
# supported here. If you wanted more than one priority (say this machine
|
|
|
c2d36b |
# is the primary on the first fabric, and second on the second fabric,
|
|
|
c2d36b |
# while the other opensm server is primary on the second fabric and
|
|
|
c2d36b |
# second on the primary), then the only way to do that is to use method #1
|
|
|
c2d36b |
# above and individually edit the config files. If you edit the config
|
|
|
c2d36b |
# files to set the priority and then also set the priority here, then
|
|
|
c2d36b |
# this setting will override the config files and render that particular
|
|
|
c2d36b |
# edit useless.
|
|
|
c2d36b |
#
|
|
|
c2d36b |
#PRIORITY=15
|