Device names changed after replacing disk

[turdburglar]

I have a system containing two identical HBAs with 8 SAS (SATA) ports each. On the first controller, I have four 2TB drives (ports 0-3) and four 3TB drives (ports 4-7). On the second controller, there are two additional 3TB drives (ports 0-1). The first group of four 2TB drives is a raidz1; the six 3TB drives are a raidz2.

Before I did anything, the device names were exactly in order. The boot drive identified as da0, the raidz1 was da1-da4, and the raidz2 was da5-da10. Then I replaced what was da3 by executing zpool <pool> replace da3 (or something similar). Everything seemed OK and the resilver started; however, the device names are no longer in order. What was da4 became da3 and the 3TB drives on the first controller are now da4-da7 (da9 and da10 on the second controller are the same). The replaced 2TB drive now shows as da8.

Code: Select all

  pool: zpool1
 state: ONLINE
  scan: none requested
config:

	NAME        STATE     READ WRITE CKSUM
	pool        ONLINE       0     0     0
	  raidz2-0  ONLINE       0     0     0
	    da4     ONLINE       0     0     0
	    da5     ONLINE       0     0     0
	    da6     ONLINE       0     0     0
	    da7     ONLINE       0     0     0
	    da9     ONLINE       0     0     0
	    da10    ONLINE       0     0     0

errors: No known data errors

  pool: zpool2
 state: ONLINE
  scan: resilvered 219G in 1h12m with 0 errors on Tue Jan 20 18:45:16 2015
config:

	NAME        STATE     READ WRITE CKSUM
	tank        ONLINE       0     0     0
	  raidz1-0  ONLINE       0     0     0
	    da1     ONLINE       0     0     0
	    da2     ONLINE       0     0     0
	    da8     ONLINE       0     0     0
	    da3     ONLINE       0     0     0

errors: No known data errors

I've tried everything I can think of and cannot get the names back to the way they used to be. I even unplugged the drives, reinstalled NAS4Free, and plugged the drives in in the order they should be named. After importing the pools, everything changed back.

Version info:
9.3.0.2 - Nayla (revision 1310)
FreeBSD Revision: 199506
FreeBSD 9.3-RELEASE-p8 #0 r277306M: Sat Jan 17 21:53:14 CET 2015

[b0ssman]

the order does not matter