Hello again everyone,
I'm getting very close to getting VDDK to work with advanced mode SAN on Ubuntu 10.04. I think the error I'm getting now may or may not be related to VDDK, but I'm not sure. Perhaps someone that knows more about Fibre Channel could help me out.
When I call VixDiskLib_Open I get the following from the logs:
[2011-05-23 10:04:39,841][DEBUG ] backup.backup:158 VixDiskLib: Trying to open disk [System-Disk] puppetTestAppServer/puppetTestAppServer.vmdk using mode san.
[2011-05-23 10:04:39,842][DEBUG ] backup.backup:158 SAN: Starting.
[2011-05-23 10:04:39,842][DEBUG ] backup.backup:158 SAN: Received valid san token arg.
[2011-05-23 10:04:39,842][DEBUG ] backup.backup:158 SAN: Attempting server connect.
[2011-05-23 10:04:40,066][DEBUG ] backup.backup:158 diskLibPlugin: [2011-05-23 10:04:40.066 7FB0AFB63700 error 'DiskLibPlugin'] No path to device LVID:4c59969d-188ea5f0-ef3c-001b7879ac2a/4c572ff4-b5eccc10-1bad-001b7879ac2a/1 found.
[2011-05-23 10:04:40,066][DEBUG ] backup.backup:158 diskLibPlugin: [2011-05-23 10:04:40.066 7FB0AFB63700 error 'DiskLibPlugin'] Failed to open new LUN LVID:4c59969d-188ea5f0-ef3c-001b7879ac2a/4c572ff4-b5eccc10-1bad-001b7879ac2a/1.
[2011-05-23 10:04:40,084][DEBUG ] backup.backup:158 diskLibPlugin: [2011-05-23 10:04:40.084 7FB0AFB63700 error 'BlockList']
[2011-05-23 10:04:40,096][DEBUG ] backup.backup:158 SAN: Cannot access a SAN/iSCSI LUN backing this virtual disk. (Hint: If you are using vcbMounter you can use the option "-m nbd" to switch to network based disk access if this is what you want.) If you were attempting file-level access, stop the vmount Service by typing "net stop vmount2" on a command prompt to force vmount to re-scan for SAN LUNs and re-try the command.
[2011-05-23 10:04:40,096][DEBUG ] backup.backup:158 DISKLIB-LINK : "san://1120-snapshot-66[System-Disk] puppetTestAppServer/puppetTestAppServer.vmdk@ks-prod-esx-01.vm.kingsolutions.local?root/XXX" : failed to open (You do not have access rights to this file).
[2011-05-23 10:04:40,097][DEBUG ] backup.backup:158 DISKLIB-CHAIN : "san://1120-snapshot-66[System-Disk] puppetTestAppServer/puppetTestAppServer.vmdk@ks-prod-esx-01.vm.kingsolutions.local?root/XXX" : failed to open (You do not have access rights to this file).
[2011-05-23 10:04:40,097][DEBUG ] backup.backup:158 DISKLIB-LIB : Failed to open 'san://1120-snapshot-66[System-Disk] puppetTestAppServer/puppetTestAppServer.vmdk@ks-prod-esx-01.vm.kingsolutions.local?root/XXX' with flags 0x1e You do not have access rights to this file (3390).
[2011-05-23 10:04:40,097][ERROR ] backup.process:181 An error occured while processing puppetTestAppServer
VixDiskLibError: [13] You do not have access rights to this file
Here are the stats on the server:
Processor : 2x Intel(R) Xeon(R) CPU 5150 @ 2.66GHz
Memory : 3924MB (3331MB used)
Operating System : Ubuntu 10.04.2 LTS
Kernel : Linux 2.6.38.2-candela (x86_64)
Compiled : #1 SMP Tue Mar 29 16:52:38 CDT 2011
C Library : GNU C Library version 2.11.1 (stable)
Default C Compiler : GNU C Compiler version 4.4.3 (Ubuntu 4.4.3-4ubuntu5)
# lspci | grep QLogic
06:00.0 Fibre Channel: QLogic Corp. ISP2432-based 4Gb Fibre Channel to PCI Express HBA (rev 03)
0f:00.0 Fibre Channel: QLogic Corp. ISP2432-based 4Gb Fibre Channel to PCI Express HBA (rev 02)
# cat /etc/multipath.conf
defaults {
user_friendly_names yes
path_grouping_policy group_by_serial
path_checker tur
}
devnode_blacklist {
devnode "^(ram|raw|loop|fd|md|dm-|sr|scd|st)[0-9]*"
devnode "^cciss!c[0-9]d[0-9]*"
# devnode "*"
}
devices {
device {
vendor "Pillar "
product "Axiom 300 "
getuid_callout "/lib/udev/scsi_id -g -u --device=/dev/%n"
prio_callout "/sbin/mpath_prio_alua %n"
features "0"
hardware_handler "0"
path_grouping_policy group_by_prio
rr_weight priorities
rr_min_io 10000
failback immediate
path_checker tur no_path_retry queue
}
}
# multipath -ll
mpath2 (2000b08002c002436) dm-6 Pillar ,Axiom 300
[size=2.0T][features=0][hwhandler=0]
\_ round-robin 0 [prio=520][active]
\_ 0:0:0:3 sdc 8:32 [active][ready]
\_ 0:0:3:3 sdag 66:0 [active][ready]
\_ 3:0:1:3 sdba 67:64 [active][ready]
\_ 3:0:2:3 sdbk 67:224 [active][ready]
\_ round-robin 0 [prio=40][enabled]
\_ 0:0:1:3 sdm 8:192 [active][ready]
\_ 0:0:2:3 sdw 65:96 [active][ready]
\_ 3:0:0:3 sdaq 66:160 [active][ready]
\_ 3:0:3:3 sdbu 68:128 [active][ready]
mpath1 (2000b080033002436) dm-10 Pillar ,Axiom 300
[size=1.5T][features=0][hwhandler=0]
\_ round-robin 0 [prio=40][enabled]
\_ 0:0:1:1 sdl 8:176 [active][ready]
\_ 0:0:2:1 sdv 65:80 [active][ready]
\_ 3:0:0:1 sdap 66:144 [active][ready]
\_ 3:0:3:1 sdbt 68:112 [active][ready]
\_ round-robin 0 [prio=520][active]
\_ 0:0:0:1 sdb 8:16 [active][ready]
\_ 0:0:3:1 sdaf 65:240 [active][ready]
\_ 3:0:1:1 sdaz 67:48 [active][ready]
\_ 3:0:2:1 sdbj 67:208 [active][ready]
mpath0 (2000b080031002436) dm-13 Pillar ,Axiom 300
[size=2.0T][features=0][hwhandler=0]
\_ round-robin 0 [prio=40][enabled]
\_ 0:0:0:0 sda 8:0 [active][ready]
\_ 0:0:3:0 sdae 65:224 [active][ready]
\_ 3:0:1:0 sday 67:32 [active][ready]
\_ 3:0:2:0 sdbi 67:192 [active][ready]
\_ round-robin 0 [prio=520][active]
\_ 0:0:1:0 sdk 8:160 [active][ready]
\_ 0:0:2:0 sdu 65:64 [active][ready]
\_ 3:0:0:0 sdao 66:128 [active][ready]
\_ 3:0:3:0 sdbs 68:96 [active][ready]
mpath9 (2000b080021002436) dm-11 Pillar ,Axiom 300
[size=2.0T][features=0][hwhandler=0]
\_ round-robin 0 [prio=40][enabled]
\_ 0:0:0:20 sdj 8:144 [active][ready]
\_ 0:0:3:20 sdan 66:112 [active][ready]
\_ 3:0:1:20 sdbh 67:176 [active][ready]
\_ 3:0:2:20 sdbr 68:80 [active][ready]
\_ round-robin 0 [prio=520][active]
\_ 0:0:1:20 sdt 65:48 [active][ready]
\_ 0:0:2:20 sdad 65:208 [active][ready]
\_ 3:0:0:20 sdax 67:16 [active][ready]
\_ 3:0:3:20 sdcb 68:240 [active][ready]
mpath8 (2000b080030002436) dm-5 Pillar ,Axiom 300
[size=2.0T][features=0][hwhandler=0]
\_ round-robin 0 [prio=40][enabled]
\_ 0:0:0:10 sdi 8:128 [active][ready]
\_ 0:0:3:10 sdam 66:96 [active][ready]
\_ 3:0:1:10 sdbg 67:160 [active][ready]
\_ 3:0:2:10 sdbq 68:64 [active][ready]
\_ round-robin 0 [prio=520][active]
\_ 0:0:1:10 sds 65:32 [active][ready]
\_ 0:0:2:10 sdac 65:192 [active][ready]
\_ 3:0:0:10 sdaw 67:0 [active][ready]
\_ 3:0:3:10 sdca 68:224 [active][ready]
mpath7 (2000b08002a002436) dm-1 Pillar ,Axiom 300
[size=385G][features=0][hwhandler=0]
\_ round-robin 0 [prio=520][active]
\_ 0:0:1:9 sdr 65:16 [active][ready]
\_ 0:0:2:9 sdab 65:176 [active][ready]
\_ 3:0:0:9 sdav 66:240 [active][ready]
\_ 3:0:3:9 sdbz 68:208 [active][ready]
\_ round-robin 0 [prio=40][enabled]
\_ 0:0:0:9 sdh 8:112 [active][ready]
\_ 0:0:3:9 sdal 66:80 [active][ready]
\_ 3:0:1:9 sdbf 67:144 [active][ready]
\_ 3:0:2:9 sdbp 68:48 [active][ready]
mpath6 (2000b08002e002436) dm-2 Pillar ,Axiom 300
[size=2.0T][features=0][hwhandler=0]
\_ round-robin 0 [prio=520][active]
\_ 0:0:1:8 sdq 65:0 [failed][ready]
\_ 0:0:2:8 sdaa 65:160 [active][ready]
\_ 3:0:0:8 sdau 66:224 [active][ready]
\_ 3:0:3:8 sdby 68:192 [active][ready]
\_ round-robin 0 [prio=40][enabled]
\_ 0:0:0:8 sdg 8:96 [active][ready]
\_ 0:0:3:8 sdak 66:64 [active][ready]
\_ 3:0:1:8 sdbe 67:128 [active][ready]
\_ 3:0:2:8 sdbo 68:32 [active][ready]
mpath5 (2000b080034002436) dm-7 Pillar ,Axiom 300
[size=500G][features=0][hwhandler=0]
\_ round-robin 0 [prio=40][enabled]
\_ 0:0:1:7 sdp 8:240 [active][ready]
\_ 0:0:2:7 sdz 65:144 [active][ready]
\_ 3:0:0:7 sdat 66:208 [active][ready]
\_ 3:0:3:7 sdbx 68:176 [active][ready]
\_ round-robin 0 [prio=520][active]
\_ 0:0:0:7 sdf 8:80 [active][ready]
\_ 0:0:3:7 sdaj 66:48 [active][ready]
\_ 3:0:1:7 sdbd 67:112 [active][ready]
\_ 3:0:2:7 sdbn 68:16 [active][ready]
mpath4 (2000b08002f002436) dm-16 Pillar ,Axiom 300
[size=1.5T][features=0][hwhandler=0]
\_ round-robin 0 [prio=40][enabled]
\_ 0:0:1:6 sdo 8:224 [active][ready]
\_ 0:0:2:6 sdy 65:128 [active][ready]
\_ 3:0:0:6 sdas 66:192 [active][ready]
\_ 3:0:3:6 sdbw 68:160 [active][ready]
\_ round-robin 0 [prio=520][active]
\_ 0:0:0:6 sde 8:64 [active][ready]
\_ 0:0:3:6 sdai 66:32 [active][ready]
\_ 3:0:1:6 sdbc 67:96 [active][ready]
\_ 3:0:2:6 sdbm 68:0 [active][ready]
mpath3 (2000b080001002436) dm-14 Pillar ,Axiom 300
[size=1.0T][features=0][hwhandler=0]
\_ round-robin 0 [prio=520][active]
\_ 0:0:0:5 sdd 8:48 [active][ready]
\_ 0:0:3:5 sdah 66:16 [active][ready]
\_ 3:0:1:5 sdbb 67:80 [active][ready]
\_ 3:0:2:5 sdbl 67:240 [active][ready]
\_ round-robin 0 [prio=40][enabled]
\_ 0:0:1:5 sdn 8:208 [active][ready]
\_ 0:0:2:5 sdx 65:112 [active][ready]
\_ 3:0:0:5 sdar 66:176 [active][ready]
\_ 3:0:3:5 sdbv 68:144 [active][ready]
# sg_map -x
/dev/sg0 1 0 0 0 5 /dev/scd0
/dev/sg1 0 0 0 0 0 /dev/sda
/dev/sg2 0 0 0 1 0 /dev/sdb
/dev/sg3 0 0 0 3 0 /dev/sdc
/dev/sg4 0 0 0 5 0 /dev/sdd
/dev/sg5 0 0 0 6 0 /dev/sde
/dev/sg6 0 0 0 7 0 /dev/sdf
/dev/sg7 0 0 0 8 0 /dev/sdg
/dev/sg8 0 0 0 9 0 /dev/sdh
/dev/sg9 0 0 0 10 0 /dev/sdi
/dev/sg10 0 0 0 20 0 /dev/sdj
/dev/sg11 0 0 1 0 0 /dev/sdk
/dev/sg12 0 0 1 1 0 /dev/sdl
/dev/sg13 0 0 1 3 0 /dev/sdm
/dev/sg14 0 0 1 5 0 /dev/sdn
/dev/sg15 0 0 1 6 0 /dev/sdo
/dev/sg16 0 0 1 7 0 /dev/sdp
/dev/sg17 0 0 1 8 0 /dev/sdq
/dev/sg18 0 0 1 9 0 /dev/sdr
/dev/sg19 0 0 1 10 0 /dev/sds
/dev/sg20 0 0 1 20 0 /dev/sdt
/dev/sg21 0 0 2 0 0 /dev/sdu
/dev/sg22 0 0 2 1 0 /dev/sdv
/dev/sg23 0 0 2 3 0 /dev/sdw
/dev/sg24 0 0 2 5 0 /dev/sdx
/dev/sg25 0 0 2 6 0 /dev/sdy
/dev/sg26 0 0 2 7 0 /dev/sdz
/dev/sg27 0 0 2 8 0 /dev/sdaa
/dev/sg28 0 0 2 9 0 /dev/sdab
/dev/sg29 0 0 2 10 0 /dev/sdac
/dev/sg30 0 0 2 20 0 /dev/sdad
/dev/sg31 0 0 3 0 0 /dev/sdae
/dev/sg32 0 0 3 1 0 /dev/sdaf
/dev/sg33 0 0 3 3 0 /dev/sdag
/dev/sg34 0 0 3 5 0 /dev/sdah
/dev/sg35 0 0 3 6 0 /dev/sdai
/dev/sg36 0 0 3 7 0 /dev/sdaj
/dev/sg37 0 0 3 8 0 /dev/sdak
/dev/sg38 0 0 3 9 0 /dev/sdal
/dev/sg39 0 0 3 10 0 /dev/sdam
/dev/sg40 0 0 3 20 0 /dev/sdan
/dev/sg41 3 0 0 0 0 /dev/sdao
/dev/sg42 3 0 0 1 0 /dev/sdap
/dev/sg43 3 0 0 3 0 /dev/sdaq
/dev/sg44 3 0 0 5 0 /dev/sdar
/dev/sg45 3 0 0 6 0 /dev/sdas
/dev/sg46 3 0 0 7 0 /dev/sdat
/dev/sg47 3 0 0 8 0 /dev/sdau
/dev/sg48 3 0 0 9 0 /dev/sdav
/dev/sg49 3 0 0 10 0 /dev/sdaw
/dev/sg50 3 0 0 20 0 /dev/sdax
/dev/sg51 3 0 1 0 0 /dev/sday
/dev/sg52 3 0 1 1 0 /dev/sdaz
/dev/sg53 3 0 1 3 0 /dev/sdba
/dev/sg54 3 0 1 5 0 /dev/sdbb
/dev/sg55 3 0 1 6 0 /dev/sdbc
/dev/sg56 3 0 1 7 0 /dev/sdbd
/dev/sg57 3 0 1 8 0 /dev/sdbe
/dev/sg58 3 0 1 9 0 /dev/sdbf
/dev/sg59 3 0 1 10 0 /dev/sdbg
/dev/sg60 3 0 1 20 0 /dev/sdbh
/dev/sg61 3 0 2 0 0 /dev/sdbi
/dev/sg62 3 0 2 1 0 /dev/sdbj
/dev/sg63 3 0 2 3 0 /dev/sdbk
/dev/sg64 3 0 2 5 0 /dev/sdbl
/dev/sg65 3 0 2 6 0 /dev/sdbm
/dev/sg66 3 0 2 7 0 /dev/sdbn
/dev/sg67 3 0 2 8 0 /dev/sdbo
/dev/sg68 3 0 2 9 0 /dev/sdbp
/dev/sg69 3 0 2 10 0 /dev/sdbq
/dev/sg70 3 0 2 20 0 /dev/sdbr
/dev/sg71 3 0 3 0 0 /dev/sdbs
/dev/sg72 3 0 3 1 0 /dev/sdbt
/dev/sg73 3 0 3 3 0 /dev/sdbu
/dev/sg74 3 0 3 5 0 /dev/sdbv
/dev/sg75 3 0 3 6 0 /dev/sdbw
/dev/sg76 3 0 3 7 0 /dev/sdbx
/dev/sg77 3 0 3 8 0 /dev/sdby
/dev/sg78 3 0 3 9 0 /dev/sdbz
/dev/sg79 3 0 3 10 0 /dev/sdca
/dev/sg80 3 0 3 20 0 /dev/sdcb
Any ideas why I might be getting this error?
Any help would be appreciated!