Panic when deleting a bucket while I have an open connection

panic: Received a configuration with a different number of vbuckets.

goroutine 184 [running]:
runtime.gopanic(0x4371580, 0xc8204beb20)
/usr/local/Cellar/go/1.5/libexec/src/runtime/panic.go:461 +0x3e6 fp=0xc8206cb5a8 sp=0xc8206cb528
github.com/mikewied/gocb/gocbcore.(*Agent).applyConfig(0xc8200fc380, 0xc820103680)
/Users/mikewied/open_source/go_workspace/src/github.com/mikewied/gocb/gocbcore/agentrouting.go:240 +0xc2 fp=0xc8206cb988 sp=0xc8206cb5a8
github.com/mikewied/gocb/gocbcore.(*Agent).updateConfig(0xc8200fc380, 0xc8205ed200)
/Users/mikewied/open_source/go_workspace/src/github.com/mikewied/gocb/gocbcore/agentrouting.go:386 +0xcc fp=0xc8206cb9c0 sp=0xc8206cb988
github.com/mikewied/gocb/gocbcore.(*Agent).httpLooper(0xc8200fc380, 0xc8203f2220)
/Users/mikewied/open_source/go_workspace/src/github.com/mikewied/gocb/gocbcore/agenthttpcfg.go:144 +0x16cc fp=0xc8206cbf80 sp=0xc8206cb9c0
runtime.goexit()
/usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc8206cbf88 sp=0xc8206cbf80
created by github.com/mikewied/gocb/gocbcore.(*Agent).connect
/Users/mikewied/open_source/go_workspace/src/github.com/mikewied/gocb/gocbcore/agent.go:246 +0xb8f

I'm pretty sure that this is happening because I am deleting a bucket while the client is still connected to it and ns_server is sending a vbucket map with no vbuckets before the connection is disconnected.