Unable to start gluster daemon after failover in Red Hat Gluster Storage 3.0 ?

Issue

• Problem with starting gluster daemon after failover

• Glusterd service was unable to start on one node after testing disaster recovery

~Snippet from cli logs,

[2015-06-02 19:00:02.610533] T [cli.c:264:cli_rpc_notify] 0-glusterfs: got RPC_CLNT_CONNECT
[2015-06-02 19:00:02.610599] W [socket.c:530:__socket_rwv] 0-glusterfs: readv on /var/run/glusterd.socket failed (Invalid argument)
[2015-06-02 19:00:02.610628] T [rpc-clnt.c:1381:rpc_clnt_record] 0-glusterfs: Auth Info: pid: 0, uid: 0, gid: 0, owner:
[2015-06-02 19:00:02.610655] D [socket.c:2263:socket_event_handler] 0-transport: disconnecting now
[2015-06-02 19:00:02.610704] T [rpc-clnt.c:1238:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 72, payload: 8, rpc hdr: 64
[2015-06-02 19:00:02.610726] T [socket.c:2740:socket_connect] 0-glusterfs: connecting 0xa96c00, state=0 gen=0 sock=-1
[2015-06-02 19:00:02.610760] T [name.c:290:af_unix_client_get_remote_sockaddr] 0-glusterfs: using connect-path /var/run/glusterd.socket
[2015-06-02 19:00:02.610812] T [name.c:106:af_unix_client_bind] 0-glusterfs: bind-path not specified for unix socket, letting connect to assign default value
[2015-06-02 19:00:02.610856] D [socket.c:2869:socket_connect] 0-glusterfs: connection attempt on /var/run/glusterd.socket failed, (Connection refused)
[2015-06-02 19:00:02.610877] I [socket.c:3149:socket_submit_request] 0-glusterfs: not connected (priv->connected = 0)
[2015-06-02 19:00:02.610884] W [rpc-clnt.c:1562:rpc_clnt_submit] 0-glusterfs: failed to submit rpc-request (XID: 0x1 Program: Gluster CLI, ProgVers: 2, Proc: 3) to rpc-transport (glusterfs)
[2015-06-02 19:00:02.610925] T [cli.c:270:cli_rpc_notify] 0-glusterfs: got RPC_CLNT_DISCONNECT

~Snippet from glusterd log,

[2015-06-02 19:00:11.734467] I [glusterd-handler.c:3185:glusterd_friend_add] 0-management: connect returned 0
[2015-06-02 19:00:11.735228] D [store.c:418:gf_store_handle_new] 0-: Returning 0
[2015-06-02 19:00:11.735240] D [store.c:437:gf_store_handle_retrieve] 0-: Returning 0
[2015-06-02 19:00:11.735248] D [store.c:499:gf_store_iter_new] 0-: Returning with 0
[2015-06-02 19:00:11.735258] D [store.c:608:gf_store_iter_get_next] 0-: Returning with -1
[2015-06-02 19:00:11.735265] D [glusterd-store.c:4093:glusterd_store_retrieve_peers] 0-: Returning with -1
[2015-06-02 19:00:11.735270] D [glusterd-store.c:4308:glusterd_restore] 0-: Returning -1
[2015-06-02 19:00:11.735280] E [xlator.c:406:xlator_init] 0-management: Initialization of volume 'management' failed, review your volfile again
[2015-06-02 19:00:11.735288] E [graph.c:322:glusterfs_graph_init] 0-management: initializing translator failed
[2015-06-02 19:00:11.735293] E [graph.c:525:glusterfs_graph_activate] 0-graph: init failed
[2015-06-02 19:00:11.735509] D [logging.c:1805:gf_log_flush_extra_msgs] 0-logging-infra: Log buffer size reduced. About to flush 3 extra log messages
[2015-06-02 19:00:11.735525] D [logging.c:1808:gf_log_flush_extra_msgs] 0-logging-infra: Just flushed 3 extra log messages
[2015-06-02 19:00:11.735736] W [glusterfsd.c:1182:cleanup_and_exit] (--> 0-: received signum (0), shutting down
[2015-06-02 19:00:11.735761] D [glusterfsd-mgmt.c:2244:glusterfs_mgmt_pmap_signout] 0-fsd-mgmt: portmapper signout arguments not given