Segmentation Fault in signer when using hsm

Facing segmentation fault in signer when using hsm (mostly when closing hsm).

(gdb) bt
#0 _GI__libc_free (mem=0x84d6030001c12003) at malloc.c:2929
#1 0x00007f41985df9a6 in SoftSlot::~SoftSlot (this=0x24a90c0, __in_chrg=<optimized out>) at SoftSlot.cpp:54
#2 0x00007f41985de58e in SoftHSMInternal::~SoftHSMInternal (this=0x2490f40, __in_chrg=<optimized out>) at SoftHSMInternal.cpp:86
#3 0x00007f41985d743e in reset (__p=<optimized out>, this=<optimized out>) at /usr/include/c++/4.8/backward/auto_ptr.h:244
#4 C_Finalize (pReserved=0x84d6030001c12003) at main.cpp:250
#5 0x0000000000447b5b in hsm_session_close (ctx=0x249ca00, session=0x2766d00, unload=1) at libhsm.c:730
#6 0x0000000000447bfc in hsm_ctx_close (ctx=0x249ca00, unload=1) at libhsm.c:754
#7 0x000000000044b23a in hsm_close () at libhsm.c:2405
#8 0x000000000041e15f in lhsm_check_connection (engine=0x2487600) at hsm.c:100
#9 0x0000000000416130 in worker_perform_task (worker=0x2492a60) at daemon/worker.c:334
#10 0x0000000000416dbf in worker_work (worker=0x2492a60) at daemon/worker.c:585
#11 0x0000000000417899 in worker_start (worker=0x2492a60) at daemon/worker.c:745
#12 0x000000000041238c in worker_thread_start (arg=0x2492a60) at daemon/engine.c:347
#13 0x00007f419ac1d182 in start_thread (arg=0x7f418b3a8700) at pthread_create.c:312