Skip to Content

MaxDB - crashes when there is load on the system or a data-file is created

Hello,

i have a problem with my MaxDB-Installation (DB for SolMan 7.2).

Every time when the DB tries to create a datafile or if there's some load on the SAP-System,

the MaxDB (Ver 7.9.09.06)crashes with the following error:

----

Thread 0x13D8 Task 5 2018-03-01 07:01:19 ERR DataCache 7: Fatal error occur during asynchronous IO acknowledgement,TEXT=failed,_FILE=vbd20+noPIC.cpp,_LINE=4036
2018-03-01 07:01:19 ERR RTEIO 31: Synchronous write to DATA_VOLUME_0008 on /sapdb/S72/sapdata/DISKD0008 returned 'File exists' (17),_FILE=RTEIO_Volume+noPIC.cpp,_LINE=1555
2018-03-01 07:01:19 RTEIO 0: page number : 29168
2018-03-01 07:01:19 RTEIO 0: position : 238952448 bytes
2018-03-01 07:01:19 RTEIO 0: wanted length : 24576 bytes
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: ----> Emergency stack backtrace <----
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: Using 'backtrace' for stack tracing
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: (0):0x000000000171824f
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: (1):0x0000000001529d8f
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: (2):0x000000000178c23f
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: (3):0x0000000000a2a992
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: (4):0x0000000000a20287
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: (5):0x0000000000a20371
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: (6):0x0000000000a1c4bb
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: (7):0x0000000000a209bf
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: (8):0x0000000000ddf085
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: (9):0x0000000001446385
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: (10):0x0000000001447b6f
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: (11):0x00000000014494aa
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: (12):0x00000000014deff0
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: (13):0x000000000170a78c
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: (14):0x00007f76ce16b310
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: ----> Symbolic stack backtrace <----
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: 0: RTEDiag_CallStack::TraceStackSymbolic(RTEDiag_RegisterSet const*) + 0x42
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: Symbol: _ZN17RTEDiag_CallStack18TraceStackSymbolicEPK19RTEDiag_RegisterSet
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: SFrame: IP: 0x0000000001718512 (0x00000000017184d0+0x42)
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: Module: /sapdb/S72/db/pgm/kernel
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: -----------------------------------------
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: 1: RTEKernel_CrashHandler::AbortHandler(RTEDiag_FaultDescriptor*, void*) + 0x1b9
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: Symbol: _ZN22RTEKernel_CrashHandler12AbortHandlerEP23RTEDiag_FaultDescriptorPv
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: SFrame: IP: 0x0000000001529d99 (0x0000000001529be0+0x1b9)
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: Module: /sapdb/S72/db/pgm/kernel
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: -----------------------------------------
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: 2: RTE_Crash(Msg_List const&) + 0x3f
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: Symbol: _Z9RTE_CrashRK8Msg_List
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: SFrame: IP: 0x000000000178c23f (0x000000000178c200+0x3f)
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: Module: /sapdb/S72/db/pgm/kernel
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: -----------------------------------------
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: 3: cbd20_DataCache::AsyncIOManager<DataCache_WriteAsyncIOContext>::CompletionPortWait(RTETask_ITask&, Msg_List&) + 0x302
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: Symbol: _ZN15cbd20_DataCache14AsyncIOManagerI29DataCache_WriteAsyncIOContextE18CompletionPortWaitER13RTETask_ITaskR8Msg_List
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: SFrame: IP: 0x0000000000a2a992 (0x0000000000a2a690+0x302)
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: Module: /sapdb/S72/db/pgm/kernel
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: -----------------------------------------
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: 4: cbd20_DataCache::AsyncWriteIOManager::Wait(RTETask_ITask&, IOMan_IDataIO&) + 0x87
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: Symbol: _ZN15cbd20_DataCache19AsyncWriteIOManager4WaitER13RTETask_ITaskR13IOMan_IDataIO
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: SFrame: IP: 0x0000000000a20287 (0x0000000000a20200+0x87)
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: Module: /sapdb/S72/db/pgm/kernel
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: -----------------------------------------
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: 5: cbd20_DataCache::AsyncWriteIOManager::GetIOContext(RTETask_ITask&, IOMan_IDataIO&) + 0x51
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: Symbol: _ZN15cbd20_DataCache19AsyncWriteIOManager12GetIOContextER13RTETask_ITaskR13IOMan_IDataIO
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: SFrame: IP: 0x0000000000a20371 (0x0000000000a20320+0x51)
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: Module: /sapdb/S72/db/pgm/kernel
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: -----------------------------------------
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: 6: cbd20_DataCache::InternClusterFlush(RTETask_ITask&, FBM_IManager&, IOMan_IDataIO&, cbd20_DataCache::IAsyncWriteIOManager&, cbd20_DataCache::Sorter&, unsigned int, unsigned int) + 0x9b
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: Symbol: _ZN15cbd20_DataCache18InternClusterFlushER13RTETask_ITaskR12FBM_IManagerR13IOMan_IDataIORNS_20IAsyncWriteIOManagerERNS_6SorterEjj
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: SFrame: IP: 0x0000000000a1c4bb (0x0000000000a1c420+0x9b)
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: Module: /sapdb/S72/db/pgm/kernel
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: -----------------------------------------
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: 7: cbd20_DataCache::FlushBeforePrepare(RTETask_ITask&, unsigned int&, unsigned int&) + 0x34f
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: Symbol: _ZN15cbd20_DataCache18FlushBeforePrepareER13RTETask_ITaskRjS2_
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: SFrame: IP: 0x0000000000a209bf (0x0000000000a20670+0x34f)
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: Module: /sapdb/S72/db/pgm/kernel
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: -----------------------------------------
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: 8: Log_Savepoint::Coordinator(Trans_Context&) + 0x3c5
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: Symbol: _ZN13Log_Savepoint11CoordinatorER13Trans_Context
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: SFrame: IP: 0x0000000000ddf085 (0x0000000000ddecc0+0x3c5)
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: Module: /sapdb/S72/db/pgm/kernel
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: -----------------------------------------
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: 9: Kernel_SavepointTask::Run() + 0x75
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: Symbol: _ZN20Kernel_SavepointTask3RunEv
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: SFrame: IP: 0x0000000001446385 (0x0000000001446310+0x75)
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: Module: /sapdb/S72/db/pgm/kernel
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: -----------------------------------------
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: 10: Kernel_NonUserTask(RTETask_ITask&, Trans_Context&, Msg_List&) + 0x38f
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: Symbol: _Z18Kernel_NonUserTaskR13RTETask_ITaskR13Trans_ContextR8Msg_List
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: SFrame: IP: 0x0000000001447b6f (0x00000000014477e0+0x38f)
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: Module: /sapdb/S72/db/pgm/kernel
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: -----------------------------------------
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: 11: Kernel_Main(RTETask_ITask&) + 0xaa
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: Symbol: _Z11Kernel_MainR13RTETask_ITask
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: SFrame: IP: 0x00000000014494aa (0x0000000001449400+0xaa)
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: Module: /sapdb/S72/db/pgm/kernel
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: -----------------------------------------
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: 12: RTETask_Task::KernelTaskMain() + 0x120
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: Symbol: _ZN12RTETask_Task14KernelTaskMainEv
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: SFrame: IP: 0x00000000014deff0 (0x00000000014deed0+0x120)
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: Module: /sapdb/S72/db/pgm/kernel
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: -----------------------------------------
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: 13: RTEExec_Coroutine::StartCoroutine(RTEExec_Coroutine*, unsigned int) + 0x42c
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: Symbol: _ZN17RTEExec_Coroutine14StartCoroutineEPS_j
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: SFrame: IP: 0x000000000170a78c (0x000000000170a360+0x42c)
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: Module: /sapdb/S72/db/pgm/kernel
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: -----------------------------------------
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: 14: __start_context + 0x0
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: SFrame: IP: 0x00007f76ce16b310 (0x00007f76ce16b310+0x0)
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR DIAG 0: Module: /lib64/libc-2.22.so
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR Messages 7: Begin of dump of registered messages,_FILE=Msg_Registry+noPIC.cpp,_LINE=507
Thread 0x13D8 Task - 2018-03-01 07:01:19 ERR RTEIO 31: Synchronous write to DATA_VOLUME_0008 on /sapdb/S72/sapdata/DISKD0008 returned 'File exists' (17),_FILE=RTEIO_Volume+noPIC.cpp,_LINE=1555
2018-03-01 07:01:19 RTEIO 0: page number : 29168
2018-03-01 07:01:19 RTEIO 0: position : 238952448 bytes
2018-03-01 07:01:19 RTEIO 0: wanted length : 24576 bytes
Thread 0x13D8 Task - 2018-03-01 07:01:19 ERR RTEIO 31: Synchronous write to DATA_VOLUME_0008 on /sapdb/S72/sapdata/DISKD0008 returned 'File exists' (17),_FILE=RTEIO_Volume+noPIC.cpp,_LINE=1555
2018-03-01 07:01:19 RTEIO 0: page number : 29168
2018-03-01 07:01:19 RTEIO 0: position : 238952448 bytes
2018-03-01 07:01:19 RTEIO 0: wanted length : 24576 bytes
Thread 0x13D8 Task - 2018-03-01 07:01:19 ERR DataCache 7: Fatal error occur during asynchronous IO acknowledgement,TEXT=failed,_FILE=vbd20+noPIC.cpp,_LINE=4036
2018-03-01 07:01:19 ERR RTEIO 31: Synchronous write to DATA_VOLUME_0008 on /sapdb/S72/sapdata/DISKD0008 returned 'File exists' (17),_FILE=RTEIO_Volume+noPIC.cpp,_LINE=1555
2018-03-01 07:01:19 RTEIO 0: page number : 29168
2018-03-01 07:01:19 RTEIO 0: position : 238952448 bytes
2018-03-01 07:01:19 RTEIO 0: wanted length : 24576 bytes
Thread 0x13D8 Task - 2018-03-01 07:01:20 ERR Messages 8: End of the message list registry dump,_FILE=Msg_Registry+noPIC.cpp,_LINE=544
Thread 0x13D8 Task - 2018-03-01 07:01:23 ERR DIAG 0: analysing LVCMem_Allocator_001
Thread 0x13D8 Task - 2018-03-01 07:01:23 ERR DIAG 0:
Thread 0x13D8 Task - 2018-03-01 07:01:23 ERR DIAG 0: no problems detected in LVCMem_Allocator_001
Thread 0x13D8 Task - 2018-03-01 07:01:23 ERR DIAG 0: analysing LVCMem_Allocator_002
Thread 0x13D8 Task - 2018-03-01 07:01:23 ERR DIAG 0:
Thread 0x13D8 Task - 2018-03-01 07:01:23 ERR DIAG 0: no problems detected in LVCMem_Allocator_002
Thread 0x13D8 Task - 2018-03-01 07:01:23 ERR DIAG 0: analysing LVCMem_Allocator_003
Thread 0x13D8 Task - 2018-03-01 07:01:23 ERR DIAG 0:
Thread 0x13D8 Task - 2018-03-01 07:01:23 ERR DIAG 0: no problems detected in LVCMem_Allocator_003
Thread 0x13D8 Task - 2018-03-01 07:01:23 ERR DIAG 0: analysing LVCMem_Allocator_004
Thread 0x13D8 Task - 2018-03-01 07:01:23 ERR DIAG 0:
Thread 0x13D8 Task - 2018-03-01 07:01:23 ERR DIAG 0: no problems detected in LVCMem_Allocator_004
Thread 0x13B5 Task - 2018-03-01 07:08:09 ERR RTEKernel 101: Kernel exited with core and exit status 0x86,_FILE=RTEKernel_Termination+noPIC.cpp,_LINE=688
Thread 0x13B5 Task - 2018-03-01 07:08:09 ERR RTEKernel 98: Kernel exited due to signal 6 (SIGABRT),_FILE=RTEKernel_Termination+noPIC.cpp,_LINE=745
Thread 0x13B5 Task - 2018-03-01 07:08:09 MsgOutput 28: ___ Stopping GMT 2018-03-01 06:08:09 7.9.09 Build 006-123-260-229

---

Does someone have a suggestion where the root cause can be or where i can find more details?

Add comment
10|10000 characters needed characters exceeded

  • Get RSS Feed

3 Answers

  • Best Answer
    Mar 02 at 04:38 AM

    This looks like OS/storeage issue when maxdb is writing data volue:

    Synchronous write to DATA_VOLUME_0008 on /sapdb/S72/sapdata/DISKD0008 returned 'File exists'

    Please check storage log to see whether there is storage error returned at the same time.
    Do you have antivirus scanner? and how the file system of maxdb data volume is mounted?

    Add comment
    10|10000 characters needed characters exceeded

  • Mar 02 at 09:47 AM

    Hi James,

    thank you for your reply.

    The Linux-system is running on an VMWare Environment and there were no log-entrys at the storage-system.

    Also there is no message on the Linux-System regarding the storage.

    The /sapdb is running on an BtrFS-Partition (primary).

    I'm thinking about to move the /sapdb Mountpoint to an XFS-Filesystem, but this will be only a shot in the dark. :)

    There is no antivirus running.

    Add comment
    10|10000 characters needed characters exceeded

  • avatar image
    Former Member
    Apr 06 at 06:06 AM

    Please update db patch to 7.9.09.07 as it contains contains many fixes related to DB crash. For more information check note: 1444241 - Feature List for SAP MaxDB 7.9


    Hope this will resolve your problem.

    Add comment
    10|10000 characters needed characters exceeded