Sep 02, 2016 at 06:10 AM

Production server is unable to startup

862 Views

Dear Team,

We have BI application on Sybase database.

We just restarted the server, but it is still in recover process of all databases (eg SID, sybmgmtdb...)

when checked the SID log, it is showing below erro

00:0000:00000:00000:2016/09/02 10:40:08.90 kernel SySAM: Using licenses from: /sybase/ABP/SYSAM-2_0/licenses/SYBASE.lic:/sybase/ABP/SYSAM-2_0/licenses/SYBASE_ASE_DE.lic

00:0000:00000:00000:2016/09/02 10:40:09.07 kernel SySAM: Checked out license for 4 ASE_CORE (2014.1231/permanent/1296 8FE3 0A83 A167).

00:0000:00000:00000:2016/09/02 10:40:09.07 kernel This product is licensed to: SAP, for use with SAP Business Applications.

00:0000:00000:00000:2016/09/02 10:40:09.07 kernel Checked out license ASE_CORE

00:0000:00000:00000:2016/09/02 10:40:09.07 kernel Adaptive Server Enterprise (Enterprise Edition)

00:0000:00000:00000:2016/09/02 10:40:09.08 kernel Using config area from primary master device.

00:0000:00000:00000:2016/09/02 10:40:09.16 kernel The value of the option 'number of engines at startup' is not set to its default. This option has no effect in threaded mode.

00:0000:00000:00000:2016/09/02 10:40:09.18 kernel SySAM: Checked out license for 4 ASE_PARTITIONS (2014.1231/permanent/1296 8FE3 0A83 A167).

00:0000:00000:00000:2016/09/02 10:40:09.18 kernel Checked out license ASE_PARTITIONS

00:0000:00000:00000:2016/09/02 10:40:09.18 kernel SySAM: Checked out license for 4 ASE_COMPRESSION (2014.1231/permanent/1296 8FE3 0A83 A167).

00:0000:00000:00000:2016/09/02 10:40:09.18 kernel Checked out license ASE_COMPRESSION

00:0000:00000:00000:2016/09/02 10:40:09.19 kernel SySAM: Checked out license for 4 ASE_ASM (2014.1231/permanent/1296 8FE3 0A83 A167).

00:0000:00000:00000:2016/09/02 10:40:09.19 kernel Checked out license ASE_ASM

00:0000:00000:00000:2016/09/02 10:40:09.28 kernel Kernel memory at 0xc000000100000000, 8589934592 bytes

00:0000:00000:00000:2016/09/02 10:40:09.28 kernel Adaptive Server is using the threaded kernel mode.

00:0000:00000:00000:2016/09/02 10:40:09.28 kernel Using 60000 file descriptors.

00:0000:00000:00000:2016/09/02 10:40:09.29 kernel Adaptive Server Enterprise/15.7/EBF 22778 SMP SP122 /P/ia64/HP-UX B.11.31/ase157sp12x/3662/64-bit/FBO/Sat Apr 19 17:40:36 2014

00:0000:00000:00000:2016/09/02 10:40:09.29 kernel Confidential property of Sybase, Inc.

00:0000:00000:00000:2016/09/02 10:40:09.29 kernel Unpublished rights reserved under U.S. copyright laws.

00:0000:00000:00000:2016/09/02 10:40:09.29 kernel

00:0000:00000:00000:2016/09/02 10:40:09.29 kernel This software contains confidential and trade secret information of Sybase,

00:0000:00000:00000:2016/09/02 10:40:09.29 kernel Inc. Use, duplication or disclosure of the software and documentation by

00:0000:00000:00000:2016/09/02 10:40:09.29 kernel the U.S. Government is subject to restrictions set forth in a license

00:0000:00000:00000:2016/09/02 10:40:09.29 kernel agreement between the Government and Sybase, Inc. or other written

00:0000:00000:00000:2016/09/02 10:40:09.29 kernel agreement specifying the Government's rights to use the software and any

00:0000:00000:00000:2016/09/02 10:40:09.29 kernel applicable FAR provisions, for example, FAR 52.227-19.

00:0000:00000:00000:2016/09/02 10:40:09.29 kernel Sybase, Inc. One Sybase Drive, Dublin, CA 94568, USA

00:0000:00000:00000:2016/09/02 10:40:09.29 kernel Using /sybase/ABP as the 'SYBASE' environment variable, found during startup.

00:0000:00000:00000:2016/09/02 10:40:09.29 kernel Using OCS-15_0 as the 'SYBASE_OCS' environment variable, found during startup.

00:0000:00000:00000:2016/09/02 10:40:09.29 kernel Using ASE-15_0 as the 'SYBASE_ASE' environment variable, found during startup.

00:0000:00000:00000:2016/09/02 10:40:09.29 kernel ASE booted on host 'AVNBIPRD' running HP-UX release B.11.31 version U.

00:0000:00000:00000:2016/09/02 10:40:09.29 kernel Using '/sybase/ABP/ASE-15_0/ABP.cfg' for configuration information.

00:0000:00000:00000:2016/09/02 10:40:09.29 kernel Logging ASE messages in file '/sybase/ABP/ASE-15_0/install/ABP.log'.

00:0000:00000:00000:2016/09/02 10:40:09.29 kernel Disk Controller Manager is online.

00:0000:00000:00000:2016/09/02 10:40:09.29 kernel Network Controller Manager is online.

00:0000:00000:00000:2016/09/02 10:40:09.29 kernel Ct-Lib Controller Manager is online.

00:0000:00000:00000:2016/09/02 10:40:09.29 kernel Platform TCP network support seems IPv6-aware, IPv4/IPv6 are both enabled.

00:0000:00000:00000:2016/09/02 10:40:09.29 kernel ASE booted with TCP_NODELAY enabled.

00:0000:00000:00000:2016/09/02 10:40:09.29 kernel Network and device connection limit is 59985.

00:0000:00000:00000:2016/09/02 10:40:09.29 kernel ASE - Dynamic Pluggable Component Interface is disabled

00:0000:00000:00000:2016/09/02 10:40:09.29 kernel Adaptive Server is running as process id 5440.

00:0000:00000:00000:2016/09/02 10:40:10.44 server Number of blocks left for proc headers: 575312.

00:0000:00000:00000:2016/09/02 10:40:10.44 server Proc header memory allocated 7191 pages for each per engine cache.

00:0000:00000:00000:2016/09/02 10:40:10.45 server Proc header memory allocated 7191 pages for engine 0 local cache

00:0000:00000:00000:2016/09/02 10:40:10.45 kernel Create Thread Pool 2, "syb_system_pool", type="Run To Completion", with 1 threads

00:0000:00000:00000:2016/09/02 10:40:10.45 kernel Create Thread Pool 1, "syb_default_pool", type="Engine (Multiplexed)", with 3 threads

00:0000:00000:00000:2016/09/02 10:40:10.45 kernel Aggressive task stealing enabled

00:0000:00000:00000:2016/09/02 10:40:10.53 server Proc header memory allocated 7191 pages for engine 1 local cache

00:0000:00000:00000:2016/09/02 10:40:10.62 server Proc header memory allocated 7191 pages for engine 2 local cache

00:0000:00000:00000:2016/09/02 10:40:10.62 kernel Create Thread Pool 3, "syb_blocking_pool", type="Run To Completion", with 4 threads

00:0000:00000:00000:2016/09/02 10:40:10.75 kernel Enabling HP Posix asynchronous disk I/O strategy.

00:0009:00000:00000:2016/09/02 10:40:10.75 kernel I/O controller 2 (NetController) is running as task 11934400 on thread 9 (LWP 5947).

00:0010:00000:00000:2016/09/02 10:40:10.75 kernel I/O controller 3 (DiskController) is running as task 11937296 on thread 10 (LWP 5948).

00:0000:00000:00000:2016/09/02 10:40:10.75 kernel Attempt to set vxfs file '/sybase/ABP/sybsystem/master.dat' to Concurrent i/o mode failed, error: Function is not available

00:0000:00000:00000:2016/09/02 10:40:10.75 kernel Attempt to set vxfs file '/sybase/ABP/sybsystem/master.dat' to Direct i/o mode failed, error: Function is not available

00:0010:00000:00000:2016/09/02 10:40:10.75 kernel Unexpected AIO error(Arg list too long) returned from aiowait().

00:0010:00000:00000:2016/09/02 10:40:10.75 kernel The AioEnh patch might not be installed. ASE requires to install the AioEnh patch to achieve better performance.

00:0000:00000:00000:2016/09/02 10:40:10.75 kernel The device does not support directio. '/sybase/ABP/sybsystem/master.dat' will be activated using dsync instead of directio.

00:0000:00000:00000:2016/09/02 10:40:10.75 kernel Initializing virtual device 0, '/sybase/ABP/sybsystem/master.dat' with dsync 'on'.

00:0000:00000:00000:2016/09/02 10:40:10.75 kernel Virtual device 0 started using asynchronous i/o.

00:0000:00000:00000:2016/09/02 10:40:10.75 server Loaded default Unilib conversion handle.

00:0000:00000:00000:2016/09/02 10:40:10.75 kernel Worker Thread Manager is not enabled for use in ASE.

00:0000:00000:00000:2016/09/02 10:40:10.75 kernel Either the config parameter 'use security services' is set to 0, or ASE does not support use of external security mechanisms on this platform. The Security Control Layer will not be initialized. No external security mechanisms will be supported.

00:0000:00000:00000:2016/09/02 10:40:10.75 kernel Stack traces will be generated without access to dladdr1() functionality.

00:0000:00000:00000:2016/09/02 10:40:10.83 kernel libsybibmmq - Sybase IBM MQ interface/15.7/EBF 22778 SMP SP122 /P/ia64/HP-UX B.11.31/ase157sp12x/3662/64-bit/OPT/Sat Apr 19 02:14:10 2014

00:0000:00000:00000:2016/09/02 10:40:11.05 kernel Loaded encryption provider CSI-2.9M10-hpia-2014/04/09 17:05:30 PDT-sybcsi_openssl-OpenSSL 1.0.1g-fips 7 Apr 2014.

00:0000:00000:00000:2016/09/02 10:40:11.05 kernel Begin processing to generate RSA keypair.

00:0000:00000:00000:2016/09/02 10:40:11.22 kernel Completed processing to generate RSA keypair.

00:0000:00000:00000:2016/09/02 10:40:11.22 kernel Begin processing to generate RSA keypair.

00:0000:00000:00000:2016/09/02 10:40:11.34 kernel Completed processing to generate RSA keypair.

00:0000:00000:00000:2016/09/02 10:40:11.34 kernel Encryption provider initialization succeeded on engine 0.

00:0002:00000:00000:2016/09/02 10:40:11.34 kernel Network and device connection limit is 59985.

00:0002:00000:00000:2016/09/02 10:40:11.34 kernel ASE - Dynamic Pluggable Component Interface is disabled

00:0002:00000:00000:2016/09/02 10:40:11.34 kernel Thread 2 (LWP 5935) of Threadpool syb_default_pool online as engine 0

00:0002:00000:00000:2016/09/02 10:40:11.35 server No active traceflags

00:0002:00000:00001:2016/09/02 10:40:11.35 kernel libomni1 - Component Integration Services: using 'Sybase Client-Library/15.7/P-EBF22674 SP126/DRV.15.7.0.12/IPF(ia64)/HP-UX 11.31 Native Threads/BUILD1570-041/64bit/OPT/Mon Apr 14 05:42:22 2014'

00:0002:00000:00001:2016/09/02 10:40:11.44 server Size of the 16K memory pool: 262144 Kb

00:0002:00000:00001:2016/09/02 10:40:11.45 server Size of the 16K memory pool: 262144 Kb

00:0002:00000:00001:2016/09/02 10:40:11.46 server Size of the 16K memory pool: 262144 Kb

00:0002:00000:00001:2016/09/02 10:40:11.47 server Size of the 16K memory pool: 262144 Kb

00:0002:00000:00001:2016/09/02 10:40:11.47 server Opening Master Database ...

00:0002:00000:00001:2016/09/02 10:40:11.91 server Loading ASE's default sort order and character set

00:0002:00000:00001:2016/09/02 10:40:12.04 server Recovering database 'master'.

00:0002:00000:00001:2016/09/02 10:40:12.04 server Started estimating recovery log boundaries for database 'master'.

00:0002:00000:00001:2016/09/02 10:40:12.05 server Database 'master', checkpoint=(3729, 80), first=(3729, 80), last=(3729, 159).

00:0002:00000:00001:2016/09/02 10:40:12.05 server Completed estimating recovery log boundaries for database 'master'.

00:0002:00000:00001:2016/09/02 10:40:12.05 server Started ANALYSIS pass for database 'master'.

00:0002:00000:00001:2016/09/02 10:40:12.05 server Completed ANALYSIS pass for database 'master'.

00:0002:00000:00001:2016/09/02 10:40:12.05 server Log contains all committed transactions until 2016/09/02 09:59:17.22 for database master.

00:0002:00000:00001:2016/09/02 10:40:12.05 server Started REDO pass for database 'master'. The total number of log records to process is 80.

00:0002:00000:00001:2016/09/02 10:40:12.23 server Roll forward transaction 'sysconfigures'.

00:0002:00000:00001:2016/09/02 10:40:12.23 server Roll forward transaction 'etcdeltskattr'.

00:0002:00000:00001:2016/09/02 10:40:12.23 server Roll forward transaction 'pool_config'.

00:0002:00000:00001:2016/09/02 10:40:12.23 server Roll forward transaction 'sybmgmtdev'.

00:0002:00000:00001:2016/09/02 10:40:12.23 server Roll forward transaction '$queryplans_insert'.

00:0002:00000:00001:2016/09/02 10:40:12.32 server Redo pass of recovery has processed 10 committed and 0 aborted transactions.

00:0002:00000:00001:2016/09/02 10:40:12.32 server Completed REDO pass for database 'master'.

00:0002:00000:00001:2016/09/02 10:40:12.52 server Timestamp for database 'master' is (0x0000, 0x00026bca).

00:0002:00000:00001:2016/09/02 10:40:12.52 server Recovery of database 'master' will undo incomplete nested top actions.

00:0002:00000:00001:2016/09/02 10:40:12.52 server Started recovery checkpoint for database 'master'.

00:0002:00000:00001:2016/09/02 10:40:12.52 server Completed recovery checkpoint for database 'master'.

00:0002:00000:00001:2016/09/02 10:40:12.52 server Started filling free space info for database 'master'.

00:0002:00000:00001:2016/09/02 10:40:12.53 server Completed filling free space info for database 'master'.

00:0002:00000:00001:2016/09/02 10:40:12.54 server Started cleaning up the default data cache for database 'master'.

00:0002:00000:00001:2016/09/02 10:40:12.55 server Completed cleaning up the default data cache for database 'master'.

00:0002:00000:00001:2016/09/02 10:40:12.56 server Checking external objects.

00:0002:00000:00001:2016/09/02 10:40:12.65 server Database 'master' is now online.

00:0002:00000:00001:2016/09/02 10:40:12.66 server The transaction log in the database 'master' will use I/O size of 16 Kb.

00:0002:00000:00001:2016/09/02 10:40:13.04 server server name is 'ABP'

00:0002:00000:00001:2016/09/02 10:40:13.05 server Activating disk 'sysprocsdev' of size 204800 KB.

00:0002:00000:00001:2016/09/02 10:40:13.05 kernel Initializing virtual device 1, '/sybase/ABP/sybsystem/sysprocs.dat' with dsync 'on'.

00:0002:00000:00001:2016/09/02 10:40:13.05 kernel Virtual device 1 started using asynchronous i/o.

00:0002:00000:00001:2016/09/02 10:40:13.05 server Activating disk 'systemdbdev' of size 24576 KB.

00:0002:00000:00001:2016/09/02 10:40:13.05 kernel Initializing virtual device 2, '/sybase/ABP/sybsystem/sybsysdb.dat' with dsync 'on'.

00:0002:00000:00001:2016/09/02 10:40:13.05 kernel Virtual device 2 started using asynchronous i/o.

00:0002:00000:00001:2016/09/02 10:40:13.05 server Activating disk 'tempdbdev' of size 1048576 KB.

00:0002:00000:00001:2016/09/02 10:40:13.05 kernel Initializing virtual device 3, '/sybase/ABP/sybtemp/tempdbdev.dat' with dsync 'on'.

00:0002:00000:00001:2016/09/02 10:40:13.05 kernel Virtual device 3 started using asynchronous i/o.

00:0002:00000:00001:2016/09/02 10:40:13.05 server Activating disk 'sybmgmtdev' of size 2375680 KB.

00:0002:00000:00001:2016/09/02 10:40:13.05 kernel Initializing virtual device 4, '/sybase/ABP/sybsystem/sybmgmtdb.dat' with dsync 'on'.

00:0002:00000:00001:2016/09/02 10:40:13.05 kernel Virtual device 4 started using asynchronous i/o.

00:0002:00000:00001:2016/09/02 10:40:13.05 server Activating disk 'ABP_data_001' of size 428867584 KB.

00:0002:00000:00001:2016/09/02 10:40:13.05 kernel Initializing virtual device 5, '/sybase/ABP/sapdata_1/ABP_data_001.dat' with dsync 'on'.

00:0002:00000:00001:2016/09/02 10:40:13.05 kernel Virtual device 5 started using asynchronous i/o.

00:0002:00000:00001:2016/09/02 10:40:13.05 server Activating disk 'ABP_log_001' of size 45600768 KB.

00:0002:00000:00001:2016/09/02 10:40:13.05 kernel Initializing virtual device 6, '/sybase/ABP/saplog_1/ABP_log_001.dat' with dsync 'on'.

00:0002:00000:00001:2016/09/02 10:40:13.05 kernel Virtual device 6 started using asynchronous i/o.

00:0002:00000:00001:2016/09/02 10:40:13.05 server Activating disk 'saptools_data_001' of size 3072000 KB.

00:0002:00000:00001:2016/09/02 10:40:13.05 kernel Initializing virtual device 7, '/sybase/ABP/sapdiag/saptools_data_001.dat' with dsync 'on'.

00:0002:00000:00001:2016/09/02 10:40:13.05 kernel Virtual device 7 started using asynchronous i/o.

00:0002:00000:00001:2016/09/02 10:40:13.05 server Activating disk 'saptools_log_001' of size 524288 KB.

00:0002:00000:00001:2016/09/02 10:40:13.05 kernel Initializing virtual device 8, '/sybase/ABP/sapdiag/saptools_log_001.dat' with dsync 'on'.

00:0002:00000:00001:2016/09/02 10:40:13.05 kernel Virtual device 8 started using asynchronous i/o.

00:0002:00000:00001:2016/09/02 10:40:13.05 server Activating disk 'saptempdb_data_001' of size 10485760 KB.

00:0002:00000:00001:2016/09/02 10:40:13.05 kernel Initializing virtual device 9, '/sybase/ABP/saptemp/saptempdb_data_001.dat' with dsync 'on'.

00:0002:00000:00001:2016/09/02 10:40:13.05 kernel Virtual device 9 started using asynchronous i/o.

00:0002:00000:00001:2016/09/02 10:40:13.12 server Recovering database 'sybsystemdb'.

00:0002:00000:00001:2016/09/02 10:40:13.12 server Started estimating recovery log boundaries for database 'sybsystemdb'.

00:0002:00000:00001:2016/09/02 10:40:13.13 server Database 'sybsystemdb', checkpoint=(867, 143), first=(867, 143), last=(867, 143).

00:0002:00000:00001:2016/09/02 10:40:13.13 server Completed estimating recovery log boundaries for database 'sybsystemdb'.

00:0002:00000:00001:2016/09/02 10:40:13.13 server Started ANALYSIS pass for database 'sybsystemdb'.

00:0002:00000:00001:2016/09/02 10:40:13.13 server Completed ANALYSIS pass for database 'sybsystemdb'.

00:0002:00000:00001:2016/09/02 10:40:13.13 server Log contains all committed transactions until 2015/08/07 17:35:59.19 for database sybsystemdb.

00:0002:00000:00001:2016/09/02 10:40:13.13 server Started REDO pass for database 'sybsystemdb'. The total number of log records to process is 1.

00:0002:00000:00001:2016/09/02 10:40:13.13 server Completed REDO pass for database 'sybsystemdb'.

00:0002:00000:00001:2016/09/02 10:40:13.17 server Timestamp for database 'sybsystemdb' is (0x0000, 0x00037f94).

00:0002:00000:00001:2016/09/02 10:40:13.17 server Recovery of database 'sybsystemdb' will undo incomplete nested top actions.

00:0002:00000:00001:2016/09/02 10:40:13.17 server Started recovery checkpoint for database 'sybsystemdb'.

00:0002:00000:00001:2016/09/02 10:40:13.17 server Completed recovery checkpoint for database 'sybsystemdb'.

00:0002:00000:00001:2016/09/02 10:40:13.17 server Started filling free space info for database 'sybsystemdb'.

00:0002:00000:00001:2016/09/02 10:40:13.18 server Completed filling free space info for database 'sybsystemdb'.

00:0002:00000:00001:2016/09/02 10:40:13.18 server Started cleaning up the default data cache for database 'sybsystemdb'.

00:0002:00000:00001:2016/09/02 10:40:13.20 server Completed cleaning up the default data cache for database 'sybsystemdb'.

00:0002:00000:00001:2016/09/02 10:40:13.20 server Boot Count: 93

00:0002:00000:00001:2016/09/02 10:40:13.21 server Checking external objects.

00:0002:00000:00001:2016/09/02 10:40:13.28 server The transaction log in the database 'sybsystemdb' will use I/O size of 16 Kb.

00:0002:00000:00001:2016/09/02 10:40:13.28 server Resident Node id: 9281d8060e35

00:0002:00000:00001:2016/09/02 10:40:13.28 server Transaction coordinator initialized.

00:0002:00000:00001:2016/09/02 10:40:13.28 server Database 'sybsystemdb' is now online.

00:0002:00000:00001:2016/09/02 10:40:13.31 server Recovering database 'model'.

00:0002:00000:00001:2016/09/02 10:40:13.32 server Started estimating recovery log boundaries for database 'model'.

00:0002:00000:00001:2016/09/02 10:40:13.33 server Database 'model', checkpoint=(867, 56), first=(867, 56), last=(867, 56).

00:0002:00000:00001:2016/09/02 10:40:13.33 server Completed estimating recovery log boundaries for database 'model'.

00:0002:00000:00001:2016/09/02 10:40:13.33 server Started ANALYSIS pass for database 'model'.

00:0002:00000:00001:2016/09/02 10:40:13.33 server Completed ANALYSIS pass for database 'model'.

00:0002:00000:00001:2016/09/02 10:40:13.33 server Log contains all committed transactions until 2014/09/08 13:30:22.29 for database model.

00:0002:00000:00001:2016/09/02 10:40:13.33 server Started REDO pass for database 'model'. The total number of log records to process is 1.

00:0002:00000:00001:2016/09/02 10:40:13.33 server Completed REDO pass for database 'model'.

00:0002:00000:00001:2016/09/02 10:40:13.34 server Timestamp for database 'model' is (0x0000, 0x000015e3).

00:0002:00000:00001:2016/09/02 10:40:13.34 server Recovery of database 'model' will undo incomplete nested top actions.

00:0002:00000:00001:2016/09/02 10:40:13.34 server Started recovery checkpoint for database 'model'.

00:0002:00000:00001:2016/09/02 10:40:13.34 server Completed recovery checkpoint for database 'model'.

00:0002:00000:00001:2016/09/02 10:40:13.34 server Started filling free space info for database 'model'.

00:0002:00000:00001:2016/09/02 10:40:13.36 server Completed filling free space info for database 'model'.

00:0002:00000:00001:2016/09/02 10:40:13.36 server Started cleaning up the default data cache for database 'model'.

00:0002:00000:00001:2016/09/02 10:40:13.37 server Completed cleaning up the default data cache for database 'model'.

00:0002:00000:00001:2016/09/02 10:40:13.37 server Checking external objects.

00:0002:00000:00001:2016/09/02 10:40:13.45 server The transaction log in the database 'model' will use I/O size of 16 Kb.

00:0002:00000:00001:2016/09/02 10:40:13.45 server Database 'model' is now online.

00:0002:00000:00001:2016/09/02 10:40:13.45 server The logical pagesize of the server is 16 Kb.

00:0002:00000:00001:2016/09/02 10:40:13.45 server 0 dump conditions detected at boot time

00:0002:00000:00001:2016/09/02 10:40:13.45 server Clearing temporary database 'tempdb'.

00:0002:00000:00001:2016/09/02 10:40:14.18 server Processed 27 allocation unit(s) out of 262 units (allocation page 6656). 10% completed.

00:0002:00000:00001:2016/09/02 10:40:14.18 server Processed 53 allocation unit(s) out of 262 units (allocation page 13312). 20% completed.

00:0002:00000:00001:2016/09/02 10:40:14.18 server Processed 79 allocation unit(s) out of 262 units (allocation page 19968). 30% completed.

00:0002:00000:00001:2016/09/02 10:40:14.18 server Processed 105 allocation unit(s) out of 262 units (allocation page 26624). 40% completed.

00:0002:00000:00001:2016/09/02 10:40:14.18 server Processed 131 allocation unit(s) out of 262 units (allocation page 33280). 50% completed.

00:0002:00000:00001:2016/09/02 10:40:14.21 server Processed 158 allocation unit(s) out of 262 units (allocation page 40192). 60% completed.

00:0002:00000:00001:2016/09/02 10:40:14.21 server Processed 184 allocation unit(s) out of 262 units (allocation page 46848). 70% completed.

00:0002:00000:00001:2016/09/02 10:40:14.21 server Processed 210 allocation unit(s) out of 262 units (allocation page 53504). 80% completed.

00:0002:00000:00001:2016/09/02 10:40:14.21 server Processed 236 allocation unit(s) out of 262 units (allocation page 60160). 90% completed.

00:0002:00000:00001:2016/09/02 10:40:14.21 server Processed 262 allocation unit(s) out of 262 units (allocation page 66816). 100% completed.

00:0002:00000:00001:2016/09/02 10:40:14.23 server Tempdb 2 is added to the list of local temporary databases

00:0002:00000:00001:2016/09/02 10:40:14.25 server Timestamp for database 'tempdb' is (0x0000, 0x000015e3).

00:0002:00000:00001:2016/09/02 10:40:14.28 server The transaction log in the database 'tempdb' will use I/O size of 16 Kb.

00:0002:00000:00001:2016/09/02 10:40:14.28 server Database 'tempdb' is now online.

00:0002:00000:00001:2016/09/02 10:40:14.32 server Recovering database 'sybsystemprocs'.

00:0002:00000:00001:2016/09/02 10:40:14.32 server Started estimating recovery log boundaries for database 'sybsystemprocs'.

00:0002:00000:00001:2016/09/02 10:40:14.33 server Database 'sybsystemprocs', checkpoint=(12789, 67), first=(12789, 67), last=(12789, 67).

00:0002:00000:00001:2016/09/02 10:40:14.33 server Completed estimating recovery log boundaries for database 'sybsystemprocs'.

00:0002:00000:00001:2016/09/02 10:40:14.33 server Started ANALYSIS pass for database 'sybsystemprocs'.

00:0002:00000:00001:2016/09/02 10:40:14.33 server Completed ANALYSIS pass for database 'sybsystemprocs'.

00:0002:00000:00001:2016/09/02 10:40:14.33 server Log contains all committed transactions until 2015/09/28 18:16:27.74 for database sybsystemprocs.

00:0002:00000:00001:2016/09/02 10:40:14.33 server Started REDO pass for database 'sybsystemprocs'. The total number of log records to process is 1.

00:0002:00000:00001:2016/09/02 10:40:14.33 server Completed REDO pass for database 'sybsystemprocs'.

00:0002:00000:00001:2016/09/02 10:40:14.51 server Timestamp for database 'sybsystemprocs' is (0x0000, 0x001ccdda).

00:0002:00000:00001:2016/09/02 10:40:14.51 server Recovery of database 'sybsystemprocs' will undo incomplete nested top actions.

00:0002:00000:00001:2016/09/02 10:40:14.51 server Started recovery checkpoint for database 'sybsystemprocs'.

00:0002:00000:00001:2016/09/02 10:40:14.51 server Completed recovery checkpoint for database 'sybsystemprocs'.

00:0002:00000:00001:2016/09/02 10:40:14.51 server Started filling free space info for database 'sybsystemprocs'.

00:0002:00000:00001:2016/09/02 10:40:14.52 server Completed filling free space info for database 'sybsystemprocs'.

00:0002:00000:00001:2016/09/02 10:40:14.52 server Started cleaning up the default data cache for database 'sybsystemprocs'.

00:0002:00000:00001:2016/09/02 10:40:14.53 server Completed cleaning up the default data cache for database 'sybsystemprocs'.

00:0002:00000:00001:2016/09/02 10:40:14.53 server Checking external objects.

00:0002:00000:00001:2016/09/02 10:40:14.62 server The transaction log in the database 'sybsystemprocs' will use I/O size of 16 Kb.

00:0002:00000:00001:2016/09/02 10:40:14.62 server Database 'sybsystemprocs' is now online.

00:0002:00000:00012:2016/09/02 10:40:14.64 kernel network name AVNBIPRD, interface IPv4, address 192.168.9.93, type tcp, port 4901, filter NONE

00:0003:00000:00000:2016/09/02 10:40:14.64 kernel Network and device connection limit is 59985.

00:0003:00000:00000:2016/09/02 10:40:14.64 kernel Encryption provider initialization succeeded on engine 1.

00:0003:00000:00000:2016/09/02 10:40:14.64 kernel Thread 3 (LWP 5936) of Threadpool syb_default_pool online as engine 1

00:0004:00000:00000:2016/09/02 10:40:14.64 kernel Network and device connection limit is 59985.

00:0004:00000:00000:2016/09/02 10:40:14.64 kernel Encryption provider initialization succeeded on engine 2.

00:0004:00000:00000:2016/09/02 10:40:14.64 kernel Thread 4 (LWP 5937) of Threadpool syb_default_pool online as engine 2

00:0002:00000:00001:2016/09/02 10:40:14.88 server Recovery has tuned the size of '128K' pool in 'default data cache' to benefit recovery performance. The original configuration will be restored at the end of recovery.

00:0002:00000:00001:2016/09/02 10:40:14.88 server Recovery has tuned the size of '16K' pool in 'default data cache' to benefit recovery performance. The original configuration will be restored at the end of recovery.

00:0002:00000:00001:2016/09/02 10:40:14.88 server Recovery has tuned the '128K' pool in 'default data cache' by changing its 'local async prefetch limit' from 10 to 80. The original configuration will be restored at the end of recovery.

00:0002:00000:00001:2016/09/02 10:40:14.88 server Recovery has tuned the '16K' pool in 'default data cache' by changing its 'local async prefetch limit' from 10 to 80. The original configuration will be restored at the end of recovery.

00:0002:00000:00014:2016/09/02 10:40:14.95 server Recovering database 'ABP'.

00:0002:00000:00014:2016/09/02 10:40:14.95 server Started estimating recovery log boundaries for database 'ABP'.

00:0002:00000:00015:2016/09/02 10:40:19.08 server Recovering database 'saptools'.

00:0002:00000:00015:2016/09/02 10:40:19.08 server Started estimating recovery log boundaries for database 'saptools'.

00:0002:00000:00015:2016/09/02 10:40:19.09 server Database 'saptools', checkpoint=(163018, 124), first=(163018, 124), last=(163018, 172).

00:0002:00000:00015:2016/09/02 10:40:19.09 server Completed estimating recovery log boundaries for database 'saptools'.

00:0002:00000:00015:2016/09/02 10:40:19.09 server Started ANALYSIS pass for database 'saptools'.

00:0002:00000:00015:2016/09/02 10:40:19.09 server Completed ANALYSIS pass for database 'saptools'.

00:0002:00000:00015:2016/09/02 10:40:19.09 server Log contains all committed transactions until 2016/09/01 19:56:31.12 for database saptools.

00:0002:00000:00015:2016/09/02 10:40:19.09 server Started REDO pass for database 'saptools'. The total number of log records to process is 49.

00:0002:00000:00015:2016/09/02 10:40:19.25 server Roll forward transaction '$dmpxact'.

00:0002:00000:00015:2016/09/02 10:40:19.25 server Roll forward transaction '$queryplans_insert'.

00:0003:00000:00015:2016/09/02 10:40:19.26 server Roll forward transaction '$queryplans_insert'.

00:0002:00000:00015:2016/09/02 10:40:19.30 server Redo pass of recovery has processed 4 committed and 0 aborted transactions.

00:0002:00000:00015:2016/09/02 10:40:19.30 server Completed REDO pass for database 'saptools'.

00:0002:00000:00015:2016/09/02 10:40:19.30 server Timestamp for database 'saptools' is (0x0000, 0x4a6101a2).

00:0002:00000:00015:2016/09/02 10:40:19.30 server Recovery of database 'saptools' will undo incomplete nested top actions.

00:0002:00000:00015:2016/09/02 10:40:19.30 server Started recovery checkpoint for database 'saptools'.

00:0002:00000:00015:2016/09/02 10:40:19.31 server Completed recovery checkpoint for database 'saptools'.

00:0002:00000:00015:2016/09/02 10:40:19.31 server Started filling free space info for database 'saptools'.

00:0002:00000:00015:2016/09/02 10:40:19.46 server Completed filling free space info for database 'saptools'.

00:0002:00000:00015:2016/09/02 10:40:19.47 server Started cleaning up the default data cache for database 'saptools'.

00:0004:00000:00015:2016/09/02 10:40:19.51 server Completed cleaning up the default data cache for database 'saptools'.

00:0004:00000:00015:2016/09/02 10:40:19.54 server Checking external objects.

00:0004:00000:00015:2016/09/02 10:40:19.74 server The transaction log in the database 'saptools' will use I/O size of 16 Kb.

00:0004:00000:00015:2016/09/02 10:40:19.77 server Database 'saptools' is now online.

00:0004:00000:00015:2016/09/02 10:40:19.83 server Recovering database 'sybmgmtdb'.

00:0004:00000:00015:2016/09/02 10:40:19.83 server Started estimating recovery log boundaries for database 'sybmgmtdb'.

00:0002:00000:00001:2016/09/02 10:40:20.04 server The optimal number of recovery processes is 2.

00:0003:00000:00015:2016/09/02 10:40:20.86 server Database 'sybmgmtdb', checkpoint=(45064, 13), first=(48696, 31), last=(48695, 26).

00:0003:00000:00015:2016/09/02 10:40:20.86 server Completed estimating recovery log boundaries for database 'sybmgmtdb'.

00:0003:00000:00015:2016/09/02 10:40:20.86 server Started ANALYSIS pass for database 'sybmgmtdb'.

00:0002:00000:00015:2016/09/02 10:40:22.76 server Completed ANALYSIS pass for database 'sybmgmtdb'.

00:0002:00000:00015:2016/09/02 10:40:22.76 server Log contains all committed transactions until 2016/08/28 04:59:24.79 for database sybmgmtdb.

00:0002:00000:00015:2016/09/02 10:40:22.76 server Started REDO pass for database 'sybmgmtdb'. The total number of log records to process is 789242.

00:0002:00000:00015:2016/09/02 10:40:22.86 server Redo pass for database 'sybmgmtdb': 39462 records done (4%); 749780 records left.

00:0002:00000:00015:2016/09/02 10:40:22.95 server Redo pass for database 'sybmgmtdb': 78924 records done (9%); 710318 records left.

00:0002:00000:00015:2016/09/02 10:40:23.03 server Redo pass for database 'sybmgmtdb': 118386 records done (14%); 670856 records left.

00:0004:00000:00015:2016/09/02 10:40:23.12 server Redo pass for database 'sybmgmtdb': 157848 records done (19%); 631394 records left.

00:0004:00000:00015:2016/09/02 10:40:23.21 server Redo pass for database 'sybmgmtdb': 197310 records done (24%); 591932 records left.

00:0004:00000:00015:2016/09/02 10:40:23.30 server Redo pass for database 'sybmgmtdb': 236772 records done (29%); 552470 records left.

00:0002:00000:00015:2016/09/02 10:40:23.39 server Redo pass for database 'sybmgmtdb': 276234 records done (34%); 513008 records left.

00:0002:00000:00015:2016/09/02 10:40:23.48 server Redo pass for database 'sybmgmtdb': 315696 records done (39%); 473546 records left.

00:0004:00000:00015:2016/09/02 10:40:23.58 server Redo pass for database 'sybmgmtdb': 355158 records done (44%); 434084 records left.

00:0004:00000:00015:2016/09/02 10:40:23.66 server Redo pass for database 'sybmgmtdb': 394620 records done (49%); 394622 records left.

00:0004:00000:00015:2016/09/02 10:40:23.81 server Redo pass for database 'sybmgmtdb': 434082 records done (54%); 355160 records left.

00:0002:00000:00015:2016/09/02 10:40:23.91 server Redo pass for database 'sybmgmtdb': 473544 records done (59%); 315698 records left.

00:0002:00000:00015:2016/09/02 10:40:23.99 server Redo pass for database 'sybmgmtdb': 513006 records done (64%); 276236 records left.

00:0002:00000:00015:2016/09/02 10:40:24.09 server Redo pass for database 'sybmgmtdb': 552468 records done (69%); 236774 records left.

00:0004:00000:00015:2016/09/02 10:40:24.20 server Redo pass for database 'sybmgmtdb': 591930 records done (74%); 197312 records left.

00:0004:00000:00015:2016/09/02 10:40:24.29 server Redo pass for database 'sybmgmtdb': 631392 records done (79%); 157850 records left.

00:0003:00000:00015:2016/09/02 10:40:24.37 server Redo pass for database 'sybmgmtdb': 670854 records done (84%); 118388 records left.

00:0002:00000:00015:2016/09/02 10:40:24.60 server Redo pass for database 'sybmgmtdb': 710316 records done (89%); 78926 records left.

00:0002:00000:00015:2016/09/02 10:40:24.64 server Roll forward transaction '$dmpxact'.

00:0002:00000:00015:2016/09/02 10:40:24.69 server Roll forward transaction 'sp_writejoboutput'.

00:0003:00000:00015:2016/09/02 10:40:24.74 server Roll forward transaction 'sp_writejoboutput'.

00:0002:00000:00015:2016/09/02 10:40:24.88 server Roll forward transaction 'sp_writejoboutput'.

00:0002:00000:00015:2016/09/02 10:40:24.93 server Roll forward transaction 'sp_writejoboutput'.

00:0002:00000:00015:2016/09/02 10:40:25.15 server Redo pass for database 'sybmgmtdb': 749778 records done (94%); 39464 records left.

00:0002:00000:00015:2016/09/02 10:40:25.16 server Roll forward transaction 'sp_writejoboutput'.

00:0002:00000:00015:2016/09/02 10:40:25.24 server Roll forward transaction 'sp_writejoboutput'.

00:0004:00000:00015:2016/09/02 10:40:25.62 server Roll forward transaction 'sp_writejoboutput'.

00:0003:00000:00015:2016/09/02 10:40:25.81 server Roll forward transaction 'sp_writejoboutput'.

00:0004:00000:00015:2016/09/02 10:40:25.90 server Redo pass for database 'sybmgmtdb': 789240 records done (99%); 2 records left.

00:0004:00000:00015:2016/09/02 10:40:25.92 server Redo pass of recovery has processed 9 committed and 0 aborted transactions.

00:0004:00000:00015:2016/09/02 10:40:25.92 server Completed REDO pass for database 'sybmgmtdb'.

00:0004:00000:00015:2016/09/02 10:40:29.94 server Timestamp for database 'sybmgmtdb' is (0x0000, 0x066aafa9).

00:0004:00000:00015:2016/09/02 10:40:29.94 server Recovery of database 'sybmgmtdb' will undo incomplete nested top actions.

00:0004:00000:00015:2016/09/02 10:40:29.94 server Started UNDO pass for database 'sybmgmtdb'. The total number of log records to process is 789242.

00:0004:00000:00015:2016/09/02 10:40:29.94 server Roll back transaction '$user_transaction' -- was aborted.

00:0004:00000:00015:2016/09/02 10:40:29.94 server Roll back transaction '$systsflush' -- was aborted.

00:0004:00000:00015:2016/09/02 10:40:29.94 server Roll back transaction 'sp_writejoboutput' -- was aborted.

00:0003:00000:00015:2016/09/02 10:40:29.99 server ERROR: Can't get a new log page in db 31515. num_left=13 num_in_plc=13.

00:0003:00000:00015:2016/09/02 10:40:30.00 server Processed 170 allocation unit(s) out of 1280 units (allocation page 43264). 13% completed.

00:0003:00000:00015:2016/09/02 10:40:30.00 server Processed 295 allocation unit(s) out of 1280 units (allocation page 75264). 23% completed.

00:0003:00000:00015:2016/09/02 10:40:30.00 server Processed 423 allocation unit(s) out of 1280 units (allocation page 108032). 33% completed.

00:0003:00000:00015:2016/09/02 10:40:30.00 server Rebuilt syslogs gam for dbid 31515

00:0003:00000:00015:2016/09/02 10:40:30.00 server ERROR: Can't get a new log page in db 31515. num_left=13 num_in_plc=13.

00:0003:00000:00015:2016/09/02 10:40:30.00 server Error: 1105, Severity: 17, State: 7

00:0003:00000:00015:2016/09/02 10:40:30.00 server Can't allocate space for object 'syslogs' in database 'sybmgmtdb' because 'logsegment' segment is full/has no free extents. If you ran out of space in syslogs, dump the transaction log. Otherwise, use ALTER DATABASE to increase the size of the segment.

00:0003:00000:00015:2016/09/02 10:40:30.00 server Error: 3475, Severity: 21, State: 7

00:0003:00000:00015:2016/09/02 10:40:30.00 server There is no space available in SYSLOGS to log a record for which space has been reserved in database 'sybmgmtdb' (id 31515). This process will retry at intervals of one minute.

00:0002:00000:00016:2016/09/02 10:40:58.35 server The temporary database (dbid = 6) is not available.

00:0002:00000:00016:2016/09/02 10:40:58.36 server Temporary database based on the specified soft binding could not be assigned. Assigning temporary database 'tempdb' from the 'default' group.

00:0003:00000:00017:2016/09/02 10:41:11.44 server The temporary database (dbid = 6) is not available.

00:0003:00000:00017:2016/09/02 10:41:11.44 server Temporary database based on the specified soft binding could not be assigned. Assigning temporary database 'tempdb' from the 'default' group.

00:0002:00000:00015:2016/09/02 10:41:29.91 server ERROR: Can't get a new log page in db 31515. num_left=13 num_in_plc=13.

00:0003:00000:00018:2016/09/02 10:41:30.18 server The temporary database (dbid = 6) is not available.

00:0003:00000:00018:2016/09/02 10:41:30.18 server Temporary database based on the specified soft binding could not be assigned. Assigning temporary database 'tempdb' from the 'default' group.

00:0003:00000:00014:2016/09/02 10:41:43.65 server Database 'ABP', checkpoint=(20766290, 206), first=(20766181, 157), last=(21080331, 131).

00:0003:00000:00014:2016/09/02 10:41:43.65 server Completed estimating recovery log boundaries for database 'ABP'.

00:0003:00000:00014:2016/09/02 10:41:43.65 server Started ANALYSIS pass for database 'ABP'.

00:0002:00000:00015:2016/09/02 10:42:29.91 server ERROR: Can't get a new log page in db 31515. num_left=13 num_in_plc=13.

00:0003:00000:00015:2016/09/02 10:43:29.94 server ERROR: Can't get a new log page in db 31515. num_left=13 num_in_plc=13.

00:0003:00000:00015:2016/09/02 10:44:29.92 server ERROR: Can't get a new log page in db 31515. num_left=13 num_in_plc=13.

00:0003:00000:00015:2016/09/02 10:45:29.92 server ERROR: Can't get a new log page in db 31515. num_left=13 num_in_plc=13.

00:0004:00000:00015:2016/09/02 10:46:29.92 server ERROR: Can't get a new log page in db 31515. num_left=13 num_in_plc=13.

00:0003:00000:00021:2016/09/02 10:47:28.29 server The temporary database (dbid = 6) is not available.

00:0003:00000:00021:2016/09/02 10:47:28.29 server Temporary database based on the specified soft binding could not be assigned. Assigning temporary database 'tempdb' from the 'default' group.

00:0004:00000:00015:2016/09/02 10:47:29.94 server ERROR: Can't get a new log page in db 31515. num_left=13 num_in_plc=13.

00:0003:00000:00015:2016/09/02 10:48:29.94 server ERROR: Can't get a new log page in db 31515. num_left=13 num_in_plc=13.

00:0003:00000:00015:2016/09/02 10:49:29.91 server ERROR: Can't get a new log page in db 31515. num_left=13 num_in_plc=13.

00:0002:00000:00015:2016/09/02 10:50:29.92 server ERROR: Can't get a new log page in db 31515. num_left=13 num_in_plc=13.

00:0003:00000:00015:2016/09/02 10:51:29.92 server ERROR: Can't get a new log page in db 31515. num_left=13 num_in_plc=13.

00:0002:00000:00015:2016/09/02 10:52:29.92 server ERROR: Can't get a new log page in db 31515. num_left=13 num_in_plc=13.

00:0002:00000:00015:2016/09/02 10:53:29.92 server ERROR: Can't get a new log page in db 31515. num_left=13 num_in_plc=13.

00:0004:00000:00015:2016/09/02 10:54:29.93 server ERROR: Can't get a new log page in db 31515. num_left=13 num_in_plc=13.

00:0004:00000:00015:2016/09/02 10:55:29.94 server ERROR: Can't get a new log page in db 31515. num_left=13 num_in_plc=13.

00:0002:00000:00015:2016/09/02 10:56:29.94 server ERROR: Can't get a new log page in db 31515. num_left=13 num_in_plc=13.

00:0002:00000:00015:2016/09/02 10:57:29.91 server ERROR: Can't get a new log page in db 31515. num_left=13 num_in_plc=13.

00:0003:00000:00015:2016/09/02 10:58:29.91 server ERROR: Can't get a new log page in db 31515. num_left=13 num_in_plc=13.

00:0004:00000:00015:2016/09/02 10:59:29.93 server ERROR: Can't get a new log page in db 31515. num_left=13 num_in_plc=13.

00:0003:00000:00015:2016/09/02 11:00:29.94 server ERROR: Can't get a new log page in db 31515. num_left=13 num_in_plc=13.

00:0004:00000:00015:2016/09/02 11:01:29.92 server ERROR: Can't get a new log page in db 31515. num_left=13 num_in_plc=13.

00:0004:00000:00015:2016/09/02 11:02:29.93 server ERROR: Can't get a new log page in db 31515. num_left=13 num_in_plc=13.

00:0003:00000:00015:2016/09/02 11:03:29.94 server ERROR: Can't get a new log page in db 31515. num_left=13 num_in_plc=13.

00:0004:00000:00015:2016/09/02 11:04:29.93 server ERROR: Can't get a new log page in db 31515. num_left=13 num_in_plc=13.

00:0004:00000:00015:2016/09/02 11:05:29.91 server ERROR: Can't get a new log page in db 31515. num_left=13 num_in_plc=13.

00:0003:00000:00015:2016/09/02 11:06:29.92 server ERROR: Can't get a new log page in db 31515. num_left=13 num_in_plc=13.

00:0002:00000:00015:2016/09/02 11:07:29.92 server ERROR: Can't get a new log page in db 31515. num_left=13 num_in_plc=13.

00:0002:00000:00015:2016/09/02 11:08:29.94 server ERROR: Can't get a new log page in db 31515. num_left=13 num_in_plc=13.

kindly check the attached log any provide a solution .

Thanks & Regards,

Vikram