Unable to fetch data from LDAP data source when number of records in more than 1000

[suraj6085]

Hi SAP Experts,
We have SAP NetWeaver AS JAVA 7.40 SP 8. we have connected an LDAP datasource to it. Datasource configuration is Microsoft ADS Deep Hierarchy + Database. We want to fetch all user accounts from both datasources. We are using a Software Development Archive (SDA) to fetch data from data sources.

Following is the code we are using to fetch the users:
IUserFactory userFact = null;
IUserSearchFilter userFilt = null;
ISearchResult result = null;
userFact = UMFactory.getUserFactory();
userFilt = userFact.getUserSearchFilter();
userFilt.setUniqueName(prefix, ISearchAttribute.LIKE_OPERATOR, false);
result = userFact.searchUsers(userFilt);

When the first time we call this code snippet from a method, prefix variable in userFilt.setUniqueName() is set to "*" character.
If the number of accounts in LDAP is less than 1000, all users are fetched in result.
But if the number of accounts in LDAP is more than 1000, SIZE_LIMIT_EXCEEDED status is observed in result, in that case we call the method again, this time setting prefix to a*, b*......z*. Problem is when the prefix is set to a*, b* ...z*, only the accounts from AS JAVA datasource are fetched, accounts from LDAP datasource are not fetched. We want to fetch all accounts from LDAP datasource even when the number of accounts is more than 1000.

I have tried setting the property <ume.ldap.access.extended_search_size>900</ume.ldap.access.extended_search_size> in private section of LDAP datasource in DatasourceConfiguration XML, but that still causes result to go in SIZE_LIMIT_EXCEEDED state when accounts in LDAP are more than 1000.

This is the datasource configuration file

<dataSources>
    <dataSource id="PRIVATE_DATASOURCE"
                className="com.sap.security.core.persistence.datasource.imp.DataBasePersistence"
                isReadonly="false"
                isPrimary="true">
        <homeFor>
            <principals>
            	<principal type="group"/>
            	<principal type="user"/>
            	<principal type="account"/>
                <principal type="team"/>
                <principal type="ROOT" />
                <principal type="OOOO" />
            </principals>
        </homeFor>
        <notHomeFor />
        <responsibleFor>
            <principals>
            	<principal type="group"/>
            	<principal type="user"/>
            	<principal type="account"/>
                <principal type="team"/>
                <principal type="ROOT" />
                <principal type="OOOO" />
            </principals>
        </responsibleFor>
        <privateSection>
        </privateSection>
    </dataSource>
	<dataSource id="CORP_LDAP"
			className="com.sap.security.core.persistence.datasource.imp.LDAPPersistence"
			isReadonly="true"
			isPrimary="true">
		<homeFor/>
		<responsibleFor>
    		<principal type="account">
    			<nameSpace name="com.sap.security.core.usermanagement">
    				<attribute name="j_user"/>
					<attribute name="j_password"/>
					<attribute name="userid"/>
					<attribute name="logonalias"/>
				</nameSpace>
    			<nameSpace name="com.sap.security.core.authentication">
    				<attribute name="principal"/>
    				<attribute name="realm"/>
    				<attribute name="domain"/>
    			</nameSpace>
			</principal>
			<principal type="user">
				<nameSpace name="com.sap.security.core.usermanagement">
					<attribute name="firstname" populateInitially="true"/>
					<attribute name="displayname" populateInitially="true"/>
					<attribute name="lastname" populateInitially="true"/>
					<attribute name="fax"/>
					<attribute name="email"/>
					<attribute name="title"/>
					<attribute name="department"/>
					<attribute name="description"/>
					<attribute name="mobile"/>
					<attribute name="telephone"/>
					<attribute name="streetaddress"/>
					<attribute name="uniquename" populateInitially="true"/>
				</nameSpace>
    			<nameSpace name="com.sap.security.core.usermanagement.relation">
    					<attribute name="PRINCIPAL_RELATION_PARENT_ATTRIBUTE"/>
    			</nameSpace>
    			<nameSpace name="$usermapping$">
    					<attribute name="REFERENCE_SYSTEM_USER"/>
    			</nameSpace>
    		</principal>
    		<principal type="group">
	    		<nameSpace name="com.sap.security.core.usermanagement">
		    		<attribute name="displayname" populateInitially="true"/>
			    	<attribute name="description" populateInitially="true"/>
				    <attribute name="uniquename"/>
	 			</nameSpace>
 				<nameSpace name="com.sap.security.core.usermanagement.relation">
					<attribute name="PRINCIPAL_RELATION_MEMBER_ATTRIBUTE"/>
					<attribute name="PRINCIPAL_RELATION_PARENT_ATTRIBUTE"/>
				</nameSpace>
				<nameSpace name="com.sap.security.core.bridge">
					<attribute name="dn"/>
				</nameSpace>
			</principal>
		</responsibleFor>
		<attributeMapping>
			<principal type="account">
				<nameSpace name="com.sap.security.core.usermanagement">
					<attribute name="j_user">
						<physicalAttribute name="samaccountname"/>
					</attribute>
					<attribute name="logonalias">
						<physicalAttribute name="samaccountname"/>
					</attribute>
					<attribute name="j_password">
						<physicalAttribute name="unicodepwd"/>
					</attribute>
					<attribute name="userid">
						<physicalAttribute name="*null*"/>
					</attribute>
				</nameSpace>
    			<nameSpace name="com.sap.security.core.authentication">
    				<attribute name="principal">
    					<physicalAttribute name="samaccountname"/>
    				</attribute>
    				<attribute name="realm">
    					<physicalAttribute name="*null*"/>
    				</attribute>
    				<attribute name="domain">
    					<physicalAttribute name="*null*"/>
    				</attribute>
    			</nameSpace>				
			</principal>
			<principal type="user">
				<nameSpace name="com.sap.security.core.usermanagement">
					<attribute name="firstname">
						<physicalAttribute name="givenname"/>
					</attribute>
					<attribute name="displayname">
						<physicalAttribute name="displayname"/>
					</attribute>
					<attribute name="lastname">
						<physicalAttribute name="sn"/>
					</attribute>
					<attribute name="fax">
						<physicalAttribute name="facsimiletelephonenumber"/>
					</attribute>
					<attribute name="uniquename">
						<physicalAttribute name="samaccountname"/>
					</attribute>
					<attribute name="loginid">
						<physicalAttribute name="*null*"/>
					</attribute>
					<attribute name="email">
						<physicalAttribute name="mail"/>
					</attribute>
					<attribute name="mobile">
						<physicalAttribute name="mobile"/>
					</attribute>
					<attribute name="telephone">
						<physicalAttribute name="telephonenumber"/>
					</attribute>
					<attribute name="department">
						<physicalAttribute name="ou"/>
					</attribute>
					<attribute name="description">
						<physicalAttribute name="description"/>
					</attribute>
					<attribute name="streetaddress">
						<physicalAttribute name="postaladdress"/>
					</attribute>
					<attribute name="pobox">
						<physicalAttribute name="postofficebox"/>
					</attribute>
				</nameSpace>
				<nameSpace name="com.sap.security.core.usermanagement.relation">
					<attribute name="PRINCIPAL_RELATION_PARENT_ATTRIBUTE">
						<physicalAttribute name="*null*"/>
					</attribute>
				</nameSpace>
				<nameSpace name="$usermapping$">
					<attribute name="REFERENCE_SYSTEM_USER">
						<physicalAttribute name="sapusername"/>
					</attribute>
				</nameSpace>
			</principal>
			<principal type="group">
				<nameSpace name="com.sap.security.core.usermanagement">
					<attribute name="displayname">
						<physicalAttribute name="displayname"/>
					</attribute>
					<attribute name="description">
						<physicalAttribute name="description"/>
					</attribute>
					<attribute name="uniquename" populateInitially="true">
						<physicalAttribute name="ou"/>
					</attribute>
				</nameSpace>
				<nameSpace name="com.sap.security.core.usermanagement.relation">
					<attribute name="PRINCIPAL_RELATION_MEMBER_ATTRIBUTE">
						<physicalAttribute name="*null*"/>
					</attribute>
					<attribute name="PRINCIPAL_RELATION_PARENT_ATTRIBUTE">
						<physicalAttribute name="*null*"/>
					</attribute>
				</nameSpace>
				<nameSpace name="com.sap.security.core.bridge">
					<attribute name="dn">
						<physicalAttribute name="*null*"/>
					</attribute>
				</nameSpace>
			</principal>
		</attributeMapping>
		<privateSection>
            <ume.ldap.access.extended_search_size>900</ume.ldap.access.extended_search_size>
			<ume.ldap.access.server_type>MSADS</ume.ldap.access.server_type>
			<ume.ldap.access.context_factory>com.sun.jndi.ldap.LdapCtxFactory</ume.ldap.access.context_factory>
			<ume.ldap.access.authentication>simple</ume.ldap.access.authentication>
			<ume.ldap.access.flat_group_hierachy>false</ume.ldap.access.flat_group_hierachy>
			<ume.ldap.access.user_as_account>true</ume.ldap.access.user_as_account>
			<ume.ldap.access.dynamic_groups>false</ume.ldap.access.dynamic_groups>
			<ume.ldap.access.ssl_socket_factory>com.sap.security.core.server.https.SecureConnectionFactory</ume.ldap.access.ssl_socket_factory>
			<ume.ldap.access.objectclass.user>User</ume.ldap.access.objectclass.user>
			<ume.ldap.access.objectclass.uacc>User</ume.ldap.access.objectclass.uacc>
			<ume.ldap.access.objectclass.grup>organizationalUnit</ume.ldap.access.objectclass.grup>
			<ume.ldap.access.naming_attribute.user>cn</ume.ldap.access.naming_attribute.user>
			<ume.ldap.access.auxiliary_naming_attribute.user>samaccountname</ume.ldap.access.auxiliary_naming_attribute.user>
			<ume.ldap.access.naming_attribute.uacc>cn</ume.ldap.access.naming_attribute.uacc>
			<ume.ldap.access.auxiliary_naming_attribute.uacc>samaccountname</ume.ldap.access.auxiliary_naming_attribute.uacc>
			<ume.ldap.access.naming_attribute.grup>ou</ume.ldap.access.naming_attribute.grup>
		</privateSection>
	</dataSource>
</dataSources>

How can I fetch all the accounts when LDAP accounts are more than 1000 ?
Thanks