Skip to Content
avatar image
Former Member

Is there a record limitation with flat file with a csv extension?

I have migrated a flat file load in BI 7.0 and now it seems there is a record limitation of 65k rows in the file. I am getting the following error mesage in the monitor: option =2. CSV split errorr: 2 =other problem with the escape character.

If I use a file with less than 65K rows ( and I mean 1 less than ) I get no error and if I use a file with more than 65K ( and I mean 1 more ) I get the error. Is there a setting somewhere that is setting the load limit to 65K or is this a real limitation?

Add comment
10|10000 characters needed characters exceeded

  • Get RSS Feed

4 Answers

  • Best Answer
    avatar image
    Former Member
    Oct 11, 2007 at 01:41 PM

    Hi

    There is no record limitation in BW side. The limitations are ruled by the limitations of the flat file... In Old excel, only 65k rows allowed and in MS-2007 upto 1 million rows possible and you can extract them

    Regards

    N Ganesh

    Add comment
    10|10000 characters needed characters exceeded

    • Former Member Former Member

      Some more thing you can try.

      Try to reduce the Inpackage Packet Size.

      If all these things are not working then we have to split the file and load it. Espescially with BI 7.0 I have also faced this problem and finally I split the file and loaded the data.

      Regs

      Gopi

  • avatar image
    Former Member
    Oct 11, 2007 at 11:23 AM

    If you open the CSV in excel then you have the limitaition.

    Try to open the CSV in Notepad.

    Regs

    Gopi

    Add comment
    10|10000 characters needed characters exceeded

  • avatar image
    Former Member
    Oct 11, 2007 at 11:24 AM

    This is the limitation of MS Excel. I don't think we can increase it.

    Regards

    Pankaj

    Add comment
    10|10000 characters needed characters exceeded

  • avatar image
    Former Member
    Oct 11, 2007 at 11:45 AM

    Yes I realize that 65K is a limitation in excel, however we have no problem loading csv files in excess of 65K records using a 3.x datasource. This appears to be a new limitation with BI 7.0 datasource.

    Add comment
    10|10000 characters needed characters exceeded