• Overflow

    By Paul J Whitehead 1 decade ago

    When running a report against a (personnel & training) database with about 48,500 records Notes crashes with an "Overflow" message and must be restarted. Running the same "report setup" against a 'trimmed down' version of the database successfully creates the Excel spreadsheet.



    Search Formula ONLY

    Form = ".SkillsTrainingRecord" & Status = "1" & SkillOrCourse = "3"

    reporting 5 fields only



    Domino 6.5.4FP3 (W2K3 server), Notes 6.5.4, Excel 2007, WinXP sp2

    • Re: overflow

      By Johnny Jiang 1 decade ago

      Hi Paul,



      Thanks for the detailed info.



      I encountered this problem a long time back where I was trying to merge 2 datasets containing over 20k docs(each). Notes Reconn stores data as XML in memory, which is memory hungry especially when dealing with huge amount of data. This is one of the reasons I decided to re-write the datastore part in Notes Reconn version 3.0. The new version is able to process over 300K docs at a time, I'm sure we could solve this issue in next version without using XML.



      You are welcome to take the following survey to let us know what are you expecting from the new version:

      http://ow.ly/nxXp



      Thanks and regards,

      Johnny

      • By Paul J Whitehead 1 decade ago

        Hi Jonny



        A little more information …



        When I opened an unrelated document in Excel today a spreadsheet was recovered (much to my surprise) containing 32,767 rows - a number which you will no doubt recognise as the maximum value allowed by the short integer type. If you know where the code is - it could be an easy fix.



        Hope this helps.



        This is already a fantastic tool - so a big thankyou to all chefs.



        Paul

        • re: re: overflow

          By Johnny Jiang 1 decade ago

          Hi Paul,



          Thanks, I do remember I've changed the type of the counter from integer to long months ago, I will double check if there are any other integers need to be changed.



          Your info makes great sense, appreciate that.



          Kind regards,

          Johnny

          • Found this

            By Olli Kämäräinen 1 decade ago

            There is SetCell-sub in MSOffice-Excel library that is still using integer as row counter. That is the place

            where error happens.

            Sub is also called from Reporting-XMLDataSet-Excel -library and there is one row that needs to be

            changed.

            from:

            m_Row As Integer 'Current row index

            to:

            m_Row As Long 'Current row index

            I'm using version 2.4.

      • Schedule for R3?

        By Olli Kämäräinen 1 decade ago

        Hi Johnny!



        Do you have any kind of schedule for next major release? I found some other ways to run biggest reports

        but it would be great to use Reconn for those also.

        I need to create reports out of 50k of documents and each contains more than 20 fields to export.





        Olli

        • Re: release 3.0

          By Johnny Jiang 1 decade ago

          Hi Olli,



          Glad to hear that, I look forward to your idea, we can have further discussion via email

          johnny.jiang(at)yahoo.com.au



          I'd like to give an update on release 3.0, which I've been working on in the past 6 months. Release 3.0 is adopting Java open source libraries such as HSQLDB and JasperReports. HSQLDB is the data store, JasperReports is for outputing reports in a variety of formats. R3 is being developed with JDK1.3 as we are making R3.0 compatible with Notes R6, 7, and 8. So far we've come up with a raw version where we can generate PDF reports.



          You've been very helpful for Notes Reconn, and we appreciate your contribution. You are very welcome to discuss anything relating to Notes Reconn.



          Kind regards,

          Johnny