out of memory when trying to parse Excel 2016 xlsx file > 3mb

[drvolk]

Hello,

the issue for "out of memory" for large files seams not to be fixed in the environment i use.

I have a Win10 64bit System , 8GB RAM and running ActiveState perl v5.24.2 (MSWin32-x86-multi-thread-64int).
The Version of the Spreadsheet::ParseXLSX packages is 0.27 and the XML::Twig is 3.52 so everything seams to be up to date ...

I tried to parse an Excel 2016 file with a size of nearly 3000 kb (see attachments), wih following script an getting the "out of memory" problem:

use Spreadsheet::ParseXLSX;
my $parser = Spreadsheet::ParseXLSX->new;
print("parsing <$ARGV[0]> ...\n");
XML::Twig::_set_weakrefs(0);
my $workbook = $parser->parse($ARGV[0]);

perl test_excel.pl test_exelv2.xlsx
parsing <test_exelv1.xlsx> ...
Out of memory!

test_exelv2.xlsx
systeminfo.docx
spreadsheet_parsexllx_Twig_version.txt

[bulrush15]

I'm also getting an out of memory error when I try to parse XLSX files, my file is 24.5mb. The error happens in XML::Twig. Out of memory! XML::Twig::DESTROY(c:/perlchuck/site/lib/XML/Twig.pm:3919):

My machine is Windows Server 2012, has 32GB of memory and Perl is Activestate perl:

C:\PerlProgs\Chuck\chuck\findcrlf>perl -v

This is perl 5, version 16, subversion 3 (v5.16.3) built for MSWin32-x86-multi-thread
(with 1 registered patch, see perl -V for more detail)

Copyright 1987-2012, Larry Wall

Binary build 1603 [296746] provided by ActiveState http://www.ActiveState.com
Built Mar 13 2013 11:29:21

Module info:

Current Activestate Perl version: v5.16.3
  Spreadsheet::ParseXLSX version 0.23
  XML::Twig version 3.49

• We cannot upgrade this perl as it is used by an app by another vendor, and I had to put modules I installed into another whole directory tree so it wouldn't affect the original vendor modules.
• It also seems that we cannot upgrade Spreadsheet::ParseXLSX because we have Perl 5.16.
• Perl is 32 bit and was using 1.9GB of memory. Why it should use that to parse a 24.5mb file is beyond me. At most I would expect the XLSX file (which is a zip file of multiple XML/text files, and in my case, no images) to expand to 300% of the compressed size, or about 75mb.
• My spreadsheet had 48,000 lines, and was probably edited on both a Mac and Windows version of Excel. Making a brand new spreadsheet only on Windows may not duplicate the problem.

If an upgrade for Activestate perl would actually help would someone let me know? I might be able to update the 2nd installation of perl and use that perl.exe for certain tasks.

UPDATE: I made a brand new XLSX file by right clicking the directory, and choosing "New Excel File". Then I opened both XLSX files and copied the one tab I need from the old file to the new XLSX file and tried to get perl to read it. I still got the same errors.

From this page I'm going to try this in my Perl program: XML::Twig::_set_weakrefs(0).