View Issue Details

IDProjectCategoryView StatusLast Update
0001430libextractorpluginspublic2009-02-20 11:54
ReporterChristian Grothoff Assigned ToChristian Grothoff  
PriorityurgentSeveritymajorReproducibilityalways
Status closedResolutionfixed 
Summary0001430: Files larger than 2^32 do not work properly
DescriptionC. Dominik Bodi" <dominik.bodi@gmx.de> writes:

I've found a discrepancy between the file size reported using gnunet-search
and the file of the size inserted.

For instance, the 1st amd64 DVD of the Debian 4.0 r4a release:
4690843648 debian-40r4a-amd64-DVD-1.iso
gnunet-insert and gnunet-search report URI
gnunet://ecrs/chk/2P5HV6726BM4P76NGL67MO3UL9SVOI1Q04T0EM07QPRER4HMNU6AM5UHJ50FSUTE4J16NFTV812P43P024I8F1TUVFGLI0QJQ751UO8.NNF7H4N32GMEEDTICAEC808C45OBVLEOQDJG54SEFSCEB0RCQK0AN5G0BG3ATA1U6HCLS8V0FCM144UPQTQCEE8K0SR28BJPSAU16DG.4690843648

However, gnunet-search says the file is 395.88 MB large. Coincidentally, when
using decimal MB, this is almost exactly the remainder result when dividing
the correct file size by 2^32.

It seems for some reason either gnunet-insert or another part of the gnunet
system is not able to cope with files larger than 2^32. Seems the variables
storing the file sizes are 32 bits only.

I'm using gnunet 0.8.0b on a Debian unstable (sid) system.
TagsNo tags attached.

Activities

Christian Grothoff

2008-11-08 02:24

manager   ~0003730

What is the exact output of gnunet-search (or wherever) where the wrong file-size is reported?

Christian Grothoff

2008-11-08 02:24

manager   ~0003731

And what is the output of "extract" for the given 4GB+ file?

Christian Grothoff

2009-02-02 08:33

manager   ~0003767

Finally managed to finish the ISO download. Now I can actually try to reproduce...

Christian Grothoff

2009-02-02 21:29

manager   ~0003769

Ok, so after inserting I get:

Upload of `/home/grothoff/debian-40r4a-amd64-DVD-1.iso' complete, 4690843648 bytes took 7328 seconds ( 625.072 KiB/s).
File `/home/grothoff/debian-40r4a-amd64-DVD-1.iso' has URI: gnunet://ecrs/chk/2P5HV6726BM4P76NGL67MO3UL9SVOI1Q04T0EM07QPRER4HMNU6AM5UHJ50FSUTE4J16NFTV812P43P024I8F1TUVFGLI0QJQ751UO8.NNF7H4N32GMEEDTICAEC808C45OBVLEOQDJG54SEFSCEB0RCQK0AN5G0BG3ATA1U6HCLS8V0FCM144UPQTQCEE8K0SR28BJPSAU16DG.4690843648

So far so good.

Christian Grothoff

2009-02-02 21:30

manager   ~0003770

Ok, so gnunet-search then gives:

$ gnunet-search debian-40r4a-amd64-DVD-1.iso
gnunet://ecrs/chk/2P5HV6726BM4P76NGL67MO3UL9SVOI1Q04T0EM07QPRER4HMNU6AM5UHJ50FSUTE4J16NFTV812P43P024I8F1TUVFGLI0QJQ751UO8.NNF7H4N32GMEEDTICAEC808C45OBVLEOQDJG54SEFSCEB0RCQK0AN5G0BG3ATA1U6HCLS8V0FCM144UPQTQCEE8K0SR28BJPSAU16DG.4690843648:
gnunet-download -o "debian-40r4a-amd64-DVD-1.iso" gnunet://ecrs/chk/2P5HV6726BM4P76NGL67MO3UL9SVOI1Q04T0EM07QPRER4HMNU6AM5UHJ50FSUTE4J16NFTV812P43P024I8F1TUVFGLI0QJQ751UO8.NNF7H4N32GMEEDTICAEC808C45OBVLEOQDJG54SEFSCEB0RCQK0AN5G0BG3ATA1U6HCLS8V0FCM144UPQTQCEE8K0SR28BJPSAU16DG.4690843648
        publication date: Mon Feb 2 08:30:19 2009

                filesize: 395.88 MB
                filename: debian-40r4a-amd64-DVD-1.iso

Christian Grothoff

2009-02-02 22:01

manager   ~0003771

Culprit found:

$ extract -f debian-40r4a-amd64-DVD-1.iso
filesize - 395.88 MB
filename - debian-40r4a-amd64-DVD-1.iso

Christian Grothoff

2009-02-02 22:06

manager   ~0003772

Fixed in SVN 8174.

Issue History

Date Modified Username Field Change
2008-10-06 00:14 Christian Grothoff New Issue
2008-11-08 02:24 Christian Grothoff Note Added: 0003730
2008-11-08 02:24 Christian Grothoff Status new => feedback
2008-11-08 02:24 Christian Grothoff Note Added: 0003731
2009-02-02 08:33 Christian Grothoff Note Added: 0003767
2009-02-02 08:34 Christian Grothoff Status feedback => assigned
2009-02-02 08:34 Christian Grothoff Assigned To => Christian Grothoff
2009-02-02 21:29 Christian Grothoff Note Added: 0003769
2009-02-02 21:30 Christian Grothoff Note Added: 0003770
2009-02-02 22:01 Christian Grothoff Note Added: 0003771
2009-02-02 22:06 Christian Grothoff Note Added: 0003772
2009-02-02 22:07 Christian Grothoff Project GNUnet 0.8.x => libextractor
2009-02-02 22:07 Christian Grothoff Category gnunet-search => plugins
2009-02-02 22:07 Christian Grothoff Product Version 0.8.0b =>
2009-02-02 22:08 Christian Grothoff Status assigned => resolved
2009-02-02 22:08 Christian Grothoff Resolution open => fixed
2009-02-20 11:54 Christian Grothoff Status resolved => closed