View Issue Details

IDProjectCategoryView StatusLast Update
0001430libextractorpluginspublic2009-02-20 10:54
ReporterChristian Grothoff Assigned ToChristian Grothoff Due Date
PriorityurgentSeveritymajorReproducibilityalways
Status closedResolutionfixed 
Summary0001430: Files larger than 2^32 do not work properly
DescriptionC. Dominik Bodi" <dominik.bodi@gmx.de> writes:

I've found a discrepancy between the file size reported using gnunet-search
and the file of the size inserted.

For instance, the 1st amd64 DVD of the Debian 4.0 r4a release:
4690843648 debian-40r4a-amd64-DVD-1.iso
gnunet-insert and gnunet-search report URI
gnunet://ecrs/chk/2P5HV6726BM4P76NGL67MO3UL9SVOI1Q04T0EM07QPRER4HMNU6AM5UHJ50FSUTE4J16NFTV812P43P024I8F1TUVFGLI0QJQ751UO8.NNF7H4N32GMEEDTICAEC808C45OBVLEOQDJG54SEFSCEB0RCQK0AN5G0BG3ATA1U6HCLS8V0FCM144UPQTQCEE8K0SR28BJPSAU16DG.4690843648

However, gnunet-search says the file is 395.88 MB large. Coincidentally, when
using decimal MB, this is almost exactly the remainder result when dividing
the correct file size by 2^32.

It seems for some reason either gnunet-insert or another part of the gnunet
system is not able to cope with files larger than 2^32. Seems the variables
storing the file sizes are 32 bits only.

I'm using gnunet 0.8.0b on a Debian unstable (sid) system.
TagsNo tags attached.

Activities

Christian Grothoff

2008-11-08 01:24

manager   ~0003730

What is the exact output of gnunet-search (or wherever) where the wrong file-size is reported?

Christian Grothoff

2008-11-08 01:24

manager   ~0003731

And what is the output of "extract" for the given 4GB+ file?

Christian Grothoff

2009-02-02 07:33

manager   ~0003767

Finally managed to finish the ISO download. Now I can actually try to reproduce...

Christian Grothoff

2009-02-02 20:29

manager   ~0003769

Ok, so after inserting I get:

Upload of `/home/grothoff/debian-40r4a-amd64-DVD-1.iso' complete, 4690843648 bytes took 7328 seconds ( 625.072 KiB/s).
File `/home/grothoff/debian-40r4a-amd64-DVD-1.iso' has URI: gnunet://ecrs/chk/2P5HV6726BM4P76NGL67MO3UL9SVOI1Q04T0EM07QPRER4HMNU6AM5UHJ50FSUTE4J16NFTV812P43P024I8F1TUVFGLI0QJQ751UO8.NNF7H4N32GMEEDTICAEC808C45OBVLEOQDJG54SEFSCEB0RCQK0AN5G0BG3ATA1U6HCLS8V0FCM144UPQTQCEE8K0SR28BJPSAU16DG.4690843648

So far so good.

Christian Grothoff

2009-02-02 20:30

manager   ~0003770

Ok, so gnunet-search then gives:

$ gnunet-search debian-40r4a-amd64-DVD-1.iso
gnunet://ecrs/chk/2P5HV6726BM4P76NGL67MO3UL9SVOI1Q04T0EM07QPRER4HMNU6AM5UHJ50FSUTE4J16NFTV812P43P024I8F1TUVFGLI0QJQ751UO8.NNF7H4N32GMEEDTICAEC808C45OBVLEOQDJG54SEFSCEB0RCQK0AN5G0BG3ATA1U6HCLS8V0FCM144UPQTQCEE8K0SR28BJPSAU16DG.4690843648:
gnunet-download -o "debian-40r4a-amd64-DVD-1.iso" gnunet://ecrs/chk/2P5HV6726BM4P76NGL67MO3UL9SVOI1Q04T0EM07QPRER4HMNU6AM5UHJ50FSUTE4J16NFTV812P43P024I8F1TUVFGLI0QJQ751UO8.NNF7H4N32GMEEDTICAEC808C45OBVLEOQDJG54SEFSCEB0RCQK0AN5G0BG3ATA1U6HCLS8V0FCM144UPQTQCEE8K0SR28BJPSAU16DG.4690843648
        publication date: Mon Feb 2 08:30:19 2009

                filesize: 395.88 MB
                filename: debian-40r4a-amd64-DVD-1.iso

Christian Grothoff

2009-02-02 21:01

manager   ~0003771

Culprit found:

$ extract -f debian-40r4a-amd64-DVD-1.iso
filesize - 395.88 MB
filename - debian-40r4a-amd64-DVD-1.iso

Christian Grothoff

2009-02-02 21:06

manager   ~0003772

Fixed in SVN 8174.

Issue History

Date ModifiedUsernameFieldChange
2008-10-05 22:14Christian GrothoffNew Issue
2008-11-08 01:24Christian GrothoffNote Added: 0003730
2008-11-08 01:24Christian GrothoffStatusnew => feedback
2008-11-08 01:24Christian GrothoffNote Added: 0003731
2009-02-02 07:33Christian GrothoffNote Added: 0003767
2009-02-02 07:34Christian GrothoffStatusfeedback => assigned
2009-02-02 07:34Christian GrothoffAssigned To => Christian Grothoff
2009-02-02 20:29Christian GrothoffNote Added: 0003769
2009-02-02 20:30Christian GrothoffNote Added: 0003770
2009-02-02 21:01Christian GrothoffNote Added: 0003771
2009-02-02 21:06Christian GrothoffNote Added: 0003772
2009-02-02 21:07Christian GrothoffProject@3@ => libextractor
2009-02-02 21:07Christian GrothoffCategorygnunet-search => plugins
2009-02-02 21:07Christian GrothoffProduct Version0.8.0b =>
2009-02-02 21:08Christian GrothoffStatusassigned => resolved
2009-02-02 21:08Christian GrothoffResolutionopen => fixed
2009-02-20 10:54Christian GrothoffStatusresolved => closed