View Issue Details

IDProjectCategoryView StatusLast Update
0002408gnunet-gtkgnunet-fs-gtkpublic2012-11-05 18:32
Reporterh4ck3rm1k3 Assigned ToChristian Grothoff  
PrioritynormalSeveritymajorReproducibilityhave not tried
Status closedResolutionfixed 
Product Version0.9.3 
Target Version0.9.4Fixed in Version0.9.4 
Summary0002408: Adding files runs out of open files
Descriptionnow i am getting this error when publishing files :
Jun 07 16:33:10-963033 util-818 ERROR `mkstemp' failed on file `/home/mdupont/.gnunet/fs/persistence//gnunet-fs-gtk/publish-file/kTDxvY' at disk.c:448 with error: Too many open files
Steps To Reproduceadd lots of files and directories
TagsNo tags attached.
Attached Files
crash.tgz (87,583 bytes)
test.zip (716,571 bytes)

Activities

h4ck3rm1k3

2012-06-07 19:58

reporter   ~0006011

I have attached a file in zip and tgz format that contains the data that causes the problem, need to unpack it first.
thanks,
mike

Christian Grothoff

2012-06-07 22:36

manager   ~0006021

Ok, thanks. Looks like fs fails to close FDs in a timely fashion when it's done with them:

$ lsof -p 9191
COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME
memcheck- 9191 grothoff 637r REG 254,0 172 11674114 /home/grothoff/test/5/0/4/0/5/5/4/3/8/d
memcheck- 9191 grothoff 638r REG 254,0 172 11674112 /home/grothoff/test/5/0/4/0/5/5/4/3/6/d
memcheck- 9191 grothoff 639r REG 254,0 172 11674116 /home/grothoff/test/5/0/4/0/5/5/4/3/9/d
memcheck- 9191 grothoff 640r REG 254,0 172 11674110 /home/grothoff/test/5/0/4/0/5/5/4/3/2/d
memcheck- 9191 grothoff 641r REG 254,0 172 11674128 /home/grothoff/test/5/0/4/0/5/5/4/5/4/d
memcheck- 9191 grothoff 642r REG 254,0 172 11674130 /home/grothoff/test/5/0/4/0/5/5/4/5/7/d
memcheck- 9191 grothoff 643r REG 254,0 172 11674123 /home/grothoff/test/5/0/4/0/5/5/4/4/6/d
memcheck- 9191 grothoff 644r REG 254,0 172 11674121 /home/grothoff/test/5/0/4/0/5/5/4/4/4/d
memcheck- 9191 grothoff 645r REG 254,0 172 11674125 /home/grothoff/test/5/0/4/0/5/5/4/4/9/d
memcheck- 9191 grothoff 646r REG 254,0 172 11674119 /home/grothoff/test/5/0/4/0/5/5/4/4/2/d
memcheck- 9191 grothoff 647r REG 254,0 172 11674152 /home/grothoff/test/5/0/4/0/5/5/4/9/3/d
memcheck- 9191 grothoff 648r REG 254,0 172 11674142 /home/grothoff/test/5/0/4/0/5/5/4/7/6/d
memcheck- 9191 grothoff 649r REG 254,0 172 11674140 /home/grothoff/test/5/0/4/0/5/5/4/7/2/d
memcheck- 9191 grothoff 650r REG 254,0 172 11674098 /home/grothoff/test/5/0/4/0/5/5/4/1/3/d
memcheck- 9191 grothoff 651r REG 254,0 172 11674100 /home/grothoff/test/5/0/4/0/5/5/4/1/7/d
memcheck- 9191 grothoff 652r REG 254,0 172 11674107 /home/grothoff/test/5/0/4/0/5/5/4/2/8/d
memcheck- 9191 grothoff 653r REG 254,0 172 11674105 /home/grothoff/test/5/0/4/0/5/5/4/2/5/d
memcheck- 9191 grothoff 654r REG 254,0 172 11674103 /home/grothoff/test/5/0/4/0/5/5/4/2/1/d
memcheck- 9191 grothoff 655r REG 254,0 172 11649237 /home/grothoff/test/5/0/4/0/5/5/9/8/8/d
memcheck- 9191 grothoff 656r REG 254,0 172 11649235 /home/grothoff/test/5/0/4/0/5/5/9/8/5/d
(... and many more)

Christian Grothoff

2012-06-07 23:12

manager   ~0006025

Fixed in SVN 21800. The issue was that inlining files into directories didn't include a call to instantly clean up the FD. So the problem would ONLY show if one tried to publish >1000 *small* files (<32k or so). Thanks for reporting and the nice test!

Issue History

Date Modified Username Field Change
2012-06-07 18:37 h4ck3rm1k3 New Issue
2012-06-07 18:52 Christian Grothoff Assigned To => Christian Grothoff
2012-06-07 18:52 Christian Grothoff Status new => assigned
2012-06-07 19:57 h4ck3rm1k3 File Added: crash.tgz
2012-06-07 19:58 h4ck3rm1k3 File Added: test.zip
2012-06-07 19:58 h4ck3rm1k3 Note Added: 0006011
2012-06-07 22:36 Christian Grothoff Note Added: 0006021
2012-06-07 23:06 Christian Grothoff Severity minor => major
2012-06-07 23:06 Christian Grothoff Target Version => 0.9.4
2012-06-07 23:12 Christian Grothoff Note Added: 0006025
2012-06-07 23:13 Christian Grothoff Status assigned => resolved
2012-06-07 23:13 Christian Grothoff Fixed in Version => 0.9.4
2012-06-07 23:13 Christian Grothoff Resolution open => fixed
2012-11-05 18:32 Christian Grothoff Status resolved => closed