View Issue Details
| ID | Project | Category | View Status | Date Submitted | Last Update |
|---|---|---|---|---|---|
| 0002408 | gnunet-gtk | gnunet-fs-gtk | public | 2012-06-07 16:37 | 2012-11-05 17:32 |
| Reporter | h4ck3rm1k3 | Assigned To | Christian Grothoff | Due Date | |
| Priority | normal | Severity | major | Reproducibility | have not tried |
| Status | closed | Resolution | fixed | ||
| Product Version | 0.9.3 | ||||
| Target Version | 0.9.4 | Fixed in Version | 0.9.4 | ||
| Summary | 0002408: Adding files runs out of open files | ||||
| Description | now i am getting this error when publishing files : Jun 07 16:33:10-963033 util-818 ERROR `mkstemp' failed on file `/home/mdupont/.gnunet/fs/persistence//gnunet-fs-gtk/publish-file/kTDxvY' at disk.c:448 with error: Too many open files | ||||
| Steps To Reproduce | add lots of files and directories | ||||
| Tags | No tags attached. | ||||
| Attached Files | |||||
| I have attached a file in zip and tgz format that contains the data that causes the problem, need to unpack it first. thanks, mike | |
| Ok, thanks. Looks like fs fails to close FDs in a timely fashion when it's done with them: $ lsof -p 9191 COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME memcheck- 9191 grothoff 637r REG 254,0 172 11674114 /home/grothoff/test/5/0/4/0/5/5/4/3/8/d memcheck- 9191 grothoff 638r REG 254,0 172 11674112 /home/grothoff/test/5/0/4/0/5/5/4/3/6/d memcheck- 9191 grothoff 639r REG 254,0 172 11674116 /home/grothoff/test/5/0/4/0/5/5/4/3/9/d memcheck- 9191 grothoff 640r REG 254,0 172 11674110 /home/grothoff/test/5/0/4/0/5/5/4/3/2/d memcheck- 9191 grothoff 641r REG 254,0 172 11674128 /home/grothoff/test/5/0/4/0/5/5/4/5/4/d memcheck- 9191 grothoff 642r REG 254,0 172 11674130 /home/grothoff/test/5/0/4/0/5/5/4/5/7/d memcheck- 9191 grothoff 643r REG 254,0 172 11674123 /home/grothoff/test/5/0/4/0/5/5/4/4/6/d memcheck- 9191 grothoff 644r REG 254,0 172 11674121 /home/grothoff/test/5/0/4/0/5/5/4/4/4/d memcheck- 9191 grothoff 645r REG 254,0 172 11674125 /home/grothoff/test/5/0/4/0/5/5/4/4/9/d memcheck- 9191 grothoff 646r REG 254,0 172 11674119 /home/grothoff/test/5/0/4/0/5/5/4/4/2/d memcheck- 9191 grothoff 647r REG 254,0 172 11674152 /home/grothoff/test/5/0/4/0/5/5/4/9/3/d memcheck- 9191 grothoff 648r REG 254,0 172 11674142 /home/grothoff/test/5/0/4/0/5/5/4/7/6/d memcheck- 9191 grothoff 649r REG 254,0 172 11674140 /home/grothoff/test/5/0/4/0/5/5/4/7/2/d memcheck- 9191 grothoff 650r REG 254,0 172 11674098 /home/grothoff/test/5/0/4/0/5/5/4/1/3/d memcheck- 9191 grothoff 651r REG 254,0 172 11674100 /home/grothoff/test/5/0/4/0/5/5/4/1/7/d memcheck- 9191 grothoff 652r REG 254,0 172 11674107 /home/grothoff/test/5/0/4/0/5/5/4/2/8/d memcheck- 9191 grothoff 653r REG 254,0 172 11674105 /home/grothoff/test/5/0/4/0/5/5/4/2/5/d memcheck- 9191 grothoff 654r REG 254,0 172 11674103 /home/grothoff/test/5/0/4/0/5/5/4/2/1/d memcheck- 9191 grothoff 655r REG 254,0 172 11649237 /home/grothoff/test/5/0/4/0/5/5/9/8/8/d memcheck- 9191 grothoff 656r REG 254,0 172 11649235 /home/grothoff/test/5/0/4/0/5/5/9/8/5/d (... and many more) | |
| Fixed in SVN 21800. The issue was that inlining files into directories didn't include a call to instantly clean up the FD. So the problem would ONLY show if one tried to publish >1000 *small* files (<32k or so). Thanks for reporting and the nice test! | |
| Date Modified | Username | Field | Change |
|---|---|---|---|
| 2012-06-07 16:37 | h4ck3rm1k3 | New Issue | |
| 2012-06-07 16:52 | Christian Grothoff | Assigned To | => Christian Grothoff |
| 2012-06-07 16:52 | Christian Grothoff | Status | new => assigned |
| 2012-06-07 17:57 | h4ck3rm1k3 | File Added: crash.tgz | |
| 2012-06-07 17:58 | h4ck3rm1k3 | File Added: test.zip | |
| 2012-06-07 17:58 | h4ck3rm1k3 | Note Added: 0006011 | |
| 2012-06-07 20:36 | Christian Grothoff | Note Added: 0006021 | |
| 2012-06-07 21:06 | Christian Grothoff | Severity | minor => major |
| 2012-06-07 21:06 | Christian Grothoff | Target Version | => 0.9.4 |
| 2012-06-07 21:12 | Christian Grothoff | Note Added: 0006025 | |
| 2012-06-07 21:13 | Christian Grothoff | Status | assigned => resolved |
| 2012-06-07 21:13 | Christian Grothoff | Fixed in Version | => 0.9.4 |
| 2012-06-07 21:13 | Christian Grothoff | Resolution | open => fixed |
| 2012-11-05 17:32 | Christian Grothoff | Status | resolved => closed |