View Issue Details
| ID | Project | Category | View Status | Date Submitted | Last Update |
|---|---|---|---|---|---|
| 0001985 | GNUnet | transport service | public | 2011-12-06 15:20 | 2012-02-28 11:05 |
| Reporter | Christian Grothoff | Assigned To | Matthias Wachs | ||
| Priority | urgent | Severity | major | Reproducibility | always |
| Status | closed | Resolution | fixed | ||
| Platform | i7 | OS | Debian GNU/Linux | OS Version | squeeze |
| Product Version | 0.9.0 | ||||
| Target Version | 0.9.2 | ||||
| Summary | 0001985: statistics paints a very inconsistent picture of the network | ||||
| Description | Here is what we get after running a peer for a while: gnunet9@tripwire:~$ gnunet-statistics -s transport | grep "peers connected" transport # peers connected : 81 gnunet9@tripwire:~$ gnunet-statistics -s transport | grep "TCP sessions active" transport # TCP sessions active : 137 gnunet9@tripwire:~$ gnunet-statistics -s core | grep "entries in session map" core # entries in session map : 5 So 137 TCP reported, but only 81 transport and finally only 5 core!? File-sharing finally only reports 3 (!). Now, what is actually going on? This is interesting as well: $ ps ax | grep transport 5974 pts/9 S+ 0:00 grep transport 19399 ? SN 0:04 gnunet-service-transport -c /home/gnunet9/.gnunet/gnunet.conf -l ~/.gnunet//transport-logs $ netstat -ntp 19399 | grep ESTAB | grep -v 127 (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) tcp 0 101570 131.159.74.67:2086 66.85.186.230:45422 ESTABLISHED 19399/gnunet-servic tcp 0 0 131.159.74.67:9989 193.196.39.10:57490 ESTABLISHED - tcp 0 0 131.159.74.67:46615 66.190.42.198:2086 ESTABLISHED 19399/gnunet-servic tcp 0 0 131.159.74.67:50697 131.159.74.67:9989 ESTABLISHED - tcp 0 0 131.159.74.67:9989 131.159.20.139:43847 ESTABLISHED - tcp 0 0 131.159.74.67:40636 174.143.119.91:6667 ESTABLISHED - tcp 0 0 131.159.74.67:48121 216.155.130.130:6667 ESTABLISHED - tcp 0 0 131.159.74.67:1080 108.5.82.190:50592 ESTABLISHED 19399/gnunet-servic tcp 0 0 131.159.74.67:993 131.159.50.64:36398 ESTABLISHED - tcp 0 0 131.159.74.67:9989 131.159.20.125:38628 ESTABLISHED - tcp 0 0 131.159.74.67:1080 108.5.82.190:50591 ESTABLISHED 19399/gnunet-servic tcp 0 0 131.159.74.67:9989 131.159.15.30:38163 ESTABLISHED - tcp 0 0 131.159.74.67:22 10.149.93.73:46201 ESTABLISHED - tcp 0 0 131.159.74.67:41544 131.159.74.67:9989 ESTABLISHED - tcp 0 0 131.159.74.67:993 131.159.50.64:36390 ESTABLISHED - tcp 0 0 131.159.74.67:993 131.159.50.64:36399 ESTABLISHED - tcp 0 0 131.159.74.67:22 4.58.28.225:7704 ESTABLISHED - tcp 0 0 131.159.74.67:9989 131.159.74.67:50697 ESTABLISHED - tcp 0 0 131.159.74.67:43627 95.84.200.156:2086 ESTABLISHED 19399/gnunet-servic tcp 0 0 131.159.74.67:2086 95.251.71.145:9766 ESTABLISHED 19399/gnunet-servic tcp 0 0 131.159.74.67:993 131.159.50.64:36397 ESTABLISHED - tcp 0 0 131.159.74.67:9989 131.159.74.67:41544 ESTABLISHED - tcp 0 0 131.159.74.67:993 131.159.50.64:36396 ESTABLISHED - tcp 0 0 131.159.74.67:9989 131.159.20.50:42227 ESTABLISHED - tcp6 0 0 2001:4ca0:2001:42:23:22 2001:4ca0:2001:11:45353 ESTABLISHED - tcp6 0 0 2001:4ca0:2001:42:23:22 2001:4ca0:2001:11:33887 ESTABLISHED - tcp6 0 0 2001:4ca0:2001:42:23:22 2001:6f8:900:a93::39275 ESTABLISHED - tcp6 0 0 2001:4ca0:2001:42:2:993 2001:4ca0:2001:11:37390 ESTABLISHED - tcp6 0 0 2001:4ca0:2001:42:2:993 2001:4ca0:2001:11:34986 ESTABLISHED - tcp6 0 0 2001:4ca0:2001:42:23:22 2001:4ca0:2001:11:55932 ESTABLISHED - tcp6 0 0 2001:4ca0:2001:42:23:22 2001:6f8:900:a93::39250 ESTABLISHED - tcp6 0 0 2001:4ca0:2001:42:2:993 2001:4ca0:2001:11:37393 ESTABLISHED - tcp6 0 0 2001:4ca0:2001:42:23:22 2001:4ca0:2001:11:53581 ESTABLISHED - tcp6 0 0 2001:4ca0:2001:42:23:22 2001:4ca0:2001:11:40931 ESTABLISHED - tcp6 0 915 131.159.74.67:443 123.126.50.79:63812 ESTABLISHED - tcp6 0 0 2001:4ca0:2001:42:23:22 2001:4ca0:2001:11:44427 ESTABLISHED - tcp6 0 0 2001:4ca0:2001:42:2:993 2001:4ca0:2001:11:37394 ESTABLISHED - tcp6 0 0 2001:4ca0:2001:42:23:22 2001:4ca0:2001:11:56059 ESTABLISHED - tcp6 0 0 2001:4ca0:2001:42:2:993 2001:4ca0:2001:11:56108 ESTABLISHED - So in total, the actual number of open TCP streams to other peers is 41 (!). | ||||
| Steps To Reproduce | Run a peer for a while... | ||||
| Tags | No tags attached. | ||||
|
|
$ gnunet-statistics | sort ats # active addresses : 5 ats # addresses destroyed : 6850 ats # address requests received : 19146 ats # address suggestions made : 5789 ats # address updates received : 2442226 ats # bandwidth recalculations performed : 1194 ats # preference change requests processed : 570828 ats # reservation requests processed : 18051320 core # avg payload per encrypted message : 3731 core # bytes decrypted : 22548139935 core # bytes encrypted : 3934046690 core # bytes of payload decrypted : 22530286211 core # encrypted bytes given to transport : 4009395221 core # entries in session map : 4 core # failed to decrypt message (no session key) : 8 core # keepalive messages sent : 2398 core # key exchanges initiated : 178 core # key exchanges stopped : 174 core # messages discarded (expired prior to transmission): 2 core # messages discarded (session disconnected) : 1 core # neighbour entries allocated : 4 core # PING messages received : 2413 core # PONG messages created : 2406 core # PONG messages decrypted : 2419 core # PONG messages received : 2419 core # send requests dropped (disconnected) : 1 core # session keys confirmed via PONG : 165 core # session keys received : 218 core # sessions terminated by timeout : 11 core # sessions terminated by transport disconnect : 174 core # SET_KEY and PING messages created : 178 core # SET_KEY messages decrypted : 214 core # type map refreshes sent : 6723 core # type maps received : 6760 core # updates to my type map : 2 datastore-api # bytes sent to datastore : 3574295 datastore-api # GET REPLICATION requests executed : 971 datastore-api # GET requests executed : 2889468 datastore-api # GET ZERO ANONYMITY requests executed : 4179 datastore-api # PUT requests executed : 681710 datastore-api # queue entries created : 3576328 datastore-api # Results received : 11294 datastore-api # status messages received : 681710 !datastore # bytes purged (low-priority) : 70702701935 !datastore # bytes stored : 70788327147 !datastore # bytes used in file-sharing datastore : 87493809 datastore # cache size : 12500000 datastore # GET REPLICATION requests received : 971 datastore # GET requests received : 2887435 datastore # GET ZERO ANONYMITY requests received : 4179 datastore # quota : 100000000 datastore # requests filtered by bloomfilter : 2877112 datastore # results found : 11294 fs # artificial delays introduced (ms) : 273769 fs # average retransmission delay (ms) : 24169 fs # Datastore lookups concluded (found last result) : 1295 fs # Datastore lookups concluded (no results) : 2876017 fs # Datastore lookups concluded (seen all) : 3673 fs # Datastore lookups initiated : 2884113 fs # Datastore `PUT' failures : 10560 fs # delay heap timeout : 35 fs # duplicate replies discarded (bloomfilter) : 6554 fs # GAP PUT messages received : 681710 fs # GET requests received (from other peers) : 2899921 fs # Loopback routes suppressed : 4088907 fs # migration stop messages received : 39157 fs # P2P query messages received and processed : 2884113 fs # P2P searches active : 781 fs # P2P searches destroyed due to ultimate reply : 67169 fs # peers connected : 3 fs # Pending requests active : 148428 fs # Pending requests created : 2884113 fs # query messages sent to other peers : 19098564 fs # query plan entries : 790186 fs # query plans executed : 19606702 fs # replies dropped : 310 fs # replies received and matched : 73813 fs # replies received for other peers : 67259 fs # replies transmitted to other peers : 66948 fs # requested DBLOCK or IBLOCK not found : 2835821 fs # requests done for free (low load) : 2884113 fs # requests dropped due to missing reverse route : 15808 fs # requests merged : 15995930 fs # results found locally : 78 fs # running average P2P latency (ms) : 297 !hostlist bytes in hostlist : 1792 !hostlist expired addresses encountered : 3179387 hostlist HELLOs without addresses encountered (ignored) : 752302 !hostlist hostlist requests processed : 22401 peerinfo # peers known : 164 topology # connect requests issued to transport : 18394 topology # HELLO messages gossipped : 170 topology # HELLO messages received : 198 topology # peers connected : 4 transport # acknowledgements sent for fragment : 847211 transport # address records discarded : 4146 transport # address revalidations started : 10108 transport # bits removed from fragmentation ACKs : 2 transport # bytes currently in TCP buffers : 373168 transport # bytes discarded by TCP (disconnect) : 2235892 transport # bytes discarded by TCP (timeout) : 63790 transport # bytes in message queue for other peers : 4009337087 transport # bytes payload discarded due to not connected peer : 163035345 transport # bytes payload dropped (other peer was not connected): 395384 transport # bytes payload received for other peers : 4009392757 transport # bytes received via TCP : 21434249185 transport # bytes TCP was asked to transmit : 3843920952 transport # bytes transmitted via TCP : 3841596126 transport # disconnect messages ignored (timestamp) : 1 transport # duplicate fragments received : 902407 transport # fast reconnects failed : 54 transport # fragment acknowledgements received : 10241 transport # fragmentation transmissions completed : 9360 transport # fragments received : 1864832 transport # fragments retransmitted : 86284 transport # fragments transmitted : 218294 transport # IPv4 broadcast HELLO beacons received via udp : 27854 transport # IPv6 multicast HELLO beacons received via udp : 13927 transport # KEEPALIVE messages discarded (not connected) : 30 transport # KEEPALIVE_RESPONSE messages discarded (not expected): 426 transport # keepalives sent : 70087 transport # messages defragmented : 40119 transport # messages fragmented : 9363 transport # ms throttling suggested : 4 transport # network-level TCP disconnect events : 4695 transport # peers connected : 80 transport # peers disconnected due to external request : 50 transport # peers disconnected due to timeout : 17726 transport # PING messages received : 9870 transport # PING without HELLO messages sent : 10108 transport # PONG messages received : 4632 transport # PONGs dropped, no matching pending validation : 2 transport # PONGs unicast via reliable transport : 9870 transport # refreshed my HELLO : 173 transport # REQUEST CONNECT messages received : 18315 transport # TCP sessions active : 136 transport # TCP WELCOME messages received : 1813 transport # total size of fragmented messages : 162767234 transport # transport-service disconnect requests for TCP : 287 transport # unexpected CONNECT_ACK messages : 31 |
|
|
AFAIK: Solved disconnect problem related to fast reconnect with revision 19831 Integration do not show any issues with disconnect anymore |
| Date Modified | Username | Field | Change |
|---|---|---|---|
| 2011-12-06 15:20 | Christian Grothoff | New Issue | |
| 2011-12-06 15:20 | Christian Grothoff | Status | new => assigned |
| 2011-12-06 15:20 | Christian Grothoff | Assigned To | => Matthias Wachs |
| 2011-12-06 15:20 | Christian Grothoff | Note Added: 0005012 | |
| 2011-12-23 11:00 | Christian Grothoff | Target Version | 0.9.1 => 0.9.2 |
| 2012-02-22 09:43 | Matthias Wachs | Note Added: 0005489 | |
| 2012-02-22 09:43 | Matthias Wachs | Status | assigned => resolved |
| 2012-02-22 09:43 | Matthias Wachs | Resolution | open => fixed |
| 2012-02-28 11:05 | Christian Grothoff | Status | resolved => closed |
