View Revisions: Issue #3575

Summary 0003575: Core takes an arbitrarily long time to call back
Revision 2015-03-08 17:16 by Christian Grothoff
Additional Information Expanding the config file to:
[ats]
# Network specific inbound/outbound quotas
UNSPECIFIED_QUOTA_IN = unlimited
UNSPECIFIED_QUOTA_OUT = unlimited
# LOOPBACK
LOOPBACK_QUOTA_IN = unlimited
LOOPBACK_QUOTA_OUT = unlimited
# LAN
LAN_QUOTA_IN = unlimited
LAN_QUOTA_OUT = unlimited
#WAN
WAN_QUOTA_OUT = unlimitedq
WAN_QUOTA_IN = unlimited
# WLAN
WLAN_QUOTA_IN = unlimited
WLAN_QUOTA_OUT = unlimited
# BLUETOOTH
BLUETOOTH_QUOTA_IN = unlimited
BLUETOOTH_QUOTA_OUT = unlimited

Does not help. In case of bandwith limiting, it would affect the sending peer first, anyway.



The timeout seems to get gradually bigger until it exceeds the CADET connection tolerance and it times out.

Here is a filtered log including the time taken to fill each core request and
the messages CADET still has in the queue for CORE after the callback. Note that there is no gap between the phases, at 02:19:32-414983 something suddenly breaks and requests start taking a long time, the next callback occuring at 02:19:32-795017. This causes CADET messages to pile up (in this test the rekeying frequency is extremely high and nevertheless this requires some optimization, but that is another story...)



*************************** Normal phase ***************************
Dec 13 02:19:30-342949 cadet-p2p-1374 DEBUG core wait time 591 µs
Dec 13 02:19:30-343078 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:30-352436 cadet-p2p-1374 DEBUG core wait time 674 µs
Dec 13 02:19:30-352568 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:30-359621 cadet-p2p-1374 DEBUG core wait time 627 µs
Dec 13 02:19:30-359748 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:30-372446 cadet-p2p-1374 DEBUG core wait time 666 µs
Dec 13 02:19:30-372573 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:30-379735 cadet-p2p-1374 DEBUG core wait time 645 µs
Dec 13 02:19:30-379854 cadet-p2p-1374 DEBUG QQQ queue length: 0
Revision 2014-12-13 03:02 by Bart Polot
Additional Information Expanding the config file to:
[ats]
# Network specific inbound/outbound quotas
UNSPECIFIED_QUOTA_IN = unlimited
UNSPECIFIED_QUOTA_OUT = unlimited
# LOOPBACK
LOOPBACK_QUOTA_IN = unlimited
LOOPBACK_QUOTA_OUT = unlimited
# LAN
LAN_QUOTA_IN = unlimited
LAN_QUOTA_OUT = unlimited
#WAN
WAN_QUOTA_OUT = unlimitedq
WAN_QUOTA_IN = unlimited
# WLAN
WLAN_QUOTA_IN = unlimited
WLAN_QUOTA_OUT = unlimited
# BLUETOOTH
BLUETOOTH_QUOTA_IN = unlimited
BLUETOOTH_QUOTA_OUT = unlimited

Does not help. In case of bandwith limiting, it would affect the sending peer first, anyway.



The timeout seems to get gradually bigger until it exceeds the CADET connection tolerance and it times out.

Here is a filtered log including the time taken to fill each core request and
the messages CADET still has in the queue for CORE after the callback. Note that there is no gap between the phases, at 02:19:32-414983 something suddenly breaks and requests start taking a long time, the next callback occuring at 02:19:32-795017. This causes CADET messages to pile up (in this test the rekeying frequency is extremely high and nevertheless this requires some optimization, but that is another story...)



*************************** Normal phase ***************************
Dec 13 02:19:30-342949 cadet-p2p-1374 DEBUG core wait time 591 µs
Dec 13 02:19:30-343078 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:30-352436 cadet-p2p-1374 DEBUG core wait time 674 µs
Dec 13 02:19:30-352568 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:30-359621 cadet-p2p-1374 DEBUG core wait time 627 µs
Dec 13 02:19:30-359748 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:30-372446 cadet-p2p-1374 DEBUG core wait time 666 µs
Dec 13 02:19:30-372573 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:30-379735 cadet-p2p-1374 DEBUG core wait time 645 µs
Dec 13 02:19:30-379854 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:30-394884 cadet-p2p-1374 DEBUG core wait time 681 µs
Dec 13 02:19:30-395020 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:30-402935 cadet-p2p-1374 DEBUG core wait time 679 µs
Dec 13 02:19:30-403053 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:30-416379 cadet-p2p-1374 DEBUG core wait time 684 µs
Dec 13 02:19:30-416580 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:30-428845 cadet-p2p-1374 DEBUG core wait time 633 µs
Dec 13 02:19:30-428972 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:30-439829 cadet-p2p-1374 DEBUG core wait time 670 µs
Dec 13 02:19:30-439959 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:30-444053 cadet-p2p-1374 DEBUG core wait time 612 µs
Dec 13 02:19:30-444179 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:30-454374 cadet-p2p-1374 DEBUG core wait time 613 µs
Dec 13 02:19:30-454500 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:30-460767 cadet-p2p-1374 DEBUG core wait time 804 µs
Dec 13 02:19:30-460893 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:30-475510 cadet-p2p-1374 DEBUG core wait time 668 µs
Dec 13 02:19:30-475639 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:30-484128 cadet-p2p-1374 DEBUG core wait time 624 µs
Dec 13 02:19:30-484256 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:30-495886 cadet-p2p-1374 DEBUG core wait time 713 µs
Dec 13 02:19:30-496011 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:30-505040 cadet-p2p-1374 DEBUG core wait time 745 µs
Dec 13 02:19:30-505165 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:30-519073 cadet-p2p-1374 DEBUG core wait time 636 µs
Dec 13 02:19:30-519201 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:30-525710 cadet-p2p-1374 DEBUG core wait time 638 µs
Dec 13 02:19:30-525840 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:30-541188 cadet-p2p-1374 DEBUG core wait time 671 µs
Dec 13 02:19:30-541319 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:30-551050 cadet-p2p-1374 DEBUG core wait time 730 µs
Dec 13 02:19:30-551179 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:30-555478 cadet-p2p-1374 DEBUG core wait time 193 µs
Dec 13 02:19:30-555939 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:30-560014 cadet-p2p-1374 DEBUG core wait time 585 µs
Dec 13 02:19:30-560147 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:30-566888 cadet-p2p-1374 DEBUG core wait time 599 µs
Dec 13 02:19:30-567012 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:30-583982 cadet-p2p-1374 DEBUG core wait time 689 µs
Dec 13 02:19:30-584161 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:30-597395 cadet-p2p-1374 DEBUG core wait time 659 µs
Dec 13 02:19:30-597524 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:30-610107 cadet-p2p-1374 DEBUG core wait time 639 µs
Dec 13 02:19:30-610243 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:30-614158 cadet-p2p-1374 DEBUG core wait time 574 µs
Dec 13 02:19:30-614285 cadet-p2p-1374 DEBUG QQQ queue length: 0



*************************** Hiccups occur ***************************
Dec 13 02:19:30-718043 cadet-p2p-1374 DEBUG core wait time 25756 µs
Dec 13 02:19:30-718297 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:30-737896 cadet-p2p-1374 DEBUG core wait time 9005 µs
Dec 13 02:19:30-738028 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:30-818503 cadet-p2p-1374 DEBUG core wait time 196 µs
Dec 13 02:19:30-818643 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:30-824193 cadet-p2p-1374 DEBUG core wait time 572 µs
Dec 13 02:19:30-824317 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:30-853052 cadet-p2p-1374 DEBUG core wait time 654 µs
Dec 13 02:19:30-853180 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:30-873507 cadet-p2p-1374 DEBUG core wait time 186 µs
Dec 13 02:19:30-873644 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:30-894212 cadet-p2p-1374 DEBUG core wait time 688 µs
Dec 13 02:19:30-894342 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:30-916119 cadet-p2p-1374 DEBUG core wait time 3657 µs
Dec 13 02:19:30-916288 cadet-p2p-1374 DEBUG QQQ queue length: 2
--
Dec 13 02:19:30-934937 cadet-p2p-1374 DEBUG core wait time 18668 µs
Dec 13 02:19:30-935222 cadet-p2p-1374 DEBUG QQQ queue length: 1
Dec 13 02:19:30-936745 cadet-p2p-1374 DEBUG core wait time 1541 µs
Dec 13 02:19:30-936891 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:30-980259 cadet-p2p-1374 DEBUG core wait time 204 µs
Dec 13 02:19:30-980401 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:31-007498 cadet-p2p-1374 DEBUG core wait time 647 µs
Dec 13 02:19:31-007626 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:31-035735 cadet-p2p-1374 DEBUG core wait time 7632 µs
Dec 13 02:19:31-035889 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:31-038626 cadet-p2p-1374 DEBUG core wait time 173 µs
Dec 13 02:19:31-038767 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:31-048631 cadet-p2p-1374 DEBUG core wait time 7069 µs
Dec 13 02:19:31-048797 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:31-061591 cadet-p2p-1374 DEBUG core wait time 679 µs
Dec 13 02:19:31-061732 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:31-086526 cadet-p2p-1374 DEBUG core wait time 24157 µs
Dec 13 02:19:31-086692 cadet-p2p-1374 DEBUG QQQ queue length: 2
Dec 13 02:19:31-098813 cadet-p2p-1374 DEBUG core wait time 12136 µs
Dec 13 02:19:31-099012 cadet-p2p-1374 DEBUG QQQ queue length: 1
Dec 13 02:19:31-099910 cadet-p2p-1374 DEBUG core wait time 918 µs
Dec 13 02:19:31-100054 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:31-132870 cadet-p2p-1374 DEBUG core wait time 718 µs
Dec 13 02:19:31-133001 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:31-164237 cadet-p2p-1374 DEBUG core wait time 203 µs
Dec 13 02:19:31-164385 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:31-204233 cadet-p2p-1374 DEBUG core wait time 717 µs
Dec 13 02:19:31-204362 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:31-284936 cadet-p2p-1374 DEBUG core wait time 70539 µs
Dec 13 02:19:31-285106 cadet-p2p-1374 DEBUG QQQ queue length: 6
--
Dec 13 02:19:31-380020 cadet-p2p-1374 DEBUG core wait time 94931 µs
Dec 13 02:19:31-380312 cadet-p2p-1374 DEBUG QQQ queue length: 8
--
Dec 13 02:19:31-473294 cadet-p2p-1374 DEBUG core wait time 93 ms
Dec 13 02:19:31-473729 cadet-p2p-1374 DEBUG QQQ queue length: 8
--
Dec 13 02:19:31-647863 cadet-p2p-1374 DEBUG core wait time 174153 µs
Dec 13 02:19:31-648156 cadet-p2p-1374 DEBUG QQQ queue length: 12
--
Dec 13 02:19:31-761983 cadet-p2p-1374 DEBUG core wait time 113846 µs
Dec 13 02:19:31-762274 cadet-p2p-1374 DEBUG QQQ queue length: 13
--
Dec 13 02:19:31-851694 cadet-p2p-1374 DEBUG core wait time 89442 µs
Dec 13 02:19:31-851983 cadet-p2p-1374 DEBUG QQQ queue length: 14
--
Dec 13 02:19:31-941376 cadet-p2p-1374 DEBUG core wait time 89417 µs
Dec 13 02:19:31-941802 cadet-p2p-1374 DEBUG QQQ queue length: 16
--
Dec 13 02:19:31-984383 cadet-p2p-1374 DEBUG core wait time 42603 µs
Dec 13 02:19:31-984675 cadet-p2p-1374 DEBUG QQQ queue length: 16
--
Dec 13 02:19:32-031765 cadet-p2p-1374 DEBUG core wait time 47110 µs
Dec 13 02:19:32-037795 cadet-p2p-1374 DEBUG QQQ queue length: 16
--
Dec 13 02:19:32-058923 cadet-p2p-1374 DEBUG core wait time 21154 µs
Dec 13 02:19:32-059236 cadet-p2p-1374 DEBUG QQQ queue length: 16
--
Dec 13 02:19:32-080243 cadet-p2p-1374 DEBUG core wait time 21026 µs
Dec 13 02:19:32-080540 cadet-p2p-1374 DEBUG QQQ queue length: 15
Dec 13 02:19:32-083616 cadet-p2p-1374 DEBUG core wait time 3093 µs
Dec 13 02:19:32-083782 cadet-p2p-1374 DEBUG QQQ queue length: 14
Dec 13 02:19:32-085143 cadet-p2p-1374 DEBUG core wait time 1377 µs
Dec 13 02:19:32-085347 cadet-p2p-1374 DEBUG QQQ queue length: 13
Dec 13 02:19:32-090867 cadet-p2p-1374 DEBUG core wait time 5543 µs
Dec 13 02:19:32-091049 cadet-p2p-1374 DEBUG QQQ queue length: 12
--
Dec 13 02:19:32-096356 cadet-p2p-1374 DEBUG core wait time 5327 µs
Dec 13 02:19:32-096660 cadet-p2p-1374 DEBUG QQQ queue length: 11
Dec 13 02:19:32-098331 cadet-p2p-1374 DEBUG core wait time 1692 µs
Dec 13 02:19:32-098506 cadet-p2p-1374 DEBUG QQQ queue length: 10
Dec 13 02:19:32-099767 cadet-p2p-1374 DEBUG core wait time 1278 µs
Dec 13 02:19:32-099955 cadet-p2p-1374 DEBUG QQQ queue length: 9
Dec 13 02:19:32-102526 cadet-p2p-1374 DEBUG core wait time 2592 µs
Dec 13 02:19:32-102699 cadet-p2p-1374 DEBUG QQQ queue length: 8
Dec 13 02:19:32-112861 cadet-p2p-1374 DEBUG core wait time 10181 µs
Dec 13 02:19:32-113044 cadet-p2p-1374 DEBUG QQQ queue length: 7
Dec 13 02:19:32-114058 cadet-p2p-1374 DEBUG core wait time 1034 µs
Dec 13 02:19:32-114233 cadet-p2p-1374 DEBUG QQQ queue length: 6
Dec 13 02:19:32-115267 cadet-p2p-1374 DEBUG core wait time 1054 µs
Dec 13 02:19:32-115446 cadet-p2p-1374 DEBUG QQQ queue length: 5
Dec 13 02:19:32-116348 cadet-p2p-1374 DEBUG core wait time 923 µs
Dec 13 02:19:32-116521 cadet-p2p-1374 DEBUG QQQ queue length: 4
Dec 13 02:19:32-129121 cadet-p2p-1374 DEBUG core wait time 12621 µs
Dec 13 02:19:32-129307 cadet-p2p-1374 DEBUG QQQ queue length: 3
Dec 13 02:19:32-130516 cadet-p2p-1374 DEBUG core wait time 1229 µs
Dec 13 02:19:32-130698 cadet-p2p-1374 DEBUG QQQ queue length: 2
Dec 13 02:19:32-131580 cadet-p2p-1374 DEBUG core wait time 901 µs
Dec 13 02:19:32-131759 cadet-p2p-1374 DEBUG QQQ queue length: 1
Dec 13 02:19:32-132653 cadet-p2p-1374 DEBUG core wait time 914 µs
Dec 13 02:19:32-132798 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:32-159087 cadet-p2p-1374 DEBUG core wait time 10685 µs
Dec 13 02:19:32-159262 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:32-190394 cadet-p2p-1374 DEBUG core wait time 675 µs
Dec 13 02:19:32-190522 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:32-274135 cadet-p2p-1374 DEBUG core wait time 190 µs
Dec 13 02:19:32-274274 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:32-399972 cadet-p2p-1374 DEBUG core wait time 259 µs
Dec 13 02:19:32-400124 cadet-p2p-1374 DEBUG QQQ queue length: 0
--
Dec 13 02:19:32-414854 cadet-p2p-1374 DEBUG core wait time 621 µs
Dec 13 02:19:32-414983 cadet-p2p-1374 DEBUG QQQ queue length: 0



*************************** Suddenly all goes south ***************************
Dec 13 02:19:32-795017 cadet-p2p-1374 DEBUG core wait time 310353 µs
Dec 13 02:19:32-822449 cadet-p2p-1374 DEBUG QQQ queue length: 13
--
Dec 13 02:19:33-358860 cadet-p2p-1374 DEBUG core wait time 536436 µs
Dec 13 02:19:33-359169 cadet-p2p-1374 DEBUG QQQ queue length: 34
--
Dec 13 02:19:33-803484 cadet-p2p-1374 DEBUG core wait time 444334 µs
Dec 13 02:19:33-805706 cadet-p2p-1374 DEBUG QQQ queue length: 40
--
Dec 13 02:19:34-190084 cadet-p2p-1374 DEBUG core wait time 384399 µs
Dec 13 02:19:34-190269 cadet-p2p-1374 DEBUG QQQ queue length: 48
--
Dec 13 02:19:34-453467 cadet-p2p-1374 DEBUG core wait time 263218 µs
Dec 13 02:19:34-453659 cadet-p2p-1374 DEBUG QQQ queue length: 52
--
Dec 13 02:19:34-662489 cadet-p2p-1374 DEBUG core wait time 208842 µs
Dec 13 02:19:34-662727 cadet-p2p-1374 DEBUG QQQ queue length: 55
--
Dec 13 02:19:34-994686 cadet-p2p-1374 DEBUG core wait time 331971 µs
Dec 13 02:19:34-994926 cadet-p2p-1374 DEBUG QQQ queue length: 59
--
Dec 13 02:19:35-241245 cadet-p2p-1374 DEBUG core wait time 246339 µs
Dec 13 02:19:35-241546 cadet-p2p-1374 DEBUG QQQ queue length: 64
--
Dec 13 02:19:35-471248 cadet-p2p-1374 DEBUG core wait time 229729 µs
Dec 13 02:19:35-471565 cadet-p2p-1374 DEBUG QQQ queue length: 68
--
Dec 13 02:19:35-583410 cadet-p2p-1374 DEBUG core wait time 111874 µs
Dec 13 02:19:35-586324 cadet-p2p-1374 DEBUG QQQ queue length: 67
--
Dec 13 02:19:35-844944 cadet-p2p-1374 DEBUG core wait time 258646 µs
Dec 13 02:19:35-845376 cadet-p2p-1374 DEBUG QQQ queue length: 73
--
Dec 13 02:19:35-974355 cadet-p2p-1374 DEBUG core wait time 129001 µs
Dec 13 02:19:35-975147 cadet-p2p-1374 DEBUG QQQ queue length: 74
--
Dec 13 02:19:36-224749 cadet-p2p-1374 DEBUG core wait time 249629 µs
Dec 13 02:19:36-225026 cadet-p2p-1374 DEBUG QQQ queue length: 78
--
Dec 13 02:19:36-329886 cadet-p2p-1374 DEBUG core wait time 104877 µs
Dec 13 02:19:36-330181 cadet-p2p-1374 DEBUG QQQ queue length: 78
--
Dec 13 02:19:36-470292 cadet-p2p-1374 DEBUG core wait time 140132 µs
Dec 13 02:19:36-470587 cadet-p2p-1374 DEBUG QQQ queue length: 80
--
Dec 13 02:19:36-623735 cadet-p2p-1374 DEBUG core wait time 153168 µs
Dec 13 02:19:36-624028 cadet-p2p-1374 DEBUG QQQ queue length: 82
--
Dec 13 02:19:36-839327 cadet-p2p-1374 DEBUG core wait time 215318 µs
Dec 13 02:19:36-839622 cadet-p2p-1374 DEBUG QQQ queue length: 86
--
Dec 13 02:19:37-090478 cadet-p2p-1374 DEBUG core wait time 250877 µs
Dec 13 02:19:37-090781 cadet-p2p-1374 DEBUG QQQ queue length: 89
--
Dec 13 02:19:37-326707 cadet-p2p-1374 DEBUG core wait time 235945 µs
Dec 13 02:19:37-327003 cadet-p2p-1374 DEBUG QQQ queue length: 92
--
Dec 13 02:19:37-538840 cadet-p2p-1374 DEBUG core wait time 211859 µs
Dec 13 02:19:37-539158 cadet-p2p-1374 DEBUG QQQ queue length: 96
--
Dec 13 02:19:37-714107 cadet-p2p-1374 DEBUG core wait time 174970 µs
Dec 13 02:19:37-714421 cadet-p2p-1374 DEBUG QQQ queue length: 98
--
Dec 13 02:19:37-880103 cadet-p2p-1374 DEBUG core wait time 165701 µs
Dec 13 02:19:37-880392 cadet-p2p-1374 DEBUG QQQ queue length: 100
--
Dec 13 02:19:38-080846 cadet-p2p-1374 DEBUG core wait time 200473 µs
Dec 13 02:19:38-081144 cadet-p2p-1374 DEBUG QQQ queue length: 103
--
Dec 13 02:19:38-258386 cadet-p2p-1374 DEBUG core wait time 177260 µs
Dec 13 02:19:38-258687 cadet-p2p-1374 DEBUG QQQ queue length: 105
--
Dec 13 02:19:38-468837 cadet-p2p-1374 DEBUG core wait time 210171 µs
Dec 13 02:19:38-469134 cadet-p2p-1374 DEBUG QQQ queue length: 109
--
Dec 13 02:19:38-647397 cadet-p2p-1374 DEBUG core wait time 178282 µs
Dec 13 02:19:38-647704 cadet-p2p-1374 DEBUG QQQ queue length: 111
--
Dec 13 02:19:38-837219 cadet-p2p-1374 DEBUG core wait time 189535 µs
Dec 13 02:19:38-853747 cadet-p2p-1374 DEBUG QQQ queue length: 114
--
Dec 13 02:19:39-183393 cadet-p2p-1374 DEBUG core wait time 329670 µs
Dec 13 02:19:39-183705 cadet-p2p-1374 DEBUG QQQ queue length: 118
--
Dec 13 02:19:39-385412 cadet-p2p-1374 DEBUG core wait time 201726 µs
Dec 13 02:19:39-385703 cadet-p2p-1374 DEBUG QQQ queue length: 121
--
Dec 13 02:19:39-623044 cadet-p2p-1374 DEBUG core wait time 237359 µs
Dec 13 02:19:39-623329 cadet-p2p-1374 DEBUG QQQ queue length: 125
--
Dec 13 02:19:39-784830 cadet-p2p-1374 DEBUG core wait time 161521 µs
Dec 13 02:19:39-785177 cadet-p2p-1374 DEBUG QQQ queue length: 127
--
Dec 13 02:19:40-029921 cadet-p2p-1374 DEBUG core wait time 244763 µs
Dec 13 02:19:40-030222 cadet-p2p-1374 DEBUG QQQ queue length: 130
--
Dec 13 02:19:40-280959 cadet-p2p-1374 DEBUG core wait time 250757 µs
Dec 13 02:19:40-281505 cadet-p2p-1374 DEBUG QQQ queue length: 132
--
Dec 13 02:19:40-654618 cadet-p2p-1374 DEBUG core wait time 373132 µs
Dec 13 02:19:40-654938 cadet-p2p-1374 DEBUG QQQ queue length: 139
--
Dec 13 02:19:40-911284 cadet-p2p-1374 DEBUG core wait time 256369 µs
Dec 13 02:19:40-911572 cadet-p2p-1374 DEBUG QQQ queue length: 143
--
Dec 13 02:19:41-274635 cadet-p2p-1374 DEBUG core wait time 363083 µs
Dec 13 02:19:41-274932 cadet-p2p-1374 DEBUG QQQ queue length: 147
--
Dec 13 02:19:41-527535 cadet-p2p-1374 DEBUG core wait time 252624 µs
Dec 13 02:19:41-527954 cadet-p2p-1374 DEBUG QQQ queue length: 150
--
Dec 13 02:19:41-786405 cadet-p2p-1374 DEBUG core wait time 258471 µs
Dec 13 02:19:41-786696 cadet-p2p-1374 DEBUG QQQ queue length: 154
--
Dec 13 02:19:42-107917 cadet-p2p-1374 DEBUG core wait time 321240 µs
Dec 13 02:19:42-108181 cadet-p2p-1374 DEBUG QQQ queue length: 159
--
Dec 13 02:19:42-315114 cadet-p2p-1374 DEBUG core wait time 206951 µs
Dec 13 02:19:42-315373 cadet-p2p-1374 DEBUG QQQ queue length: 162
--
Dec 13 02:19:42-587436 cadet-p2p-1374 DEBUG core wait time 272084 µs
Dec 13 02:19:42-587754 cadet-p2p-1374 DEBUG QQQ queue length: 166
--
Dec 13 02:19:42-798166 cadet-p2p-1374 DEBUG core wait time 210437 µs
Dec 13 02:19:42-798691 cadet-p2p-1374 DEBUG QQQ queue length: 166
--
Dec 13 02:19:43-243418 cadet-p2p-1374 DEBUG core wait time 444744 µs
Dec 13 02:19:43-243626 cadet-p2p-1374 DEBUG QQQ queue length: 173
--
Dec 13 02:19:43-499046 cadet-p2p-1374 DEBUG core wait time 255441 µs
Dec 13 02:19:43-501942 cadet-p2p-1374 DEBUG QQQ queue length: 176
--
Dec 13 02:19:43-850149 cadet-p2p-1374 DEBUG core wait time 348256 µs
Dec 13 02:19:43-850356 cadet-p2p-1374 DEBUG QQQ queue length: 182
--
Dec 13 02:19:44-142798 cadet-p2p-1374 DEBUG core wait time 292462 µs
Dec 13 02:19:44-143241 cadet-p2p-1374 DEBUG QQQ queue length: 185
--
Dec 13 02:19:44-459880 cadet-p2p-1374 DEBUG core wait time 316652 µs
Dec 13 02:19:44-460109 cadet-p2p-1374 DEBUG QQQ queue length: 191
--
Dec 13 02:19:44-708481 cadet-p2p-1374 DEBUG core wait time 248391 µs
Dec 13 02:19:44-708787 cadet-p2p-1374 DEBUG QQQ queue length: 194
--
Dec 13 02:19:44-989931 cadet-p2p-1374 DEBUG core wait time 281163 µs
Dec 13 02:19:44-990249 cadet-p2p-1374 DEBUG QQQ queue length: 198
--
Dec 13 02:19:45-359468 cadet-p2p-1374 DEBUG core wait time 369245 µs
Dec 13 02:19:45-359800 cadet-p2p-1374 DEBUG QQQ queue length: 202
--
Dec 13 02:19:45-652953 cadet-p2p-1374 DEBUG core wait time 293177 µs
Dec 13 02:19:45-653179 cadet-p2p-1374 DEBUG QQQ queue length: 207
--
Dec 13 02:19:45-905083 cadet-p2p-1374 DEBUG core wait time 251920 µs
Dec 13 02:19:45-905387 cadet-p2p-1374 DEBUG QQQ queue length: 211
--
Dec 13 02:19:46-169457 cadet-p2p-1374 DEBUG core wait time 264092 µs
Dec 13 02:19:46-169694 cadet-p2p-1374 DEBUG QQQ queue length: 214
--
Dec 13 02:19:46-453145 cadet-p2p-1374 DEBUG core wait time 283464 µs
Dec 13 02:19:46-453389 cadet-p2p-1374 DEBUG QQQ queue length: 218
--
Dec 13 02:19:46-739669 cadet-p2p-1374 DEBUG core wait time 286295 µs
Dec 13 02:19:46-739958 cadet-p2p-1374 DEBUG QQQ queue length: 222
--
Dec 13 02:19:47-069617 cadet-p2p-1374 DEBUG core wait time 329680 µs
Dec 13 02:19:47-069923 cadet-p2p-1374 DEBUG QQQ queue length: 227
--
Dec 13 02:19:47-475742 cadet-p2p-1374 DEBUG core wait time 405843 µs
Dec 13 02:19:47-476051 cadet-p2p-1374 DEBUG QQQ queue length: 231
--
Dec 13 02:19:47-852668 cadet-p2p-1374 DEBUG core wait time 376634 µs
Dec 13 02:19:47-852935 cadet-p2p-1374 DEBUG QQQ queue length: 237
--
Dec 13 02:19:48-173309 cadet-p2p-1374 DEBUG core wait time 320395 µs
Dec 13 02:19:48-173581 cadet-p2p-1374 DEBUG QQQ queue length: 242
--
Dec 13 02:19:48-515885 cadet-p2p-1374 DEBUG core wait time 342327 µs
Dec 13 02:19:48-519592 cadet-p2p-1374 DEBUG QQQ queue length: 247
--
Dec 13 02:19:48-762902 cadet-p2p-1374 DEBUG core wait time 243324 µs
Dec 13 02:19:48-763344 cadet-p2p-1374 DEBUG QQQ queue length: 248
--
Dec 13 02:19:49-138311 cadet-p2p-1374 DEBUG core wait time 374985 µs
Dec 13 02:19:49-138638 cadet-p2p-1374 DEBUG QQQ queue length: 254
--
Dec 13 02:19:49-538806 cadet-p2p-1374 DEBUG core wait time 400203 µs
Dec 13 02:19:49-539066 cadet-p2p-1374 DEBUG QQQ queue length: 260
--
Dec 13 02:19:49-939980 cadet-p2p-1374 DEBUG core wait time 400929 µs
Dec 13 02:19:49-940227 cadet-p2p-1374 DEBUG QQQ queue length: 266
--
Dec 13 02:19:50-222286 cadet-p2p-1374 DEBUG core wait time 282072 µs
Dec 13 02:19:50-235767 cadet-p2p-1374 DEBUG QQQ queue length: 270
--
Dec 13 02:19:50-580628 cadet-p2p-1374 DEBUG core wait time 344883 µs
Dec 13 02:19:50-580937 cadet-p2p-1374 DEBUG QQQ queue length: 275
--
Dec 13 02:19:50-991111 cadet-p2p-1374 DEBUG core wait time 410193 µs
Dec 13 02:19:50-991594 cadet-p2p-1374 DEBUG QQQ queue length: 279
--
Dec 13 02:19:51-610032 cadet-p2p-1374 DEBUG core wait time 618458 µs
Dec 13 02:19:51-610347 cadet-p2p-1374 DEBUG QQQ queue length: 286
--
Dec 13 02:19:52-232440 cadet-p2p-1374 DEBUG core wait time 622114 µs
Dec 13 02:19:52-232681 cadet-p2p-1374 DEBUG QQQ queue length: 293
--
Dec 13 02:19:52-787068 cadet-p2p-1374 DEBUG core wait time 554400 µs
Dec 13 02:19:52-787377 cadet-p2p-1374 DEBUG QQQ queue length: 301
--
Dec 13 02:19:53-522625 cadet-p2p-1374 DEBUG core wait time 735267 µs
Dec 13 02:19:53-522930 cadet-p2p-1374 DEBUG QQQ queue length: 311
--
Dec 13 02:19:54-151808 cadet-p2p-1374 DEBUG core wait time 628898 µs
Dec 13 02:19:54-152111 cadet-p2p-1374 DEBUG QQQ queue length: 318
--
Dec 13 02:19:54-778622 cadet-p2p-1374 DEBUG core wait time 626532 µs
Dec 13 02:19:54-778811 cadet-p2p-1374 DEBUG QQQ queue length: 326
--
Dec 13 02:19:55-442121 cadet-p2p-1374 DEBUG core wait time 663326 µs
Dec 13 02:19:55-442511 cadet-p2p-1374 DEBUG QQQ queue length: 334
--
Dec 13 02:19:56-238746 cadet-p2p-1374 DEBUG core wait time 796254 µs
Dec 13 02:19:56-238904 cadet-p2p-1374 DEBUG QQQ queue length: 344
--
Dec 13 02:19:56-742343 cadet-p2p-1374 DEBUG core wait time 503453 µs
Dec 13 02:19:56-742652 cadet-p2p-1374 DEBUG QQQ queue length: 351
--
Dec 13 02:19:57-243637 cadet-p2p-1374 DEBUG core wait time 500995 µs
Dec 13 02:19:57-243943 cadet-p2p-1374 DEBUG QQQ queue length: 358
--
Dec 13 02:19:57-776103 cadet-p2p-1374 DEBUG core wait time 532181 µs
Dec 13 02:19:57-776371 cadet-p2p-1374 DEBUG QQQ queue length: 365
--
Dec 13 02:19:58-483066 cadet-p2p-1374 DEBUG core wait time 706717 µs
Dec 13 02:19:58-483324 cadet-p2p-1374 DEBUG QQQ queue length: 375
--
Dec 13 02:19:58-985245 cadet-p2p-1374 DEBUG core wait time 501930 µs
Dec 13 02:19:58-985452 cadet-p2p-1374 DEBUG QQQ queue length: 381
--
Dec 13 02:19:59-556994 cadet-p2p-1374 DEBUG core wait time 571561 µs
Dec 13 02:19:59-557140 cadet-p2p-1374 DEBUG QQQ queue length: 389
--
Dec 13 02:19:59-988353 cadet-p2p-1374 DEBUG core wait time 431224 µs
Dec 13 02:19:59-988506 cadet-p2p-1374 DEBUG QQQ queue length: 394
--
Dec 13 02:20:00-606627 cadet-p2p-1374 DEBUG core wait time 618132 µs
Dec 13 02:20:00-606891 cadet-p2p-1374 DEBUG QQQ queue length: 402
--
Dec 13 02:20:01-254736 cadet-p2p-1374 DEBUG core wait time 647864 µs
Dec 13 02:20:01-255011 cadet-p2p-1374 DEBUG QQQ queue length: 410
--
Dec 13 02:20:01-805702 cadet-p2p-1374 DEBUG core wait time 550710 µs
Dec 13 02:20:01-805983 cadet-p2p-1374 DEBUG QQQ queue length: 418
--
Dec 13 02:20:02-476192 cadet-p2p-1374 DEBUG core wait time 670230 µs
Dec 13 02:20:02-476459 cadet-p2p-1374 DEBUG QQQ queue length: 424
--
Dec 13 02:20:03-194557 cadet-p2p-1374 DEBUG core wait time 718108 µs
Dec 13 02:20:03-194705 cadet-p2p-1374 DEBUG QQQ queue length: 434
--
Dec 13 02:20:03-913385 cadet-p2p-1374 DEBUG core wait time 718689 µs
Dec 13 02:20:03-913652 cadet-p2p-1374 DEBUG QQQ queue length: 444
--
Dec 13 02:20:04-682389 cadet-p2p-1374 DEBUG core wait time 768761 µs
Dec 13 02:20:04-682563 cadet-p2p-1374 DEBUG QQQ queue length: 454
--
Dec 13 02:20:05-340831 cadet-p2p-1374 DEBUG core wait time 658281 µs
Dec 13 02:20:05-341258 cadet-p2p-1374 DEBUG QQQ queue length: 463
--
Dec 13 02:20:06-085849 cadet-p2p-1374 DEBUG core wait time 744613 µs
Dec 13 02:20:06-103342 cadet-p2p-1374 DEBUG QQQ queue length: 474
--
Dec 13 02:20:06-879822 cadet-p2p-1374 DEBUG core wait time 776503 µs
Dec 13 02:20:06-880277 cadet-p2p-1374 DEBUG QQQ queue length: 482
--
Dec 13 02:20:07-693054 cadet-p2p-1374 DEBUG core wait time 812791 µs
Dec 13 02:20:07-693301 cadet-p2p-1374 DEBUG QQQ queue length: 494
--
Dec 13 02:20:08-690913 cadet-p2p-1374 DEBUG core wait time 997626 µs
Dec 13 02:20:08-691224 cadet-p2p-1374 DEBUG QQQ queue length: 505
--
Dec 13 02:20:09-739074 cadet-p2p-1374 DEBUG core wait time 1047907 µs
Dec 13 02:20:09-739290 cadet-p2p-1374 DEBUG QQQ queue length: 517
--
Dec 13 02:20:11-094143 cadet-p2p-1374 DEBUG core wait time 1354865 µs
Dec 13 02:20:11-094338 cadet-p2p-1374 DEBUG QQQ queue length: 533








For comparison, this is the same log from the theoretically traffic-heavy sender peer:

Dec 13 02:19:59-599543 cadet-p2p-1381 DEBUG core wait time 4012 µs
Dec 13 02:19:59-599782 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:19:59-607045 cadet-p2p-1381 DEBUG core wait time 7279 µs
Dec 13 02:19:59-607841 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:19:59-692619 cadet-p2p-1381 DEBUG core wait time 84797 µs
Dec 13 02:19:59-692756 cadet-p2p-1381 DEBUG QQQ queue length: 3
Dec 13 02:19:59-712623 cadet-p2p-1381 DEBUG core wait time 19876 µs
Dec 13 02:19:59-713411 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:19:59-717701 cadet-p2p-1381 DEBUG core wait time 4307 µs
Dec 13 02:19:59-717895 cadet-p2p-1381 DEBUG QQQ queue length: 3
Dec 13 02:19:59-727436 cadet-p2p-1381 DEBUG core wait time 9557 µs
Dec 13 02:19:59-727627 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:19:59-731421 cadet-p2p-1381 DEBUG core wait time 3812 µs
Dec 13 02:19:59-732200 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:19:59-818420 cadet-p2p-1381 DEBUG core wait time 367 µs
Dec 13 02:19:59-818743 cadet-p2p-1381 DEBUG QQQ queue length: 3
--
Dec 13 02:19:59-943865 cadet-p2p-1381 DEBUG core wait time 250 µs
Dec 13 02:19:59-944050 cadet-p2p-1381 DEBUG QQQ queue length: 3
Dec 13 02:20:00-009701 cadet-p2p-1381 DEBUG core wait time 105 µs
Dec 13 02:20:00-009865 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:00-010409 cadet-p2p-1381 DEBUG core wait time 556 µs
Dec 13 02:20:00-010876 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:00-013335 cadet-p2p-1381 DEBUG core wait time 2468 µs
Dec 13 02:20:00-013614 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:00-029545 cadet-p2p-1381 DEBUG core wait time 15938 µs
Dec 13 02:20:00-029661 cadet-p2p-1381 DEBUG QQQ queue length: 3
Dec 13 02:20:00-035705 cadet-p2p-1381 DEBUG core wait time 6053 µs
Dec 13 02:20:00-035835 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:00-036653 cadet-p2p-1381 DEBUG core wait time 830 µs
Dec 13 02:20:00-037094 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:00-040629 cadet-p2p-1381 DEBUG core wait time 3543 µs
Dec 13 02:20:00-040763 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:00-043640 cadet-p2p-1381 DEBUG core wait time 2887 µs
Dec 13 02:20:00-044085 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:00-069373 cadet-p2p-1381 DEBUG core wait time 278 µs
Dec 13 02:20:00-069585 cadet-p2p-1381 DEBUG QQQ queue length: 3
--
Dec 13 02:20:00-194870 cadet-p2p-1381 DEBUG core wait time 250 µs
Dec 13 02:20:00-195045 cadet-p2p-1381 DEBUG QQQ queue length: 3
--
Dec 13 02:20:00-320721 cadet-p2p-1381 DEBUG core wait time 416 µs
Dec 13 02:20:00-321106 cadet-p2p-1381 DEBUG QQQ queue length: 3
--
Dec 13 02:20:00-446453 cadet-p2p-1381 DEBUG core wait time 393 µs
Dec 13 02:20:00-446818 cadet-p2p-1381 DEBUG QQQ queue length: 3
--
Dec 13 02:20:00-572023 cadet-p2p-1381 DEBUG core wait time 315 µs
Dec 13 02:20:00-572361 cadet-p2p-1381 DEBUG QQQ queue length: 3
Dec 13 02:20:00-646177 cadet-p2p-1381 DEBUG core wait time 122 µs
Dec 13 02:20:00-646365 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:00-647520 cadet-p2p-1381 DEBUG core wait time 1174 µs
Dec 13 02:20:00-648315 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:00-666600 cadet-p2p-1381 DEBUG core wait time 18301 µs
Dec 13 02:20:00-666733 cadet-p2p-1381 DEBUG QQQ queue length: 3
Dec 13 02:20:00-667947 cadet-p2p-1381 DEBUG core wait time 1222 µs
Dec 13 02:20:00-668696 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:00-688334 cadet-p2p-1381 DEBUG core wait time 19654 µs
Dec 13 02:20:00-688539 cadet-p2p-1381 DEBUG QQQ queue length: 3
Dec 13 02:20:00-690378 cadet-p2p-1381 DEBUG core wait time 1855 µs
Dec 13 02:20:00-690670 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:00-691738 cadet-p2p-1381 DEBUG core wait time 1085 µs
Dec 13 02:20:00-693483 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:00-701096 cadet-p2p-1381 DEBUG core wait time 7631 µs
Dec 13 02:20:00-701338 cadet-p2p-1381 DEBUG QQQ queue length: 3
Dec 13 02:20:00-709354 cadet-p2p-1381 DEBUG core wait time 8032 µs
Dec 13 02:20:00-710064 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:00-722189 cadet-p2p-1381 DEBUG core wait time 12132 µs
Dec 13 02:20:00-722394 cadet-p2p-1381 DEBUG QQQ queue length: 3
Dec 13 02:20:00-726746 cadet-p2p-1381 DEBUG core wait time 4369 µs
Dec 13 02:20:00-727032 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:00-825862 cadet-p2p-1381 DEBUG core wait time 277 µs
Dec 13 02:20:00-826126 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:00-951409 cadet-p2p-1381 DEBUG core wait time 300 µs
Dec 13 02:20:00-951679 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:01-076956 cadet-p2p-1381 DEBUG core wait time 229 µs
Dec 13 02:20:01-077104 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:01-202717 cadet-p2p-1381 DEBUG core wait time 354 µs
Dec 13 02:20:01-202900 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:01-290125 cadet-p2p-1381 DEBUG core wait time 131 µs
Dec 13 02:20:01-291420 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:01-294058 cadet-p2p-1381 DEBUG core wait time 2656 µs
Dec 13 02:20:01-294398 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:01-298855 cadet-p2p-1381 DEBUG core wait time 4476 µs
Dec 13 02:20:01-299013 cadet-p2p-1381 DEBUG QQQ queue length: 3
Dec 13 02:20:01-299869 cadet-p2p-1381 DEBUG core wait time 872 µs
Dec 13 02:20:01-300007 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:01-301081 cadet-p2p-1381 DEBUG core wait time 1083 µs
Dec 13 02:20:01-301883 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:01-305914 cadet-p2p-1381 DEBUG core wait time 4047 µs
Dec 13 02:20:01-306155 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:01-312347 cadet-p2p-1381 DEBUG core wait time 6209 µs
Dec 13 02:20:01-313094 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:01-316904 cadet-p2p-1381 DEBUG core wait time 3828 µs
Dec 13 02:20:01-317035 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:01-325800 cadet-p2p-1381 DEBUG core wait time 8772 µs
Dec 13 02:20:01-326535 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:01-335676 cadet-p2p-1381 DEBUG core wait time 9155 µs
Dec 13 02:20:01-335792 cadet-p2p-1381 DEBUG QQQ queue length: 3
Dec 13 02:20:01-345772 cadet-p2p-1381 DEBUG core wait time 9994 µs
Dec 13 02:20:01-346034 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:01-459175 cadet-p2p-1381 DEBUG core wait time 305 µs
Dec 13 02:20:01-459380 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:01-584795 cadet-p2p-1381 DEBUG core wait time 278 µs
Dec 13 02:20:01-584997 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:01-755452 cadet-p2p-1381 DEBUG core wait time 8388 µs
Dec 13 02:20:01-755727 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:01-828192 cadet-p2p-1381 DEBUG core wait time 118 µs
Dec 13 02:20:01-828734 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:01-831449 cadet-p2p-1381 DEBUG core wait time 2725 µs
Dec 13 02:20:01-832069 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:01-844292 cadet-p2p-1381 DEBUG core wait time 12233 µs
Dec 13 02:20:01-844447 cadet-p2p-1381 DEBUG QQQ queue length: 3
Dec 13 02:20:01-846894 cadet-p2p-1381 DEBUG core wait time 2455 µs
Dec 13 02:20:01-847073 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:01-847840 cadet-p2p-1381 DEBUG core wait time 779 µs
Dec 13 02:20:01-848344 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:01-870532 cadet-p2p-1381 DEBUG core wait time 22196 µs
Dec 13 02:20:01-870738 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:01-871854 cadet-p2p-1381 DEBUG core wait time 1132 µs
Dec 13 02:20:01-872368 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:01-878029 cadet-p2p-1381 DEBUG core wait time 5670 µs
Dec 13 02:20:01-878183 cadet-p2p-1381 DEBUG QQQ queue length: 3
Dec 13 02:20:01-890442 cadet-p2p-1381 DEBUG core wait time 12267 µs
Dec 13 02:20:01-890687 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:01-891826 cadet-p2p-1381 DEBUG core wait time 1159 µs
Dec 13 02:20:01-892776 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:01-903222 cadet-p2p-1381 DEBUG core wait time 10465 µs
Dec 13 02:20:01-903443 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:02-001645 cadet-p2p-1381 DEBUG core wait time 275 µs
Dec 13 02:20:02-001843 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:02-127397 cadet-p2p-1381 DEBUG core wait time 321 µs
Dec 13 02:20:02-127657 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:02-256498 cadet-p2p-1381 DEBUG core wait time 405 µs
Dec 13 02:20:02-256764 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:02-382020 cadet-p2p-1381 DEBUG core wait time 265 µs
Dec 13 02:20:02-382245 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:02-500121 cadet-p2p-1381 DEBUG core wait time 123 µs
Dec 13 02:20:02-500863 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:02-503884 cadet-p2p-1381 DEBUG core wait time 3038 µs
Dec 13 02:20:02-504657 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:02-511152 cadet-p2p-1381 DEBUG core wait time 6511 µs
Dec 13 02:20:02-511317 cadet-p2p-1381 DEBUG QQQ queue length: 6
Dec 13 02:20:02-513760 cadet-p2p-1381 DEBUG core wait time 2455 µs
Dec 13 02:20:02-514152 cadet-p2p-1381 DEBUG QQQ queue length: 5
Dec 13 02:20:02-524317 cadet-p2p-1381 DEBUG core wait time 10206 µs
Dec 13 02:20:02-524713 cadet-p2p-1381 DEBUG QQQ queue length: 4
--
Dec 13 02:20:02-536494 cadet-p2p-1381 DEBUG core wait time 11788 µs
Dec 13 02:20:02-537111 cadet-p2p-1381 DEBUG QQQ queue length: 3
Dec 13 02:20:02-543527 cadet-p2p-1381 DEBUG core wait time 6447 µs
Dec 13 02:20:02-543779 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:02-544891 cadet-p2p-1381 DEBUG core wait time 1131 µs
Dec 13 02:20:02-545712 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:02-553202 cadet-p2p-1381 DEBUG core wait time 7507 µs
Dec 13 02:20:02-553493 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:02-554655 cadet-p2p-1381 DEBUG core wait time 1179 µs
Dec 13 02:20:02-555455 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:02-574958 cadet-p2p-1381 DEBUG core wait time 19519 µs
Dec 13 02:20:02-575266 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:02-635652 cadet-p2p-1381 DEBUG core wait time 306 µs
Dec 13 02:20:02-635911 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:02-761308 cadet-p2p-1381 DEBUG core wait time 296 µs
Dec 13 02:20:02-761582 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:02-886942 cadet-p2p-1381 DEBUG core wait time 302 µs
Dec 13 02:20:02-887208 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:03-012413 cadet-p2p-1381 DEBUG core wait time 234 µs
Dec 13 02:20:03-012564 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:03-138029 cadet-p2p-1381 DEBUG core wait time 288 µs
Dec 13 02:20:03-138285 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:03-210464 cadet-p2p-1381 DEBUG core wait time 92 µs
Dec 13 02:20:03-210930 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:03-213504 cadet-p2p-1381 DEBUG core wait time 2584 µs
Dec 13 02:20:03-213793 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:03-225359 cadet-p2p-1381 DEBUG core wait time 11574 µs
Dec 13 02:20:03-225467 cadet-p2p-1381 DEBUG QQQ queue length: 3
Dec 13 02:20:03-227181 cadet-p2p-1381 DEBUG core wait time 1722 µs
Dec 13 02:20:03-227294 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:03-228037 cadet-p2p-1381 DEBUG core wait time 752 µs
Dec 13 02:20:03-228482 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:03-231265 cadet-p2p-1381 DEBUG core wait time 2793 µs
Dec 13 02:20:03-231397 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:03-249173 cadet-p2p-1381 DEBUG core wait time 17785 µs
Dec 13 02:20:03-249614 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:03-252579 cadet-p2p-1381 DEBUG core wait time 2978 µs
Dec 13 02:20:03-252728 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:03-254544 cadet-p2p-1381 DEBUG core wait time 1830 µs
Dec 13 02:20:03-254984 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:03-260417 cadet-p2p-1381 DEBUG core wait time 5442 µs
Dec 13 02:20:03-260554 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:03-265047 cadet-p2p-1381 DEBUG core wait time 4501 µs
Dec 13 02:20:03-265470 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:03-283316 cadet-p2p-1381 DEBUG core wait time 17854 µs
Dec 13 02:20:03-283429 cadet-p2p-1381 DEBUG QQQ queue length: 3
Dec 13 02:20:03-284463 cadet-p2p-1381 DEBUG core wait time 1042 µs
Dec 13 02:20:03-284671 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:03-390660 cadet-p2p-1381 DEBUG core wait time 339 µs
Dec 13 02:20:03-390963 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:03-516183 cadet-p2p-1381 DEBUG core wait time 301 µs
Dec 13 02:20:03-516375 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:03-644726 cadet-p2p-1381 DEBUG core wait time 344 µs
Dec 13 02:20:03-645029 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:03-803637 cadet-p2p-1381 DEBUG core wait time 7405 µs
Dec 13 02:20:03-803938 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:03-922059 cadet-p2p-1381 DEBUG core wait time 244 µs
Dec 13 02:20:03-922279 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:03-939939 cadet-p2p-1381 DEBUG core wait time 93 µs
Dec 13 02:20:03-940453 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:03-942961 cadet-p2p-1381 DEBUG core wait time 2521 µs
Dec 13 02:20:03-947415 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:03-980860 cadet-p2p-1381 DEBUG core wait time 37615 µs
Dec 13 02:20:03-981016 cadet-p2p-1381 DEBUG QQQ queue length: 4
Dec 13 02:20:03-982171 cadet-p2p-1381 DEBUG core wait time 1163 µs
Dec 13 02:20:03-982398 cadet-p2p-1381 DEBUG QQQ queue length: 3
Dec 13 02:20:03-983379 cadet-p2p-1381 DEBUG core wait time 1001 µs
Dec 13 02:20:03-983854 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:03-992100 cadet-p2p-1381 DEBUG core wait time 8261 µs
Dec 13 02:20:03-992262 cadet-p2p-1381 DEBUG QQQ queue length: 3
Dec 13 02:20:03-994390 cadet-p2p-1381 DEBUG core wait time 2138 µs
Dec 13 02:20:03-994598 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:04-002811 cadet-p2p-1381 DEBUG core wait time 8223 µs
Dec 13 02:20:04-003352 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:04-020412 cadet-p2p-1381 DEBUG core wait time 17069 µs
Dec 13 02:20:04-020699 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:04-022220 cadet-p2p-1381 DEBUG core wait time 1540 µs
Dec 13 02:20:04-023203 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:04-033649 cadet-p2p-1381 DEBUG core wait time 10464 µs
Dec 13 02:20:04-033837 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:04-035019 cadet-p2p-1381 DEBUG core wait time 1192 µs
Dec 13 02:20:04-035529 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:04-105415 cadet-p2p-1381 DEBUG core wait time 462 µs
Dec 13 02:20:04-105791 cadet-p2p-1381 DEBUG QQQ queue length: 3
--
Dec 13 02:20:04-230971 cadet-p2p-1381 DEBUG core wait time 291 µs
Dec 13 02:20:04-231215 cadet-p2p-1381 DEBUG QQQ queue length: 3
--
Dec 13 02:20:04-356697 cadet-p2p-1381 DEBUG core wait time 412 µs
Dec 13 02:20:04-357128 cadet-p2p-1381 DEBUG QQQ queue length: 3
--
Dec 13 02:20:04-482066 cadet-p2p-1381 DEBUG core wait time 233 µs
Dec 13 02:20:04-482246 cadet-p2p-1381 DEBUG QQQ queue length: 3
--
Dec 13 02:20:04-607818 cadet-p2p-1381 DEBUG core wait time 366 µs
Dec 13 02:20:04-608151 cadet-p2p-1381 DEBUG QQQ queue length: 3
Dec 13 02:20:04-694559 cadet-p2p-1381 DEBUG core wait time 93 µs
Dec 13 02:20:04-694696 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:04-695196 cadet-p2p-1381 DEBUG core wait time 510 µs
Dec 13 02:20:04-695628 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:04-698469 cadet-p2p-1381 DEBUG core wait time 2850 µs
Dec 13 02:20:04-698765 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:04-715445 cadet-p2p-1381 DEBUG core wait time 16688 µs
Dec 13 02:20:04-715561 cadet-p2p-1381 DEBUG QQQ queue length: 3
Dec 13 02:20:04-724172 cadet-p2p-1381 DEBUG core wait time 8620 µs
Dec 13 02:20:04-724320 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:04-729304 cadet-p2p-1381 DEBUG core wait time 4996 µs
Dec 13 02:20:04-729762 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:04-733122 cadet-p2p-1381 DEBUG core wait time 3371 µs
Dec 13 02:20:04-733264 cadet-p2p-1381 DEBUG QQQ queue length: 3
Dec 13 02:20:04-739117 cadet-p2p-1381 DEBUG core wait time 5863 µs
Dec 13 02:20:04-739586 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:04-753381 cadet-p2p-1381 DEBUG core wait time 13803 µs
Dec 13 02:20:04-753498 cadet-p2p-1381 DEBUG QQQ queue length: 3
Dec 13 02:20:04-754704 cadet-p2p-1381 DEBUG core wait time 1214 µs
Dec 13 02:20:04-754840 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:04-755726 cadet-p2p-1381 DEBUG core wait time 897 µs
Dec 13 02:20:04-756247 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:04-765176 cadet-p2p-1381 DEBUG core wait time 8941 µs
Dec 13 02:20:04-765309 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:04-769585 cadet-p2p-1381 DEBUG core wait time 4283 µs
Dec 13 02:20:04-770056 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:04-858720 cadet-p2p-1381 DEBUG core wait time 252 µs
Dec 13 02:20:04-858902 cadet-p2p-1381 DEBUG QQQ queue length: 3
--
Dec 13 02:20:04-984224 cadet-p2p-1381 DEBUG core wait time 248 µs
Dec 13 02:20:04-984409 cadet-p2p-1381 DEBUG QQQ queue length: 3
--
Dec 13 02:20:05-109655 cadet-p2p-1381 DEBUG core wait time 248 µs
Dec 13 02:20:05-109843 cadet-p2p-1381 DEBUG QQQ queue length: 3
--
Dec 13 02:20:05-235362 cadet-p2p-1381 DEBUG core wait time 414 µs
Dec 13 02:20:05-235764 cadet-p2p-1381 DEBUG QQQ queue length: 3
--
Dec 13 02:20:05-360804 cadet-p2p-1381 DEBUG core wait time 245 µs
Dec 13 02:20:05-361101 cadet-p2p-1381 DEBUG QQQ queue length: 3
Dec 13 02:20:05-372179 cadet-p2p-1381 DEBUG core wait time 119 µs
Dec 13 02:20:05-372437 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:05-373796 cadet-p2p-1381 DEBUG core wait time 1378 µs
Dec 13 02:20:05-374594 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:05-379903 cadet-p2p-1381 DEBUG core wait time 5326 µs
Dec 13 02:20:05-380086 cadet-p2p-1381 DEBUG QQQ queue length: 4
Dec 13 02:20:05-381215 cadet-p2p-1381 DEBUG core wait time 1145 µs
Dec 13 02:20:05-381544 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:05-382943 cadet-p2p-1381 DEBUG core wait time 1416 µs
Dec 13 02:20:05-383637 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:05-387560 cadet-p2p-1381 DEBUG core wait time 3932 µs
Dec 13 02:20:05-387794 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:05-395007 cadet-p2p-1381 DEBUG core wait time 7231 µs
Dec 13 02:20:05-395773 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:05-401094 cadet-p2p-1381 DEBUG core wait time 5329 µs
Dec 13 02:20:05-401295 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:05-412560 cadet-p2p-1381 DEBUG core wait time 11282 µs
Dec 13 02:20:05-413346 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:05-426337 cadet-p2p-1381 DEBUG core wait time 13005 µs
Dec 13 02:20:05-426519 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:05-427610 cadet-p2p-1381 DEBUG core wait time 1107 µs
Dec 13 02:20:05-428381 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:05-436450 cadet-p2p-1381 DEBUG core wait time 8085 µs
Dec 13 02:20:05-436752 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:05-486229 cadet-p2p-1381 DEBUG core wait time 214 µs
Dec 13 02:20:05-486376 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:05-611854 cadet-p2p-1381 DEBUG core wait time 259 µs
Dec 13 02:20:05-612057 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:05-737701 cadet-p2p-1381 DEBUG core wait time 376 µs
Dec 13 02:20:05-738005 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:05-867507 cadet-p2p-1381 DEBUG core wait time 268 µs
Dec 13 02:20:05-867679 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:05-993084 cadet-p2p-1381 DEBUG core wait time 258 µs
Dec 13 02:20:05-993283 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:06-118820 cadet-p2p-1381 DEBUG core wait time 265 µs
Dec 13 02:20:06-119041 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:06-133172 cadet-p2p-1381 DEBUG core wait time 136 µs
Dec 13 02:20:06-133912 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:06-137375 cadet-p2p-1381 DEBUG core wait time 3476 µs
Dec 13 02:20:06-137862 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:06-156955 cadet-p2p-1381 DEBUG core wait time 19110 µs
Dec 13 02:20:06-157122 cadet-p2p-1381 DEBUG QQQ queue length: 3
Dec 13 02:20:06-168489 cadet-p2p-1381 DEBUG core wait time 11376 µs
Dec 13 02:20:06-168732 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:06-169957 cadet-p2p-1381 DEBUG core wait time 1245 µs
Dec 13 02:20:06-170884 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:06-182280 cadet-p2p-1381 DEBUG core wait time 11414 µs
Dec 13 02:20:06-182492 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:06-183618 cadet-p2p-1381 DEBUG core wait time 1137 µs
Dec 13 02:20:06-184145 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:06-199453 cadet-p2p-1381 DEBUG core wait time 15316 µs
Dec 13 02:20:06-199705 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:06-204542 cadet-p2p-1381 DEBUG core wait time 4856 µs
Dec 13 02:20:06-207984 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:06-217003 cadet-p2p-1381 DEBUG core wait time 9035 µs
Dec 13 02:20:06-217206 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:06-225851 cadet-p2p-1381 DEBUG core wait time 8657 µs
Dec 13 02:20:06-226621 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:06-246329 cadet-p2p-1381 DEBUG core wait time 295 µs
Dec 13 02:20:06-246551 cadet-p2p-1381 DEBUG QQQ queue length: 3
--
Dec 13 02:20:06-372018 cadet-p2p-1381 DEBUG core wait time 296 µs
Dec 13 02:20:06-372264 cadet-p2p-1381 DEBUG QQQ queue length: 3
--
Dec 13 02:20:06-497689 cadet-p2p-1381 DEBUG core wait time 336 µs
Dec 13 02:20:06-497938 cadet-p2p-1381 DEBUG QQQ queue length: 3
--
Dec 13 02:20:06-623353 cadet-p2p-1381 DEBUG core wait time 288 µs
Dec 13 02:20:06-623594 cadet-p2p-1381 DEBUG QQQ queue length: 3
--
Dec 13 02:20:06-748997 cadet-p2p-1381 DEBUG core wait time 357 µs
Dec 13 02:20:06-749246 cadet-p2p-1381 DEBUG QQQ queue length: 3
--
Dec 13 02:20:06-875006 cadet-p2p-1381 DEBUG core wait time 567 µs
Dec 13 02:20:06-875406 cadet-p2p-1381 DEBUG QQQ queue length: 3
Dec 13 02:20:06-910322 cadet-p2p-1381 DEBUG core wait time 101 µs
Dec 13 02:20:06-910474 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:06-911484 cadet-p2p-1381 DEBUG core wait time 1027 µs
Dec 13 02:20:06-912001 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:06-918375 cadet-p2p-1381 DEBUG core wait time 6383 µs
Dec 13 02:20:06-918599 cadet-p2p-1381 DEBUG QQQ queue length: 5
Dec 13 02:20:06-919823 cadet-p2p-1381 DEBUG core wait time 1241 µs
Dec 13 02:20:06-920229 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:06-921587 cadet-p2p-1381 DEBUG core wait time 1369 µs
Dec 13 02:20:06-922151 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:06-925525 cadet-p2p-1381 DEBUG core wait time 3384 µs
Dec 13 02:20:06-925734 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:06-928625 cadet-p2p-1381 DEBUG core wait time 2900 µs
Dec 13 02:20:06-929144 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:06-933315 cadet-p2p-1381 DEBUG core wait time 4180 µs
Dec 13 02:20:06-933499 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:06-947806 cadet-p2p-1381 DEBUG core wait time 14316 µs
Dec 13 02:20:06-948330 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:06-961444 cadet-p2p-1381 DEBUG core wait time 13133 µs
Dec 13 02:20:06-961642 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:06-966287 cadet-p2p-1381 DEBUG core wait time 4658 µs
Dec 13 02:20:06-966824 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:06-970420 cadet-p2p-1381 DEBUG core wait time 3607 µs
Dec 13 02:20:06-970639 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:07-000432 cadet-p2p-1381 DEBUG core wait time 279 µs
Dec 13 02:20:07-000712 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:07-126102 cadet-p2p-1381 DEBUG core wait time 266 µs
Dec 13 02:20:07-126330 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:07-251867 cadet-p2p-1381 DEBUG core wait time 361 µs
Dec 13 02:20:07-252181 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:07-377391 cadet-p2p-1381 DEBUG core wait time 253 µs
Dec 13 02:20:07-377603 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:07-503083 cadet-p2p-1381 DEBUG core wait time 258 µs
Dec 13 02:20:07-503283 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:07-628911 cadet-p2p-1381 DEBUG core wait time 364 µs
Dec 13 02:20:07-629228 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:07-734650 cadet-p2p-1381 DEBUG core wait time 126 µs
Dec 13 02:20:07-735443 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:07-738368 cadet-p2p-1381 DEBUG core wait time 2941 µs
Dec 13 02:20:07-738891 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:07-757202 cadet-p2p-1381 DEBUG core wait time 18328 µs
Dec 13 02:20:07-757387 cadet-p2p-1381 DEBUG QQQ queue length: 4
Dec 13 02:20:07-772970 cadet-p2p-1381 DEBUG core wait time 15596 µs
Dec 13 02:20:07-773174 cadet-p2p-1381 DEBUG QQQ queue length: 3
Dec 13 02:20:07-774099 cadet-p2p-1381 DEBUG core wait time 943 µs
Dec 13 02:20:07-774742 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:07-778213 cadet-p2p-1381 DEBUG core wait time 3485 µs
Dec 13 02:20:07-778424 cadet-p2p-1381 DEBUG QQQ queue length: 3
Dec 13 02:20:07-782985 cadet-p2p-1381 DEBUG core wait time 4576 µs
Dec 13 02:20:07-783141 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:07-787503 cadet-p2p-1381 DEBUG core wait time 4373 µs
Dec 13 02:20:07-788228 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:07-794704 cadet-p2p-1381 DEBUG core wait time 6493 µs
Dec 13 02:20:07-794910 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:07-807041 cadet-p2p-1381 DEBUG core wait time 12139 µs
Dec 13 02:20:07-807783 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:07-814285 cadet-p2p-1381 DEBUG core wait time 6518 µs
Dec 13 02:20:07-814459 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:07-817317 cadet-p2p-1381 DEBUG core wait time 2870 µs
Dec 13 02:20:07-817859 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:07-830118 cadet-p2p-1381 DEBUG core wait time 12267 µs
Dec 13 02:20:07-830424 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:07-920574 cadet-p2p-1381 DEBUG core wait time 21926 µs
Dec 13 02:20:07-920848 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:08-024562 cadet-p2p-1381 DEBUG core wait time 313 µs
Dec 13 02:20:08-024835 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:08-150227 cadet-p2p-1381 DEBUG core wait time 336 µs
Dec 13 02:20:08-150501 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:08-275859 cadet-p2p-1381 DEBUG core wait time 314 µs
Dec 13 02:20:08-276127 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:08-401511 cadet-p2p-1381 DEBUG core wait time 350 µs
Dec 13 02:20:08-401787 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:08-526960 cadet-p2p-1381 DEBUG core wait time 213 µs
Dec 13 02:20:08-527102 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:08-652476 cadet-p2p-1381 DEBUG core wait time 234 µs
Dec 13 02:20:08-652633 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:08-719542 cadet-p2p-1381 DEBUG core wait time 107 µs
Dec 13 02:20:08-720369 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:08-723547 cadet-p2p-1381 DEBUG core wait time 3194 µs
Dec 13 02:20:08-724076 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:08-753144 cadet-p2p-1381 DEBUG core wait time 29084 µs
Dec 13 02:20:08-753337 cadet-p2p-1381 DEBUG QQQ queue length: 3
Dec 13 02:20:08-754466 cadet-p2p-1381 DEBUG core wait time 1145 µs
Dec 13 02:20:08-754665 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:08-755453 cadet-p2p-1381 DEBUG core wait time 805 µs
Dec 13 02:20:08-755944 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:08-764384 cadet-p2p-1381 DEBUG core wait time 8448 µs
Dec 13 02:20:08-764549 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:08-765800 cadet-p2p-1381 DEBUG core wait time 1265 µs
Dec 13 02:20:08-766508 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:08-783058 cadet-p2p-1381 DEBUG core wait time 16567 µs
Dec 13 02:20:08-783196 cadet-p2p-1381 DEBUG QQQ queue length: 3
Dec 13 02:20:08-791769 cadet-p2p-1381 DEBUG core wait time 8581 µs
Dec 13 02:20:08-792539 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:08-796293 cadet-p2p-1381 DEBUG core wait time 3770 µs
Dec 13 02:20:08-796502 cadet-p2p-1381 DEBUG QQQ queue length: 3
Dec 13 02:20:08-800722 cadet-p2p-1381 DEBUG core wait time 4236 µs
Dec 13 02:20:08-800941 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:08-803757 cadet-p2p-1381 DEBUG core wait time 2834 µs
Dec 13 02:20:08-804473 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:08-823033 cadet-p2p-1381 DEBUG core wait time 18576 µs
Dec 13 02:20:08-823324 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:08-908058 cadet-p2p-1381 DEBUG core wait time 338 µs
Dec 13 02:20:08-908357 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:09-033662 cadet-p2p-1381 DEBUG core wait time 295 µs
Dec 13 02:20:09-033912 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:09-159283 cadet-p2p-1381 DEBUG core wait time 326 µs
Dec 13 02:20:09-159554 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:09-284886 cadet-p2p-1381 DEBUG core wait time 301 µs
Dec 13 02:20:09-285134 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:09-410579 cadet-p2p-1381 DEBUG core wait time 391 µs
Dec 13 02:20:09-410829 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:09-536107 cadet-p2p-1381 DEBUG core wait time 292 µs
Dec 13 02:20:09-536358 cadet-p2p-1381 DEBUG QQQ queue length: 2
--
Dec 13 02:20:09-661880 cadet-p2p-1381 DEBUG core wait time 328 µs
Dec 13 02:20:09-662147 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:09-773570 cadet-p2p-1381 DEBUG core wait time 133 µs
Dec 13 02:20:09-774428 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:09-777478 cadet-p2p-1381 DEBUG core wait time 3067 µs
Dec 13 02:20:09-778001 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:09-782966 cadet-p2p-1381 DEBUG core wait time 4981 µs
Dec 13 02:20:09-783102 cadet-p2p-1381 DEBUG QQQ queue length: 4
Dec 13 02:20:09-784360 cadet-p2p-1381 DEBUG core wait time 1265 µs
Dec 13 02:20:09-784691 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:09-786005 cadet-p2p-1381 DEBUG core wait time 1333 µs
Dec 13 02:20:09-786756 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:09-804104 cadet-p2p-1381 DEBUG core wait time 17365 µs
Dec 13 02:20:09-804294 cadet-p2p-1381 DEBUG QQQ queue length: 3
Dec 13 02:20:09-805395 cadet-p2p-1381 DEBUG core wait time 1117 µs
Dec 13 02:20:09-805610 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:09-806458 cadet-p2p-1381 DEBUG core wait time 866 µs
Dec 13 02:20:09-807222 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:09-823811 cadet-p2p-1381 DEBUG core wait time 16606 µs
Dec 13 02:20:09-829298 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:09-834115 cadet-p2p-1381 DEBUG core wait time 4830 µs
Dec 13 02:20:09-834909 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:09-838965 cadet-p2p-1381 DEBUG core wait time 4073 µs
Dec 13 02:20:09-839217 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:09-844137 cadet-p2p-1381 DEBUG core wait time 4936 µs
Dec 13 02:20:09-844879 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:09-859162 cadet-p2p-1381 DEBUG core wait time 14300 µs
Dec 13 02:20:09-859381 cadet-p2p-1381 DEBUG QQQ queue length: 2
Dec 13 02:20:09-860865 cadet-p2p-1381 DEBUG core wait time 1500 µs
Dec 13 02:20:09-861567 cadet-p2p-1381 DEBUG QQQ queue length: 1
--
Dec 13 02:20:09-954547 cadet-p2p-1381 DEBUG core wait time 2358 µs
Dec 13 02:20:09-954879 cadet-p2p-1381 DEBUG QQQ queue length: 3
--
Dec 13 02:20:10-078346 cadet-p2p-1381 DEBUG core wait time 441 µs
Dec 13 02:20:10-078728 cadet-p2p-1381 DEBUG QQQ queue length: 3
--
Dec 13 02:20:10-203859 cadet-p2p-1381 DEBUG core wait time 317 µs
Dec 13 02:20:10-204042 cadet-p2p-1381 DEBUG QQQ queue length: 3
--
Dec 13 02:20:10-329562 cadet-p2p-1381 DEBUG core wait time 347 µs
Dec 13 02:20:10-329877 cadet-p2p-1381 DEBUG QQQ queue length: 3
--
Dec 13 02:20:10-455152 cadet-p2p-1381 DEBUG core wait time 284 µs
Dec 13 02:20:10-455448 cadet-p2p-1381 DEBUG QQQ queue length: 3
--
Dec 13 02:20:10-580819 cadet-p2p-1381 DEBUG core wait time 360 µs
Dec 13 02:20:10-581154 cadet-p2p-1381 DEBUG QQQ queue length: 3
--
Dec 13 02:20:10-706325 cadet-p2p-1381 DEBUG core wait time 318 µs
Dec 13 02:20:10-706603 cadet-p2p-1381 DEBUG QQQ queue length: 3
--
Dec 13 02:20:10-831975 cadet-p2p-1381 DEBUG core wait time 364 µs
Dec 13 02:20:10-832263 cadet-p2p-1381 DEBUG QQQ queue length: 3
--
Dec 13 02:20:10-865254 cadet-p2p-1381 DEBUG core wait time 198 µs
Dec 13 02:20:10-865480 cadet-p2p-1381 DEBUG QQQ queue length: 3
--
Dec 13 02:20:10-957676 cadet-p2p-1381 DEBUG core wait time 492 µs
Dec 13 02:20:10-957929 cadet-p2p-1381 DEBUG QQQ queue length: 3
--
Dec 13 02:20:11-083325 cadet-p2p-1381 DEBUG core wait time 356 µs
Dec 13 02:20:11-083643 cadet-p2p-1381 DEBUG QQQ queue length: 3