View Issue Details

IDProjectCategoryView StatusLast Update
0007782Talerauditorpublic2023-09-23 15:09
Reportersebasjm Assigned ToMS  
PriorityhighSeveritycrashReproducibilitysometimes
Status closedResolutionfixed 
Target Version0.9.3Fixed in Version0.9.3 
Summary0007782: nexus was dead, found "sorry, too many clients already" in the logs
Description    at org.jetbrains.exposed.sql.Transaction.exec(Transaction.kt:121)

    at org.jetbrains.exposed.sql.AbstractQuery.iterator(AbstractQuery.kt:65)

    at org.jetbrains.exposed.sql.IterableExKt$mapLazy$1.iterator(IterableEx.kt:129)

    at tech.libeufin.nexus.SchedulingKt$startOperationScheduler$2.invoke(Scheduling.kt:149)

    at tech.libeufin.nexus.SchedulingKt$startOperationScheduler$2.invoke(Scheduling.kt:108)

    at org.jetbrains.exposed.sql.transactions.ThreadLocalTransactionManagerKt.inTopLevelTransaction$run(ThreadLocalTransactionManager.kt:173)

    at org.jetbrains.exposed.sql.transactions.ThreadLocalTransactionManagerKt.access$inTopLevelTransaction$run(ThreadLocalTransactionManager.kt:1)

    at org.jetbrains.exposed.sql.transactions.ThreadLocalTransactionManagerKt$inTopLevelTransaction$1.invoke(ThreadLocalTransactionManager.kt:194)

    at org.jetbrains.exposed.sql.transactions.ThreadLocalTransactionManagerKt.keepAndRestoreTransactionRefAfterRun(ThreadLocalTransactionManager.kt:202)

    at org.jetbrains.exposed.sql.transactions.ThreadLocalTransactionManagerKt.inTopLevelTransaction(ThreadLocalTransactionManager.kt:193)

    at org.jetbrains.exposed.sql.transactions.ThreadLocalTransactionManagerKt$transaction$1.invoke(ThreadLocalTransactionManager.kt:151)

    at org.jetbrains.exposed.sql.transactions.ThreadLocalTransactionManagerKt.keepAndRestoreTransactionRefAfterRun(ThreadLocalTransactionManager.kt:202)

    at org.jetbrains.exposed.sql.transactions.ThreadLocalTransactionManagerKt.transaction(ThreadLocalTransactionManager.kt:123)

    at org.jetbrains.exposed.sql.transactions.ThreadLocalTransactionManagerKt.transaction(ThreadLocalTransactionManager.kt:121)

    at org.jetbrains.exposed.sql.transactions.ThreadLocalTransactionManagerKt.transaction$default(ThreadLocalTransactionManager.kt:120)

    at tech.libeufin.nexus.SchedulingKt.startOperationScheduler(Scheduling.kt:108)

    at tech.libeufin.nexus.SchedulingKt$startOperationScheduler$1.invokeSuspend(Scheduling.kt)

    at kotlin.coroutines.jvm.internal.BaseContinuationImpl.resumeWith(ContinuationImpl.kt:33)

    at kotlinx.coroutines.DispatchedTask.run(DispatchedTask.kt:106)

    at kotlinx.coroutines.internal.LimitedDispatcher.run(LimitedDispatcher.kt:42)

    at kotlinx.coroutines.scheduling.TaskImpl.run(Tasks.kt:95)

    at kotlinx.coroutines.scheduling.CoroutineScheduler.runSafely(CoroutineScheduler.kt:570)

    at kotlinx.coroutines.scheduling.CoroutineScheduler$Worker.executeTask(CoroutineScheduler.kt:750)

    at kotlinx.coroutines.scheduling.CoroutineScheduler$Worker.runWorker(CoroutineScheduler.kt:677)

    at kotlinx.coroutines.scheduling.CoroutineScheduler$Worker.run(CoroutineScheduler.kt:664)

Caused by: org.postgresql.util.PSQLException: FATAL: sorry, too many clients already

    at org.postgresql.core.v3.ConnectionFactoryImpl.doAuthentication(ConnectionFactoryImpl.java:693)

    at org.postgresql.core.v3.ConnectionFactoryImpl.tryConnect(ConnectionFactoryImpl.java:203)

    at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:258)

    at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:54)

    at org.postgresql.jdbc.PgConnection.<init>(PgConnection.java:253)

    at org.postgresql.Driver.makeConnection(Driver.java:434)

    at org.postgresql.Driver.connect(Driver.java:291)

    at java.sql/java.sql.DriverManager.getConnection(DriverManager.java:681)

    at java.sql/java.sql.DriverManager.getConnection(DriverManager.java:229)

    at org.jetbrains.exposed.sql.Database$Companion$connect$10.invoke(Database.kt:160)

    at org.jetbrains.exposed.sql.Database$Companion$connect$10.invoke(Database.kt:160)

    at org.jetbrains.exposed.sql.Database$Companion$doConnect$3.invoke(Database.kt:112)

    at org.jetbrains.exposed.sql.Database$Companion$doConnect$3.invoke(Database.kt:111)

    at org.jetbrains.exposed.sql.transactions.ThreadLocalTransactionManager$ThreadLocalTransaction$connectionLazy$1.invoke(ThreadLocalTransactionManager.kt:58)

    at org.jetbrains.exposed.sql.transactions.ThreadLocalTransactionManager$ThreadLocalTransaction$connectionLazy$1.invoke(ThreadLocalTransactionManager.kt:57)

    at kotlin.UnsafeLazyImpl.getValue(Lazy.kt:81)

    at org.jetbrains.exposed.sql.transactions.ThreadLocalTransactionManager$ThreadLocalTransaction.getConnection(ThreadLocalTransactionManager.kt:64)

    at org.jetbrains.exposed.sql.Transaction.getConnection(Transaction.kt)

    at org.jetbrains.exposed.sql.statements.Statement.prepared(Statement.kt:24)

    at org.jetbrains.exposed.sql.statements.Statement.executeIn$exposed_core(Statement.kt:47)

    ... 26 common frames omitted

17:16:26.469 [eventLoopGroupProxy-4-1] DEBUG tech.libeufin.nexus - LISTENing on domain LIBEUFIN_TALER_INCOMING for IBAN: DE210658 with timeout: 60000. Resulting channel name: XVD3K5HSN1KXP9YQG8SH29BTJNEWF4QYFB48EEKKW4B5VE38ZYW00

17:16:26.470 [DefaultDispatcher-worker-11] ERROR tech.libeufin.nexus - org.jetbrains.exposed.exceptions.ExposedSQLException: org.postgresql.util.PSQLException: FATAL: sorry, too many clients already

SQL: [Failed on expanding args for SELECT: org.jetbrains.exposed.sql.Query@4284b0bc]

    at org.jetbrains.exposed.sql.statements.Statement.executeIn$exposed_core(Statement.kt:49)

    at org.jetbrains.exposed.sql.Transaction.exec(Transaction.kt:135)

    at org.jetbrains.exposed.sql.Transaction.exec(Transaction.kt:121)

    at org.jetbrains.exposed.sql.AbstractQuery.iterator(AbstractQuery.kt:65)

    at org.jetbrains.exposed.sql.IterableExKt$mapLazy$1.iterator(IterableEx.kt:129)

    at tech.libeufin.nexus.SchedulingKt$startOperationScheduler$2.invoke(Scheduling.kt:149)

    at tech.libeufin.nexus.SchedulingKt$startOperationScheduler$2.invoke(Scheduling.kt:108)

    at org.jetbrains.exposed.sql.transactions.ThreadLocalTransactionManagerKt.inTopLevelTransaction$run(ThreadLocalTransactionManager.kt:173)

    at org.jetbrains.exposed.sql.transactions.ThreadLocalTransactionManagerKt.access$inTopLevelTransaction$run(ThreadLocalTransactionManager.kt:1)

    at org.jetbrains.exposed.sql.transactions.ThreadLocalTransactionManagerKt$inTopLevelTransaction$1.invoke(ThreadLocalTransactionManager.kt:194)

    at org.jetbrains.exposed.sql.transactions.ThreadLocalTransactionManagerKt.keepAndRestoreTransactionRefAfterRun(ThreadLocalTransactionManager.kt:202)

    at org.jetbrains.exposed.sql.transactions.ThreadLocalTransactionManagerKt.inTopLevelTransaction(ThreadLocalTransactionManager.kt:193)

    at org.jetbrains.exposed.sql.transactions.ThreadLocalTransactionManagerKt$transaction$1.invoke(ThreadLocalTransactionManager.kt:151)

    at org.jetbrains.exposed.sql.transactions.ThreadLocalTransactionManagerKt.keepAndRestoreTransactionRefAfterRun(ThreadLocalTransactionManager.kt:202)

    at org.jetbrains.exposed.sql.transactions.ThreadLocalTransactionManagerKt.transaction(ThreadLocalTransactionManager.kt:123)

    at org.jetbrains.exposed.sql.transactions.ThreadLocalTransactionManagerKt.transaction(ThreadLocalTransactionManager.kt:121)

    at org.jetbrains.exposed.sql.transactions.ThreadLocalTransactionManagerKt.transaction$default(ThreadLocalTransactionManager.kt:120)

    at tech.libeufin.nexus.SchedulingKt.startOperationScheduler(Scheduling.kt:108)

    at tech.libeufin.nexus.SchedulingKt$startOperationScheduler$1.invokeSuspend(Scheduling.kt)

    at kotlin.coroutines.jvm.internal.BaseContinuationImpl.resumeWith(ContinuationImpl.kt:33)

    at kotlinx.coroutines.DispatchedTask.run(DispatchedTask.kt:106)

    at kotlinx.coroutines.internal.LimitedDispatcher.run(LimitedDispatcher.kt:42)

    at kotlinx.coroutines.scheduling.TaskImpl.run(Tasks.kt:95)

    at kotlinx.coroutines.scheduling.CoroutineScheduler.runSafely(CoroutineScheduler.kt:570)

    at kotlinx.coroutines.scheduling.CoroutineScheduler$Worker.executeTask(CoroutineScheduler.kt:750)

    at kotlinx.coroutines.scheduling.CoroutineScheduler$Worker.runWorker(CoroutineScheduler.kt:677)

    at kotlinx.coroutines.scheduling.CoroutineScheduler$Worker.run(CoroutineScheduler.kt:664)

Caused by: org.postgresql.util.PSQLException: FATAL: sorry, too many clients already

    at org.postgresql.core.v3.ConnectionFactoryImpl.doAuthentication(ConnectionFactoryImpl.java:693)

    at org.postgresql.core.v3.ConnectionFactoryImpl.tryConnect(ConnectionFactoryImpl.java:203)

    at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:258)

    at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:54)

    at org.postgresql.jdbc.PgConnection.<init>(PgConnection.java:253)

    at org.postgresql.Driver.makeConnection(Driver.java:434)

    at org.postgresql.Driver.connect(Driver.java:291)

    at java.sql/java.sql.DriverManager.getConnection(DriverManager.java:681)

    at java.sql/java.sql.DriverManager.getConnection(DriverManager.java:229)

    at org.jetbrains.exposed.sql.Database$Companion$connect$10.invoke(Database.kt:160)

    at org.jetbrains.exposed.sql.Database$Companion$connect$10.invoke(Database.kt:160)

    at org.jetbrains.exposed.sql.Database$Companion$doConnect$3.invoke(Database.kt:112)

    at org.jetbrains.exposed.sql.Database$Companion$doConnect$3.invoke(Database.kt:111)

    at org.jetbrains.exposed.sql.transactions.ThreadLocalTransactionManager$ThreadLocalTransaction$connectionLazy$1.invoke(ThreadLocalTransactionManager.kt:58)

    at org.jetbrains.exposed.sql.transactions.ThreadLocalTransactionManager$ThreadLocalTransaction$connectionLazy$1.invoke(ThreadLocalTransactionManager.kt:57)

    at kotlin.UnsafeLazyImpl.getValue(Lazy.kt:81)

    at org.jetbrains.exposed.sql.transactions.ThreadLocalTransactionManager$ThreadLocalTransaction.getConnection(ThreadLocalTransactionManager.kt:64)

    at org.jetbrains.exposed.sql.Transaction.getConnection(Transaction.kt)

    at org.jetbrains.exposed.sql.statements.Statement.prepared(Statement.kt:24)

    at org.jetbrains.exposed.sql.statements.Statement.executeIn$exposed_core(Statement.kt:47)

    ... 26 more
TagsNo tags attached.

Activities

sebasjm

2023-04-10 15:16

developer   ~0020048

not seen anymore

Issue History

Date Modified Username Field Change
2023-03-29 20:05 sebasjm New Issue
2023-03-29 20:05 sebasjm Status new => assigned
2023-03-29 20:05 sebasjm Assigned To => MS
2023-04-10 15:16 sebasjm Status assigned => resolved
2023-04-10 15:16 sebasjm Resolution open => fixed
2023-04-10 15:16 sebasjm Note Added: 0020048
2023-04-13 20:26 Florian Dold Project libeufin => Taler
2023-04-13 20:26 Florian Dold Category nexus => General
2023-04-17 11:58 Florian Dold Category General => auditor
2023-04-17 11:58 Florian Dold Product Version Git master =>
2023-04-17 11:58 Florian Dold Target Version 0.9.4 => 0.9.3
2023-09-23 15:07 Christian Grothoff Fixed in Version => 0.9.3
2023-09-23 15:09 Christian Grothoff Status resolved => closed