Performance issues while updating issues caused by webhook connection error
Platform Notice: Data Center Only - This article only applies to Atlassian products on the Data Center platform.
Note that this KB was created for the Data Center version of the product. Data Center KBs for non-Data-Center-specific features may also work for Server versions of the product, however they have not been tested. Support for Server* products ended on February 15th 2024. If you are running a Server product, you can visit the Atlassian Server end of support announcement to review your migration options.
*Except Fisheye and Crucible
Summary
Multiple actions as add, update, or delete comments or update issues, are taking a long time to finish execution (~15-30 seconds).
Environment
9.4.6
Diagnosis
Conditions:
It is not a Performance problem (other functionalities are working as expected);
Only one or few Projects are impacted;
Not all issue types for these projects are impacted;
Data Excerpt
Following one of the incidents, we can observe:
Access.log shows that deleting a comment took 19293 ms:
xxx.xx.xxx.xx 1039x8839141x1 xxxxxxxx [07/Jul/2023:17:19:51 +0000] "POST /secure/DeleteComment.jspa HTTP/1.1" 200 86 19293 "https://xxxxxxxx/browse/XXX-3699?filter=54482" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/114.0.0.0 Safari/537.36" "1g2pmye"Atlassian-jira.log shows the following sequence for the request 1039x8839141x1:
2023-07-07 17:19:40,840+0000 https-jsse-nio-8443-exec-126 url: /secure/DeleteComment.jspa; user: xxxxxxxx ERROR xxxxxxxx 1039x8839141x1 1g2pmye xxx.xx.xxx.xx /secure/DeleteComment.jspa [c.o.scriptrunner.customfield.GroovyCustomField] ************************************************************************************* 2023-07-07 17:19:40,840+0000 https-jsse-nio-8443-exec-126 url: /secure/DeleteComment.jspa; user: xxxxxxxx ERROR xxxxxxxx 1039x8839141x1 1g2pmye xxx.xx.xxx.xx /secure/DeleteComment.jspa [c.o.scriptrunner.customfield.GroovyCustomField] Script field failed on issue: XXX-3699, field: Manager javax.net.ssl.SSLHandshakeException: Remote host terminated the handshake at Script32.run(Script32.groovy:9) Caused by: java.io.EOFException: SSL peer shut down incorrectly ... 1 more 2023-07-07 17:19:41,136+0000 https-jsse-nio-8443-exec-126 url: /secure/DeleteComment.jspa; user: xxxxxxxx INFO xxxxxxxx 1039x8839141x1 1g2pmye xxx.xx.xxx.xx /secure/DeleteComment.jspa [c.a.j.p.webhooks.matcher.JqlEventMatcher_SLOW] JQL query '{project = "Jarvis"} AND {key in ("XXX-3699")}' produced lucene query and took '108' ms to run. 2023-07-07 17:19:50,216+0000 https-jsse-nio-8443-exec-126 url: /secure/DeleteComment.jspa; user: xxxxxxxx ERROR xxxxxxxx 1039x8839141x1 1g2pmye xxx.xx.xxx.xx /secure/DeleteComment.jspa [c.o.scriptrunner.customfield.GroovyCustomField] ************************************************************************************* 2023-07-07 17:19:50,216+0000 https-jsse-nio-8443-exec-126 url: /secure/DeleteComment.jspa; user: xxxxxxxx ERROR xxxxxxxx 1039x8839141x1 1g2pmye xxx.xx.xxx.xx /secure/DeleteComment.jspa [c.o.scriptrunner.customfield.GroovyCustomField] Script field failed on issue: XXX-3699, field: Manager javax.net.ssl.SSLHandshakeException: Remote host terminated the handshake at Script32.run(Script32.groovy:9) Caused by: java.io.EOFException: SSL peer shut down incorrectly ... 1 more* The same sequence of entries in the logs was observed when updating an issue or adding a new comment.
Cause
A scripted custom field was added to the project, although it was not added to the screens;
This custom field was executing a Groovy script and submitting a webhook;
The webhook was failing with the handshake error.
Solution
After removing the field from the project, adding a comment or creating a new issue was back to 3-4s, instead of 30s.
Was this helpful?