This discussion has been locked.
You can no longer post new replies to this discussion. If you have a question you can start a new discussion

Webadmin "Firewall is starting"

Sometimes when working in webadmin, the session seems to crash.

If you refresh the page, it shows "Firewall is starting" on blue background.

It seems, the machine remanins functional but only webadmin crashed. After some minutes, we can login again.

Can you get it fixed please?



This thread was automatically locked due to age.
  • Looks like the daemon of webadmin crashed in your backend.

    You need to get this sorted out. RCA is needed to find the issue. 

    You could get in touch with sophos support to supply the logs or you could dig a little bit deeper in your own logs to find the reason this occurs. Maybe you find the steps to reproduce this. 

    __________________________________________________________________________________________________________________

  • Crashed again on Fri Sep 04 15:23
    I only found this in error_log.log

    Can you provide info about log files of the java process on local port 8009
    tcp6       0      0 localhost:8009          localhost:51618         ESTABLISHED 10279/java
    tcp6       0      0 localhost:8009          localhost:46498         ESTABLISHED 10279/java


    [Fri Sep 04 15:23:58.410759 2020] [proxy_http:error] [pid 2962:tid 3937303360] (20014)Internal error (specific information not available): [client 10.242.xxx.6:50435] AH01102: error reading status line from remote server localhost:8009, referer: firewall.local.domain:4444/.../EventViewer.jsp
    [Fri Sep 04 15:23:58.410787 2020] [proxy:error] [pid 2962:tid 3937303360] [client 10.242.xxx.6:50435] AH00898: Error reading from remote server returned by /webconsole/Controller, referer: firewall.local.domain:4444/.../EventViewer.jsp
    [Fri Sep 04 15:23:58.702834 2020] [proxy:error] [pid 2962:tid 4046408512] (111)Connection refused: AH00957: HTTP: attempt to connect to 127.0.0.1:8009 (localhost) failed
    [Fri Sep 04 15:23:58.702853 2020] [proxy:error] [pid 2962:tid 4046408512] AH00959: ap_proxy_connect_backend disabling worker for (localhost) for 60s
    [Fri Sep 04 15:23:58.702858 2020] [proxy_http:error] [pid 2962:tid 4046408512] [client 10.242.xxx.9:59491] AH01114: HTTP: failed to make connection to backend: localhost, referer: firewall.local.domain:4444/.../index.jsp
    [Fri Sep 04 15:24:07.476238 2020] [proxy:error] [pid 2962:tid 4063193920] AH00940: HTTP: disabled connection for (localhost)
    [Fri Sep 04 15:24:09.344793 2020] [proxy:error] [pid 2962:tid 3945696064] AH00940: HTTP: disabled connection for (localhost)
    [Fri Sep 04 15:24:13.073760 2020] [proxy:error] [pid 1379:tid 4088372032] (111)Connection refused: AH00957: HTTP: attempt to connect to 127.0.0.1:8009 (localhost) failed
    [Fri Sep 04 15:24:13.073777 2020] [proxy:error] [pid 1379:tid 4088372032] AH00959: ap_proxy_connect_backend disabling worker for (localhost) for 60s
    [Fri Sep 04 15:24:13.073782 2020] [proxy_http:error] [pid 1379:tid 4088372032] [client 10.242.xxx.9:59525] AH01114: HTTP: failed to make connection to backend: localhost
    [Fri Sep 04 15:24:14.196657 2020] [proxy:error] [pid 2962:tid 4004444992] AH00940: HTTP: disabled connection for (localhost)
    [Fri Sep 04 15:24:25.648965 2020] [proxy:error] [pid 2962:tid 3996052288] AH00940: HTTP: disabled connection for (localhost)
    [Fri Sep 04 15:24:30.850987 2020] [proxy:error] [pid 2962:tid 4130335552] AH00940: HTTP: disabled connection for (localhost)
    [Fri Sep 04 15:24:38.953584 2020] [proxy:error] [pid 2962:tid 4021230400] AH00940: HTTP: disabled connection for (localhost)
    [Fri Sep 04 15:24:43.447429 2020] [proxy:error] [pid 1379:tid 4121942848] AH00940: HTTP: disabled connection for (localhost)

  • Can you reproduce the steps, if this issue occurs? 

     Can we track a Case for this? 

    __________________________________________________________________________________________________________________

  • Sorry, cannot reproduce - seems to happen at random time mostly in logviewer. Quite often since upgrade to v18.0 compared to occourences happened on v17.5 as you can see.

     

    XG430_WP02_SFOS 18.0.1 MR-1-Build396# cat /log/error_log.log |grep "proxy_http:error]"
    [Mon Sep 02 13:05:56.202886 2019] [proxy_http:error] [pid 5363:tid 3931110208] (20014)Internal error (specific information not available): [client xxx.xxx.xxx.23:53757] AH01102: error reading status line from remote server localhost:8009, referer: xxx.xxx.xxx.xxx:4444/.../EventViewer.jsp
    [Mon Sep 02 13:05:56.465820 2019] [proxy_http:error] [pid 5364:tid 3989830464] [client xxx.xxx.xxx.23:53761] AH01114: HTTP: failed to make connection to backend: localhost, referer: xxx.xxx.xxx.xxx:4444/.../index.jsp
    [Mon Sep 02 13:05:57.473707 2019] [proxy_http:error] [pid 5363:tid 4048550720] [client xxx.xxx.xxx.23:53765] AH01114: HTTP: failed to make connection to backend: localhost, referer: xxx.xxx.xxx.xxx:4444/.../index.jsp
    [Mon Sep 02 13:05:58.565719 2019] [proxy_http:error] [pid 6076:tid 4073716544] [client xxx.xxx.xxx.23:53769] AH01114: HTTP: failed to make connection to backend: localhost, referer: xxx.xxx.xxx.xxx:4444/.../index.jsp
    [Mon Sep 02 13:06:02.455741 2019] [proxy_http:error] [pid 5365:tid 4098882368] [client xxx.xxx.xxx.23:53776] AH01114: HTTP: failed to make connection to backend: localhost, referer: xxx.xxx.xxx.xxx:4444/.../index.jsp
    [Fri Nov 08 16:08:51.470352 2019] [proxy_http:error] [pid 21391:tid 3990879040] (20014)Internal error (specific information not available): [client xxx.xxx.xxx.23:55211] AH01102: error reading status line from remote server localhost:8009, referer: xxx.xxx.xxx.xxx:4444/.../index.jsp
    [Tue Nov 26 14:44:11.775589 2019] [proxy_http:error] [pid 10612:tid 3982490432] (70007)The timeout specified has expired: [client 93.189.157.98:55749] AH01102: error reading status line from remote server localhost:8009, referer: xxx.xxx.xxx.xxx/.../TelnetConsole.jsp
    -> Upgrade V17.5.12 to 18.0.1.1
    [Sat Aug 29 12:01:29.559076 2020] [proxy_http:error] [pid 20095:tid 4088372032] [client xxx.xxx.xxx.20:60714] AH01114: HTTP: failed to make connection to backend: localhost, referer: xxxx.xxxx.xx:4444/.../index.jsp
    [Mon Aug 31 09:57:18.480597 2020] [proxy_http:error] [pid 24646:tid 3945696064] (20014)Internal error (specific information not available): [client xxx.xxx.xxx.9:52726] AH01102: error reading status line from remote server localhost:8009, referer: xxxx.xxxx.xx:4444/.../EventViewer.jsp
    [Mon Aug 31 09:57:18.480597 2020] [proxy_http:error] [pid 24646:tid 3962481472] (20014)Internal error (specific information not available): [client xxx.xxx.xxx.10:55142] AH01102: error reading status line from remote server localhost:8009, referer: xxx.xxx.xxx.xxx:4444/.../EventViewer.jsp
    [Mon Aug 31 09:57:25.513946 2020] [proxy_http:error] [pid 24295:tid 4079979328] [client xxx.xxx.xxx.37:65187] AH01114: HTTP: failed to make connection to backend: localhost, referer: xxxx.xxxx.xx:4444/.../EventViewer.jsp
    [Tue Sep 01 08:31:04.166830 2020] [proxy_http:error] [pid 24294:tid 3945696064] [client xxx.xxx.xxx.20:51317] AH01114: HTTP: failed to make connection to backend: localhost, referer: xxx.xxx.xxx.xxx:4444/.../index.jsp
    [Wed Sep 02 12:31:14.185611 2020] [proxy_http:error] [pid 21731:tid 3996052288] (20014)Internal error (specific information not available): [client xxx.xxx.xxx.13:57106] AH01102: error reading status line from remote server localhost:8009, referer: xxxx.xxxx.xx:4444/.../EventViewer.jsp
    [Fri Sep 04 15:23:58.410759 2020] [proxy_http:error] [pid 2962:tid 3937303360] (20014)Internal error (specific information not available): [client xxx.xxx.xxx.6:50435] AH01102: error reading status line from remote server localhost:8009, referer: xxxx.xxxx.xx:4444/.../EventViewer.jsp
    [Fri Sep 04 15:23:58.702858 2020] [proxy_http:error] [pid 2962:tid 4046408512] [client xxx.xxx.xxx.9:59491] AH01114: HTTP: failed to make connection to backend: localhost, referer: xxxx.xxxx.xx:4444/.../index.jsp
    [Fri Sep 04 15:24:13.073782 2020] [proxy_http:error] [pid 1379:tid 4088372032] [client xxx.xxx.xxx.9:59525] AH01114: HTTP: failed to make connection to backend: localhost

  • Same issue "Firewall is starting". Java Process on 8009 not running. Java error:

    SFVH_KV01_SFOS 17.5.10 MR-10.HF062020.1# java -version
    Error occurred during initialization of VM
    java/lang/ClassNotFoundException: error in opening JAR file /lib/jvm/java-8-openjdk/jre/lib/rt.jar

  • FormerMember
    0 FormerMember in reply to Roland Lentschig

    Hi ,

    Thank you for reaching out to the Community! 

    Please open a support case for further investigation and PM me the case number so that I can help with followup. 

    Thanks,

  • I have this same issue on an XG SFOS 17.5.13 MR-13 after a UPS battery failure and replacement, the UTM is stuck at Firewall is Starting, it is working to pass traffic, although reports of slowness, and I can SSH into the unit internally.  Any way to  resolve this failure to load WebAdmin

  • Could you please attempt to restart the tomcat service from the SSH back-end see if the issue continues?
    The command on the advanced shell will be #service tomcat:restart -ds nosync.

    I would suggest you create a support case if the issue persists and contact H_Patel so he can arrange they contact you in a reasonable time.

  • it is still happening sometimes but only very rarely.

    XG430_WP02_SFOS 18.0.1 MR-1-Build396# cat /log/error_log.log |grep "proxy_http:error]"
    [Mon Sep 02 13:05:56.202886 2019] [proxy_http:error] [pid 5363:tid 3931110208] (20014)Internal error (specific information not available): [client Client-IP.23:53757] AH01102: error reading status line from remote server localhost:8009, referer: https://XGFirewall-IP:4444/webconsole/webpages/logging/EventViewer.jsp?selectedTab=log_viewer&csrf=5qmd7c9t3s9b5g5e8bckapln3n
    [Mon Sep 02 13:05:56.465820 2019] [proxy_http:error] [pid 5364:tid 3989830464] [client Client-IP.23:53761] AH01114: HTTP: failed to make connection to backend: localhost, referer: https://XGFirewall-IP:4444/webconsole/webpages/index.jsp
    [Mon Sep 02 13:05:57.473707 2019] [proxy_http:error] [pid 5363:tid 4048550720] [client Client-IP.23:53765] AH01114: HTTP: failed to make connection to backend: localhost, referer: https://XGFirewall-IP:4444/webconsole/webpages/index.jsp
    [Mon Sep 02 13:05:58.565719 2019] [proxy_http:error] [pid 6076:tid 4073716544] [client Client-IP.23:53769] AH01114: HTTP: failed to make connection to backend: localhost, referer: https://XGFirewall-IP:4444/webconsole/webpages/index.jsp
    [Mon Sep 02 13:06:02.455741 2019] [proxy_http:error] [pid 5365:tid 4098882368] [client Client-IP.23:53776] AH01114: HTTP: failed to make connection to backend: localhost, referer: https://XGFirewall-IP:4444/webconsole/webpages/index.jsp
    [Fri Nov 08 16:08:51.470352 2019] [proxy_http:error] [pid 21391:tid 3990879040] (20014)Internal error (specific information not available): [client Client-IP.23:55211] AH01102: error reading status line from remote server localhost:8009, referer: https://XGFirewall-IP:4444/webconsole/webpages/index.jsp
    [Tue Nov 26 14:44:11.775589 2019] [proxy_http:error] [pid 10612:tid 3982490432] (70007)The timeout specified has expired: [client XGFirewall-IP.98:55749] AH01102: error reading status line from remote server localhost:8009, referer: https://212.126.215.59/webconsole/webpages/TelnetConsole.jsp?csrf=i9eeaps97ccro9nhp7bshmh79h
    [Sat Aug 29 12:01:29.559076 2020] [proxy_http:error] [pid 20095:tid 4088372032] [client Client-IP.20:60714] AH01114: HTTP: failed to make connection to backend: localhost, referer: https://fwhostname:4444/webconsole/webpages/index.jsp
    [Mon Aug 31 09:57:18.480597 2020] [proxy_http:error] [pid 24646:tid 3945696064] (20014)Internal error (specific information not available): [client Client-IP.9:52726] AH01102: error reading status line from remote server localhost:8009, referer: https://fwhostname:4444/webconsole/webpages/logging/EventViewer.jsp?selectedTab=log_viewer&csrf=mariu8i3bb7n7vsa38lg8rc920
    [Mon Aug 31 09:57:18.480597 2020] [proxy_http:error] [pid 24646:tid 3962481472] (20014)Internal error (specific information not available): [client Client-IP.10:55142] AH01102: error reading status line from remote server localhost:8009, referer: https://XGFirewall-IP:4444/webconsole/webpages/logging/EventViewer.jsp?selectedTab=log_viewer&csrf=9hc7odvpkcmk085anqp8ehoroe
    [Mon Aug 31 09:57:25.513946 2020] [proxy_http:error] [pid 24295:tid 4079979328] [client Client-IP.37:65187] AH01114: HTTP: failed to make connection to backend: localhost, referer: https://xgvpn.villa-bosch.de:4444/webconsole/webpages/logging/EventViewer.jsp?selectedTab=log_viewer&csrf=kqfq9ud223a3moqpc1o2h26k00
    [Tue Sep 01 08:31:04.166830 2020] [proxy_http:error] [pid 24294:tid 3945696064] [client Client-IP.20:51317] AH01114: HTTP: failed to make connection to backend: localhost, referer: https://XGFirewall-IP:4444/webconsole/webpages/index.jsp
    [Wed Sep 02 12:31:14.185611 2020] [proxy_http:error] [pid 21731:tid 3996052288] (20014)Internal error (specific information not available): [client Client-IP.13:57106] AH01102: error reading status line from remote server localhost:8009, referer: https://fwhostname:4444/webconsole/webpages/logging/EventViewer.jsp?selectedTab=log_viewer&csrf=bd5vl3kp8pjj9217mhfu9p96de
    [Fri Sep 04 15:23:58.410759 2020] [proxy_http:error] [pid 2962:tid 3937303360] (20014)Internal error (specific information not available): [client Client-IP.6:50435] AH01102: error reading status line from remote server localhost:8009, referer: https://fwhostname:4444/webconsole/webpages/logging/EventViewer.jsp?selectedTab=log_viewer&csrf=4qg0gqbnutvfdpnb1obldu1j52
    [Fri Sep 04 15:23:58.702858 2020] [proxy_http:error] [pid 2962:tid 4046408512] [client Client-IP.9:59491] AH01114: HTTP: failed to make connection to backend: localhost, referer: https://fwhostname:4444/webconsole/webpages/index.jsp
    [Fri Sep 04 15:24:13.073782 2020] [proxy_http:error] [pid 1379:tid 4088372032] [client Client-IP.9:59525] AH01114: HTTP: failed to make connection to backend: localhost
    [Tue Sep 29 11:31:10.083866 2020] [proxy_http:error] [pid 2959:tid 4130335552] [client Client-IP.8:64673] AH01114: HTTP: failed to make connection to backend: localhost, referer: https://fwhostname:4444/webconsole/webpages/index.jsp
    [Tue Sep 29 11:31:12.118758 2020] [proxy_http:error] [pid 1034:tid 3996052288] [client Client-IP.8:64693] AH01114: HTTP: failed to make connection to backend: localhost, referer: https://fwhostname:4444/webconsole/webpages/index.jsp
    [Thu Oct 01 10:58:31.523406 2020] [proxy_http:error] [pid 1033:tid 3937303360] (20014)Internal error (specific information not available): [client Client-IP.9:55835] AH01102: error reading status line from remote server localhost:8009, referer: https://fwhostname:4444/webconsole/webpages/logging/EventViewer.jsp?selectedTab=log_viewer&csrf=omurg94qtrp5dh5qjo9bjihm3t
    [Thu Oct 01 10:58:34.281180 2020] [proxy_http:error] [pid 2959:tid 4046408512] [client Client-IP.66:52916] AH01114: HTTP: failed to make connection to backend: localhost, referer: https://XGFirewall-IP:4444/webconsole/webpages/index.jsp
    [Tue Oct 06 15:31:15.855193 2020] [proxy_http:error] [pid 12672:tid 3970874176] [client Client-IP.12:52220] AH01114: HTTP: failed to make connection to backend: localhost, referer: https://fwhostname:4444/webconsole/webpages/index.jsp
    [Tue Oct 06 15:31:17.050909 2020] [proxy_http:error] [pid 11699:tid 4105157440] [client Client-IP.12:52232] AH01114: HTTP: failed to make connection to backend: localhost, referer: https://fwhostname:4444/webconsole/webpages/index.jsp
    [Tue Oct 06 15:31:18.063473 2020] [proxy_http:error] [pid 11701:tid 4105157440] [client Client-IP.12:52237] AH01114: HTTP: failed to make connection to backend: localhost, referer: https://fwhostname:4444/webconsole/webpages/index.jsp
    [Wed Oct 07 07:32:27.243176 2020] [proxy_http:error] [pid 10784:tid 4120894272] (70007)The timeout specified has expired: [client Client-IP.20:53067] AH01102: error reading status line from remote server localhost:8009
    [Wed Oct 07 07:33:23.774516 2020] [proxy_http:error] [pid 10784:tid 4112501568] (70007)The timeout specified has expired: [client Client-IP.20:53181] AH01102: error reading status line from remote server localhost:8009
    [Thu Oct 08 10:31:24.563451 2020] [proxy_http:error] [pid 10784:tid 4095716160] [client Client-IP.27:50694] AH01114: HTTP: failed to make connection to backend: localhost, referer: https://fwhostname:4444/webconsole/webpages/index.jsp
    [Thu Oct 08 12:13:47.372171 2020] [proxy_http:error] [pid 8770:tid 4137679680] (20014)Internal error (specific information not available): [client Client-IP.22:56544] AH01102: error reading status line from remote server localhost:8009, referer: https://fwhostname:4444/webconsole/webpages/logging/EventViewer.jsp?selectedTab=log_viewer&csrf=840tm3g0pi2srtp665g90e9d2m
    [Thu Nov 26 15:31:06.084275 2020] [proxy_http:error] [pid 17378:tid 3970874176] (20014)Internal error (specific information not available): [client Client-IP.210:52836] AH01102: error reading status line from remote server localhost:8009, referer: https://XGFirewall-IP:4444/webconsole/webpages/index.jsp
    [Thu Nov 26 15:31:06.106416 2020] [proxy_http:error] [pid 17534:tid 4121942848] [client Client-IP.210:52903] AH01114: HTTP: failed to make connection to backend: localhost, referer: https://XGFirewall-IP:4444/webconsole/webpages/index.jsp
    [Thu Dec 10 15:31:10.959567 2020] [proxy_http:error] [pid 9219:tid 3996052288] [client Client-IP.10:57458] AH01114: HTTP: failed to make connection to backend: localhost, referer: https://fwhostname:4444/webconsole/webpages/index.jsp
    [Thu Dec 10 15:31:10.959568 2020] [proxy_http:error] [pid 9060:tid 3979266880] [client Client-IP.10:57456] AH01114: HTTP: failed to make connection to backend: localhost, referer: https://fwhostname:4444/webconsole/webpages/index.jsp