This discussion has been locked.
You can no longer post new replies to this discussion. If you have a question you can start a new discussion

High httpproxy memory usage with 9.713 and 9.714

Hello,

I have a pair of virtual UTMs which have run for years with about 4G of RAM allocated to them. After the upgrade from 9.712 to 9.713 in Nov I noticed my swap usage climbing beyond its normal 10-15% level. The culprit was the httpproxy proces so I added about 1/2G to the VMs which returned the swap usage to about 15%. This past week I updated to 9.714 and observed the httpproxy process growing much larger driving swap usage into the 60% range.

The two systems run with almost identical configurations which change very little over time. Our usage patterns have not changed much either. I have not noticed anything in the release notes suggesting a significant change that should require more memory, so my suspicion at this point is that the httpproxy process has a memory leak.

The graph below shows 9.714 after a restart last week. Here is the current httpproxy memory/swap usage:

  PID USER      PR  NI  VIRT  RES  SHR S   %CPU %MEM    TIME+  SWAP COMMAND                                                                                                      
 4776 httpprox  20   0 6202m 1.6g 3996 S      1 38.4  46:09.01 4.4g httpproxy
                                                                                                     

--Larry



This thread was automatically locked due to age.
Parents
  • Following up on this, the httpproxy process continues to grow:

    top - 09:54:36 up 10 days,  3:28,  1 user,  load average: 0.07, 0.08, 0.11
    Tasks: 155 total,   2 running, 152 sleeping,   0 stopped,   1 zombie
    Cpu(s):  2.0%us,  0.7%sy,  0.0%ni, 97.3%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
    Mem:   4460820k total,  4292284k used,   168536k free,    15272k buffers
    Swap:  4194300k total,  3956524k used,   237776k free,   841224k cached

      PID USER      PR  NI  VIRT  RES  SHR S   %CPU %MEM    TIME+  SWAP COMMAND                                                                                                      
     4776 httpprox  20   0 6901m 1.7g 3388 S      0 40.9  62:26.44 5.0g httpproxy                                                                                                     

    And, to put this in a little more perspective, the yearly memory usage with annotations for UTM upgrades and when I added memory to the VM:

    --Larry

Reply
  • Following up on this, the httpproxy process continues to grow:

    top - 09:54:36 up 10 days,  3:28,  1 user,  load average: 0.07, 0.08, 0.11
    Tasks: 155 total,   2 running, 152 sleeping,   0 stopped,   1 zombie
    Cpu(s):  2.0%us,  0.7%sy,  0.0%ni, 97.3%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
    Mem:   4460820k total,  4292284k used,   168536k free,    15272k buffers
    Swap:  4194300k total,  3956524k used,   237776k free,   841224k cached

      PID USER      PR  NI  VIRT  RES  SHR S   %CPU %MEM    TIME+  SWAP COMMAND                                                                                                      
     4776 httpprox  20   0 6901m 1.7g 3388 S      0 40.9  62:26.44 5.0g httpproxy                                                                                                     

    And, to put this in a little more perspective, the yearly memory usage with annotations for UTM upgrades and when I added memory to the VM:

    --Larry

Children
  • I think we're seeing the 64-bit mode taking a part in this, just my personal opinion.  If your environment hasn't changed at all and mere updates are bringing swap usage that high, that could be the case. I really think at this point, the memory allocation for UTM is subpar, and that worries me for those going to XG with its limited hardware.  My UTM currently:

    And, I'm actually replacing my hard drive this evening, as it is finally failing after all these years (noticed since 9.714 a huge hesitation in the webadmin interface when clicking anywhere, smartctl shows some fail).

    My hardware hasn't changed in the past year at least, and my only change to it has been the CPU to a Xeon.

    OPNSense 64-bit | Intel Xeon 4-core v3 1225 3.20Ghz
    16GB Memory | 500GB SSD HDD | ATT Fiber 1GB
    (Former Sophos UTM Veteran, Former XG Rookie)