[OpenSIPS-Users] Failed to trigger pkg stats in logs

Yury Kirsanov y.kirsanov at gmail.com
Wed Sep 21 08:54:04 UTC 2022


Hi Bogdan,
Sorry, I just realized that I haven't turned off the auto-scaler for UDP
processes so you're right - that error is for them. I've switched TCP
auto-scaling off due to all my previous issues that I wasn't able to
overcome.

auto_scaling_profile = PROFILE_UDP
     scale up to 32 on 80% for 4 cycles within 5
     scale down to 2 on 10% for 5 cycles

udp_workers=1 use_auto_scaling_profile PROFILE_UDP

socket=udp:10.x.x.x:5060
socket=udp:103.x.x.x:7060

In regards to pkg memory - I only have 32MB as -M parameter, maybe that's
not enough? I'm not sure how to do 'pkg dump' - never tried to do that
before, is this what you're asking about?

Sep 21 18:52:09 ERROR:core:signal_pkg_status: failed to trigger pkg stats
for process 45
 opensips-cli -x mi ps
{
    "Processes": [
...
        {
            "ID": 45,
            "PID": 310115,
            "Type": "SIP receiver udp:103.x.x.x:7060"
        }
    ]
}
root at osgw1:~# opensips-cli -x mi mem_pkg_dump 310115
ERROR: command 'mem_pkg_dump' returned: 500: Internal error

Best regards,
Yury.

On Wed, Sep 21, 2022 at 4:07 PM Bogdan-Andrei Iancu <bogdan at opensips.org>
wrote:

> Hi Yury,
>
> By the IDs of the faulty processes, I see they are auto-scaled procs.
>
> Could you confirm that the pkg status ever works for such processes - with
> or without below error, is the pkg dump ever done by the auto-scaled procs ?
>
> Regards,
>
> Bogdan-Andrei Iancu
>
> OpenSIPS Founder and Developer
>   https://www.opensips-solutions.com
> OpenSIPS Summit 27-30 Sept 2022, Athens
>   https://www.opensips.org/events/Summit-2022Athens/
>
> On 9/20/22 8:23 PM, Yury Kirsanov wrote:
>
> Hi,
> We're experiencing a lot of messages like this:
>
> Sep 21 03:18:09 ERROR:core:signal_pkg_status: failed to trigger pkg stats
> for process 42
> Sep 21 03:18:09 ERROR:core:signal_pkg_status: failed to trigger pkg stats
> for process 43
> Sep 21 03:18:09 ERROR:core:signal_pkg_status: failed to trigger pkg stats
> for process 45
> Sep 21 03:18:09 ERROR:core:signal_pkg_status: failed to trigger pkg stats
> for process 42
> Sep 21 03:18:09 ERROR:core:signal_pkg_status: failed to trigger pkg stats
> for process 43
> Sep 21 03:18:09 ERROR:core:signal_pkg_status: failed to trigger pkg stats
> for process 45
> Sep 21 03:18:09 ERROR:core:signal_pkg_status: failed to trigger pkg stats
> for process 42
> Sep 21 03:18:09 ERROR:core:signal_pkg_status: failed to trigger pkg stats
> for process 43
> Sep 21 03:18:09 ERROR:core:signal_pkg_status: failed to trigger pkg stats
> for process 45
> Sep 21 03:18:09 ERROR:core:signal_pkg_status: failed to trigger pkg stats
> for process 42
> Sep 21 03:18:09 ERROR:core:signal_pkg_status: failed to trigger pkg stats
> for process 43
> Sep 21 03:18:09 ERROR:core:signal_pkg_status: failed to trigger pkg stats
> for process 45
> Sep 21 03:18:09 ERROR:core:signal_pkg_status: failed to trigger pkg stats
> for process 42
> Sep 21 03:18:09 ERROR:core:signal_pkg_status: failed to trigger pkg stats
> for process 43
> Sep 21 03:18:09 ERROR:core:signal_pkg_status: failed to trigger pkg stats
> for process 45
> Sep 21 03:18:09 ERROR:core:signal_pkg_status: failed to trigger pkg stats
> for process 42
> Sep 21 03:18:09 ERROR:core:signal_pkg_status: failed to trigger pkg stats
> for process 43
> Sep 21 03:18:09 ERROR:core:signal_pkg_status: failed to trigger pkg stats
> for process 45
>
> Here's a list of all processes:
>
> opensips-cli -x mi get_statistics load:
> {
>     "load:load-proc-1": 0,
>     "load:load1m-proc-1": 0,
>     "load:load10m-proc-1": 0,
>     "load:load-proc-2": 0,
>     "load:load1m-proc-2": 0,
>     "load:load10m-proc-2": 0,
>     "load:load-proc-3": 0,
>     "load:load1m-proc-3": 0,
>     "load:load10m-proc-3": 0,
>     "load:load-proc-4": 0,
>     "load:load1m-proc-4": 0,
>     "load:load10m-proc-4": 0,
>     "load:load-proc-5": 0,
>     "load:load1m-proc-5": 0,
>     "load:load10m-proc-5": 1,
>     "load:load-proc-6": 1,
>     "load:load1m-proc-6": 1,
>     "load:load10m-proc-6": 1,
>     "load:load-proc-7": 0,
>     "load:load1m-proc-7": 1,
>     "load:load10m-proc-7": 1,
>     "load:load-proc-8": 0,
>     "load:load1m-proc-8": 1,
>     "load:load10m-proc-8": 1,
>     "load:load-proc-9": 0,
>     "load:load1m-proc-9": 1,
>     "load:load10m-proc-9": 1,
>     "load:load-proc-10": 0,
>     "load:load1m-proc-10": 1,
>     "load:load10m-proc-10": 1,
>     "load:load-proc-11": 0,
>     "load:load1m-proc-11": 1,
>     "load:load10m-proc-11": 1,
>     "load:load-proc-12": 0,
>     "load:load1m-proc-12": 1,
>     "load:load10m-proc-12": 1,
>     "load:load-proc-13": 0,
>     "load:load1m-proc-13": 1,
>     "load:load10m-proc-13": 1,
>     "load:load-proc-14": 0,
>     "load:load1m-proc-14": 1,
>     "load:load10m-proc-14": 1,
>     "load:load-proc-15": 7,
>     "load:load1m-proc-15": 0,
>     "load:load10m-proc-15": 0,
>     "load:load-proc-16": 0,
>     "load:load1m-proc-16": 1,
>     "load:load10m-proc-16": 0,
>     "load:load-proc-17": 4,
>     "load:load1m-proc-17": 0,
>     "load:load10m-proc-17": 0,
>     "load:load-proc-18": 0,
>     "load:load1m-proc-18": 0,
>     "load:load10m-proc-18": 0,
>     "load:load-proc-19": 0,
>     "load:load1m-proc-19": 0,
>     "load:load10m-proc-19": 0,
>     "load:load-proc-20": 0,
>     "load:load1m-proc-20": 0,
>     "load:load10m-proc-20": 0,
>     "load:load-proc-21": 0,
>     "load:load1m-proc-21": 0,
>     "load:load10m-proc-21": 0,
>     "load:load-proc-22": 0,
>     "load:load1m-proc-22": 0,
>     "load:load10m-proc-22": 0,
>     "load:load-proc-23": 0,
>     "load:load1m-proc-23": 0,
>     "load:load10m-proc-23": 0,
>     "load:load-proc-24": 0,
>     "load:load1m-proc-24": 0,
>     "load:load10m-proc-24": 0,
>     "load:load-proc-25": 0,
>     "load:load1m-proc-25": 0,
>     "load:load10m-proc-25": 0,
>     "load:load-proc-26": 0,
>     "load:load1m-proc-26": 0,
>     "load:load10m-proc-26": 0,
>     "load:load-proc-27": 0,
>     "load:load1m-proc-27": 0,
>     "load:load10m-proc-27": 0,
>     "load:load-proc-28": 0,
>     "load:load1m-proc-28": 0,
>     "load:load10m-proc-28": 0,
>     "load:load-proc-29": 0,
>     "load:load1m-proc-29": 0,
>     "load:load10m-proc-29": 0,
>     "load:load-proc-30": 0,
>     "load:load1m-proc-30": 0,
>     "load:load10m-proc-30": 0,
>     "load:load-proc-31": 0,
>     "load:load1m-proc-31": 0,
>     "load:load10m-proc-31": 0,
>     "load:load-proc-32": 0,
>     "load:load1m-proc-32": 0,
>     "load:load10m-proc-32": 0,
>     "load:load-proc-33": 0,
>     "load:load1m-proc-33": 0,
>     "load:load10m-proc-33": 0,
>     "load:load-proc-34": 0,
>     "load:load1m-proc-34": 0,
>     "load:load10m-proc-34": 0,
>     "load:load-proc-35": 0,
>     "load:load1m-proc-35": 0,
>     "load:load10m-proc-35": 0,
>     "load:load-proc-36": 0,
>     "load:load1m-proc-36": 0,
>     "load:load10m-proc-36": 0,
>     "load:load-proc-37": 0,
>     "load:load1m-proc-37": 0,
>     "load:load10m-proc-37": 0,
>     "load:load-proc-38": 0,
>     "load:load1m-proc-38": 0,
>     "load:load10m-proc-38": 0,
>     "load:load-proc-39": 0,
>     "load:load1m-proc-39": 0,
>     "load:load10m-proc-39": 0,
>     "load:load-proc-40": 9,
>     "load:load1m-proc-40": 5,
>     "load:load10m-proc-40": 6,
>     "load:load-proc-41": 2,
>     "load:load1m-proc-41": 0,
>     "load:load10m-proc-41": 1,
>     "load:load-proc-42": 0,
>     "load:load1m-proc-42": 0,
>     "load:load10m-proc-42": 0,
>     "load:load-proc-43": 0,
>     "load:load1m-proc-43": 0,
>     "load:load10m-proc-43": 0,
>     "load:load-proc-44": 2,
>     "load:load1m-proc-44": 1,
>     "load:load10m-proc-44": 2,
>     "load:load-proc-45": 0,
>     "load:load1m-proc-45": 0,
>     "load:load10m-proc-45": 0,
>     "load:load": 0,
>     "load:load1m": 0,
>     "load:load10m": 0,
>     "load:load-all": 0,
>     "load:load1m-all": 0,
>     "load:load10m-all": 0,
>     "load:processes_number": 46
> }
>
> Here's a list of all running processes:
> opensips-cli -x mi ps
> {
>     "Processes": [
>         {
>             "ID": 0,
>             "PID": 226004,
>             "Type": "attendant"
>         },
>         {
>             "ID": 1,
>             "PID": 226010,
>             "Type": "HTTPD 10.x.x.x:8888"
>         },
>         {
>             "ID": 2,
>             "PID": 226011,
>             "Type": "MI FIFO"
>         },
>         {
>             "ID": 3,
>             "PID": 226012,
>             "Type": "time_keeper"
>         },
>         {
>             "ID": 4,
>             "PID": 226013,
>             "Type": "timer"
>         },
>         {
>             "ID": 5,
>             "PID": 226014,
>             "Type": "SIP receiver udp:10.x.x.x:5060"
>         },
>         {
>             "ID": 6,
>             "PID": 226017,
>             "Type": "SIP receiver udp:103.x.x.x:7060"
>         },
>         {
>             "ID": 7,
>             "PID": 226018,
>             "Type": "TCP receiver"
>         },
>         {
>             "ID": 8,
>             "PID": 226019,
>             "Type": "TCP receiver"
>         },
>         {
>             "ID": 9,
>             "PID": 226020,
>             "Type": "TCP receiver"
>         },
>         {
>             "ID": 10,
>             "PID": 226021,
>             "Type": "TCP receiver"
>         },
>         {
>             "ID": 11,
>             "PID": 226022,
>             "Type": "TCP receiver"
>         },
>         {
>             "ID": 12,
>             "PID": 226023,
>             "Type": "TCP receiver"
>         },
>         {
>             "ID": 13,
>             "PID": 226024,
>             "Type": "TCP receiver"
>         },
>         {
>             "ID": 14,
>             "PID": 226025,
>             "Type": "TCP receiver"
>         },
>         {
>             "ID": 15,
>             "PID": 226026,
>             "Type": "TCP receiver"
>         },
>         {
>             "ID": 16,
>             "PID": 226027,
>             "Type": "TCP receiver"
>         },
>         {
>             "ID": 17,
>             "PID": 226028,
>             "Type": "TCP receiver"
>         },
>         {
>             "ID": 18,
>             "PID": 226029,
>             "Type": "TCP receiver"
>         },
>         {
>             "ID": 19,
>             "PID": 226030,
>             "Type": "TCP receiver"
>         },
>         {
>             "ID": 20,
>             "PID": 226031,
>             "Type": "TCP receiver"
>         },
>         {
>             "ID": 21,
>             "PID": 226032,
>             "Type": "TCP receiver"
>         },
>         {
>             "ID": 22,
>             "PID": 226033,
>             "Type": "TCP receiver"
>         },
>         {
>             "ID": 23,
>             "PID": 226034,
>             "Type": "TCP receiver"
>         },
>         {
>             "ID": 24,
>             "PID": 226035,
>             "Type": "TCP receiver"
>         },
>         {
>             "ID": 25,
>             "PID": 226036,
>             "Type": "TCP receiver"
>         },
>         {
>             "ID": 26,
>             "PID": 226038,
>             "Type": "TCP receiver"
>         },
>         {
>             "ID": 27,
>             "PID": 226039,
>             "Type": "TCP receiver"
>         },
>         {
>             "ID": 28,
>             "PID": 226040,
>             "Type": "TCP receiver"
>         },
>         {
>             "ID": 29,
>             "PID": 226041,
>             "Type": "TCP receiver"
>         },
>         {
>             "ID": 30,
>             "PID": 226042,
>             "Type": "TCP receiver"
>         },
>         {
>             "ID": 31,
>             "PID": 226043,
>             "Type": "TCP receiver"
>         },
>         {
>             "ID": 32,
>             "PID": 226044,
>             "Type": "TCP receiver"
>         },
>         {
>             "ID": 33,
>             "PID": 226045,
>             "Type": "TCP receiver"
>         },
>         {
>             "ID": 34,
>             "PID": 226046,
>             "Type": "TCP receiver"
>         },
>         {
>             "ID": 35,
>             "PID": 226047,
>             "Type": "TCP receiver"
>         },
>         {
>             "ID": 36,
>             "PID": 226048,
>             "Type": "TCP receiver"
>         },
>         {
>             "ID": 37,
>             "PID": 226049,
>             "Type": "TCP receiver"
>         },
>         {
>             "ID": 38,
>             "PID": 226050,
>             "Type": "TCP receiver"
>         },
>         {
>             "ID": 39,
>             "PID": 226051,
>             "Type": "Timer handler"
>         },
>         {
>             "ID": 40,
>             "PID": 226052,
>             "Type": "TCP main"
>         },
>         {
>             "ID": 41,
>             "PID": 226069,
>             "Type": "SIP receiver udp:10.x.x.x:5060"
>         },
>         {
>             "ID": 42,
>             "PID": 226077,
>             "Type": "SIP receiver udp:10.x.x.x:5060"
>         },
>         {
>             "ID": 43,
>             "PID": 226650,
>             "Type": "SIP receiver udp:10.x.x.x:5060"
>         },
>         {
>             "ID": 44,
>             "PID": 262593,
>             "Type": "SIP receiver udp:103.x.x.x:7060"
>         },
>         {
>             "ID": 45,
>             "PID": 310115,
>             "Type": "SIP receiver udp:103.x.x.x:7060"
>         }
>     ]
> }
>
> OpenSIPS seem to be behaving fine and working but these errors are quite
> confusing...Should I be worried about them?
>
> OpenSIPS was compiled from sources with some options like futexes on:
>
> version: opensips 3.3.1 (x86_64/linux)
> flags: STATS: On, DISABLE_NAGLE, USE_MCAST, SHM_MMAP, PKG_MALLOC,
> Q_MALLOC, F_MALLOC, HP_MALLOC, FAST_LOCK-FUTEX-ADAPTIVE_WAIT
> ADAPTIVE_WAIT_LOOPS=1024, MAX_RECV_BUFFER_SIZE 262144, MAX_LISTEN 16,
> MAX_URI_SIZE 1024, BUF_SIZE 65535
> poll method support: poll, epoll, sigio_rt, select.
> git revision: d187a0bd5
> main.c compiled on 06:06:34 Sep 13 2022 with gcc 9
>
> Any ideas?
>
> Thanks and regards,
> Yury.
>
>
> _______________________________________________
> Users mailing listUsers at lists.opensips.orghttp://lists.opensips.org/cgi-bin/mailman/listinfo/users
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.opensips.org/pipermail/users/attachments/20220921/f7eb4c0c/attachment-0001.html>


More information about the Users mailing list