[OpenSIPS-Users] ERROR:core:io_watch_del: BUG - trying to del fd 38 with flags 2 1

Bogdan-Andrei Iancu bogdan at opensips.org
Fri Aug 7 10:13:09 CEST 2015


Thank you Rahul,

Regards,

Bogdan-Andrei Iancu
OpenSIPS Founder and Developer
http://www.opensips-solutions.com

On 07.08.2015 00:12, Gupta, Rahul wrote:
>
> Hi Bogdan, I have created an issue with opensips github
>
> https://github.com/OpenSIPS/opensips/issues/591
>
> And uploaded the logs specified in the link with the description along 
> with timestamps.
>
> Thanks
>
> Rahul Gupta
>
> *From:*Bogdan-Andrei Iancu [mailto:bogdan at opensips.org]
> *Sent:* Tuesday, August 04, 2015 10:51 AM
> *To:* Gupta, Rahul; users at lists.opensips.org
> *Subject:* Re: ERROR:core:io_watch_del: BUG - trying to del fd 38 with 
> flags 2 1
>
> Hi Rahul,
>
> Any logs will be  useful (use some pastebin or file transfer to upload).
>
> On your observations : when a connection timeout does expire (via 
> __tcpconn_lifetime()), reactor_del_all() removes the fd with both 
> IO_WATCH_READ and IO_WATCH_WRITE flags. While in the logs it shows 
> "1", removing with READ only.
>
> Going back
>
> Bogdan-Andrei Iancu
> OpenSIPS Founder and Developer
> http://www.opensips-solutions.com
>
> On 04.08.2015 16:29, Gupta, Rahul wrote:
>
>     Hi Bogdan,
>
>     I tried the scenario with 1.11.3 as well as 1.11.5 latest code and
>     could reproduce it consistently. I can turn on the higher debug
>     level logging and provide you the log file. Let me know where can
>     I upload these logs ?
>
>     Thanks
>
>     Rahul
>
>     *From:*Bogdan-Andrei Iancu [mailto:bogdan at opensips.org]
>     *Sent:* Tuesday, August 04, 2015 8:18 AM
>     *To:* Gupta, Rahul; users at lists.opensips.org
>     <mailto:users at lists.opensips.org>
>     *Subject:* Re: ERROR:core:io_watch_del: BUG - trying to del fd 38
>     with flags 2 1
>
>     Hi Rahul,
>
>     I tried to reproduce your scenario during the last 2 days. Thanks
>     to the detailed instructions and stepping, I mananged to get (as
>     described) to the last step. But instead of getting the error you
>     mentioned, the tcp conn timeout event was properly handled:
>
>     [23203] DBG:core:__tcpconn_lifetime: timeout for hash=3 -
>     0x7f94f298fea0 (322 > 317)
>     [23203] DBG:core:io_watch_del: [TCP_main] io_watch_del op on index
>     -1 29 (0x8828a0, 29, -1, 0x10,0x3) fd_no=22 called
>
>     Are you sure you are using the latest GIT code (I tested both 2.1
>     and 1.11).
>
>     Regards,
>
>
>
>     Bogdan-Andrei Iancu
>
>     OpenSIPS Founder and Developer
>
>     http://www.opensips-solutions.com
>
>     On 31.07.2015 17:40, Gupta, Rahul wrote:
>
>         Hi Bogdan, thanks for looking into this issue. Let me know if
>         anyway I can help to get to the bottom of this issue, like
>         providing logs etc
>
>         Thanks
>
>         Rahul
>
>         *From:*Bogdan-Andrei Iancu [mailto:bogdan at opensips.org]
>         *Sent:* Tuesday, July 28, 2015 1:13 PM
>         *To:* Gupta, Rahul; users at lists.opensips.org
>         <mailto:users at lists.opensips.org>
>         *Subject:* Re: ERROR:core:io_watch_del: BUG - trying to del fd
>         38 with flags 2 1
>
>         Hi Rahul,
>
>         These are great news - that you find a way to reproduce it.
>         Let me do it and start debugging.
>
>         I really do appreciate your effort in dealing with this error.
>
>         Regards,
>
>
>
>         Bogdan-Andrei Iancu
>
>         OpenSIPS Founder and Developer
>
>         http://www.opensips-solutions.com
>
>         On 24.07.2015 00:19, Gupta, Rahul wrote:
>
>             Hi Bogdan,
>
>             Almost a month ago, I have raised the issue regarding the
>             opensips log file filling up with the following message
>
>             ERROR:core:io_watch_del: BUG - trying to del fd 38 with
>             flags 2 1
>
>             Now I can reproduce it every time with the following scenario:
>
>             1)UAC and UAS are connected to opensips proxy with TCP
>             transport
>
>             2)Connections looks good
>
>             3)Netstat shows the connection to UAC in ESTABLISHED state
>             and the tcp_conn_lists of opensips also looks fine for
>             that UAC
>
>             4)Now unplug the Ethernet cable on UAC
>
>             5)After tcp connection timeout (set to 5 mins in
>             opensips.cfg), the tcp connection goes away from netstat
>             as well as from tcp_conn_lists
>
>             6)UAS tries another tcp call to the UAC which is still
>             unplugged
>
>             7)tcp_conn_lists shows the tcp connection to the UAC and
>             netstat shows the connection in SYN_SENT state
>
>             8)After the tcp connection timeout (set to 5 mins in
>             opensips.cfg), the connection goes away from netstat
>             however it remains there in tcp_conn_lists and at that
>             moment the “BUG - trying to del fd 38 with flags 2 1”
>             starts printing in infinite loop.
>
>             I looked at the source code and observed the following
>
>             1)When the network cable is plugged in
>
>             The io_watch_add happens with flag IO_WATCH_READ in
>             tcp_main.c  when the command is CONN_NEW
>
>             2)When the network cable is unplugged
>
>             The io_watch_add happens with flag IO_WATCH_WRITE in
>             tcp_main.c  when the command is ASYNC_CONNECT
>
>             3)While doing io_watch_del after timeout, from
>             handle_tcpconn_ev method, io_watch_del always uses
>             IO_WATCH_READ to delete the fd, which gives this error in
>             case of unplugged cable.
>
>             Please look into this and suggest how can I fix this issue ?
>
>             Thanks
>
>             Rahul Gupta
>
>             ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
>             DISCLAIMER: This e-mail may contain information that is
>             confidential, privileged or otherwise protected from
>             disclosure. If you are not an intended recipient of this
>             e-mail, do not duplicate or redistribute it by any means.
>             Please delete it and any attachments and notify the sender
>             that you have received it in error. Unintended recipients
>             are prohibited from taking action on the basis of
>             information in this e-mail.E-mail messages may contain
>             computer viruses or other defects, may not be accurately
>             replicated on other systems, or may be intercepted,
>             deleted or interfered with without the knowledge of the
>             sender or the intended recipient. If you are not
>             comfortable with the risks associated with e-mail
>             messages, you may decide not to use e-mail to communicate
>             with IPC. IPC reserves the right, to the extent and under
>             circumstances permitted by applicable law, to retain,
>             monitor and intercept e-mail messages to and from its systems.
>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.opensips.org/pipermail/users/attachments/20150807/6a7b3e7b/attachment-0001.htm>


More information about the Users mailing list