[OpenSIPS-Users] opensips will not start while loading huge blacklist

[Bogdan-Andrei Iancu]

Hi Abdul,

OK, but what is the blacklist related operation you do in startup route 
?? As far as I know, the blacklist module is not doing any kind of 
caching, so any check you do against the blacklists will translate into 
a DB query, right ?

Regards,

Bogdan-Andrei Iancu

OpenSIPS Founder and Developer
   http://www.opensips-solutions.com
OpenSIPS Bootcamp 2018
   http://opensips.org/training/OpenSIPS_Bootcamp_2018/

On 10/01/2018 06:58 PM, Abdul Basit wrote:
> Yes. That's right.
> The code I am using is as below. globalblacklist table has complete 
> number as prefixwith and whitelist status.
>
> route {
> .....
> if ( !check_blacklist("globalblacklist") ) {
> xlog("L_NOTICE","[$fU/$tU/$ci] [$rm] Destination [$rU] is not Allowed. 
> Dropping call.\n");
> sl_send_reply("403", "Forbidden");
> exit;
> }
> else {
> xlog("L_INFO", "[$fU/$tU/$ci] [$rm] INBOUND CALL for [$ru]");
> route(10);
> exit;
> }
> .....
> }
>
>
> --
> regards,
>
> abdul basit
>
>
> On Mon, 1 Oct 2018 at 19:07, Bogdan-Andrei Iancu <bogdan at opensips.org 
> <mailto:bogdan at opensips.org>> wrote:
>
>     Hi Abdul,
>
>     IF I understand correctly, you use startup route to load (from
>     DB?) some blacklists into localcache ?
>
>     Regards,
>
>     Bogdan-Andrei Iancu
>
>     OpenSIPS Founder and Developer
>        http://www.opensips-solutions.com
>     OpenSIPS Bootcamp 2018
>        http://opensips.org/training/OpenSIPS_Bootcamp_2018/
>
>     On 09/28/2018 04:10 AM, Abdul Basit wrote:
>>     Hi team,
>>
>>     I have a opensips 2.4 deployed having 4 children and with mysql
>>     configured for loading user blacklist to opensips local cache on
>>     opensips startup.
>>     Opensips work fine on filtering the call based on user blacklist
>>     records loaded into local cache.
>>
>>     While blacklist was growing upto 1.3m records, opensips startup
>>     was taking ~60 sec on VM of 16GB RAM and 6 CPU.
>>     I increased shared memory to *6144* and package memory to *256.*
>>     Filter works fine here yet. Call load is not that much only
>>     blacklist entries are growing.
>>
>>     But now blacklist has grown to very huge number, up to 10m
>>     records in mysql. Opensips is not starting successfully and
>>     service startup requests timeout after huge CPU spikes while
>>     trying to populate local cache from mysql.
>>     I increased shared memory to *12288* and package memory to *1024*
>>     but no success yet.
>>
>>     I indexed mysql blacklist table but no luck.
>>
>>     Please advise what settings I should add to opensips for
>>     successful startup.
>>
>>     --
>>     regards,
>>
>>     abdul basit
>>
>>
>>     _______________________________________________
>>     Users mailing list
>>     Users at lists.opensips.org <mailto:Users at lists.opensips.org>
>>     http://lists.opensips.org/cgi-bin/mailman/listinfo/users
>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.opensips.org/pipermail/users/attachments/20181002/bdcff3b8/attachment-0001.html>