[Rspamd-Users] initial configuration errors

Thu Jan 31 11:52:19 UTC 2019

On 31/01/2019 11:40, Ian Springett wrote:
> I've added the following to local.d/logging.inc
> 
> Debug_modules = ["lua", "lua_tcp", "antivirus"] 
> 
> So running monitor in redis reveals the following:
> 
> 1548934564.186741 [0 127.0.0.1:46776] "SMEMBERS" "BAYES_SPAM_keys"
> 1548934566.682144 [0 127.0.0.1:46784] "SMEMBERS" "tRFANNB87F7B7290CFD31626"
> 1548934567.772832 [0 127.0.0.1:46804] "MGET" "rgbnsw6k38neaxft1jbw7is" "rgmg4pxu4twxiuq4uzw93x1"
> 1548934567.774145 [0 127.0.0.1:46804] "HMGET" "ip_score" "a:203067" "c:GB" "n:46.175.55.0/24" "46.175.55.200"
> 1548934568.020814 [0 127.0.0.1:46808] "HGET" "RS" "learns_ham"
> 1548934568.020838 [0 127.0.0.1:46808] "MULTI"
> 1548934568.020903 [0 127.0.0.1:46808] "HGET" "RS_3055194396082884210" "H"
> 1548934568.020915 [0 127.0.0.1:46808] "HGET" "RS_11305945617076287366" "H"
> 1548934568.020920 [0 127.0.0.1:46808] "HGET" "RS_4340055159657749584" "H"
> 1548934568.020925 [0 127.0.0.1:46808] "HGET" "RS_6664547668384822362" "H"
> 1548934568.020929 [0 127.0.0.1:46808] "HGET" "RS_7250210129653775854" "H"
> 1548934568.020934 [0 127.0.0.1:46808] "HGET" "RS_11679220676242210900" "H"
> 
> So this suggests communication of some type is taking place, at the same time the rspamd logs are showing:
> 
> 2019-01-31 11:36:07 #25850(rspamd_proxy) <3cb69d>; proxy; proxy_milter_finish_handler: finished milter connection
> 2019-01-31 11:36:07 #25850(rspamd_proxy) <917bae>; proxy; proxy_accept_socket: accepted milter connection from 127.0.0.1 port 46564
> 2019-01-31 11:36:07 #25850(rspamd_proxy) <917bae>; milter; rspamd_milter_process_command: got connection from 46.175.55.200:43526
> 2019-01-31 11:36:07 #25854(normal) <c1a793>; task; accept_socket: accepted connection from ::1 port 0, task ptr: 00007FD9561D5D00
> 2019-01-31 11:36:07 #25854(normal) <c1a793>; task; rspamd_message_parse: loaded message; id: <71ee268adc104e7db799dacc848d3676 at cloudplatform4.com>; queue-id: <B288B60129DA8>; size: 2912; checksum: <c17d433e4690e7b5037d0b400abdd126>
> 2019-01-31 11:36:07 #25854(normal) <c1a793>; lua; settings.lua:358: check for settings
> 2019-01-31 11:36:07 #25854(normal) <c1a793>; task; rspamd_mime_text_part_utf8_convert: converted from ISO_8859-1:1987 to UTF-8 inlen: 5, outlen: 5 (5 UTF16 chars)
> 2019-01-31 11:36:07 #25854(normal) <c1a793>; task; rspamd_mime_text_part_utf8_convert: converted from ISO_8859-1:1987 to UTF-8 inlen: 380, outlen: 380 (380 UTF16 chars)
> 2019-01-31 11:36:07 #25854(normal) <c1a793>; surbl; surbl_test_url: disable surbl multi.uribl.com as it is reported to be offline
> 2019-01-31 11:36:08 #25854(normal) <c1a793>; task; rspamd_redis_connected: error getting reply from redis server localhost: Connection refused
> 2019-01-31 11:36:08 #25854(normal) <c1a793>; task; rspamd_redis_processed: error getting reply from redis server localhost: Connection refused
> 2019-01-31 11:36:08 #25854(normal) <c1a793>; lua; greylist.lua:260: Score too low - skip greylisting
> 2019-01-31 11:36:08 #25854(normal) <c1a793>; lua; history_redis.lua:97: got error Connection refused when writing history row: no value
> 2019-01-31 11:36:08 #25854(normal) <c1a793>; task; rspamd_task_write_log: id: <71ee268adc104e7db799dacc848d3676 at cloudplatform4.com>, qid: <B288B60129DA8>, ip: 46.175.55.200, from: <Administrator at cloudplatform4.com>, (default: F (no action): [0.40/15.00] [HFILTER_HELO_IP_A(1.00){cp4-rly-01.localdomain;},DMARC_POLICY_ALLOW(-0.50){cloudplatform4.com;reject;},HFILTER_HELO_NORES_A_OR_MX(0.30){cp4-rly-01.localdomain;},R_DKIM_ALLOW(-0.20){cloudplatform4.com:s=default;},R_SPF_ALLOW(-0.20){+ip4:46.175.55.200;},MIME_GOOD(-0.10){multipart/alternative;text/plain;},RCVD_NO_TLS_LAST(0.10){},ARC_NA(0.00){},ASN(0.00){asn:203067, ipnet:46.175.55.0/24, country:GB;},DKIM_TRACE(0.00){cloudplatform4.com:+;},FROM_EQ_ENVFROM(0.00){},FROM_HAS_DN(0.00){},HAS_XOIP(0.00){},MID_RHS_MATCH_FROM(0.00){},MIME_TRACE(0.00){0:+;1:+;},PREVIOUSLY_DELIVERED(0.00){ian.springett at giacom.com;},RCPT_COUNT_ONE(0.00){1;},RCVD_COUNT_FIVE(0.00){6;},TO_DN_EQ_ADDR_ALL(0.00){},TO_MATCH_ENVRCPT_ALL(0.00){}]), len: 2912, time: 250.195ms real, 7.135ms virtual, dns req: 32, digest: <c17d433e4690e7b5037d0b400abdd126>, rcpts: <ian.springett at giacom.com>, mime_rcpts: <ian.springett at giacom.com>
> 2019-01-31 11:36:08 #25854(normal) <c1a793>; task; rspamd_protocol_http_reply: regexp statistics: 0 pcre regexps scanned, 2 regexps matched, 180 regexps total, 93 regexps cached, 0B bytes scanned using pcre, 2.90k bytes scanned total
> 2019-01-31 11:36:08 #25850(rspamd_proxy) <100c3b>; proxy; proxy_milter_finish_handler: finished milter connection
> 2019-01-31 11:36:09 #25854(normal) rspamd_redis_stat_keys: cannot get keys to gather stat: Connection refused
> 2019-01-31 11:36:09 #25853(normal) rspamd_redis_stat_keys: cannot get keys to gather stat: Connection refused
> 2019-01-31 11:36:11 #25851(controller) rspamd_redis_stat_keys: cannot get keys to gather stat: Connection refused
> 2019-01-31 11:36:16 #25850(rspamd_proxy) <d854d3>; proxy; proxy_accept_socket: accepted milter connection from 127.0.0.1 port 46586
> 2019-01-31 11:36:16 #25850(rspamd_proxy) <d854d3>; milter; rspamd_milter_process_command: got connection from 10.200.10.10:12133
> 2019-01-31 11:36:16 #25850(rspamd_proxy) <d854d3>; proxy; proxy_milter_finish_handler: finished milter connection
> 
> Does anyone have any suggestions?
> 
> -----Original Message-----
> From: Users <users-bounces at lists.rspamd.com> On Behalf Of Ian Springett
> Sent: 30 January 2019 15:57
> To: User questions <users at lists.rspamd.com>
> Subject: Re: [Rspamd-Users] initial configuration errors
> 
> Hi
> Rspamdm configwizard was run
> 
> Redis-cli returns the redis prompt
> 
> Systemctl status shows all components are running
> 
> -----Original Message-----
> From: Users <users-bounces at lists.rspamd.com> On Behalf Of Manuel Garbin
> Sent: 30 January 2019 15:54
> To: User questions <users at lists.rspamd.com>
> Subject: Re: [Rspamd-Users] initial configuration errors
> 
> Hi Ian,
> have you read the documentation about "rspamdm configwizard" comand?
> 
> https://rspamd.com/doc/quickstart.html
> 
> Are you sure the redis server is working? ( redis-cli to view if you can connect on it )
> 
> ----- Messaggio originale -----
> Da: "Ian Springett" <ian.springett at giacom.com>
> A: "users at lists.rspamd.com" <users at lists.rspamd.com>
> Inviato: Mercoledì, 30 gennaio 2019 16:43:34
> Oggetto: [Rspamd-Users] initial configuration errors
> 
> Hi
> I've just configured a new centos 7 server with the latest postfix, rspamd, redis and clamav.
> Redis was installed with default configuration, postfix was configured to use rspamd with a milter. The message is been scanned by rspamd but the AV module is not working and the connection to redis does not appear to work. (history in webui shows connection error). I have attempted to add a redis section to an override.d/override.conf with the 127.0.0.1:6379 configured.
> The rspamd logs are showing as follows:
> 
> 2019-01-30 15:21:09 #26790(normal) <fh5z3u>; lua; lua_redis.lua:1074: cannot upload script to 127.0.0.1: Connection refused
> 2019-01-30 15:21:09 #26790(normal) logger; file_log_function: Last message repeated 13 times
> 2019-01-30 15:21:09 #26790(normal) rspamd_redis_stat_keys: cannot get keys to gather stat: Connection refused
> 2019-01-30 15:21:16 #26786(rspamd_proxy) <b2cddb>; proxy; proxy_accept_socket: accepted milter connection from 127.0.0.1 port 50598
> 2019-01-30 15:21:16 #26786(rspamd_proxy) <b2cddb>; milter; rspamd_milter_process_command: got connection from 10.200.10.11:48687
> 2019-01-30 15:21:16 #26786(rspamd_proxy) <b2cddb>; proxy; proxy_milter_finish_handler: finished milter connection
> 2019-01-30 15:21:17 #26787(controller) <fh5z3u>; lua; lua_redis.lua:1074: cannot upload script to 127.0.0.1: Connection refused
> 2019-01-30 15:21:17 #26787(controller) <fh5z3u>; lua; lua_redis.lua:1074: cannot upload script to 127.0.0.1: Connection refused
> 2019-01-30 15:21:17 #26786(rspamd_proxy) <fh5z3u>; lua; lua_redis.lua:1074: cannot upload script to 127.0.0.1: Connection refused
> 2019-01-30 15:21:17 #26786(rspamd_proxy) <fh5z3u>; lua; lua_redis.lua:1074: cannot upload script to 127.0.0.1: Connection refused
> 2019-01-30 15:21:17 #26788(normal) <fh5z3u>; lua; lua_redis.lua:1074: cannot upload script to 127.0.0.1: Connection refused
> 2019-01-30 15:21:17 #26790(normal) <fh5z3u>; lua; lua_redis.lua:1074: cannot upload script to 127.0.0.1: Connection refused
> 2019-01-30 15:21:17 #26788(normal) <fh5z3u>; lua; lua_redis.lua:1074: cannot upload script to 127.0.0.1: Connection refused
> 2019-01-30 15:21:17 #26790(normal) <fh5z3u>; lua; lua_redis.lua:1074: cannot upload script to 127.0.0.1: Connection refused
> 2019-01-30 15:21:17 #26789(normal) <fh5z3u>; lua; lua_redis.lua:1074: cannot upload script to 127.0.0.1: Connection refused
> 2019-01-30 15:21:17 #26789(normal) <fh5z3u>; lua; lua_redis.lua:1080: uploaded redis script to ::1 with id 7, sha: 473ded076882895aaa4d03c83358c86be000efe3
> 2019-01-30 15:21:17 #26791(normal) <fh5z3u>; lua; lua_redis.lua:1074: cannot upload script to 127.0.0.1: Connection refused
> 2019-01-30 15:21:17 #26791(normal) <fh5z3u>; lua; lua_redis.lua:1074: cannot upload script to 127.0.0.1: Connection refused
> 2019-01-30 15:21:18 #26786(rspamd_proxy) <add275>; proxy; proxy_accept_socket: accepted milter connection from 127.0.0.1 port 50628
> 2019-01-30 15:21:18 #26786(rspamd_proxy) <fa9baa>; proxy; proxy_accept_socket: accepted milter connection from 127.0.0.1 port 50630
> 2019-01-30 15:21:18 #26786(rspamd_proxy) <add275>; milter; rspamd_milter_process_command: got connection from 46.175.55.200:60540
> 2019-01-30 15:21:18 #26786(rspamd_proxy) <add275>; proxy; proxy_milter_finish_handler: finished milter connection
> 2019-01-30 15:21:18 #26786(rspamd_proxy) <fa9baa>; milter; rspamd_milter_process_command: got connection from 46.175.55.200:55071
> 2019-01-30 15:21:18 #26786(rspamd_proxy) <fa9baa>; proxy; proxy_milter_finish_handler: finished milter connection
> 
> Thanks in advance
> Ian
> 

What is `localhost` in your system? If it has also v6 address, then
Redis should listen on it. I'd recommend not to use IPv6 at all in general.