1. Forum
  2. DOVE-Net
  3. Synchronet Programming C+

  • exec/scrubmsgs.js

    From rswindell@VERT to CVS commit on Thu Feb 15 18:02:38 2018
    exec scrubmsgs.js NONE 1.1
    Update of /cvsroot/sbbs/exec
    In directory cvs:/tmp/cvs-serv2874

    Added Files:
    scrubmsgs.js
    Log Message:
    A little script to detect and fix (by default) message headers containing illegal control characters, a sign of corruption. Use it like this:
    jsexec scrubmsgs <sub_code> [sub_code]
    The available options are:
    -debug enable debug output
    -scan do not modify headers, just scan and report corruption detected


    ---
    þ Synchronet þ Vertrauen þ Home of Synchronet þ [vert/cvs/bbs].synchro.net
  • From rswindell@VERT to CVS commit on Thu Feb 15 18:29:25 2018
    exec scrubmsgs.js 1.1 1.2
    Update of /cvsroot/sbbs/exec
    In directory cvs:/tmp/cvs-serv5763

    Modified Files:
    scrubmsgs.js
    Log Message:
    Strip the file extension off the passed sub-codes, this allows usage like: 'jsexec scrubmsgs /sbbs/data/subs/*.shd'


    ---
    þ Synchronet þ Vertrauen þ Home of Synchronet þ [vert/cvs/bbs].synchro.net
  • From KK4QBN@VERT/KK4QBN to rswindell on Fri Feb 16 01:59:50 2018
    Re: exec/scrubmsgs.js
    By: rswindell to CVS commit on Thu Feb 15 2018 18:02:38

    exec scrubmsgs.js NONE 1.1
    Update of /cvsroot/sbbs/exec
    In directory cvs:/tmp/cvs-serv2874

    Added Files:
    scrubmsgs.js
    Log Message:
    A little script to detect and fix (by default) message headers containing illegal control characters, a sign of corruption. Use it like this:
    jsexec scrubmsgs <sub_code> [sub_code]
    The available options are:
    -debug enable debug output
    -scan do not modify headers, just scan and report corruption detected

    Reading script from /home/kk4qbn/sbbs/exec/scrubmsgs.js /home/kk4qbn/sbbs/exec/scrubmsgs.js compiled in 0.00 seconds
    !JavaScript /home/kk4qbn/sbbs/exec/scrubmsgs.js line 61: Error: Unrecognized msgbase code: activeuserservice
    /home/kk4qbn/sbbs/exec/scrubmsgs.js executed in 0.00 seconds
    !Module set exit_code: 1

    --

    Tim Smith (KK4QBN)
    KK4QBN BBS

    ---
    * Synchronet * KK4QBN BBS - kk4qbn.com - kk4qbn.synchro.net - Chatsworth GA USA
  • From Digital Man@VERT to KK4QBN on Thu Feb 15 23:43:04 2018
    Re: exec/scrubmsgs.js
    By: KK4QBN to rswindell on Fri Feb 16 2018 01:59 am

    Re: exec/scrubmsgs.js
    By: rswindell to CVS commit on Thu Feb 15 2018 18:02:38

    exec scrubmsgs.js NONE 1.1
    Update of /cvsroot/sbbs/exec
    In directory cvs:/tmp/cvs-serv2874

    Added Files:
    scrubmsgs.js
    Log Message:
    A little script to detect and fix (by default) message headers containing illegal control characters, a sign of corruption. Use it like this:
    jsexec scrubmsgs <sub_code> [sub_code]
    The available options are:
    -debug enable debug output
    -scan do not modify headers, just scan and report corruption detected

    Reading script from /home/kk4qbn/sbbs/exec/scrubmsgs.js /home/kk4qbn/sbbs/exec/scrubmsgs.js compiled in 0.00 seconds
    !JavaScript /home/kk4qbn/sbbs/exec/scrubmsgs.js line 61: Error: Unrecognized msgbase code: activeuserservice

    What did you type?

    digital man

    This Is Spinal Tap quote #41:
    Ian Faith: It say's "Memphis show cancelled due to lack of advertising funds." Norco, CA WX: 58.1øF, 25.0% humidity, 0 mph SW wind, 0.00 inches rain/24hrs
    ---
    þ Synchronet þ Vertrauen þ Home of Synchronet þ [vert/cvs/bbs].synchro.net
  • From KK4QBN@VERT/KK4QBN to rswindell on Fri Feb 16 02:12:25 2018
    Re: exec/scrubmsgs.js
    By: rswindell to CVS commit on Thu Feb 15 2018 18:29:25

    exec scrubmsgs.js 1.1 1.2
    Update of /cvsroot/sbbs/exec
    In directory cvs:/tmp/cvs-serv5763

    Modified Files:
    scrubmsgs.js
    Log Message:
    Strip the file extension off the passed sub-codes, this allows usage like: 'jsexec scrubmsgs /sbbs/data/subs/*.shd'


    DISREGARD last message, I was running it wrong. I was using * as wildcard instead of /sbbs/data/subs/*

    just an example, had a few:

    "id": "<5A70D81B.9085.sync_sys@mojo.synchro.net>",
    "ftn_pid": "Synchronet 3.17a-Win32 Jan 30 2018 MSC 1800",
    "field_list": [
    {
    "type": 176,
    "data": "WhenImported: 20180130142750-0800 41e0"
    },
    {
    "type": 176,
    "data": "WhenExported: 20180130144322-0800 41e0"
    },
    {
    "type": 176,
    "data": "ExportedFrom: VERT sync_sys 41891"
    },
    {
    "type": 176,
    "data": "WhenImported: 20180130153955-0500 412c"
    },
    {
    "type": 176,
    "data": "WhenExported: 20180130172751-0500 412c"
    },
    {
    "type": 176,
    "data": "ExportedFrom: MOJO sync_sys 9085"
    }
    ],
    "can_read": true
    }
    1 corrupted messages headers found
    Scanning /sbbs/data/subs/dove-syncprog
    Corrupted message header #159
    {
    "number": 159,
    "offset": 158,
    "to": "Lord Time",
    "from": "Digital Man",
    "subject": "Re: Error during the 11/21/16 dev build",
    "from_org": "Vertrauen",
    "from_net_type": 4,
    "from_net_addr": "VERT",
    "from_ip_addr": "192.19.255.250",
    "from_host_name": "<no name>",
    "from_protocol": "Telnet",
    "type": 0,
    "version": 289,
    "attr": 0,
    "auxattr": 0,
    "netattr": 0,
    "when_written_time": 1479755483,
    "when_written_zone": 16864,
    "when_written_zone_offset": -480,
    "when_imported_time": 1479768479,
    "when_imported_zone": 16684,
    "when_imported_zone_offset": -300,
    "thread_id": 155,
    "thread_back": 156,
    "thread_next": 0,
    "thread_first": 161,
    "delivery_attempts": 0,
    "last_downloaded": 0,
    "times_downloaded": 0,
    "data_length": 1614,
    "date": "Mon, 21 Nov 2016 14:11:23 -0800",
    "votes": 0,
    "reply_id": "pn\ufffd\ufffd\u007f",
    "id": "<5833710B.33357.syncprog@vert.synchro.net>",
    "ftn_msgid": "33357.syncprog@1:103/705 1c992958",
    "ftn_reply": "14327.syncprog@1:340/400 1c98bd02",
    "ftn_pid": "Synchronet 3.17a-Linux Debug Nov 21 2016 GCC 4.9.2",
    "field_list": [
    {
    "type": 176,
    "data": "WhenImported: 20161121141123-0800 41e0"
    },
    {
    "type": 176,
    "data": "WhenExported: 20161121144760-0800 41e0"
    },
    {
    "type": 176,
    "data": "ExportedFrom: VERT syncprog 33357"
    }
    ],
    "can_read": true
    }
    1 corrupted messages headers found


    /home/kk4qbn/sbbs/exec/scrubmsgs.js executed in 17.98 seconds


    Should this be run on nightly maint?

    --

    Tim Smith (KK4QBN)
    KK4QBN BBS

    ---
    * Synchronet * KK4QBN BBS - kk4qbn.com - kk4qbn.synchro.net - Chatsworth GA USA
  • From KK4QBN@VERT/KK4QBN to rswindell on Fri Feb 16 02:58:52 2018
    Re: exec/scrubmsgs.js
    By: KK4QBN to rswindell on Fri Feb 16 2018 02:12:25

    /home/kk4qbn/sbbs/exec/scrubmsgs.js executed in 17.98 seconds


    Should this be run on nightly maint?

    I decided to run it twice a week after msgmaint.

    --

    Tim Smith (KK4QBN)
    KK4QBN BBS

    ---
    * Synchronet * KK4QBN BBS - kk4qbn.com - kk4qbn.synchro.net - Chatsworth GA USA
  • From Digital Man@VERT to KK4QBN on Fri Feb 16 00:41:52 2018
    Re: exec/scrubmsgs.js
    By: KK4QBN to rswindell on Fri Feb 16 2018 02:12 am

    Should this be run on nightly maint?

    Nah, just on an as-needed basis.

    digital man

    Synchronet "Real Fact" #26:
    The Synchronet Web Server was written predominantly by Stephen Hurd (Deuce). Norco, CA WX: 56.5øF, 25.0% humidity, 1 mph SSW wind, 0.00 inches rain/24hrs ---
    þ Synchronet þ Vertrauen þ Home of Synchronet þ [vert/cvs/bbs].synchro.net
  • From KK4QBN@VERT/KK4QBN to Digital Man on Fri Feb 16 05:11:04 2018
    Re: exec/scrubmsgs.js
    By: Digital Man to KK4QBN on Thu Feb 15 2018 23:43:04

    Reading script from /home/kk4qbn/sbbs/exec/scrubmsgs.js
    /home/kk4qbn/sbbs/exec/scrubmsgs.js compiled in 0.00 seconds
    !JavaScript /home/kk4qbn/sbbs/exec/scrubmsgs.js line 61: Error:
    Unrecognized msgbase code: activeuserservice

    What did you type?

    I'm sure you caught my other message where I screwed up.. I believe I only tpyed a * for wildcard instead of ../data/subs/*.shd for wildcard.

    all good now.

    --

    Tim Smith (KK4QBN)
    KK4QBN BBS

    ---
    * Synchronet * KK4QBN BBS - kk4qbn.com - kk4qbn.synchro.net - Chatsworth GA USA