• Re: mutil MassUpload adding duplicates?

    From Paul Hayton@3:770/100 to Björn Wiberg on Tue Feb 8 16:44:40 2022
    On 07 Feb 2022 at 02:06p, Bj�rn Wiberg pondered and said...

    Hi there

    --------------------- MUTIL v1.12 A48 2022/02/02 Mon, Feb 07 2022 (loglevel 3) + 2022-02-07 00:00:02 Startup using maint.ini
    - 2022-02-07 00:00:02 EXEC MassUpload
    - 2022-02-07 00:00:02 EXEC GenerateTopLists
    - 2022-02-07 00:00:02 EXEC PackUserBase
    - 2022-02-07 00:00:02 EXEC PurgeMessageBases
    - 2022-02-07 00:00:02 EXEC PackMessageBases
    - 2022-02-07 00:00:02 EXEC LinkMessages
    - 2022-02-07 00:00:02 EXEC MergeNodeLists
    - 2022-02-07 00:00:02 EXEC PackFileBases
    - 2022-02-07 00:00:02 EXEC FileSort
    - 2022-02-07 00:00:02 EXEC GenerateAllFiles
    - 2022-02-07 00:00:02 EXEC Export_FILEBONE.NA
    - 2022-02-07 00:00:02 EXEC Export_AREAS.BBS
    - 2022-02-07 00:00:02 EXEC Export_Golded

    Just an observation but that's a lot of stuff to run in a maint. I wonder if it would be better to run the mass upload process as something separate from the rest. I personally don't really see it as a nightly maint thing.

    --- Mystic BBS v1.12 A47 2021/11/06 (Linux/64)
    * Origin: Agency BBS | Dunedin, New Zealand | agency.bbs.nz (3:770/100)
  • From Björn Wiberg@2:201/137 to Paul Hayton on Tue Feb 8 09:17:59 2022
    Hello Paul!

    Thank you for your reply!

    On 08 Feb 2022, Paul Hayton said the following...
    Just an observation but that's a lot of stuff to run in a maint. I

    Yes =), some of it could perhaps be run less often (e.g. weekly or monthly).

    Best regards
    Bj�rn

    --- Mystic BBS v1.12 A48 2022/02/02 (Linux/64)
    * Origin: Star Collision BBS, Uppsala, Sweden (2:201/137)
  • From Paul Hayton@3:770/100 to Björn Wiberg on Tue Feb 8 21:43:44 2022
    On 08 Feb 2022 at 09:17a, Bj�rn Wiberg pondered and said...

    Yes =), some of it could perhaps be run less often (e.g. weekly or monthly).

    If it helps I need to revisit my ini files too :)

    --- Mystic BBS v1.12 A47 2021/12/24 (Linux/64)
    * Origin: Agency BBS | Dunedin, New Zealand | agency.bbs.nz (3:770/100)
  • From g00r00@1:129/215 to Paul Hayton on Tue Feb 8 12:19:23 2022
    Just an observation but that's a lot of stuff to run in a maint. I
    wonder if it would be better to run the mass upload process as something separate from the rest. I personally don't really see it as a nightly maint thing.

    I would also add to this that purging/packing the msg/file bases isn't something that I would be expected to do nightly either.

    It shouldn't hurt things to run every night but it does recreate all of your msg/file base data files and is probably the "heaviest" process that MUTIL does.

    I personally run it manually every month or so but if I had a public BBS I'd probably schedule it to run once per week.

    --- Mystic BBS v1.12 A48 2022/02/03 (Windows/64)
    * Origin: Sector 7 * Mystic WHQ (1:129/215)
  • From Paul Hayton@3:770/100 to g00r00 on Wed Feb 9 14:22:23 2022
    On 08 Feb 2022 at 12:19p, g00r00 pondered and said...

    I would also add to this that purging/packing the msg/file bases isn't something that I would be expected to do nightly either.

    It shouldn't hurt things to run every night but it does recreate all of your msg/file base data files and is probably the "heaviest" process
    that MUTIL does.

    I personally run it manually every month or so but if I had a public BBS I'd probably schedule it to run once per week.

    Yep. good thoughts thanks... I recall it was packing that was the more intensive, is that right?

    Could you happily purge more often than pack?

    The other question I had was regarding linking, is it better to link each time packets are processed or do you think it's more of a nightly thing?

    Thanks :)

    --- Mystic BBS v1.12 A47 2021/12/24 (Linux/64)
    * Origin: Agency BBS | Dunedin, New Zealand | agency.bbs.nz (3:770/100)
  • From Jay Harris@1:229/664 to Paul Hayton on Tue Feb 8 21:36:33 2022
    On 09 Feb 2022, Paul Hayton said the following...

    The other question I had was regarding linking, is it better to link
    each time packets are processed or do you think it's more of a nightly thing?

    I personally link each time I toss in my mailin.ini.

    [General]
    ImportEchoMail = true
    FileToss = true
    LinkMessages = true


    Jay

    ... His eyes are so bad, he has to wear contact lenses to see his glasses.

    --- Mystic BBS v1.12 A47 2021/12/24 (Raspberry Pi/32)
    * Origin: Northern Realms (1:229/664)
  • From Paul Hayton@3:770/100 to Jay Harris on Wed Feb 9 16:29:49 2022
    On 08 Feb 2022 at 09:36p, Jay Harris pondered and said...

    I personally link each time I toss in my mailin.ini.

    All this chatter of linking... feels like we should be holding hands and singing kum-bye-ya heheh

    --- Mystic BBS v1.12 A47 2021/12/24 (Linux/64)
    * Origin: Agency BBS | Dunedin, New Zealand | agency.bbs.nz (3:770/100)
  • From g00r00@1:129/215 to Paul Hayton on Wed Feb 9 12:43:59 2022
    Yep. good thoughts thanks... I recall it was packing that was the more intensive, is that right?

    Could you happily purge more often than pack?

    You could but it makes most sense to me anyway to run them both together maybe once a week or so.

    Purging will enforce the message limits on your bases (max messages and max message age) by marking them deleted. It will also go through and remove any private messages that are in the data files for users that no longer exist.

    Its not as intensive as rebuilding the message bases, but its still a good amount of work being done since its scanning through a lot of data.

    Packing will then physically rebuild your message bases without all of the data that purge marked to be deleted. It keeps the bases slim and the message numbers in order, etc. It can sometimes fix errors as well.

    ... They say there's always one weirdo on the bus, but I couldn't find them! --- Mystic BBS v1.12 A48 2022/02/03 (Windows/64)
    * Origin: Sector 7 * Mystic WHQ (1:129/215)