syncBKUP, a Bash script to that synchronises data directories and files to a backup repository. Only the most recent backup is stored in the repository. All changes and deletion to any directory or file between backups are kept in individual version directories. There are no limits on how long or how much historical data is kept, its user managed. This script is based on the capabilities of rsync.

Duplicate file finder, a small Linux app (x86 & ARM) that produces reports on duplicate & unique files using sha256 checksum. Input can be one or more directories with optional filters of maximum files size and parts of file names. Output is multiple CSV (spreadsheet) reports that can be used to move or delete duplicates in Linux, Windows-WSL, MSYS2, Gitbash

A small Linux app that creates test files filling them with random data in a single directory or a directory tree.

• Includes a calculator for creating data in directory trees.
• Can create a single file to a directory tree, tree size provided by user.
• File contents can either be printable or binary. All contents generated from /dev/urandom.
• Selecting the printable pool of characters determines the compressibility of file contents.
• Files sizes can be identical or randomly sized within a given range.
• Files can be identical or individually filled with random content.
• Run either interactively or unaccompanied in batch mode.

TestFilesCreate Datasheet Usage plus results testing data compression and data deduplication

Similar to testFilesCreate. Differences being: only produces a single directory of test files, has an option for sparse files and no calculator.

Makes test data for testing data storage, compression and transfer. The app can create test data files filled random selectable printable characters or binary data. Selecting printable content controls how compressible the test data is. There is a sparse file option. Files are created in a single directory. No data creation limits.

A script ( Bash & Powershell) that renames files, in a directory, that have generic meaningless names produced by phones, cameras log file genrators. This script will add the names of the parent directories as a prefix to current names. The script creates an executable log that will undo the renaming processing. The number of parent directory names you want to include in the prefix of the new name is selectable.

Calculations are theoretical and used to illustrate the dynamics of the impact deduplication. Calcultor out will not likely to match vendor calculations because there are many factors that influence deduplication capacity planning.

Download Data dedupe calculator (MS-Excel) macro free. The repro has examples of usage.

System, security and application administrators use command line mail tools like sendmail, postfix, mailx and mutt to mail out reports, alerts and other material to external people. These guides describe how setup up command line mail services using Proton Mail Bridge and mail-only SMTP services. SMTP services can used with Linux system utilities that are mail enabled, like cron.

Guide for installing, configuring and using the Mutt mail client with Proton Mail Bridge. Mutt is an option for those that do not have a domian to use.

Mutt_Proton_Mail-Bridge_Guide (PDF) The repo contins the muttrc and scripts

Guide for installing, configuring and using Postfix with Proton Mail TLS/SASL secure SMTP. Requires a personal/company domain to be configured within th4e Prootn Mail account that is going to act as a send-only mail relay.

Postfix SMTP Proton Mail - Installation, Configuration and Usage Guide

Undergoing development and testing

Scaleway are a French transactional email providers the provide a free service for low volume usage. Transactional email servcies are for delivering automated emails triggered by:

• Application that can send alerts, account verifications, invoices, notifications, and similar messages.
• IT Infrastruture, including servers, that can send alerts, reports using local email clients and utlities like postfix.