Re: [Astlinux-devel] AstLinux Pre-Release with S3 object storage support (s3fs)

[Lonnie A. <li...@lo...>]

Hi David,

You are correct, I withdraw my "sym-link(s) on /mnt/kd/ to the S3 mount on /var/s3fs/mnt/" idea ... bad idea.

Alternatively, the S3 mount could contain directories of config files, each with a "ver" file (or hash) that gets incremented (or re-hashed) when changes are made.  A nightly cron script could compare local /mnt/kd/ config's "ver" file with the S3 mount config's "ver" file and rsync or cp the files, update the local "ver" file and restart the service.

You might ask, how is the above better than a similar nightly cron script using scp to a tightly firewall'ed or VPN connected server?  Some might say the S3 mount is simpler, many S3 providers support encryption at rest, some have redundancy by default. S3 access with Read/Only privileges is a good feature.

Lonnie



> On Jul 9, 2024, at 9:38 PM, David Kerr <Da...@Ke...> wrote:
> 
> Is there any local caching of files and/or directory structure?  And any offline support?  I'm just wondering if someone uses this for file(s) that may be accessed during system boot... what happens if either the network link is down, or it takes a long time to establish an initial connection.  Or is this just something that we shouldn't do?
> 
> David.
> 
> On Tue, Jul 9, 2024 at 8:09 PM Lonnie Abelbeck <li...@lo...> wrote:
> > Awesome possibilities here.
> > First thought is to store config files to be shared between systems. Do you think this would work?
> 
> That should work, though it would probably require sym-link(s) on /mnt/kd/ to the S3 mount on /var/s3fs/mnt/
> 
> Easy to test with the Pre-Release VM
> 
> Lonnie
> 
> 
> 
> > On Jul 9, 2024, at 6:30 PM, Michael Knill <mic...@ip...> wrote:
> > 
> > Awesome possibilities here.
> > 
> > First thought is to store config files to be shared between systems. Do you think this would work?
> > 
> > Regards
> > Michael KnillFrom: Lonnie Abelbeck <li...@lo...>
> > Sent: Saturday, 6 July 2024 11:43 PM
> > To: AstLinux Users Mailing List <ast...@li...>
> > Cc: AstLinux Developers Mailing List <ast...@li...>
> > Subject: [Astlinux-devel] AstLinux Pre-Release with S3 object storage support (s3fs)
> >  Greetings,
> > 
> > Pre-Release Version: astlinux-1.5-6098-6ab1c5
> > 
> > AstLinux Project -> Development
> > https://www.astlinux-project.org/dev.html
> > 
> > Of particular note is a new feature to mount S3 Object Storage.
> > --
> > S3 Object Storage Client (s3fs)
> > https://doc.astlinux-project.org/userdoc:tt_s3_object_storage_client
> > --
> > 
> > One interesting use case for s3fs is to provide a Read/Only mount to an S3 bucket containing a custom AstLinux firmware repository.
> > --
> > https://doc.astlinux-project.org/userdoc:tt_s3_object_storage_client#custom_firmware_repository
> > --
> > 
> > I'm sure there are many other interesting use cases.  If you are so inclined, spin-up the beta Install ISO and give it a test.
> > 
> > I personally tested it with: Linode (Akamai), Vultr, Backblaze B2, Cloudflare R2 (all but Vultr supports limited access keys)
> > 
> > 
> > Complete Pre-Release ChangeLog:
> > https://astlinux-project.org/beta/astlinux-changelog/ChangeLog.txt
> > 
> > The "AstLinux Pre-Release ChangeLog" and "Pre-Release Repository URL" entries can be found under the "Development" tab of the AstLinux Project web site ...
> > 
> > AstLinux Project -> Development
> > https://www.astlinux-project.org/dev.html
> > 
> > 
> > AstLinux Team
> > 
> > 
> > 
> > _______________________________________________
> > Astlinux-devel mailing list
> > Ast...@li...
> > https://lists.sourceforge.net/lists/listinfo/astlinux-devel
> > _______________________________________________
> > Astlinux-devel mailing list
> > Ast...@li...
> > https://lists.sourceforge.net/lists/listinfo/astlinux-devel
> 
> 
> 
> 
> _______________________________________________
> Astlinux-devel mailing list
> Ast...@li...
> https://lists.sourceforge.net/lists/listinfo/astlinux-devel
> _______________________________________________
> Astlinux-devel mailing list
> Ast...@li...
> https://lists.sourceforge.net/lists/listinfo/astlinux-devel