<!DOCTYPE html><html><head><title></title><style type="text/css">p.MsoNormal,p.MsoNoSpacing{margin:0}</style></head><body><div>Hi Anestis,<br></div><div> I used to be "The Ceph guy" at a large an annoying government department. I think the nutshell differences I see are:<br></div><div> <br></div><div>Gluster:<br></div><ul><li>Smaller scale (5-ish nodes max, I think)<br></li><li>Network filesystem only<br></li><li>Integrated services (storage and control/mgmt on the same boxes)<br></li><li>Limited redundancy and failure-domain options<br></li><li>A little simpler to set up on its own<br></li></ul><div>Ceph:<br></div><ul><li>Scales up to gigantic, multi-region clusters<br></li><li>Block storage (RBD), File storage (CephFS) and Object storage (RGW) options available<br></li><li>Control/mgmt can be on separate nodes (And should be unless you have a really small cluster)<br></li><li>Any speed, redundancy (replication or erasure coding) or failure-domain setup you can think of. You can have multiple setups for different storage pools within the cluster.<br></li><li>Takes a bit more planning and implementation to deploy<br></li></ul><div>Like Neill said: Openstack uses the RBD application to present "disk like" virtual storage devices to the compute nodes for the VMs to use. The old Redhat Enterprise Virtualisation (OVirt) <i>used</i> to use Gluster as its network storage system (putting disk images as files on top of it). However I'm not sure this is still the case.<br></div><div><br></div><div>CephFS works really well as an NFS replacement (it's just a lot more fiddly to set up). RGW can present itself as either S3 or Swift protocol (Or a "weird" NFS version too - but don't go there).<br></div><div><br></div><div>Hope that's enough, but not too much info,<br></div><div><br></div><div>M0les.<br></div><div><br></div><div>On Tue, 6 Jun 2023, at 04:55, Anestis Kozakis via linux-aus wrote:<br></div><blockquote type="cite" id="qt" style=""><div dir="ltr"><div>I was wondering fi people could summarize me the difference as well s the pros and cons fo GlusterFS vs CephFS inr regards to the following uses:<br></div><div><br></div><div>File Server/System and creating Virtual Machines and Containers.<br></div><div><br></div><div>I will, of course, do my own research, but I am looking to get other people's experiences and opinions.<br></div><div><br></div><div><div>Anestis.<br></div><div><span class="qt-gmail_signature_prefix">--</span><br></div><div dir="ltr" class="qt-gmail_signature"><div dir="ltr"><div>Anestis Kozakis | <a href="mailto:kenosti@gmail.com" target="_blank">kenosti@gmail.com</a><br></div><div><br></div></div></div></div></div><div>_______________________________________________<br></div><div>linux-aus mailing list<br></div><div><a href="mailto:linux-aus@lists.linux.org.au">linux-aus@lists.linux.org.au</a><br></div><div><a href="http://lists.linux.org.au/mailman/listinfo/linux-aus">http://lists.linux.org.au/mailman/listinfo/linux-aus</a><br></div><div><br></div><div>To unsubscribe from this list, send a blank email to<br></div><div><a href="mailto:linux-aus-unsubscribe@lists.linux.org.au">linux-aus-unsubscribe@lists.linux.org.au</a><br></div></blockquote><div><br></div></body></html>