all posts tagged gluster


by on July 31, 2017

Gluster Monthly Newsletter, July 2017

Gluster Monthly Newsletter, July 2017

The Gluster Summit CfP has been extended to midnight Pacific time, August 15th.

Want to get your talk in but wasn’t sure what to say? Drop something in before August 15th anyways!

https://www.gluster.org/events/summit2017

 

Welcome new maintainers!

https://github.com/gluster/glusterfs/blob/master/MAINTAINERS now reflects our modified maintainer structure, and the maintainers meeting happens every other week at the same time as the community meeting.

http://lists.gluster.org/pipermail/gluster-devel/2017-July/053362.html has more details.

 

Our weekly community meeting has changed: we’ll be meeting every other week instead of weekly, moving the time to 15:00 UTC, and our agenda is at: https://bit.ly/gluster-community-meetings  

 

Release 3.12 has been branched! This Long Term Release will be available in August.

http://lists.gluster.org/pipermail/gluster-devel/2017-July/053367.html

 

Noteworthy threads:

[Gluster-users] GlusterFS 3.8.14 is here, 3.8 even closer to End-Of-Life http://lists.gluster.org/pipermail/gluster-users/2017-July/031826.html

[Gluster-users] Web python framework under GlusterFS

http://lists.gluster.org/pipermail/gluster-users/2017-July/031888.html

[Gluster-devel] [New Release] GlusterD2 v4.0dev-7

http://lists.gluster.org/pipermail/gluster-devel/2017-July/053229.html

[Gluster-devel] create restrictions xlator

http://lists.gluster.org/pipermail/gluster-devel/2017-July/053288.html

[Gluster-devel] What would be ideal option for ‘auth.allow’ to support subdir mount?

http://lists.gluster.org/pipermail/gluster-devel/2017-July/053355.html

[Gluster-devel] Changing the relative order of read-ahead and open-behind

http://lists.gluster.org/pipermail/gluster-devel/2017-July/053363.html

 

Gluster Top 5 Contributors in the last 30 days:

Michael Scherer, Kaleb Keithley, Sachidananda URS, Niels De Vos, Nithya Balachandran

 

Upcoming CFPs:

LinuxConf AU

https://linux.conf.au/proposals/ – August 6th

by on June 30, 2017

Gluster Monthly Newsletter, June 2017

Important happenings for Gluster for June:

Gluster Summit 2017!

Gluster Summit 2017 will be held in Prague, Czech Republic on October 27 and 28th.

More details at:

https://www.gluster.org/events/summit2017  

Our weekly community meeting has changed: we’ll be meeting every other week instead of weekly, moving the time to 15:00 UTC, and our agenda is at: https://bit.ly/gluster-community-meetings

3.11 Retrospective

Thanks all who gave feedback! From the notes we got, you’d like to see us do better release testing, you want to continue to see a focus on performance for small files, gluster swift, monitoring. You like how we’re putting our release plans publicly on Github, and we’re planning on continuing that! You’d like to see the ways that a feature gets proposed be streamlined, and we’ll look to that in future releases. We’ll be doing retrospectives for every major release, watch for the next one for 3.12.

Noteworthy threads from the mailing lists:

 

Vijay Bellur asks – Who’s using OpenStack Cinder & Gluster?

http://lists.gluster.org/pipermail/gluster-users/2017-June/031370.html

Nithya B asks for Gluster Documentation Feedback

http://lists.gluster.org/pipermail/gluster-users/2017-June/031498.html

Raghavendra Talur introduces minister

http://lists.gluster.org/pipermail/gluster-users/2017-June/031589.html

Shyam announces Release 3.12: Scope and calendar!

http://lists.gluster.org/pipermail/gluster-devel/2017-June/052953.html

Krutika Dhananjay outlines performance experiments with io-stats translator

http://lists.gluster.org/pipermail/gluster-devel/2017-June/052993.html

Amar requests [Need Feedback] Monitoring

http://lists.gluster.org/pipermail/gluster-devel/2017-June/053048.html

Nigel proposes Regression Voting Changes

http://lists.gluster.org/pipermail/gluster-devel/2017-June/053080.html

Amar explains a new ‘experimental’ branch created for validating your ideas

http://lists.gluster.org/pipermail/gluster-devel/2017-June/053092.html

Raghavendra Talur starts a conversation on brick multiplexing and memory consumption

http://lists.gluster.org/pipermail/gluster-devel/2017-June/053101.html

Pranith Kumar Karampuri suggests changes to backport information while porting patches

http://lists.gluster.org/pipermail/gluster-devel/2017-June/053140.html

Kotresh Hiremath Ravishankar comments on adding xxhash to gluster code base

http://lists.gluster.org/pipermail/gluster-devel/2017-June/053173.html

Amar posts updates on Maintainers 2.0

http://lists.gluster.org/pipermail/gluster-devel/2017-June/053192.html

Jeff Darcy notes a need for a new coding standard

http://lists.gluster.org/pipermail/gluster-devel/2017-June/053204.html

 

Gluster Top 5 Contributors in the last 30 days:

Kaleb Keithley, Michael Scherer, Nigel Babu, Prashanth Pai, Nithya Balachandran

 

Upcoming CFPs:

Open Source Summit Europe –

http://events.linuxfoundation.org/events/open-source-summit-europe/program/cfp

July 8

Gluster Summit 2017  –https://goo.gl/forms/IUacgG5JjpuMTWe52 – July 31

by on June 4, 2017

Gluster Monthly Newsletter, May 2017

Gluster Monthly Newsletter, May 2017

Important happenings for Gluster for May:

3.11 Release!

Our 3.11 release is officially out!

https://blog.gluster.org/2017/05/announcing-gluster-3-11/

Note that this is a short term supported release.

3.12 is underway with a feature freeze date of July 17, 2017.

Gluster Summit 2017!

Gluster Summit 2017 will be held in Prague, Czech Republic on October 27 and 28th. We’ll be opening a call for papers for this instead of having an application process to attend.

https://www.gluster.org/events/summit2017  

Our weekly community meeting has changed: we’ll be meeting every other week instead of weekly, moving the time to 15:00 UTC, and our agenda is at: https://bit.ly/gluster-community-meetings

We hope this means that more people can join us. Kaushal outlines the changes on the mailing list: http://lists.gluster.org/pipermail/gluster-devel/2017-January/051918.html

 

From Red Hat Summit:

Container-Native Storage for Modern Applications with OpenShift and Red Hat Gluster Storage

http://bit.ly/2qpLVP0

Gluster Top 5 Contributors in the last 30 days:

Architecting and Performance-Tuning Efficient Gluster Storage Pools

http://bit.ly/2qpMgkK

 

Noteworthy threads from the mailing lists:

Announcing GlusterFS release 3.11.0 (Short Term Maintenance) – Shyam –

http://lists.gluster.org/pipermail/gluster-users/2017-May/031298.html  

GlusterFS and Kafka – Christopher Schmidt –

http://lists.gluster.org/pipermail/gluster-users/2017-May/031185.html

gluster-block v0.2 is alive! – Prasanna Kalever – http://lists.gluster.org/pipermail/gluster-users/2017-May/030933.html

GlusterFS removal from Openstack Cinder – Joe Julian

http://lists.gluster.org/pipermail/gluster-users/2017-May/031223.html

Release 3.12 and 4.0: Thoughts on scope – Shyam  –

http://lists.gluster.org/pipermail/gluster-devel/2017-May/052811.html

Reviews older than 90 days  – Amar Tumballi –

http://lists.gluster.org/pipermail/gluster-devel/2017-May/052844.html  

[Proposal]: Changes to how we test and vote each patch  – Amar Tumballi –  

http://lists.gluster.org/pipermail/gluster-devel/2017-May/052868.html

Volgen support for loading trace and io-stats translators at specific points in the graph – Krutika Dhananjay –

http://lists.gluster.org/pipermail/gluster-devel/2017-May/052881.html  

Backport for “Add back socket for polling of events immediately…” – Shyam

http://lists.gluster.org/pipermail/gluster-devel/2017-May/052887.html  

[Proposal]: New branch (earlier: Changes to how we test and vote each patch) –  Amar Tumballi –   

http://lists.gluster.org/pipermail/gluster-devel/2017-May/052933.html  

 

Gluster Top 5 Contributors in the last 30 days:

Krutika Dhananjay, Michael Scherer, Kaleb S. Keithley, Nigel Babu, Xavier Hernandez

 

Upcoming CFPs:

Open Source Summit Europe –

http://events.linuxfoundation.org/events/open-source-summit-europe/program/cfp

July 8

 

by on May 31, 2017

Announcing Gluster 3.11

Release notes for Gluster 3.11

The Gluster community is pleased to announce the release of Gluster 3.11.

This is a short term maintenance (STM) Gluster release that includes some substantial changes. The features revolve around, improvements to small file workloads, Halo replication enhancement from Facebook, some usability and performance improvements, among other bug fixes.

The most notable features and changes are documented on the full release notes.

Moving forward, Gluster versions 3.11, 3.10 and 3.8 are actively maintained.

With the release of 3.12 in the future, active maintenance of this (3.11) STM release will be terminated.

Major changes and features

  • Switched to storhaug for ganesha and samba high availability
  • Added SELinux support for Gluster Volumes
  • Several memory leaks are fixed in gfapi during graph switches
  • get-state CLI is enhanced to provide client and brick capacity related information
  • Ability to serve negative lookups from cache has been added
  • New xlator to help developers detecting resource leaks has been added
  • Feature for metadata-caching/small file performance is production ready
  • “Parallel Readdir” feature introduced in 3.10.0 is production ready
  • Object versioning is enabled only if bitrot is enabled
  • Distribute layer provides more robust transactions during directory namespace operations
  • gfapi extended readdirplus API has been added
  • Improved adoption of standard refcounting functions across the code
  • Performance improvements to rebalance have been made
  • Halo Replication feature in AFR has been introduced
  • FALLOCATE support with EC
by on May 1, 2017

Gluster Monthly Newsletter, April 2017

 

Release 3.11 has been branched and tagged! More details on the mailing list.

http://lists.gluster.org/pipermail/gluster-users/2017-April/030764.html

 

Our weekly community meeting has changed: we’ll be meeting every other week instead of weekly, moving the time to 15:00 UTC, and our agenda is at: https://bit.ly/gluster-community-meetings

We hope this means that more people can join us. Kaushal outlines the changes on the mailing list: http://lists.gluster.org/pipermail/gluster-devel/2017-January/051918.html

 

New meetup! We’re delighted to welcome the first Seattle Storage meetup, run by our very own Joe Julian.

https://www.meetup.com/Seattle-Storage-Meetup/

 

Coming to Red Hat Summit?

Come find us at the Gluster Community Booth in our Community Central area!

 

Upcoming Talks:

Red Hat Summit:

Container-Native Storage for Modern Applications with OpenShift and Red Hat Gluster Storage

http://bit.ly/2qpLVP0

Architecting and Performance-Tuning Efficient Gluster Storage Pools

http://bit.ly/2qpMgkK

 

Noteworthy threads:

Gluster-users:

Announcing release 3.11 : Scope, schedule and feature tracking

http://lists.gluster.org/pipermail/gluster-users/2017-April/030561.html

Usability Initiative for Gluster: Documentation

http://lists.gluster.org/pipermail/gluster-users/2017-April/030567.html

How do you oVirt? Here the answers!

http://lists.gluster.org/pipermail/gluster-users/2017-April/030592.html

Revisiting Quota functionality in GlusterFS

http://lists.gluster.org/pipermail/gluster-users/2017-April/030676.html

 

Gluster-devel:

Back porting guidelines: Change-ID consistency across branches

http://lists.gluster.org/pipermail/gluster-devel/2017-April/052495.html

GlusterFS+NFS-Ganesha longevity cluster

http://lists.gluster.org/pipermail/gluster-devel/2017-April/052503.html

GFID2 – Proposal to add extra byte to existing GFID

http://lists.gluster.org/pipermail/gluster-devel/2017-April/052520.html

[Gluster-Maintainers] Maintainers 2.0 Proposal

http://lists.gluster.org/pipermail/gluster-devel/2017-April/052551.html

Proposal for an extended READDIRPLUS operation via gfAPI

http://lists.gluster.org/pipermail/gluster-devel/2017-April/052596.html

 

Gluster-infra:

Jenkins Upgrade

http://lists.gluster.org/pipermail/gluster-infra/2017-April/003495.html

 

Gluster Top 5 Contributors in the last 30 days:

Krutika Dhananjay, Michael Scherer, Kaleb S. Keithley, Nigel Babu, Xavier Hernandez

 

Upcoming CFPs:

Open Source Summit North America – http://events.linuxfoundation.org/events/open-source-summit-north-america/program/cfp  – May 6

Open Source Summit Europe –

http://events.linuxfoundation.org/events/open-source-summit-europe/program/cfp

July 8

by on March 31, 2017

Gluster Monthly Newsletter, March 2017

 

3.10 Release: If you didn’t already see this, we’ve released Gluster 3.10. Further details on the blog.

https://blog.gluster.org/2017/02/announcing-gluster-3-10/

 

Our weekly community meeting has changed: we’ll be meeting every other week instead of weekly, moving the time to 15:00 UTC, and our agenda is at: https://bit.ly/gluster-community-meetings

We hope this means that more people can join us. Kaushal outlines the changes on the mailing list: http://lists.gluster.org/pipermail/gluster-devel/2017-January/051918.html

 

New meetup!

Seattle Storage Meetup has its first meeting, April 13!

 

Upcoming Talks:

Red Hat Summit –

Container-Native Storage for Modern Applications with OpenShift and Red Hat Gluster Storage

Architecting and Performance-Tuning Efficient Gluster Storage Pools

 

Noteworthy threads:

Gluster-users:

Gluster RPC Internals – Lecture #1 – recording – Milind Changire

http://lists.gluster.org/pipermail/gluster-users/2017-March/030136.html

Shyam announces release 3.11 : Scope, schedule and feature tracking

http://lists.gluster.org/pipermail/gluster-users/2017-March/030251.html

Vijay announces new demos in Community Meeting

http://lists.gluster.org/pipermail/gluster-users/2017-March/030264.html

Prasanna Kalever posts about Elasticsearch with gluster-block

http://lists.gluster.org/pipermail/gluster-users/2017-March/030302.html

Raghavendra Talur has a proposal to deprecate replace-brick for “distribute only” volumes

http://lists.gluster.org/pipermail/gluster-users/2017-March/030304.html

Deepak Naidu asks about Secured mount in GlusterFS using keys

http://lists.gluster.org/pipermail/gluster-users/2017-March/030312.html

Ramesh Nachimuthu has a question for gluster-users: How do you oVirt?

http://lists.gluster.org/pipermail/gluster-users/2017-March/030366.html  

Joe Julian announces a Seattle Storage meetup

http://lists.gluster.org/pipermail/gluster-users/2017-March/030398.html

 

Gluster-devel:

Shyam posts about Back porting guidelines: Change-ID consistency across branches

http://lists.gluster.org/pipermail/gluster-devel/2017-March/052216.html

Niels de Vos asks about a pluggable interface for erasure coding?

http://lists.gluster.org/pipermail/gluster-devel/2017-March/052223.html

Niels de Vos has a proposal on Reducing maintenance burden and moving fuse support to an external project

http://lists.gluster.org/pipermail/gluster-devel/2017-March/052238.html

Nigel Babu starts a conversation on defining a good build

http://lists.gluster.org/pipermail/gluster-devel/2017-March/052245.html

Ben Werthmann announces gogfapi improvements

http://lists.gluster.org/pipermail/gluster-devel/2017-March/052274.html

Saravanakumar Arumugam posts about Gluster Volume as object storage with S3 interface

http://lists.gluster.org/pipermail/gluster-devel/2017-March/052263.html

Vijay posts about Maintainers 2.0 proposal

http://lists.gluster.org/pipermail/gluster-devel/2017-March/052321.html

George Lian posts: nodeid changed due to write-behind option changed online will lead to unexpected umount by kernel

http://lists.gluster.org/pipermail/gluster-devel/2017-March/052372.html

Sriram posts a proposal for Gluster volume snapshot – Plugin architecture proposal

http://lists.gluster.org/pipermail/gluster-devel/2017-March/052385.html

Mark Ferrell posts improvements for Gluster volume snapshot

http://lists.gluster.org/pipermail/gluster-devel/2017-March/052396.html

Sonal Arora has a script to identify ref leaks

http://lists.gluster.org/pipermail/gluster-devel/2017-March/052468.html

 

Gluster-infra:

Nigel Babu posts about RPM build failures post-mortem

http://lists.gluster.org/pipermail/gluster-infra/2017-March/003300.html

Nigel Babu posts about Servers in UTC now (mostly)

http://lists.gluster.org/pipermail/gluster-infra/2017-March/003368.html

 

Gluster Top 5 Contributors in the last 30 days:

Krutika Dhananjay, Michael Scherer, Kaleb S. Keithley, Nigel Babu, Xavier Hernandez

 

Upcoming CFPs:

OpenSource Summit Los Angeles – http://events.linuxfoundation.org/events/open-source-summit-north-america/program/cfp  – May 6

 

by on March 29, 2017

Enhancing & Optimizing Gluster for Container Storage

Containers are designed to run applications and be stateless in nature. This necessitates containerized applications to store data externally on persistent storage. Since applications can be launched at any point in time in a container cloud, the persistent storage shares also need to be dynamically provisioned without any administrative intervention. Gluster has been taking big strides for this form of container storage by introducing new features and deepening integration with other projects in the container ecosystem.

We have introduced two deployment models for addressing persistent storage with Gluster:

 

  • Container Native Storage: Containerized Gluster runs hyperconverged with application containers and builds volumes from disks that are available on the container hosts.
  • Container Ready Storage: Non-containerized Gluster running as a traditional trusted storage pool. Volumes are carved out of this pool and shares are made available to containers.

A lot of our integration focus for persistent storage has been with Kubernetes. Kubernetes provides multiple access modes for persistent storage – Read Write Many (RWM), Read Write Once (RWO) and Read Only Many (ROM).  Gluster’s native file based access has been found to be an apt match for RWM & ROM workloads. Block devices in gluster volumes are suitable for RWO workloads.

For RWM scenarios with both CNS and CRS, we recommend mapping a Kubernetes persistent volume claim to a Gluster volume. This approach provides isolation, reduces the likelihood of noisy neighbors and enables data services like geo-replication, snapshotting to be applied separately for different persistent volumes.

To enable dynamic provisioning of Gluster volumes, ReST based volume management operations have been introduced via Heketi. Heketi can manage multiple trusted storage pools and has the intelligence to carve out a volume in a trusted storage pool with minimal inputs from users. The provisioner for glusterfs in Kubernetes leverages the capabilities exposed by Heketi and creates volumes on the fly for addressing persistent volume claims made by users. You can find our work to bring together all these projects in the gluster-kubernetes project on github.  With support for Storage Classes and Daemon Sets, we have eased the storage setup and dynamic provisioning even further.

Along with  dynamic provisioning, a key requirement in container storage environments is the ability to scale and address a large number of persistent volume claims. To get to this level of scale, Gluster has evolved significantly in the recent 3.10 release. Key features that enable scale include:

  • Brick Multiplexing

  Brick multiplexing introduces the capability of aggregating bricks belonging to several volumes in a single glusterfsd process. This vastly improves the memory footprint of gluster for serving multiple brick directories from the same node. In addition to being a lesser memory hog, a multiplexed brick also consumes far fewer network ports than the non-multiplexed model. In hyperconverged CNS deployments where resources need to be shared between compute and storage, brick multiplexing optimizes gluster to scale to more number of volumes.

 gluster-block provides a management framework for exposing block devices backed by files in a volume through iSCSI. Going forward, we intend using this block interface for scalable RWO persistent volumes. We already have an external provisioner to integrate Kubernetes, Heketi and gluster-block to dynamically provision RWO persistent volumes.

Along with file and block accesses, we have envisioned the need for an Amazon S3 compatible object store in containerized environments. Several applications that are containerized look for ReSTful access to persist data. To address that we recently announced the availability of a gluster-object container that enables accessing a gluster volume through S3 APIs.

We are excited about these innovations in file, block and object accesses of Gluster to address container storage needs. Do let us know if our vision matches your container storage requirements and look forward to more details about our onward journey in the container world here!

 

by on March 15, 2017

Brick Multiplexing in Gluster 3.10

One of the salient features in Gluster 3.10 goes by the rather boring – and slightly opaque – name of brick multiplexing.  To understand what it is, and why it’s a good thing, read on.
(more…)

by on March 1, 2017

FOSDEM 2017 Gluster Talks

This year at FOSDEM, we helped run a Software Defined Storage DevRoom on Sunday, February 5th:

For those who weren’t able to make it, we’ve collected the recordings from the event related to Gluster here.

GlusterD-2.0 – the next generation of GlusterFS management – Kaushal Madappa

https://fosdem.org/2017/schedule/event/glusterd2/

Gluster Features Update – Niels de Vos

https://fosdem.org/2017/schedule/event/cephglustercommunity/

SELinux Support over GlusterFS  – Jiffin Tony Thottan

https://fosdem.org/2017/schedule/event/glusterselinux/  

Hyper-converged, persistent storage for containers with GlusterFS – Jose Rivera, Mohamed Ashiq

https://fosdem.org/2017/schedule/event/glustercontainer/

 

Our overall schedule:

GlusterD-2.0 – The next generation of GlusterFS management Kaushal Madappa
Introduction to Ceph cloud object storage Orit Wasserman
Storage overloaded to smoke? Legolize with LizardFS! Michal Bielicki
Gluster Features Overview,  Niels de Vos
Ceph Community Update Patrick McGarry
Evaluating NVMe drives for accelerating HBase, NVM HBase acceleration Nicolas Poggi
Ceph USB Storage Gateway David Disseldorp
Ceph and Storage management with openATTIC Lenz Grimmer
SELinux Support over GlusterFS Jiffin Tony Thottan
Deploying Ceph Clusters with Salt Jan Fajerski
Hyper-converged, persistent storage for containers with GlusterFS  – Jose Rivera, Mohamed Ashiq
Ceph weather report Orit Wasserman

https://fosdem.org/2017/schedule/track/software_defined_storage/