all posts tagged Community
Lots of people at Vault this week!
Last month’s newsletter included a list of all of the Gluster related talks, so if you’re here, come by the Red Hat booth and say hi!
3.7.11 Released: https://www.gluster.org/pipermail/gluster-devel/2016-April/049155.html
We’ve got a new Events (https://www.gluster.org/events/) page to replace the publicpad.
(https://public.pad.fsfe.org/p/gluster-events) – Feel free to add a PR updating the markdown page with your event!
Highlights from this past month’s mailing lists:
Taira Hajime announced the general availability of Glubix 1.4 with support for Zabbix Server 3.0.
Rajesh suggested using “–mode=script” option in order to enable non interactive use of gluster snapshot delete.
The 3.7.10 release continued to create conversations on the list.
Raghavendra Talur picked up a conversation thread on GlusterFS on HPC cluster as this has been requested earlier
Atin discussed the topic of brick port allocation by GlusterD and proposed a patch which adopts an approach similar to snapd.
With the 3.8 release process being more firm about the need to have well written features pages, there appear to be a subset of features which are now “at risk”. While 30 Apr is the date by which this needs to be completed, both Niels and Amye urge feature owners to work on squaring things away.
Jiffin reminded the feature owners about adding tests to the DiSTAF. With the framework having additional maintainers and more active development, inclusion of test cases by 30Apr is a requirement for consideration of 3.8 release feature completion.
The location of the DiSTAF tests received a fair amount of conversation intending to ensure that helper libraries and tests are appropriately located to help packaging and wider adoption of the framework itself.
Karthik Subrahmanya provided an update on his work on the WORM feature.
Kaushal provided additional context around the 3.7.10 release, mentioning in detail the regression (which was also present in 3.7.9)
Vijay had asked for additional detail about coherence issues in context of the SELinux client support in GlusterFS design. which Manikandan had put up for review. Manikandan explained that the work continues on invalidating the xattrs through the Upcall Infrastructure which would handle the coherence issues.
Quota Enhancements is a design document posted by Manikandan intended to improve the quota enable/disable processes. A patch is also under review.
Amye announced the week of 28Mar would have the Jenkins infrastructure moved from iWeb hosting to Red Hat’s data centers. Since this has potential impact on 3.7.10 release, the announcement was intended to seek agreement and make the necessary changes. Michael Scherer reported back that the migration was completed without hassles.
Niels alerted the maintainers about not merging patches with topic ‘rfc’ in Gerrit. He mentioned that without a bug to track the changes it is difficult to build a query which lists all the changes against the particular feature.
Atin’s note about a regression around GlusterD failing to restart when volume has snapshots spawned an entire thread to the feasibility of the 3.7.10 release. Subsequently, a decision was arrived at to work towards a 3.7.11 addresses this topic. More at 3.7.10 known issue.
Small kerfuffle around a recent change which caused failures to build artifacts was discussed – the issue arose from the failures being not reported back to gerrit. Since the report, it has been addressed and things are back to normal.
The 3.7 release has not been without drama. Kaushal reported another set of regressions, this time with management encryption enabled, daemons such as NFS etc would not start. This is where the 3.7.11 release dates received some amount of serious consideration and planning.
Pranith’s intent to include the multi-threaded self-heal patch in a 3.7.12 release received a good amount of discussion with Niels highlighting the concern around back-porting this to a 3.7 release because potential undiscovered issues are something which is expected for new features and thus contain a risk.
Gluster Top 5 Contributors in the last 30 days:
Niels de Vos, Vijaykumar M , Pranith Kumar K, Atin Mukherjee, Sakshi Bansal
LISA: April 25th
LinuxCon North America: April 26th
LinuxCon Japan: May 6
LinuxCon Europe: June 17
In November 2015, we did our annual Gluster Community Survey, and we had some great responses and turnout!
We’ve taken some of the highlights and distilled them down for our overall community to review.
Some interesting things:
- 68% of respondents have been using Gluster for less than 2 years.
- 3 shall be the number:The most popular amount of nodes in a cluster is 3
- Top uses for Gluster: 44% Virtual Infrastructure, 42% File Sync and Share, 8% On demand media backup, 6% Backup
- 70% of installations are managing less than 50 terabytes, but 3% are managing over one petabyte!
View our visual followup highlights – Gluster Community Survey Highlights – 2015
Just in time for Halloween, GlusterFS 3.6.0 has been released. The newest release, as you would expect, is full of new features and new elements for stability.
GlusterFS, as you may know, is a general-purpose scale out distributed file system. It aggregates storage exports over network interconnects provide a single unified namespace, is stackable and completely in user space. GlusterFS is layered on disk file systems that support extended attributes.
Some highlights for GlusterFS 3.6.0 include:
- Better SSL support GlusterFS now enables SSL on both management and data connections, designed to provide sufficient security where security is a requirement.
- Erasure coding and
- Erasure coding makes use of the new disperse translator, functionality that performs erasure coding across nodes.
- Volume snapshot
- Volume snapshot provides a point in time copy of a Gluster volume. Since this is an online operation, file system data continues to be available.
- User serviceable snapshots
- With user serviceable snapshots, users can access snapshots of GlusterFS volumes without requiring administrative intervention.
Documentation about major changes and features are also included in the ‘doc/features/` directory of GlusterFS repository.
There are also a number of experimental features in this release of GlusterFS 3.6.0. These include support for rdma volumes, support for NUFA translator, disk encryption and on wire compression and decompression.
More information can be found in the release notes and information on upgrading to the new release can be found here.
GlusterFS 3.6 continues the driving concept for Gluster, namely that storage should be simple. Kudos to the contributors and community members who together made this release more stable, more performance and more production ready.
So, take a look at the GlusterFS 3.60 release and get ready to help create the next great version of GlusterFS.
What’s that bug worth?
One of the values of open source and open development is the impact of Community involvement. That involvement takes many forms, code development, innovation and evangelism, guidance for new users and solutions and identifying bugs.
Finding and fixing problems in existing code is incredibly valuable in building production ready systems. And the process of setting bug priorities (bug triage) is equally important.
The bug discussion meeting is where we all screen and prioritize tracker issues. This should help ensure we are managing all reported issues, bugs as well as feature requests.
And like most things in open development and open source, it’s better when we are all actively involved.
With that in mind, we’d like to make sure you’re aware of the upcoming Gluster bug prioritization meeting on Tuesday, October 14, 2014, at 12:00 UTC. (You can find your time with the World Clock)
This meeting will take place, on the Freenode IRC, channel #gluster-meeting, at 12:00 UTC. The last one was quite helpful and it’s clear that these meetings should continue.
The current information on the upcoming meeting can be found on the public Etherpad. Note, Item 4, propose your chosen bugs for discussion and Item 5, propose your own topics of interest.
We’ll be reminding you of this upcoming meeting through a couple of channels. And we hope to see you there.
When: Tuesday, October 14th, 2014, 12:00 UTC
Where: Freenode IRC channel #gluster-meeting
Diversity is important to communities. Diversity adds new ideas, new concepts, innovative approaches and unique values. Open source thrives on those same things, and open source communities need to recognize and strive to increase their own diversity.
Today, I’d like to share “A Challenge to the Open Storage Community” from Sage Weil. Sage is talking specifically about the Ada Initiative, who is one of the organizations directly addressing gender diversity including a specific focus on open source and open data. Sage is offering to match the community dollar for dollar should we, the open storage community, raise $8192 for them.
Sage brings out incredibly relevant points about diverse organizations and being inclusive of all. In his own words:
“Research, experience, and common sense have demonstrated that diverse communities perform better: they are more dynamic, they generate better ideas, and they are more pleasant to be a part of. On the gender axis, however, most open source communities–including storage–are extremely homogeneous, with far less than 10% participation from women. It surprised me to learn that this is significantly lower than software engineering in general, where you find women make up about 30% of the community.”
With GlusterFS as a significant part of the open storage communities, I’d like to see us also work to meet this challenge and to extend our own diversity to all.
Sages full blog is here: http://ceph.com/community/support-ada-initiative-challenge-open-storage-community/
The donation link is here: https://adainitiative.org/donate/?campaign=storage
The Ada Initiative can be found here: https://adainitiative.org/
All good things must come to an end. I can say with no equivocation that the last three years have been the most rewarding from a work perspective than any other job I’ve ever had. When I accepted this challenge in May, 2011, I had no idea that the project and community would blossom as they have. I had no idea how many great people were already in place to push this project to the forefront of open source development. I had no idea how many great partners we would find who share our vision for open source storage. I also, of course, didn’t know that Gluster, Inc. would be acquired within months of my arrival, which drastically increased the velocity of the project and community. I didn’t know any of that – what I did know was that there was a pretty cool project called GlusterFS and it seemed like the way forward for storage.
After we were acquired, we knew there would be a bit of angst from the community about whether we would still actively support other distributions outside of the Red Hat arena. I’m proud to say that we have done that, with active contributions from various community members for Ubuntu, Debian, NetBSD and OpenSUSE builds. We always strove to make gluster.org a truly open community and, in some respects, “bigger than Red Hat.”
Along the way, we created a board consisting of active community members and organizations. We made the project more transparent and active than ever. We greatly increased the degree that the community is a collaborative experience beyond just the immediate development team. And we greatly increased the reach and scope of the open source storage ecosystem. I can look back and feel privileged to have worked with such amazing visionaries, developers and community evangelists.
Now it’s time to turn the Gluster community over to someone who can build on what we’ve done and take it even further. I’m staying at Red Hat but moving on to other projects and communities. The ideal candidate should know their way around open source projects and communities, should have an unyielding desire to push things beyond the status quo, should know a thing or two about business strategy, and should understand how to identify which organizations should invest in a community and sell them on the vision. As I’ve mentioned before, today’s community leaders are the equivalent of startup executives, having to mesh together product management and marketing, business development and strategy, sales and messaging into a cohesive whole.
Are you the next Gluster Community Leader? Drop me a line on IRC – I’m “johnmark” on the Freenode network.
If you saw our Gluster Spotlight (“Integration Nation”) last week, you’ll recall that Javi and Jaime from the OpenNebula project were discussing their recent advances with GlusterFS and libgfapi access. Here’s a post where they go into some detail about it:
The good news is that for some time now qemu and libvirt have native support for GlusterFS. This makes possible for VMs running from images stored in Gluster to talk directly with its servers making the IO much faster.
In this case, they use GFAPI for direct virtual machine access in addition to the FUSE-based GlusterFS client mount for image registration as an example of using the best tool for a particular job. As they explain, OpenNebula administrators expect a mounted, POSIX filesystem for many operations, so the FUSE-based mount fits best with their workflow while GFAPI works when lower latency and better performance are called for.
Read the full post here.
The GFAPI integration is slated for the 4.6 release of OpenNebula. To get an early look at the code, check out their Git repository. Documentation is available here.
This week’s spotlight will be all about software integrated with storage services. GFAPI has opened the floodgates for this type of integration with GlusterFS. In this spotlight, we’ll hear from people who have been actively working on integrations with Apache CloudStack, Pydio, and OpenNebula.
Hear about how they integrated with GlusterFS and they would suggest to others who wish to deploy any application stack with scale-out storage requirements.
As usual, you can request to be part of the live hangout, or follow along on YouTube. Q&A will be managed from the IRC channel #gluster-meeting.
Join us on March 4 for the Gluster Community seminar and learn how to improve your storage.
This half day seminar brings you in-depth presentations, use cases, demos and developer content presented by Gluster Community experts.
Register today for this free half-day seminar and reserve your seat since spaces are limited. Click here to register.
We look forward to meeting you on March 4th!
13:30 – 13:45 Registration
13:45 – 14:15 The State of the Gluster Community
14:15 – 15:30 GlusterFS for SysAdmins, Niels de Vos, Red Hat
15:30 – 15:45 Break
15:45 – 16:30 Adventures in Cloud Storage with OpenStack and GlusterFS
Tycho Klitsee (Technical Consultant and Co-owner) of Kratz Business Solutions
16:30 – 17:15 Gluster Forge Demos, Fred van Zwieten, Technical Engineer, VX Company and Marcel Hergaarden, Red Hat
17:15 – 18:00 Networking Drinks
***UPDATE: Due to weather-related flight cancelations and rebooking, we had to push this back to Thursday, January 23, at noon PST/3pm EST/20:00 GMT***
James Shubin is known in the Gluster community for his work on the Puppet-Gluster module.
Recently, he’s begun to create powerful cocktails of Puppet and Vagrant to create recipes for automated Gluster deployments. See, eg.
Building Base Images for Vagrant with a Makefile
Testing GlusterFS During GlusterFest
This will be quite a fun spotlight, and very much worth your while. As usual, join the #gluster-meeting channel on the Freenode IRC network to participate in the live Q&A.
About Gluster Spotlight
Gluster Spotlight is a weekly Q&A show featuring the most exciting movers and shakers in the Gluster Community. If you don’t catch them live, you can always watch the recordings later.