Gluster Release 11.0 - Planned Feature list

[msaju]

This issue is intended to receive updates for all the enhancements/improvements being proposed to be included in release 11.0

Approx Release Deadlines:
Code Freeze: 31-Oct-2022
RC : 30-Nov-2022
GA : 10-JAN-2023

• Unified performance xlator [RFE] Unified performance xlator [RFE] Unified performance xlator #218
• Implement an I/O framework Implement an I/O framework #2123 (comment)
• Changelog Enhancements: Add identifier while recording internal traffic in Changelog Add identifier while recording internal traffic in Changelog #638

[amarts]

• Simple-Quota Simple quota: based on namespace #1750
• ZFS Snaphosts snapshots: Support for ZFS Snapshots #2855

[mykaul]

Cleanups: (TBD - list of cleanup items that v11 is a good release to get them into, such as header files cleanup, removal of 3.x protocol, old authentication scheme and more - will edit as they get ack'ed):

• Cleanup common include files #3137
• Reduce the number of #include statements and code #3130
• Remove old authentication schemes #2998
• AFR: reduce variable indirection #2986
• Make relevant functions static #2967
• Release 11: remove 'GlusterFS 3.3' RPC code #2898
• rpc/xdr: removed old version of glusterfs3 #3165
• rpc clnt - cleanups #3146
• rpc: cleanup data structures once again #3291
• glusterd: cleanup data structures once again #3139
• xlators: use common GF_UUID_BUF_SIZE #3135
• call-stub.c: do not unconditionally set errno #2980
• server-helpers.c: streamline get_frame_from_request() function #2872
• multiple files: remove the stub pool #2965
• dht: Remove dead code function dht_nonblocking_inodelk #3298
• libglusterfs: cleanup iobufs #3272
• dict.c/h: remove hash code #3383
• client-cbk: remove multiple calls to 'THIS' #3464
• posix-handle: remove posix_handle_unset() and call posix_handle_unset… #3460
• dht-lock.c: readability improvements #3292
• posix-acl*: remove unused variables, move functions to static #3658
• Multiple files: clean glusterd_is_local_brick() #3765
• Small dictionary code improvements #3764
• Additional #ifdef if gNFS is not compiled #3763
• mem-pool.c: remove redundant calls to 'THIS' #3723
• bit-rot: remove unused iatt variable #3713
• refactor logging.c - remove 'THIS' where possible, use 'log instead of 'ctx' where possible #3451
• Multiple files: clean glusterd_is_local_brick() #3765
• fd_ctx_get() and fd_ctx_del() should just return the value #3730
• ec-common, helpers: minor cleanups #3777
• syncop functions: no need to copy iatt structs if you are not going t… #3712
• dht-hashfn.c: remove strcpy() from DHT calculation #3788
• posix-pstat() - delay gfid copying to after lstat() succeeded #3789
• Mem types changes #3852
• client_t: improve client get/set/del functions #3874
• memory accounting - reduce code in non DEBUG build #3854

[mykaul]

readdir/readdirp improvements: go over all the callbacks and see what we can improve in the loop that goes over all entries.
Examples include:

• shard.c: improve readdir(p) a bit #3151
• multiple files: improve gf_dirent_for_name() functionality #3008
• afr: readdir(p) improvements #3150
• readdir-ahead.c: few improvements #3295
• Upcall minor improvements #3318
• gf_dirent_for_name2() - copy an existing iatt struct if such exists #3538
• multiple files: unify and improve the check for . and .. entries #3680
• client-helpers.c/server-helpers.c: move to MALLOC instead of CALLOC i… #3325
• index.c: skip some strcmp() in case entry length is short enough. #3843
• posix-inode-fd-ops.c: perform __is_root_gfid() check once #3844
• fuse_readdirp_cbk() - minor modifications #3846
  And I hope to find others.

[mykaul]

OS support:

• CentOS (and Enterprise Linux) 7.x deprecation

[mykaul]

event-epoll improvements:

• event-epoll.c: create the 1st table on event epoll creation #3283
• [event-epoll.c] Check for slots in next table if all slots are used #3268
• Events: make structures more memory friendly #3041
• event-epoll.c: do not CALLOC a whole table #3285

[mykaul]

cdc-xlator improvements:

• Zstandard compression support (replacing zlib, if libzstd is available on compile-time) #3841
• cdc-helper: move the CRC and len (gzip trailer to the 1st iovec - and… #3835
• cdc xlator improvements #3802

[mykaul]

Reduce separate allocation for some variables in a structure - allows locality and less calls to alloc and free code.

• epoll - allocate table 0 as part of the event pool allocation #3862
• io-stats.c: allocate io sample struct samples and buffer in a single … #3858
• inode.c/h: use flexible array member for inode _ctx struct #3859
• syncop: use flexible array for synctask's stack (allocate along the t… #3861
• iobuf: allocate iobuf arrays along with the arena itself #3857
• Make client_uid variable a flexible array member of client structure - and allocate / deallocate together #3865
• iobuf: allocate/deallocate the ptr/freeptr along with the iobuf… #3868
• Use a flexible array member for data pair key #3870
• glfs-fops: turn gio->iov to a flexible array member (for read and wri… #3872
• inode.c: dentry->name is now a flexible array member instead of a poi… #3873

[amarts]

• volfile-server as a xlator #3635

[mohit84]

• Optimize index xlator code path to improve performance #3669

[kmoore134]

Hello! Checking in if there is any movement or ETA on the release. We're trying to see when this may land in Debian packages and we can pull into TrueNAS SCALE.