Is the idea really an utter madness? Majority of regular files that may be of interest from the perspective of UFS aren't reflinked or snapshotted (let alone the lack of support from ext4 or f2fs).
Device-side fragmentation is a real issue [1] and it makes more than enough sense to defrag LBAs of interests to improve performance. This was long overdue, unless the block interface itself changes somehow.
The question is how to implement it correctly without creating a mess with mismatched/outdated LBAs as you've mentioned, preferably through file-system's integration: If the LBAs in questions are indeed reflinked, how do we handle it?, If the LBAs are moved/invalidated from defrag or GC, how do we make sure that UFS is up-to-date?, etc.