fix: support concurrent read/write from same active segment.

[ankur-anand]

Currently, wal.Read supports concurrent reads without data races only when using the exact chunk position, as it assumes that WAL is actively being written.

wal/wal.go

Line 426 in 9f1a618

func (wal *WAL) Read(pos *ChunkPosition) ([]byte, error) {

However, if parallel/concurrent log replay is needed, the active segment modifies certain fields in the segment struct during writes. These same fields are also accessed by reader instances, leading to potential data races:

currentBlockNumber uint32
currentBlockSize   uint32
closed             bool

To enable safe concurrent reads while the WAL is being written, this PR updates these fields to use atomic operations:

currentBlockNumber atomic.Uint32
currentBlockSize   atomic.Uint32
closed             atomic.Bool

By making these changes, the WAL will support parallel log replay from different readers without data races, ensuring consistency and thread safety.

Changes in this PR
• Replaced uint32 and bool fields with their atomic counterparts.
• Ensured all accesses to these fields use atomic operations.

[ankur-anand]

Some of the concurrent race conditions that were observed.

==================
WARNING: DATA RACE
Write at 0x00c00003e978 by goroutine 54:
  github.com/rosedblabs/wal.(*segment).Close()
      /Users/ankur/go/pkg/mod/github.com/rosedblabs/[email protected]/segment.go:172 +0x448
  github.com/rosedblabs/wal.(*WAL).Close()
      /Users/ankur/go/pkg/mod/github.com/rosedblabs/[email protected]/wal.go:442 +0x40c
      
      
Previous read at 0x00c00003e978 by goroutine 80:
  github.com/rosedblabs/wal.(*segmentReader).Next()
      /Users/ankur/go/pkg/mod/github.com/rosedblabs/[email protected]/segment.go:481 +0x48
  github.com/rosedblabs/wal.(*Reader).Next()
      /Users/ankur/go/pkg/mod/github.com/rosedblabs/[email protected]/wal.go:262 +0xb4

==================
WARNING: DATA RACE
Write at 0x00c00003e978 by goroutine 54:
github.com/rosedblabs/wal.(*segment).Close()
   /Users/ankur/go/pkg/mod/github.com/rosedblabs/[email protected]/segment.go:172 +0x448
github.com/rosedblabs/wal.(*WAL).Close()
   /Users/ankur/go/pkg/mod/github.com/rosedblabs/[email protected]/wal.go:442 +0x40c
  
Previous read at 0x00c00003e978 by goroutine 80:
github.com/rosedblabs/wal.(*segmentReader).Next()
   /Users/ankur/go/pkg/mod/github.com/rosedblabs/[email protected]/segment.go:481 +0x48
github.com/rosedblabs/wal.(*Reader).Next()

I agree that the closed variable data race,part will not happen until Wal.Close is called concurrently without Releasing the reader, but should be protected from a data-race condition.

[ankur-anand]

\cc @roseduan

[roseduan]

\cc @roseduan

Thanks, I will recheck this later.