refactor: remove H5 storage backend in favor of mmap bin

- Remove H5Store, H5Writer, save_h5/load_h5 and h5py dependency
- MmapStore (bin) is the sole pre-tokenized storage backend
- Move setup_logging after imports to fix E402 in __init__.py
- Clean up unused imports across test files
- Move inline test imports to file top

This commit is contained in:

ViperEkura

2026-07-29 12:50:27 +08:00

parent c2b04d8458

commit 115192c67c

17 changed files with 91 additions and 209 deletions

									
										tests/trainer/conftest.py
									
		-2
	
												View File
												
				@@ -1,5 +1,3 @@

				import os

				import pytest

				import torch