Memory errors
When running python run.py -m fit -o ./sign0.h5
on B4.002
I got a memory error:
Traceback (most recent call last):
File "run.py", line 164, in <module>
main(sys.argv[1:])
File "run.py", line 161, in main
args.models_path, dataset.discrete, features)
File "/aloy/home/mduran/myscripts/chemical_checker/package/chemicalchecker/util/preprocess/script.py", line 54, in save_output
raws = np.zeros((len(keys), len(orderwords)), dtype=np.int8)
MemoryError
We need to think of ways of not having to load full matrices into memory.