A memory efficient implementation of the .mtx reading function

[gjeuken]

• Closes #
• Tests included or not required because: test_datasets.py already implemented

• Release notes not necessary because: This is a backend change

Pandas read_csv function is very memory intensive, and this makes loading data (especially large datasets from EBI Single Cell Expression Atlas) impossible on computers with 16gb of ram or less. The subsequent analysis of such datasets with scanpy, however, works well on such computers.

Loading the data into chunks, using the same pandas function, solves this problem.

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 76.50%. Comparing base (7131500) to head (fa91b73).

Additional details and impacted files

@@           Coverage Diff           @@
##             main    #3389   +/-   ##
=======================================
  Coverage   76.50%   76.50%           
=======================================
  Files         111      111           
  Lines       12874    12877    +3     
=======================================
+ Hits         9849     9852    +3     
  Misses       3025     3025           

Files with missing lines	Coverage Δ
src/scanpy/datasets/_ebi_expression_atlas.py	94.18% <100.00%> (+0.21%)	⬆️