Data sizes, a taxonomy:

  • Tape backup facility
  • Spark + Parquet cluster
  • Fits on disk
  • Fits in memory
  • Just use a list