Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Migration timings on Alhena

Shell-transcripts below

Timing the shardmigrator (A4)

[fedora@alhena bin]$ time ./uuidExtractorForProgramObjects.sh extractedUuids
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 17500 0 17500 0 0 16610 0 --:--:-- 0:00:01 --:--:-- 16634

real 0m1.150s
user 0m0.007s
sys 0m0.006s
[fedora@alhena bin]$

...

[fedora@alhena bin]$ time ./shardmigrator.sh extractedUuids shardmigrator.properties
...
real 4m18.102s
user 0m37.013s
sys 0m4.877s
[fedora@alhena bin]$

Timing the file-object-creation aka "register files" (A1)

[fedora@alhena fileobjectcreator-0.0.1-SNAPSHOT]$ time cat ../md5sv2 | bin/fileobjectcreator.sh

...

real 660m7.330s
user 144m45.022s
sys 35m28.446s


[fedora@alhena fileobjectcreator-0.0.1-SNAPSHOT]$ wc -l fileobjectcreator_*
66 fileobjectcreator_existing-uuids
13 fileobjectcreator_failed-files
18357 fileobjectcreator_ffprobe-errors
147933 fileobjectcreator_ignored-files
135235 fileobjectcreator_new-uuids
135235 fileobjectcreator_successful-files
436839 total
[fedora@alhena fileobjectcreator-0.0.1-SNAPSHOT]$

Timing the file-migrator (A3+A6)