Migration timings on Alhena

Shell-transcripts below

Timing the shardmigrator (A4)

[fedora@alhena bin]$ time ./uuidExtractorForProgramObjects.sh extractedUuids
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 17500 0 17500 0 0 16610 0 --:--:-- 0:00:01 --:--:-- 16634

real 0m1.150s
user 0m0.007s
sys 0m0.006s
[fedora@alhena bin]$

[fedora@alhena resources]$ head extractedUuids
uuid:81ae8e7f-e58c-4ac2-a350-6f15cf65b5a4
uuid:8bbac0e8-bf91-470c-aea5-b397294dfcbb
uuid:fa3295ae-615d-42fe-82c7-c4914f37ef37
uuid:de2f7e16-4b7e-40fe-9fa0-bbbfd654098a
uuid:36f030be-da6c-49c7-99c7-a8916137cc49
uuid:3351c57d-a338-4873-9e32-39e3b37aa021
uuid:5ae7177d-80b9-49cb-8bf6-7dcab60e1805
uuid:a8fab742-ec90-4ead-b94d-c47167eda5fc
uuid:64a1daec-0cfe-48c7-9ccf-4585fc3781e7
uuid:e0bf9c80-9986-46a7-912c-9eee4f5cf462

[fedora@alhena resources]$ wc extractedUuids
324 324 13608 extractedUuids
[fedora@alhena resources]$

[fedora@alhena bin]$ time ./shardmigrator.sh extractedUuids shardmigrator.properties
...
real 4m18.102s
user 0m37.013s
sys 0m4.877s
[fedora@alhena bin]$

Timing the file-object-creation aka "register files" (A1)

[fedora@alhena fileobjectcreator-0.0.1-SNAPSHOT]$ time cat ../md5sv2 | bin/fileobjectcreator.sh

...

real 660m7.330s
user 144m45.022s
sys 35m28.446s

[fedora@alhena fileobjectcreator-0.0.1-SNAPSHOT]$ wc -l fileobjectcreator_*
66 fileobjectcreator_existing-uuids
13 fileobjectcreator_failed-files
18357 fileobjectcreator_ffprobe-errors
147933 fileobjectcreator_ignored-files
135235 fileobjectcreator_new-uuids
135235 fileobjectcreator_successful-files
436839 total
[fedora@alhena fileobjectcreator-0.0.1-SNAPSHOT]$

Timing the file-migrator (A3+A6)

[fedora@alhena fileenricher-0.0.1-SNAPSHOT]$ time bin/uuidExtractor.sh > uuids
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 7135k 0 7135k 0 0 1042k 0 --:--:-- 0:00:06 --:--:-- 1859k

real 0m6.946s
user 0m0.520s
sys 0m0.046s

[fedora@alhena fileenricher-0.0.1-SNAPSHOT]$ wc -l uuids
135301 uuids

[fedora@alhena fileenricher-0.0.1-SNAPSHOT]$ time cat ../md5sv2 | bin/fileenricher.sh uuids

real 1616m55.670s
user 29m35.541s
sys 3m17.524s

[fedora@alhena fileenricher-0.0.1-SNAPSHOT]$ wc -l *uuid*
16288 failure_uuids.txt
135082 success_uuids.txt
135301 uuids
286671 total
[fedora@alhena fileenricher-0.0.1-SNAPSHOT]$