progress - to monitor progress of commands

Issues related to applications and software problems
robertw
Posts: 131
Joined: 2012/04/25 13:26:59

progress - to monitor progress of commands

Postby robertw » 2017/09/13 14:07:26

hi all,

i have found a really good command that monitors the progress of a bunch of commands, its here -

https://github.com/Xfennec/progress

once installed you can run this command -

cp -r /mnt/local/data/call_the_midwife_7_1708/ /mnt/local/data/new/

then open a new terminal and run this command -

watch -n 0.5 progress -w

this will give you this -

Every 0.5s: progress -w Wed Sep 13 15:05:16 2017

[12254] cp /mnt/local/data/call_the_midwife_7_1708/Promo/grading_output/for_approval/170818_ctm_7_mipcom_graded_1-1_10bit_422_ycc_f2l_bl_or/192
0x1080/170818_ctm_7_mipcom_graded_1-1_10bit_422_ycc_f2l_bl_or_V1.mxf
19.6% (2.3 GiB / 11.9 GiB) 27.4 MiB/s remaining 0:05:55

has anyone heard of this

but this gives you details of individual files being copied over, i need something that can give me the ETA and percent of the whole directory copied over and not just individual files?

rob

User avatar
jlehtone
Posts: 1798
Joined: 2007/12/11 08:17:33
Location: Finland

Re: progress - to monitor progress of commands

Postby jlehtone » 2017/09/14 06:12:34

Code: Select all

rsync -a --progress /mnt/local/data/call_the_midwife_7_1708/ /mnt/local/data/new/

does show something more, but watching that output should make it clear that ETA and percentage are far from trivial.

robertw
Posts: 131
Joined: 2012/04/25 13:26:59

Re: progress - to monitor progress of commands

Postby robertw » 2017/09/14 11:47:13

mmm...

got me thinking can i use the command pv and progress together to get the total ETA/percent of the whole directory instead of an ETA/percent of each individual file in the directory?

robertw
Posts: 131
Joined: 2012/04/25 13:26:59

Re: progress - to monitor progress of commands

Postby robertw » 2017/09/15 15:38:21

smashed it -

[root@robw-linux data]# tar -c call_the_midwife_7_1708/ | pv -lep -s 32455212 | tar -x -C /mnt/local/data/new/
[=> ] 2% ETA 2:34:31

and to find the dir size i did -

du -s call_the_midwife_7_1708/

but doing it via this method takes ages as its creating the tar and extracting the tar, normally doing a normal copy only takes roughly 18 minutes


Return to “CentOS 7 - Software Support”

Who is online

Users browsing this forum: lightman47 and 6 guests