On 2021-06-16 1:33 p.m., Richard Purdie wrote:
[Please note: This e-mail is from an EXTERNAL e-mail address]
On Wed, 2021-06-16 at 04:43 -0400, sakib.sajal@... wrote:
summarize_top_output.py is used to summarize the top
output that is captured during autobuilder intermittent
failures.
Use the script to summarize the host top output and
publish the summary that is created instead of
the raw logfile.
[...]
if jcfg:
diff --git a/scripts/summarize_top_output.py b/scripts/summarize_top_output.py
new file mode 100755
index 0000000..0606a34
--- /dev/null
+++ b/scripts/summarize_top_output.py
@@ -0,0 +1,132 @@
+#!/usr/bin/env python3
+
+import os, sys, glob
+
+# constants
+top_header = 7
+top_summary = 5
+max_cols = 11
+
+# string substitution to make things easier to read
+subs = {
+ "/home/pokybuild/yocto-worker/" : "~/",
+ "/build/build/tmp/work/core2-32-poky-linux/" : "/.../POKY_32/.../",
+ "/build/build/tmp/work/core2-64-poky-linux/" : "/.../POKY_64/.../",
+ "/recipe-sysroot-native/usr/bin/x86_64-poky-linux/../../libexec/x86_64-poky-linux/gcc/x86_64-poky-linux/" : "/...GCC.../"
+}
One quick question - the above assumes an x86 target machine using those two tunes.
Should that be wildcarded?
Cheers,
Richard
Yes it should be. We've looked at a number of logs and I will send a V2 with wild-carding for the cross-compiler paths.
After the V2, I plan on submitting patches for the following in roughly the presented order:
1) any process that is listed once (singleton) is not reported in the summary, but we are planning to make exceptions for "special" commands such as "rm" and "tar"
2) i noticed some zombie processes and it might be worthwhile to report them. Right now they are not indicated in the summary. Should we report all zombies or ignore the singletons?
For example I'd collapse [Parser-31], [Parser-32] into [Parser-N]
3) It would be nice to specify other builds going on and the top level directory
4) currently top does not show PPID, should we include the information in the output? This is useful for more context in the raw logfile.
5) show top 5 or 10 virtual memory users
From the yp-ab index page, there are no logs for arm host. I will run a build and make sure the script work well there as well.
Any ideas on why the arm host builds are not being shown on the index page?
Sakib
