csaf_checker memory consumption

[wagner-intevation]

The memory usage of csaf_checker appears high for domains that contain data. @bernhardreiter suggested there might be a bug in the tool causing the high memory consumption.

Here are two memory analysis graphs generated by mprof:

IIRC both graphs are with gocsaf/csaf version 3.4.0

Test with:

time python3-mprof run /path/to/bin-linux-amd64/csaf_checker redhat.com

[bernhardreiter]

Thanks for the good report!
Am I right in that the latest version 3.5.1 displays the same characteristics?

[wagner-intevation]

Indirectly, by using 3.5.1 in the online checker: yes, same or similar behavior.

You can analyze and visualize memory usage using the commands pasted above.

[bernhardreiter]

Analysis (by @s-l-teichmann and @4echow):
There are two problems:
a) leaking memory for a long term process (needs the same fix as downloader and isduba)
b) parsing the rolie feed consumes too much memory, https://wid.cert-bund.de/.well-known/csaf/white/bsi-wid-white.json is only 39 MiB big, but almost 10 times the memory is needed to place it into the go structure. Afterwards the resulting structure is small again.

[wagner-intevation]

Scanning suse.com with 3.5.1, the maximum consumption is 6.4GB: