This page will contain the activity log of the pyFF+ experiments and endeavours.
Memory usage investigation
from guppy import hpy import code hp=hpy() ... hp.setrelheap() ... # just print the heap somewhere:h = hp.heap() log.debug(f"\nheapy: {h}") # or possibly interrupt the code execution and inspect the hp object: code.interact(local=dict(globals(), **locals()))
Un/Pickling etree.ElementTree object
# Create pickled datafile source = open("edugain.xml", "r", encoding="utf-8") sink = open("edugain.pkl", "w") t = objectify.parse(source) p = pickle.dumps(t).decode('latin1') sink.write(p) # Read pickled object back in pyFF def parse_xml return pickle.loads(io.encode('latin1')) In metadata parser: t = parse_xml(content) #Instead of parse_xml(unicode_stream(content))