Repository navigation
Performance degradation in 2.1.3 #605
Description
Activity
- added a commit that references this issue
on Mar 8, 2017 - added 2 commits that reference this issue
on Mar 8, 2017 - added 2 commits that reference this issue
on Mar 9, 2017 - added a commit that references this issue
on Mar 13, 2017 It's worth noting that most objects in python are freed by use of
reference counting,Actually all objects were freed on ref-counting, till Python-3.5; since 3.5 that is not the case.
They are freed later, by a GC thread (I guess).
You rarely get to notice that in Linux - you can still delete files that are open.
But you bump into this every time you create a temp-file/folder on Windows, and then try to clean it up, because dead but non-GCed objects still prevent files from deleting.Now, the "correct" way is to use WeakRef finalizers.
You can see all efforts into these issues by searching fortag.leaks.Any improvement would be gladly accepted.
I expect all TCs to remain the same, it should be fine.
- added a commit that references this issue
on Apr 26, 2017 - added a commit that references this issue
on May 22, 2017
Hi,
The recent commit f1a82e4 has caused a significant performance
degradation in the use of GitPython. As an example, one unit
test that we have which performs operations on about 42
repositories normally runs in 6.7 seconds, but with the two new
gc.collect() calls in f1a82e4 it now takes 24.2 seconds.
The gitdb.util.mman.collect() call does not seem to be expensive,
only gc.collect().
It's worth noting that most objects in python are freed by use of
reference counting, while gc.collect() invokes the garbage
collector, which is only needed to free objects with reference
cycles. Normally, the garbage collector runs periodically and
does not need to be explicitly invoked.
Since the garbage collector should only be effective on objects
which no longer have references from active frames, it's not
clear why these two calls to gc.collect() are required. It would
be nice to know if there are any other ways to address what they
are attempting to fix. If they truly are required in some
circumstances, it would be good to know what those are and if
there are cases where we do not need to invoke the expense. And
if they are not required, we should remove them.
Thanks!