ansaurus

Question

I have a very long and repetitive python path, where do I look to correct this?

Answer 1

+1 A:

There are probably some files with extension .pth presumably in site-packages that add things to sys.path. This would explain (and let you fix) everything except the repetitions, which your site.py should actually eliminate (did you perhaps change site.py? Nobody ever does or should, but ...

If site.py is unbroken, the only explanation is that some other code running after site.py is doing a sys.path.append in a too-enthusiastic loop. "grepping" might help find the culprit. Until you do, a simple bandaid on the wound is to run a simple "uniquifier" as soon as you can to remove the duplicates:

  done = set()
  newp = []
  for p in sys.path:
    if p in done: continue
    newp.append(p)
    done.add(p)
  sys.path = newp

Alex Martelli 2010-05-27 00:53:20

yes you are right. In site-packages there are .pth files that add stuff like:import sys,new,os; p = os.path.join(sys._getframe(1).f_locals['sitedir'], *('paste',)); ie = os.path.exists(os.path.join(p,'__init__.py')); m = not ie and sys.modules.setdefault('paste',new.module('paste')); mp = (m or []) and m.__dict__.setdefault('__path__',[]); (p not in mp) and mp.append(p)Is it safe to take all that off without breaking anything else?

ninja123 2010-05-27 00:57:50

Alex Martelli 2010-05-27 01:01:08

Yea, i figured the stuff in .pth is not what is adding the repetitions. Its some code in site.py that is messed up. How can I get a fresh copy of site.py?

ninja123 2010-05-27 01:10:33

Alex Martelli 2010-05-27 04:37:36

You are right, the problem is with code after site.py. I have tried everything I could but couldn't resolve the issue. You said "grepping" might help to find the culprit. How would I go about doing that? Thanks for your help.

ninja123 2010-05-27 06:26:12

Actually putting your four lines of code into site-packages/site.py now solves the problem. I am wondering why there aren't already any measures to avoid repeated modules from loading into sys.path?

ninja123 2010-05-27 07:36:07

@ninja, there _are_ -- see function `removeduppaths` in site.py (it's called right at the start of site's `main` function). Mystery is, why doesn't it get executed in your case! Anyway, `grep`ping means searching for strings and regular expressions inside text files with the good old Unix command `grep` ("Global Regular Expression Print") or by extension with any other similar engine, editor, etc.

Alex Martelli 2010-05-27 14:18:34

ansaurus

tags:

views:

answers:

I have a very long and repetitive python path, where do I look to correct this?

related questions