WinPython 3.3 analysis doesn't complete


WD, WinPython 32-bit manually added as a custom interpreter. Environments window always shows "Completion DB needs refresh", with the following tooltip:
Database at C:\Users\pminaev\AppData\Local\Python Tools\CompletionDB\12.0\44b4a553-2e7d-4841-beb5-a76da90505b3\3.3 does not contain the following modules:
Here's the warnings/errors from the analysis log:
2014-03-20T10:30:12: Parsing "win32comext.adsi.demos.scp" ("C:\WinPython-32bit-\python-3.3.3\Lib\site-packages\win32comext\adsi\demos\scp.py")
2014-03-20T10:30:12: [WARNING] File "C:\WinPython-32bit-\python-3.3.3\Lib\site-packages\win32comext\adsi\demos\scp.py" contained parse errors
2014-03-20T10:30:12: (1,1) - (35,4) 'unicodeescape' codec can't decode bytes in position 486: truncated \uXXXX escape
2014-03-20T10:30:13: Parsing "win32comext.mapi.demos.mapisend" ("C:\WinPython-32bit-\python-3.3.3\Lib\site-packages\win32comext\mapi\demos\mapisend.py")
2014-03-20T10:30:13: [WARNING] File "C:\WinPython-32bit-\python-3.3.3\Lib\site-packages\win32comext\mapi\demos\mapisend.py" contained parse errors
2014-03-20T10:30:13: (14,19) - (14,23) can't assign to literal
(14,32) - (14,37) can't assign to literal


Zooba wrote Mar 20 at 6:02 PM

I suspect the more relevant part of the log reads something like this:
2014-02-10T20:26:49: Scraping win32comext.ifilter.ifilter
2014-02-10T20:26:49: Command: D:\WinPython3332_x86\python-3.3.3\python.exe D:\AnalysisTesting\ExtensionScraper.py scrape win32comext.ifilter.ifilter D:\WinPython3332_x86\python-3.3.3\Lib\site-packages D:\AnalysisTesting\Out\WinPython3332_x86\DB\site-packages_win32comext\win32comext.ifilter.ifilter
2014-02-10T20:26:49: environ['Path'] = C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;D:\WinPython3332_x86\python-3.3.3
2014-02-10T20:26:49: [ERROR] Failed to scrape win32comext.ifilter.ifilter (Exit code: -1073741819)
I'm not sure what that error code means, but apparently ifilter can't be imported. Can you try importing it from python.exe?

Zooba wrote Mar 20 at 6:10 PM

We need to add a check to PyLibAnalyzer after running ExtensionScraper.py to create the .idb if the scraper crashed so badly that it didn't make the default one (-1073741819 == 0xC0000005 == AV).

We also need to figure out what dependencies ifilter/propsys have that we aren't passing through. WinPython seems to include extra paths in sys.path and possibly os.environ['PATH'] that we probably aren't using when running the scraper, but these ought to be picked up anyway, since we are running the actual python.exe.