lzma踩坑记

2019-07-24

lzma 是python3.3 之后引入的一个官方压缩库，但是在使用时候发现import error

$ python
Python 3.6.0 (default, Mar 10 2017, 10:08:04)
[GCC 4.2.1 Compatible Apple LLVM 8.0.0 (clang-800.0.42.1)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> import lzma
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/Users/mody/.pyenv/versions/3.6.0/lib/python3.6/lzma.py", line 27, in <module>
    from _lzma import *
ModuleNotFoundError: No module named '_lzma'
>>>

日常机器环境oxs+brew+pyenv，一顿找，发现应该是lib的问题，新版lzma 已经合并到xz库里面，安装xz

1	brew install xz

pyenv 安装个新的 3.5.6版本测试

1	pyenv install 3.5.6

报错：install failed, “zlib not available” on macOS Mojave

1	CFLAGS="-I$(xcrun --show-sdk-path)/usr/include" pyenv install 3.5.6

$pyenv local 3.5.6
$python
Python 3.5.6 (default, Jul 24 2019, 09:55:40)
[GCC 4.2.1 Compatible Apple LLVM 10.0.1 (clang-1001.0.46.4)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> import lzma
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/Users/mody/.pyenv/versions/3.6.0/lib/python3.6/lzma.py", line 27, in <module>
    from _lzma import *
ModuleNotFoundError: No module named '_lzma'
>>>

仍然报错，思考应该python编译的时候依赖库问题

brew 安装的依赖库都会放在/usr/local/homebrew/Cellar/下面

$ ll /usr/local/homebrew/Cellar/xz/5.2.4/include/
total 24
drwxr-xr-x   4 mody  staff   128 Apr 30  2018 ./
drwxr-xr-x  14 mody  staff   448 Jul 23 14:58 ../
drwxr-xr-x  16 mody  staff   512 Apr 30  2018 lzma/
-rw-r--r--   1 mody  staff  9817 Apr 30  2018 lzma.h

通过brew link xz 软连接到/usr/local/homebrew/include/目录下(默认执行)

1
2
3

$ ll /usr/local/homebrew/include/ |grep lzma
lrwxr-xr-x    1 mody  admin    31 Jul 24 09:47 lzma@ -> ../Cellar/xz/5.2.4/include/lzma
lrwxr-xr-x    1 mody  admin    33 Jul 24 09:47 lzma.h@ -> ../Cellar/xz/5.2.4/include/lzma.h

所以

1	CFLAGS="-I$(xcrun --show-sdk-path)/usr/include -I/usr/local/homebrew/include" pyenv install 3.5.5

$pyenv local 3.5.5
$python
Python 3.5.5 (default, Jul 24 2019, 10:22:29)
[GCC 4.2.1 Compatible Apple LLVM 10.0.1 (clang-1001.0.46.4)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> import lzma
>>

成功，反思“定位到是python编译的时候依赖库问题”走了弯路，CFLAGS解决zlib时就应该想到

参考

https://github.com/pyenv/pyenv/issues/1219

20201225

pyenv macOS Big Sur 11.1安装问题，解决方法：

CFLAGS="-I$(brew --prefix openssl)/include -I$(brew --prefix bzip2)/include -I$(brew --prefix readline)/include -I$(xcrun --show-sdk-path)/usr/include" LDFLAGS="-L$(brew --prefix openssl)/lib -L$(brew --prefix readline)/lib -L$(brew --prefix zlib)/lib -L$(brew --prefix bzip2)/lib" pyenv install --patch 2.7.15 < <(curl -sSL https://github.com/python/cpython/commit/8ea6353.patch\?full_index\=1)

参考

https://github.com/pyenv/pyenv/issues/1643