python_notes
Differences
This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revision | ||
python_notes [2020/04/08 14:40] – juckins | python_notes [2023/04/05 08:56] (current) – juckins | ||
---|---|---|---|
Line 1: | Line 1: | ||
- | ==== Python Notes ==== | + | ==== Python |
+ | __5 Apr 2023__ | ||
+ | |||
+ | # python3 -m pip list --outdated | ||
+ | Package | ||
+ | ------------------- --------------- --------------- ----- | ||
+ | chromedriver-binary 110.0.5481.30.0 112.0.5615.28.0 sdist | ||
+ | mypy-extensions | ||
+ | pdf2image | ||
+ | pytesseract | ||
+ | pytz 2022.7.1 | ||
+ | urllib3 | ||
+ | |||
+ | Ran this: | ||
+ | # python3 -m pip install --upgrade < | ||
+ | # find /usr -name " | ||
+ | # chmod 755 / | ||
+ | |||
+ | __11 Jan 2023__ | ||
+ | |||
+ | # python3 -m pip list --outdated | ||
+ | Package | ||
+ | ------------------- --------------- --------------- ----- | ||
+ | certifi | ||
+ | chromedriver-binary 108.0.5359.22.0 109.0.5414.74.0 sdist | ||
+ | dictor | ||
+ | pdf2image | ||
+ | pytesseract | ||
+ | pytz 2022.6 | ||
+ | |||
+ | Upgraded all of the above except for pytesseract. | ||
+ | |||
+ | # find /usr -name " | ||
+ | # chmod 755 / | ||
+ | |||
+ | |||
+ | __30 Nov 2022__ | ||
+ | |||
+ | Upgraded several python packages on physical and virtual servers. | ||
+ | |||
+ | __26 Oct 2022__ | ||
+ | |||
+ | Upgraded several python packages on physical server. | ||
+ | |||
+ | |||
+ | Current list of python modules: | ||
+ | |||
+ | [root@tidewater: | ||
+ | Package | ||
+ | ------------------- --------------- | ||
+ | astral | ||
+ | backports.zoneinfo | ||
+ | black | ||
+ | certifi | ||
+ | chardet | ||
+ | charset-normalizer | ||
+ | chromedriver | ||
+ | chromedriver-binary 107.0.5304.62.0 | ||
+ | click | ||
+ | dataclasses | ||
+ | dictor | ||
+ | idna 3.4 | ||
+ | importlib-metadata | ||
+ | importlib-resources 5.4.0 | ||
+ | mypy-extensions | ||
+ | numpy | ||
+ | pathspec | ||
+ | pdf2image | ||
+ | Pillow | ||
+ | pip | ||
+ | platformdirs | ||
+ | PyMySQL | ||
+ | pytesseract | ||
+ | pytz 2022.5 | ||
+ | requests | ||
+ | selenium | ||
+ | setuptools | ||
+ | tomli | ||
+ | typed-ast | ||
+ | typing_extensions | ||
+ | urllib3 | ||
+ | vboxapi | ||
+ | wget 3.2 | ||
+ | zipp 3.6.0 | ||
+ | |||
+ | |||
+ | __30 Sep 2022__ | ||
+ | |||
+ | Current list of python modules: | ||
+ | |||
+ | [root@tidewater: | ||
+ | Package | ||
+ | ------------------- --------------- | ||
+ | astral | ||
+ | black | ||
+ | certifi | ||
+ | chardet | ||
+ | charset-normalizer | ||
+ | chromedriver | ||
+ | chromedriver-binary 105.0.5195.52.0 | ||
+ | click | ||
+ | dataclasses | ||
+ | dictor | ||
+ | idna 3.4 | ||
+ | importlib-metadata | ||
+ | mypy-extensions | ||
+ | numpy | ||
+ | pathspec | ||
+ | pdf2image | ||
+ | Pillow | ||
+ | pip | ||
+ | platformdirs | ||
+ | PyMySQL | ||
+ | pytesseract | ||
+ | pytz 2022.2.1 | ||
+ | requests | ||
+ | selenium | ||
+ | setuptools | ||
+ | tomli | ||
+ | typed-ast | ||
+ | typing_extensions | ||
+ | urllib3 | ||
+ | vboxapi | ||
+ | wget 3.2 | ||
+ | zipp 3.6.0 | ||
+ | |||
+ | __22 Sep 2022__ | ||
+ | |||
+ | Upgraded several python packages on both physical and virtual servers. | ||
+ | |||
+ | __2 Aug 2022__ | ||
+ | |||
+ | Upgraded several python packages on both physical and virtual servers. | ||
+ | |||
+ | __22 June 2022__ | ||
+ | |||
+ | Upgraded several python packages on both physical and virtual servers. | ||
+ | |||
+ | __26 May 2022__ | ||
+ | |||
+ | Upgraded several python packages on both physical and virtual servers. | ||
+ | |||
+ | __27 Apr 2022__ | ||
+ | |||
+ | Upgraded several python packages on both physical and virtual servers. | ||
+ | |||
+ | __30 Mar 2022__ | ||
+ | |||
+ | Upgraded several python packages on both physical and virtual servers. | ||
+ | |||
+ | __3 Mar 2022__ | ||
+ | |||
+ | Upgraded several python packages on both __physical__ and __virtual__ servers. | ||
+ | |||
+ | [root@tidewater: | ||
+ | Package | ||
+ | ------------------- -------------- -------------- ----- | ||
+ | charset-normalizer | ||
+ | chromedriver-binary 98.0.4758.48.0 99.0.4844.51.0 sdist | ||
+ | numpy | ||
+ | pytesseract | ||
+ | |||
+ | [root@tidewater: | ||
+ | |||
+ | Fix chromedriver-binary permissions: | ||
+ | |||
+ | [root@tidewater: | ||
+ | [root@tidewater: | ||
+ | |||
+ | The virtual server updates included the following: | ||
+ | |||
+ | [root@centos8S-vtatdb2-l: | ||
+ | Package | ||
+ | ------------------ -------- -------- ----- | ||
+ | charset-normalizer 2.0.11 | ||
+ | dbus-python | ||
+ | ethtool | ||
+ | httplib2 | ||
+ | imageio | ||
+ | lxml | ||
+ | ntplib | ||
+ | pycairo | ||
+ | pycups | ||
+ | pycurl | ||
+ | PyGObject | ||
+ | pykickstart | ||
+ | python-augeas | ||
+ | pyudev | ||
+ | simpleline | ||
+ | slip | ||
+ | typing_extensions | ||
+ | |||
+ | |||
+ | __2 Feb 2022__ | ||
+ | |||
+ | Upgraded several python packages on both __physical__ and __virtual__ servers. | ||
+ | |||
+ | [root@tidewater: | ||
+ | Package | ||
+ | ------------------- -------------- -------------- ----- | ||
+ | charset-normalizer | ||
+ | chromedriver-binary 96.0.4664.35.0 98.0.4758.48.0 sdist | ||
+ | dictor | ||
+ | |||
+ | [root@tidewater: | ||
+ | |||
+ | Fix chromedriver-binary permissions: | ||
+ | |||
+ | [root@tidewater: | ||
+ | [root@tidewater: | ||
+ | |||
+ | The virtual server updates included the following: | ||
+ | |||
+ | [root@centos8S-vtatdb2-l: | ||
+ | Package | ||
+ | --------------- ----------- -------- ----- | ||
+ | beautifulsoup4 | ||
+ | blivet | ||
+ | chardet | ||
+ | coverage | ||
+ | cssselect | ||
+ | dasbus | ||
+ | dbus-python | ||
+ | decorator | ||
+ | dictor | ||
+ | dnspython | ||
+ | ethtool | ||
+ | html5lib | ||
+ | httplib2 | ||
+ | humanize | ||
+ | idna 2.5 | ||
+ | iniparse | ||
+ | langtable | ||
+ | lxml 4.2.3 | ||
+ | ntplib | ||
+ | numpy | ||
+ | ordered-set | ||
+ | pexpect | ||
+ | pid | ||
+ | ply | ||
+ | productmd | ||
+ | psutil | ||
+ | ptyprocess | ||
+ | pycairo | ||
+ | pycups | ||
+ | pycurl | ||
+ | PyGObject | ||
+ | pykickstart | ||
+ | pyparsing | ||
+ | PySocks | ||
+ | python-augeas | ||
+ | python-dateutil 2.6.1 | ||
+ | pytz 2017.2 | ||
+ | pyudev | ||
+ | PyYAML | ||
+ | requests | ||
+ | requests-file | ||
+ | scipy | ||
+ | setuptools | ||
+ | simpleline | ||
+ | six | ||
+ | slip 0.6.4 | ||
+ | urllib3 | ||
+ | wheel | ||
+ | |||
+ | Most installed as user root; a few installed as non-admin user. | ||
+ | |||
+ | These were unable to be updated: | ||
+ | |||
+ | $ python3 -m pip list --outdated | ||
+ | Package | ||
+ | ----------- -------- -------- ----- | ||
+ | dbus-python 1.2.4 1.2.18 | ||
+ | ethtool | ||
+ | pycairo | ||
+ | pycups | ||
+ | PyGObject | ||
+ | SLIP 20171205 20191113 sdist | ||
+ | |||
+ | __20 Jan 2022__ | ||
+ | |||
+ | Upgraded several python packages. | ||
+ | |||
+ | [root@tidewater: | ||
+ | Package | ||
+ | ------------------- -------------- -------------- ----- | ||
+ | charset-normalizer | ||
+ | chromedriver-binary 96.0.4664.35.0 98.0.4758.48.0 sdist | ||
+ | requests | ||
+ | setuptools | ||
+ | urllib3 | ||
+ | |||
+ | [root@tidewater: | ||
+ | |||
+ | Note: Did not update chromedriver-binary as Chrome is still version 97.0.4692.99 | ||
+ | |||
+ | __16 Nov 2021__ | ||
+ | |||
+ | Upgraded several python packages. | ||
+ | |||
+ | [root@tidewater: | ||
+ | Package | ||
+ | ------------------- -------------- -------------- ----- | ||
+ | certifi | ||
+ | charset-normalizer | ||
+ | chromedriver-binary 94.0.4606.61.0 96.0.4664.35.0 sdist | ||
+ | idna 3.2 3.3 wheel | ||
+ | Pillow | ||
+ | pytz 2021.1 | ||
+ | setuptools | ||
+ | |||
+ | [root@tidewater: | ||
+ | |||
+ | __29 Sep 2021__ | ||
+ | |||
+ | Upgraded the following python3 packages using the commands listed below: | ||
+ | |||
+ | pip | ||
+ | charset-normalizer | ||
+ | setuptools | ||
+ | urllib3 | ||
+ | chromedriver-binary | ||
+ | |||
+ | Then got the following error message for chromedriver-binary: | ||
+ | |||
+ | selenium.common.exceptions.SessionNotCreatedException: | ||
+ | Current browser version is 94.0.4606.61 with binary path / | ||
+ | |||
+ | So did the following to fix: | ||
+ | |||
+ | python3 -m pip install chromedriver-binary==94.0.4606.61 | ||
+ | find /usr -name " | ||
+ | chmod 755 / | ||
+ | |||
+ | __21 Jul 2021__ | ||
+ | |||
+ | # python3 -m pip list --outdated | ||
+ | Package | ||
+ | ------------------- -------------- -------------- ----- | ||
+ | certifi | ||
+ | chromedriver-binary 91.0.4472.19.0 92.0.4515.43.0 sdist | ||
+ | idna 3.1 3.2 wheel | ||
+ | requests | ||
+ | setuptools | ||
+ | urllib3 | ||
+ | |||
+ | Upgraded all using: | ||
+ | |||
+ | python3 -m pip install --upgrade < | ||
+ | |||
+ | Note on chromedriver-binary...don' | ||
+ | |||
+ | # find /usr -name " | ||
+ | # chmod 755 / | ||
+ | |||
+ | __26 May 2021__ | ||
+ | |||
+ | |||
+ | These packages were outdated: | ||
+ | |||
+ | # python3 -m pip list --outdated | ||
+ | Package | ||
+ | ------------------- -------------- -------------- ----- | ||
+ | chromedriver-binary 90.0.4430.24.0 91.0.4472.19.0 sdist | ||
+ | pip | ||
+ | setuptools | ||
+ | WARNING: You are using pip version 21.1.1; however, version 21.1.2 is available. | ||
+ | You should consider upgrading via the '/ | ||
+ | |||
+ | Upgraded all using: | ||
+ | |||
+ | python3 -m pip install --upgrade < | ||
+ | |||
+ | |||
+ | __15 Apr 2021__ | ||
+ | |||
+ | Updated various python packages, including chromedriver-binary | ||
+ | |||
+ | __3 Mar 2021__ | ||
+ | |||
+ | |||
+ | These packages were outdated: | ||
+ | |||
+ | # python3 -m pip list --outdated | ||
+ | Package | ||
+ | ------------------- -------------- -------------- ----- | ||
+ | certifi | ||
+ | chardet | ||
+ | chromedriver-binary 87.0.4280.20.0 89.0.4389.23.0 sdist | ||
+ | httplib2 | ||
+ | idna 2.10 | ||
+ | PyMySQL | ||
+ | pytz 2020.4 | ||
+ | requests | ||
+ | selenium-wire | ||
+ | setuptools | ||
+ | urllib3 | ||
+ | wheel | ||
+ | |||
+ | Upgraded all using: | ||
+ | |||
+ | python3 -m pip install --upgrade < | ||
+ | |||
+ | <color # | ||
+ | |||
+ | __18 Nov 2020__ | ||
+ | |||
+ | Manually updated chrome to v87. | ||
+ | Ran the following: | ||
+ | |||
+ | python3 -m pip list --outdated | ||
+ | |||
+ | With the resulting list, then ran the following for each < | ||
+ | python3 -m pip install --upgrade < | ||
+ | |||
+ | __11 Oct 2020__ | ||
+ | |||
+ | To upgrade pip modules manually when dependencies give an error: | ||
+ | # python3 -m pip --list outdated | ||
+ | # python3 -m pip install --upgrade < | ||
+ | |||
+ | These are reported as outdated: | ||
+ | |||
+ | [root: ~]# python3 -m pip list --outdated | ||
+ | Package | ||
+ | ------------- ---------- --------- ----- | ||
+ | certifi | ||
+ | idna 2.9 2.10 wheel | ||
+ | requests | ||
+ | selenium-wire 1.0.12 | ||
+ | setuptools | ||
+ | urllib3 | ||
+ | |||
+ | All upgraded using the command: | ||
+ | |||
+ | python3 -m pip install --upgrade < | ||
+ | |||
+ | |||
+ | __9 Oct 2020__ | ||
+ | |||
+ | Updated Chrome via yum to version 86.0.4240.75-1 and now check_envoy.pl fails. | ||
+ | |||
+ | Did the following as root (checked on the VM " | ||
+ | |||
+ | # / | ||
+ | # / | ||
+ | |||
+ | Note: you can also do specific versions of chromedrive-binary (see available versions at https:// | ||
+ | |||
+ | # python3 -m pip install chromedriver-binary==90.0.4430.24.0 | ||
+ | |||
+ | # / | ||
+ | # find /usr -name " | ||
+ | # chmod 755 / | ||
+ | |||
+ | __6 Oct 2020__ | ||
+ | # python3 -m pip install demjson | ||
+ | # python3 -m pip install wheel | ||
+ | |||
+ | __26 Aug 2020__ | ||
+ | |||
+ | Updated Chrome via yum to version 85.0.4183.83-1 and now check_envoy.pl fails. | ||
+ | |||
+ | Did the following as root to fix: | ||
+ | |||
+ | # / | ||
+ | # / | ||
+ | # / | ||
+ | # find /usr -name " | ||
+ | # chmod 755 / | ||
+ | |||
+ | Re-ran the cron and script worked. | ||
+ | |||
+ | __20 May 2020__ | ||
+ | |||
+ | Updated Chrome via yum to version 83.0.4103.61-1 and now check_envoy.pl fails. | ||
+ | |||
+ | Did the following as root to fix: | ||
+ | |||
+ | # / | ||
+ | # / | ||
+ | # / | ||
+ | # find /usr -name " | ||
+ | # chmod 755 / | ||
+ | |||
+ | Re-ran the cron and script worked. | ||
+ | |||
+ | Then tried looking at old packages needing an update: | ||
+ | |||
+ | # cd / | ||
+ | # ./pip3 list --outdated | ||
+ | # pip_upgrade_outdated | ||
__8 April 2020__ | __8 April 2020__ | ||
Line 5: | Line 496: | ||
Upgraded Chrome via yum to version 81.0.4044.92 and now check_envoy.pl fails. | Upgraded Chrome via yum to version 81.0.4044.92 and now check_envoy.pl fails. | ||
+ | Did the following as root to fix: | ||
+ | |||
+ | # / | ||
+ | # / | ||
+ | # / | ||
+ | | ||
+ | # cd / | ||
+ | # ./pip3 install --upgrade | ||
+ | # ./pip3 list --outdated | ||
+ | # pip_upgrade_outdated | ||
+ | | ||
+ | # find /usr -name " | ||
+ | | ||
+ | / | ||
+ | | ||
+ | # chmod 755 / | ||
+ | The pip upgrade moved the astral package to v2.1 which broke sun.py and it needed some major changes. | ||
| | ||
__11 December 2019__ | __11 December 2019__ | ||
Line 49: | Line 557: | ||
pip3.6 install --upgrade httplib2 | pip3.6 install --upgrade httplib2 | ||
pip3.6 install pymysql | pip3.6 install pymysql | ||
+ | pip3.6 install selenium | ||
pip3.6 install selenium-wire | pip3.6 install selenium-wire | ||
pip3.6 install chromedriver | pip3.6 install chromedriver | ||
Line 55: | Line 564: | ||
pip3.6 install wget | pip3.6 install wget | ||
pip3.6 install pip-upgrade-outdated | pip3.6 install pip-upgrade-outdated | ||
+ | pip3.6 install pytz | ||
+ | pip3.6 install astral | ||
+ | |||
+ | Note: replace the " | ||
| | ||
To update all pip packages: | To update all pip packages: | ||
Line 83: | Line 596: | ||
| | ||
$ pip list | $ pip list | ||
- | | ||
- | [[https:// | ||
- | |||
- | logging.basicConfig(format=' | ||
- | logging.debug(' | ||
- | logging.info(' | ||
- | logging.warning(' | ||
- | |||
- | |||
- | [[https:// |
python_notes.txt · Last modified: 2023/04/05 08:56 by juckins