python_notes
Differences
This shows you the differences between two versions of the page.
| Both sides previous revisionPrevious revisionNext revision | Previous revision | ||
| python_notes [2019/06/26 15:07] – juckins | python_notes [2023/04/05 08:56] (current) – juckins | ||
|---|---|---|---|
| Line 1: | Line 1: | ||
| - | ==== Python Notes ==== | + | ==== Python |
| + | __5 Apr 2023__ | ||
| + | |||
| + | # python3 -m pip list --outdated | ||
| + | Package | ||
| + | ------------------- --------------- --------------- ----- | ||
| + | chromedriver-binary 110.0.5481.30.0 112.0.5615.28.0 sdist | ||
| + | mypy-extensions | ||
| + | pdf2image | ||
| + | pytesseract | ||
| + | pytz 2022.7.1 | ||
| + | urllib3 | ||
| + | |||
| + | Ran this: | ||
| + | # python3 -m pip install --upgrade < | ||
| + | # find /usr -name " | ||
| + | # chmod 755 / | ||
| + | |||
| + | __11 Jan 2023__ | ||
| + | |||
| + | # python3 -m pip list --outdated | ||
| + | Package | ||
| + | ------------------- --------------- --------------- ----- | ||
| + | certifi | ||
| + | chromedriver-binary 108.0.5359.22.0 109.0.5414.74.0 sdist | ||
| + | dictor | ||
| + | pdf2image | ||
| + | pytesseract | ||
| + | pytz 2022.6 | ||
| + | |||
| + | Upgraded all of the above except for pytesseract. | ||
| + | |||
| + | # find /usr -name " | ||
| + | # chmod 755 / | ||
| + | |||
| + | |||
| + | __30 Nov 2022__ | ||
| + | |||
| + | Upgraded several python packages on physical and virtual servers. | ||
| + | |||
| + | __26 Oct 2022__ | ||
| + | |||
| + | Upgraded several python packages on physical server. | ||
| + | |||
| + | |||
| + | Current list of python modules: | ||
| | | ||
| - | Install | + | [root@tidewater: |
| + | Package | ||
| + | ------------------- --------------- | ||
| + | astral | ||
| + | backports.zoneinfo | ||
| + | black | ||
| + | certifi | ||
| + | chardet | ||
| + | charset-normalizer | ||
| + | chromedriver | ||
| + | chromedriver-binary 107.0.5304.62.0 | ||
| + | click | ||
| + | dataclasses | ||
| + | dictor | ||
| + | idna 3.4 | ||
| + | importlib-metadata | ||
| + | importlib-resources 5.4.0 | ||
| + | mypy-extensions | ||
| + | numpy | ||
| + | pathspec | ||
| + | pdf2image | ||
| + | Pillow | ||
| + | pip | ||
| + | platformdirs | ||
| + | PyMySQL | ||
| + | pytesseract | ||
| + | pytz 2022.5 | ||
| + | requests | ||
| + | selenium | ||
| + | setuptools | ||
| + | tomli | ||
| + | typed-ast | ||
| + | typing_extensions | ||
| + | urllib3 | ||
| + | vboxapi | ||
| + | wget 3.2 | ||
| + | zipp 3.6.0 | ||
| + | |||
| + | |||
| + | __30 Sep 2022__ | ||
| + | |||
| + | Current list of python modules: | ||
| + | |||
| + | [root@tidewater: | ||
| + | Package | ||
| + | ------------------- --------------- | ||
| + | astral | ||
| + | black | ||
| + | certifi | ||
| + | chardet | ||
| + | charset-normalizer | ||
| + | chromedriver | ||
| + | chromedriver-binary 105.0.5195.52.0 | ||
| + | click | ||
| + | dataclasses | ||
| + | dictor | ||
| + | idna 3.4 | ||
| + | importlib-metadata | ||
| + | mypy-extensions | ||
| + | numpy | ||
| + | pathspec | ||
| + | pdf2image | ||
| + | Pillow | ||
| + | pip | ||
| + | platformdirs | ||
| + | PyMySQL | ||
| + | pytesseract | ||
| + | pytz 2022.2.1 | ||
| + | requests | ||
| + | selenium | ||
| + | setuptools | ||
| + | tomli | ||
| + | typed-ast | ||
| + | typing_extensions | ||
| + | urllib3 | ||
| + | vboxapi | ||
| + | wget 3.2 | ||
| + | zipp 3.6.0 | ||
| + | |||
| + | __22 Sep 2022__ | ||
| + | |||
| + | Upgraded several python packages on both physical and virtual servers. | ||
| + | |||
| + | __2 Aug 2022__ | ||
| + | |||
| + | Upgraded several python packages on both physical and virtual servers. | ||
| + | |||
| + | __22 June 2022__ | ||
| + | |||
| + | Upgraded several python packages on both physical and virtual servers. | ||
| + | |||
| + | __26 May 2022__ | ||
| + | |||
| + | Upgraded several python packages on both physical and virtual servers. | ||
| + | |||
| + | __27 Apr 2022__ | ||
| + | |||
| + | Upgraded several python packages on both physical and virtual servers. | ||
| + | |||
| + | __30 Mar 2022__ | ||
| + | |||
| + | Upgraded several python packages on both physical and virtual servers. | ||
| + | |||
| + | __3 Mar 2022__ | ||
| + | |||
| + | Upgraded several python packages on both __physical__ and __virtual__ servers. | ||
| + | |||
| + | [root@tidewater: | ||
| + | Package | ||
| + | ------------------- -------------- -------------- ----- | ||
| + | charset-normalizer | ||
| + | chromedriver-binary 98.0.4758.48.0 99.0.4844.51.0 sdist | ||
| + | numpy | ||
| + | pytesseract | ||
| + | |||
| + | [root@tidewater: | ||
| + | |||
| + | Fix chromedriver-binary permissions: | ||
| + | |||
| + | [root@tidewater: | ||
| + | [root@tidewater: | ||
| + | |||
| + | The virtual server updates included the following: | ||
| + | |||
| + | [root@centos8S-vtatdb2-l: | ||
| + | Package | ||
| + | ------------------ -------- -------- ----- | ||
| + | charset-normalizer 2.0.11 | ||
| + | dbus-python | ||
| + | ethtool | ||
| + | httplib2 | ||
| + | imageio | ||
| + | lxml | ||
| + | ntplib | ||
| + | pycairo | ||
| + | pycups | ||
| + | pycurl | ||
| + | PyGObject | ||
| + | pykickstart | ||
| + | python-augeas | ||
| + | pyudev | ||
| + | simpleline | ||
| + | slip | ||
| + | typing_extensions | ||
| + | |||
| + | |||
| + | __2 Feb 2022__ | ||
| + | |||
| + | Upgraded several python packages on both __physical__ and __virtual__ servers. | ||
| + | |||
| + | [root@tidewater: | ||
| + | Package | ||
| + | ------------------- -------------- -------------- ----- | ||
| + | charset-normalizer | ||
| + | chromedriver-binary 96.0.4664.35.0 98.0.4758.48.0 sdist | ||
| + | dictor | ||
| + | |||
| + | [root@tidewater: | ||
| + | |||
| + | Fix chromedriver-binary permissions: | ||
| + | |||
| + | [root@tidewater: | ||
| + | [root@tidewater: | ||
| + | |||
| + | The virtual server updates included the following: | ||
| + | |||
| + | [root@centos8S-vtatdb2-l: | ||
| + | Package | ||
| + | --------------- ----------- -------- ----- | ||
| + | beautifulsoup4 | ||
| + | blivet | ||
| + | chardet | ||
| + | coverage | ||
| + | cssselect | ||
| + | dasbus | ||
| + | dbus-python | ||
| + | decorator | ||
| + | dictor | ||
| + | dnspython | ||
| + | ethtool | ||
| + | html5lib | ||
| + | httplib2 | ||
| + | humanize | ||
| + | idna 2.5 | ||
| + | iniparse | ||
| + | langtable | ||
| + | lxml 4.2.3 | ||
| + | ntplib | ||
| + | numpy | ||
| + | ordered-set | ||
| + | pexpect | ||
| + | pid | ||
| + | ply | ||
| + | productmd | ||
| + | psutil | ||
| + | ptyprocess | ||
| + | pycairo | ||
| + | pycups | ||
| + | pycurl | ||
| + | PyGObject | ||
| + | pykickstart | ||
| + | pyparsing | ||
| + | PySocks | ||
| + | python-augeas | ||
| + | python-dateutil 2.6.1 | ||
| + | pytz 2017.2 | ||
| + | pyudev | ||
| + | PyYAML | ||
| + | requests | ||
| + | requests-file | ||
| + | scipy | ||
| + | setuptools | ||
| + | simpleline | ||
| + | six | ||
| + | slip 0.6.4 | ||
| + | urllib3 | ||
| + | wheel | ||
| + | |||
| + | Most installed as user root; a few installed as non-admin user. | ||
| + | |||
| + | These were unable to be updated: | ||
| + | |||
| + | $ python3 -m pip list --outdated | ||
| + | Package | ||
| + | ----------- -------- -------- ----- | ||
| + | dbus-python 1.2.4 1.2.18 | ||
| + | ethtool | ||
| + | pycairo | ||
| + | pycups | ||
| + | PyGObject | ||
| + | SLIP 20171205 20191113 sdist | ||
| + | |||
| + | __20 Jan 2022__ | ||
| + | |||
| + | Upgraded several python packages. | ||
| + | |||
| + | [root@tidewater: | ||
| + | Package | ||
| + | ------------------- -------------- -------------- ----- | ||
| + | charset-normalizer | ||
| + | chromedriver-binary 96.0.4664.35.0 98.0.4758.48.0 sdist | ||
| + | requests | ||
| + | setuptools | ||
| + | urllib3 | ||
| + | |||
| + | [root@tidewater: | ||
| + | |||
| + | Note: Did not update chromedriver-binary as Chrome is still version 97.0.4692.99 | ||
| + | |||
| + | __16 Nov 2021__ | ||
| + | |||
| + | Upgraded several python packages. | ||
| + | |||
| + | [root@tidewater: | ||
| + | Package | ||
| + | ------------------- -------------- -------------- ----- | ||
| + | certifi | ||
| + | charset-normalizer | ||
| + | chromedriver-binary 94.0.4606.61.0 96.0.4664.35.0 sdist | ||
| + | idna 3.2 3.3 wheel | ||
| + | Pillow | ||
| + | pytz 2021.1 | ||
| + | setuptools | ||
| + | |||
| + | [root@tidewater: | ||
| + | |||
| + | __29 Sep 2021__ | ||
| + | |||
| + | Upgraded the following python3 packages using the commands listed below: | ||
| + | |||
| + | pip | ||
| + | charset-normalizer | ||
| + | setuptools | ||
| + | urllib3 | ||
| + | chromedriver-binary | ||
| + | |||
| + | Then got the following error message for chromedriver-binary: | ||
| + | |||
| + | selenium.common.exceptions.SessionNotCreatedException: | ||
| + | Current browser version is 94.0.4606.61 with binary path / | ||
| + | |||
| + | So did the following to fix: | ||
| + | |||
| + | python3 -m pip install chromedriver-binary==94.0.4606.61 | ||
| + | find /usr -name " | ||
| + | chmod 755 / | ||
| + | |||
| + | __21 Jul 2021__ | ||
| + | |||
| + | # python3 -m pip list --outdated | ||
| + | Package | ||
| + | ------------------- -------------- -------------- ----- | ||
| + | certifi | ||
| + | chromedriver-binary 91.0.4472.19.0 92.0.4515.43.0 sdist | ||
| + | idna 3.1 3.2 wheel | ||
| + | requests | ||
| + | setuptools | ||
| + | urllib3 | ||
| + | |||
| + | Upgraded all using: | ||
| + | |||
| + | python3 -m pip install --upgrade < | ||
| + | |||
| + | Note on chromedriver-binary...don' | ||
| + | |||
| + | # find /usr -name " | ||
| + | # chmod 755 / | ||
| + | |||
| + | __26 May 2021__ | ||
| + | |||
| + | |||
| + | These packages were outdated: | ||
| + | |||
| + | # python3 -m pip list --outdated | ||
| + | Package | ||
| + | ------------------- -------------- -------------- ----- | ||
| + | chromedriver-binary 90.0.4430.24.0 91.0.4472.19.0 sdist | ||
| + | pip | ||
| + | setuptools | ||
| + | WARNING: You are using pip version 21.1.1; however, version 21.1.2 is available. | ||
| + | You should consider upgrading via the '/ | ||
| + | |||
| + | Upgraded all using: | ||
| + | |||
| + | python3 -m pip install --upgrade < | ||
| + | |||
| + | |||
| + | __15 Apr 2021__ | ||
| + | |||
| + | Updated various python packages, including chromedriver-binary | ||
| + | |||
| + | __3 Mar 2021__ | ||
| + | |||
| + | |||
| + | These packages were outdated: | ||
| + | |||
| + | # python3 -m pip list --outdated | ||
| + | Package | ||
| + | ------------------- -------------- -------------- ----- | ||
| + | certifi | ||
| + | chardet | ||
| + | chromedriver-binary 87.0.4280.20.0 89.0.4389.23.0 sdist | ||
| + | httplib2 | ||
| + | idna 2.10 | ||
| + | PyMySQL | ||
| + | pytz 2020.4 | ||
| + | requests | ||
| + | selenium-wire | ||
| + | setuptools | ||
| + | urllib3 | ||
| + | wheel | ||
| + | |||
| + | Upgraded all using: | ||
| + | |||
| + | python3 -m pip install --upgrade < | ||
| + | |||
| + | <color # | ||
| + | |||
| + | __18 Nov 2020__ | ||
| + | |||
| + | Manually updated chrome to v87. | ||
| + | Ran the following: | ||
| + | |||
| + | python3 -m pip list --outdated | ||
| + | |||
| + | With the resulting list, then ran the following for each < | ||
| + | python3 -m pip install --upgrade < | ||
| + | |||
| + | __11 Oct 2020__ | ||
| + | |||
| + | To upgrade pip modules manually when dependencies give an error: | ||
| + | # python3 -m pip --list outdated | ||
| + | # python3 -m pip install --upgrade < | ||
| + | |||
| + | These are reported as outdated: | ||
| + | |||
| + | [root: ~]# python3 -m pip list --outdated | ||
| + | Package | ||
| + | ------------- ---------- --------- ----- | ||
| + | certifi | ||
| + | idna 2.9 2.10 wheel | ||
| + | requests | ||
| + | selenium-wire 1.0.12 | ||
| + | setuptools | ||
| + | urllib3 | ||
| + | |||
| + | All upgraded using the command: | ||
| + | |||
| + | python3 -m pip install --upgrade < | ||
| + | |||
| + | |||
| + | __9 Oct 2020__ | ||
| + | |||
| + | Updated Chrome via yum to version 86.0.4240.75-1 and now check_envoy.pl fails. | ||
| + | |||
| + | Did the following as root (checked on the VM " | ||
| + | |||
| + | # / | ||
| + | # / | ||
| + | |||
| + | Note: you can also do specific versions of chromedrive-binary (see available versions at https:// | ||
| + | |||
| + | # python3 -m pip install chromedriver-binary==90.0.4430.24.0 | ||
| + | |||
| + | # / | ||
| + | # find /usr -name " | ||
| + | # chmod 755 / | ||
| + | |||
| + | __6 Oct 2020__ | ||
| + | # python3 -m pip install demjson | ||
| + | # python3 -m pip install wheel | ||
| + | |||
| + | __26 Aug 2020__ | ||
| + | |||
| + | Updated Chrome via yum to version 85.0.4183.83-1 and now check_envoy.pl fails. | ||
| + | |||
| + | Did the following as root to fix: | ||
| + | |||
| + | # / | ||
| + | # / | ||
| + | # / | ||
| + | # find /usr -name " | ||
| + | # chmod 755 / | ||
| + | |||
| + | Re-ran the cron and script worked. | ||
| + | |||
| + | __20 May 2020__ | ||
| + | |||
| + | Updated Chrome via yum to version 83.0.4103.61-1 and now check_envoy.pl fails. | ||
| + | |||
| + | Did the following as root to fix: | ||
| + | |||
| + | # / | ||
| + | # / | ||
| + | # / | ||
| + | # find /usr -name " | ||
| + | # chmod 755 / | ||
| + | |||
| + | Re-ran the cron and script worked. | ||
| + | |||
| + | Then tried looking at old packages needing an update: | ||
| + | |||
| + | # cd / | ||
| + | # ./pip3 list --outdated | ||
| + | # pip_upgrade_outdated | ||
| + | |||
| + | __8 April 2020__ | ||
| + | |||
| + | Upgraded Chrome via yum to version 81.0.4044.92 and now check_envoy.pl fails. | ||
| + | |||
| + | Did the following as root to fix: | ||
| + | |||
| + | # / | ||
| + | # / | ||
| + | # / | ||
| + | |||
| + | # cd / | ||
| + | # ./pip3 install --upgrade | ||
| + | # ./pip3 list --outdated | ||
| + | # pip_upgrade_outdated | ||
| + | |||
| + | # find /usr -name " | ||
| + | |||
| + | / | ||
| + | |||
| + | # chmod 755 / | ||
| + | |||
| + | The pip upgrade moved the astral package to v2.1 which broke sun.py and it needed some major changes. | ||
| + | |||
| + | __11 December 2019__ | ||
| + | |||
| + | Upgraded Chrome via yum to version 79.0.3945.79 and now check_envoy.pl fails. | ||
| + | |||
| + | Did the following as root to fix: | ||
| + | |||
| + | # / | ||
| + | # / | ||
| + | # / | ||
| + | # pip-upgrade-outdated | ||
| + | |||
| + | # find /usr -name " | ||
| + | |||
| + | / | ||
| + | / | ||
| + | |||
| + | # chmod 755 / | ||
| + | |||
| + | Note that both **/ | ||
| + | |||
| + | |||
| + | |||
| + | ---- | ||
| + | |||
| + | With CentOS7.7, python3 can load from base. Do the following to fix previously-installed IUS release: | ||
| + | |||
| + | # yum remove python36u | ||
| + | # yum install python3 | ||
| + | # yum remove ius-release | ||
| + | |||
| + | * Then follow instructions for installing local python packages to ensure all still work. | ||
| + | * If you have pip problems, uninstall/ | ||
| + | * Ensure pip3.6 is in your $PATH or you have a sym link to it (/ | ||
| + | |||
| + | __Install | ||
| * https:// | * https:// | ||
| * https:// | * https:// | ||
| - | Do some local configuration for my scripts: | + | Do some local configuration for my scripts |
| pip3.6 install --upgrade pip | pip3.6 install --upgrade pip | ||
| pip3.6 install --upgrade httplib2 | pip3.6 install --upgrade httplib2 | ||
| pip3.6 install pymysql | pip3.6 install pymysql | ||
| + | pip3.6 install selenium | ||
| + | pip3.6 install selenium-wire | ||
| + | pip3.6 install chromedriver | ||
| + | pip3.6 install chromedriver_binary | ||
| + | pip3.6 install dictor | ||
| + | pip3.6 install wget | ||
| + | pip3.6 install pip-upgrade-outdated | ||
| + | pip3.6 install pytz | ||
| + | pip3.6 install astral | ||
| + | |||
| + | Note: replace the " | ||
| + | | ||
| + | To update all pip packages: | ||
| + | |||
| + | # pip_upgrade_outdated | ||
| + | |||
| + | Note that https:// | ||
| + | | ||
| + | Download and install geckodriver (see https:// | ||
| + | |||
| + | As root, copy geckodriver to / | ||
| + | |||
| + | Notes at https:// | ||
| | | ||
| Notes about [[https:// | Notes about [[https:// | ||
python_notes.1561576036.txt.gz · Last modified: by juckins
