Archiving a wiki with SSL 1.0 possible? #246

big-edd · 2024-06-17T06:32:26Z

big-edd
Jun 17, 2024

Hello,

We have a very old install of MediaWiki that has not been kept updated, and is only using version 1.0 of SSL. I am now trying backup with dumpgenerator so that we can build something more current, but am getting an ssl unsupported protocol errors.

For example.. ..
requests.exceptions.SSLError: HTTPSConnectionPool(host='our-internal-url.com', port=443): Max retries exceeded with url: / (Caused by SSLError(SSLError(1, '[SSL: UNSUPPORTED_PROTOCOL] unsupported protocol (_ssl.c:1000)')))

Is it possible to archive a wiki only using version 1.0 of SSL?

Cheers,
Eddie.

robkam · 2024-06-17T10:25:56Z

robkam
Jun 17, 2024
Collaborator

Add option --insecure to the command line to disable SSL certificate verification.

12 replies

yzqzss Jun 20, 2024

Possibly related: https://stackoverflow.com/questions/71603314/ssl-error-unsafe-legacy-renegotiation-disabled

big-edd Jun 20, 2024
Author

I can't guarantee that this feature will work on SSL on Windows.

Rocky Linux 9.4 results.. ..

wikiteam3dumpgenerator --user someone --pass BogusPassword --insecure https://wiki.our_internal_stuff.com --xml --images
WARNING: SSL certificate verification disabled
Hard retry... (1), due to: HTTPSConnectionPool(host='wiki.our_internal_stuff.com', port=443): Max retries exceeded with url: / (Caused by SSLError(SSLError(1, '[SSL: UNSAFE_LEGACY_RENEGOTIATION_DISABLED] unsafe legacy renegotiation disabled (_ssl.c:1129)')))
Traceback (most recent call last):
  File "/home/someone/.local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 466, in _make_request
    self._validate_conn(conn)
  File "/home/someone/.local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 1095, in _validate_conn
    conn.connect()
  File "/home/someone/.local/lib/python3.9/site-packages/urllib3/connection.py", line 652, in connect
    sock_and_verified = _ssl_wrap_socket_and_match_hostname(
  File "/home/someone/.local/lib/python3.9/site-packages/urllib3/connection.py", line 805, in _ssl_wrap_socket_and_match_hostname
    ssl_sock = ssl_wrap_socket(
  File "/home/someone/.local/lib/python3.9/site-packages/urllib3/util/ssl_.py", line 465, in ssl_wrap_socket
    ssl_sock = _ssl_wrap_socket_impl(sock, context, tls_in_tls, server_hostname)
  File "/home/someone/.local/lib/python3.9/site-packages/urllib3/util/ssl_.py", line 509, in _ssl_wrap_socket_impl
    return ssl_context.wrap_socket(sock, server_hostname=server_hostname)
  File "/usr/lib64/python3.9/ssl.py", line 501, in wrap_socket
    return self.sslsocket_class._create(
  File "/usr/lib64/python3.9/ssl.py", line 1074, in _create
    self.do_handshake()
  File "/usr/lib64/python3.9/ssl.py", line 1343, in do_handshake
    self._sslobj.do_handshake()
ssl.SSLError: [SSL: UNSAFE_LEGACY_RENEGOTIATION_DISABLED] unsafe legacy renegotiation disabled (_ssl.c:1129)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/someone/.local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 789, in urlopen
    response = self._make_request(
  File "/home/someone/.local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 490, in _make_request
    raise new_e
urllib3.exceptions.SSLError: [SSL: UNSAFE_LEGACY_RENEGOTIATION_DISABLED] unsafe legacy renegotiation disabled (_ssl.c:1129)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/home/someone/.local/lib/python3.9/site-packages/requests/adapters.py", line 667, in send
    resp = conn.urlopen(
  File "/home/someone/.local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 873, in urlopen
    return self.urlopen(
  File "/home/someone/.local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 873, in urlopen
    return self.urlopen(
  File "/home/someone/.local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 873, in urlopen
    return self.urlopen(
  [Previous line repeated 2 more times]
  File "/home/someone/.local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 843, in urlopen
    retries = retries.increment(
  File "/home/someone/.local/lib/python3.9/site-packages/wikiteam3/dumpgenerator/cli/cli.py", line 337, in increment
    return super(CustomRetry, self).increment(method=method, url=url, *args, **kwargs)
  File "/home/someone/.local/lib/python3.9/site-packages/urllib3/util/retry.py", line 519, in increment
    raise MaxRetryError(_pool, url, reason) from reason  # type: ignore[arg-type]
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='wiki.our_internal_stuff.com', port=443): Max retries exceeded with url: / (Caused by SSLError(SSLError(1, '[SSL: UNSAFE_LEGACY_RENEGOTIATION_DISABLED] unsafe legacy renegotiation disabled (_ssl.c:1129)')))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/someone/.local/bin/wikiteam3dumpgenerator", line 8, in <module>
    sys.exit(main())
  File "/home/someone/.local/lib/python3.9/site-packages/wikiteam3/dumpgenerator/__init__.py", line 7, in main
    DumpGenerator()
  File "/home/someone/.local/lib/python3.9/site-packages/wikiteam3/dumpgenerator/dump/generator.py", line 34, in __init__
    config, other = get_parameters(params=params)
  File "/home/someone/.local/lib/python3.9/site-packages/wikiteam3/dumpgenerator/cli/cli.py", line 401, in get_parameters
    if get_WikiEngine(args.wiki, session=session) == "MediaWiki":
  File "/home/someone/.local/lib/python3.9/site-packages/wikiteam3/dumpgenerator/api/wiki_check.py", line 14, in get_WikiEngine
    r = session.post(url=url, timeout=30)
  File "/home/someone/.local/lib/python3.9/site-packages/requests/sessions.py", line 637, in post
    return self.request("POST", url, data=data, json=json, **kwargs)
  File "/home/someone/.local/lib/python3.9/site-packages/requests/sessions.py", line 589, in request
    resp = self.send(prep, **send_kwargs)
  File "/home/someone/.local/lib/python3.9/site-packages/wikiteam3/utils/monkey_patch.py", line 150, in new_send
    return self.old_send_method(request, **kwargs)
  File "/home/someone/.local/lib/python3.9/site-packages/requests/sessions.py", line 703, in send
    r = adapter.send(request, **kwargs)
  File "/home/someone/.local/lib/python3.9/site-packages/requests/adapters.py", line 698, in send
    raise SSLError(e, request=request)
requests.exceptions.SSLError: HTTPSConnectionPool(host='wiki.our_internal_stuff.com', port=443): Max retries exceeded with url: / (Caused by SSLError(SSLError(1, '[SSL: UNSAFE_LEGACY_RENEGOTIATION_DISABLED] unsafe legacy renegotiation disabled (_ssl.c:1129)')))
Undo monkey patch...

big-edd Jun 20, 2024
Author

Possibly related: https://stackoverflow.com/questions/71603314/ssl-error-unsafe-legacy-renegotiation-disabled

Tried the custom openssl.cnf file with OPENSSL_CONF=/path/to/openssl.cnf and had the exact same result as above.

big-edd Jul 4, 2024
Author

Possibly related: https://stackoverflow.com/questions/71603314/ssl-error-unsafe-legacy-renegotiation-disabled

Tried in and Ubuntu 24.04 VM, with a different result.. ..

WARNING: SSL certificate verification disabled
Checking API... https://wiki.our_internal_stuff.com/api.php
MediaWiki API seems to work but returned no index URL
API is OK:  https://wiki.our_internal_stuff.com/api.php
Trying to log in to the wiki using clientLogin... (MW 1.27+)
fetch login token: Oops! Something went wrong --  {'error': {'code': 'readapidenied', 'info': 'You need read permission to use this module'}}
Trying to log in to the wiki using botLogin... (MW 1.27+)
fetch login token: Oops! Something went wrong --  {'error': {'code': 'readapidenied', 'info': 'You need read permission to use this module'}}
Trying to log in to the wiki using indexLogin... (generic)
index login: Success! Welcome,  Someone !
-- Login OK --
Checking index.php... https://wiki.our_internal_stuff.com/index.php
check_index(): Trying Special:Random...
POST https://wiki.our_internal_stuff.com/index.php {'title': 'Special:Random'} 302
GET https://wiki.our_internal_stuff.com/index.php/EUR-GC-07 {'title': 'Special:Random'} 200
index.php available probability: 90% (0.9)
index.php is OK
/home/edd/.local/lib/python3.12/site-packages/wikiteam3/dumpgenerator/cli/cli.py:517: DeprecationWarning: datetime.datetime.utcnow() is deprecated and scheduled for removal in a future version. Use timezone-aware objects to represent datetimes in UTC: datetime.datetime.now(datetime.UTC).
  "date": datetime.datetime.utcnow().strftime("%Y%m%d"),
No --path argument provided. Defaulting to:
  [working_directory]/[domain_prefix]-[date]-wikidump
Which expands to:
  ./wiki.our_internal_stuff.com-20240704-wikidump
--delay is the default value of 1.5
There will be a 1.5 second delay between HTTP calls in order to keep the server from timing you out.
If you know that this is unnecessary, you can manually specify '--delay 0.0'.
Undo monkey patch...
/home/edd/.local/lib/python3.12/site-packages/wikiteam3/dumpgenerator/cli/greeter.py:11: DeprecationWarning: datetime.datetime.utcnow() is deprecated and scheduled for removal in a future version. Use timezone-aware objects to represent datetimes in UTC: datetime.datetime.now(datetime.UTC).
  copyright_string = f"# Copyright (C) 2011-{datetime.datetime.utcnow().year} WikiTeam developers"
#########################################################################
# Welcome to DumpGenerator 4.2.5 by WikiTeam3 (GPL v3)                  #
# More info at: <https://github.com/saveweb/wikiteam3>                  #
# Copyright (C) 2011-2024 WikiTeam developers                           #
#########################################################################

Analysing https://wiki.our_internal_stuff.com/api.php
/home/edd/.local/lib/python3.12/site-packages/wikiteam3/utils/ia_checker.py:65: DeprecationWarning: datetime.datetime.utcnow() is deprecated and scheduled for removal in a future version. Use timezone-aware objects to represent datetimes in UTC: datetime.datetime.now(datetime.UTC).
  now_utc = datetime.datetime.utcnow()
No suitable dump found at Internet Archive
Trying generating a new dump into a new directory...
https://wiki.our_internal_stuff.com/api.php
ATTENTION: This wiki does not allow some parameters in Special:Export, therefore pages with large histories may be truncated

Retrieving the XML for every page from the beginning


Retrieving the XML for every page

Loading page titles from namespaces = all
Excluding titles from namespaces = None
16 namespaces found
    Retrieving titles in the namespace 0
Traceback (most recent call last):                                  
  File "/home/edd/.local/bin/wikiteam3dumpgenerator", line 8, in <module>
    sys.exit(main())
             ^^^^^^
  File "/home/edd/.local/lib/python3.12/site-packages/wikiteam3/dumpgenerator/__init__.py", line 7, in main
    DumpGenerator()
  File "/home/edd/.local/lib/python3.12/site-packages/wikiteam3/dumpgenerator/dump/generator.py", line 86, in __init__
    DumpGenerator.createNewDump(config=config, other=other)
  File "/home/edd/.local/lib/python3.12/site-packages/wikiteam3/dumpgenerator/dump/generator.py", line 112, in createNewDump
    generate_XML_dump(config=config, session=other.session)
  File "/home/edd/.local/lib/python3.12/site-packages/wikiteam3/dumpgenerator/dump/xmldump/xml_dump.py", line 145, in generate_XML_dump
    doXMLExportDump(config, session, xmlfile, lastPage)
  File "/home/edd/.local/lib/python3.12/site-packages/wikiteam3/dumpgenerator/dump/xmldump/xml_dump.py", line 70, in doXMLExportDump
    for title in read_titles(config, session=session, start=start):
  File "/home/edd/.local/lib/python3.12/site-packages/wikiteam3/dumpgenerator/api/page_titles.py", line 266, in read_titles
    getPageTitles(config=config, session=session)
  File "/home/edd/.local/lib/python3.12/site-packages/wikiteam3/dumpgenerator/api/page_titles.py", line 215, in getPageTitles
    for title in titles:
  File "/home/edd/.local/lib/python3.12/site-packages/wikiteam3/dumpgenerator/api/page_titles.py", line 41, in getPageTitlesAPI
    site = mwclient.Site(
           ^^^^^^^^^^^^^^
  File "/home/edd/.local/lib/python3.12/site-packages/mwclient/client.py", line 130, in __init__
    self.site_init()
  File "/home/edd/.local/lib/python3.12/site-packages/mwclient/client.py", line 165, in site_init
    self.require(1, 16)
  File "/home/edd/.local/lib/python3.12/site-packages/mwclient/client.py", line 464, in require
    raise errors.MediaWikiVersionError(
mwclient.errors.MediaWikiVersionError: Requires version 1.16, current version is 1.15
Undo monkey patch...

big-edd Jul 4, 2024
Author

Possibly related: https://stackoverflow.com/questions/71603314/ssl-error-unsafe-legacy-renegotiation-disabled

Tried in and Ubuntu 24.04 VM, with a different result.. ..
    raise errors.MediaWikiVersionError(
mwclient.errors.MediaWikiVersionError: Requires version 1.16, current version is 1.15
Undo monkey patch...

The target system and version 1.15.1 for MediaWiki. Not quite version 1.16 as required by mwclient.

I cloned the latest mwclient and disabled version errors by modifying with raise_error=False as shown below.

$ grep "def require" mwclient/client.py 
    def require(self, major, minor, revision=None, raise_error=False):

Seems to be working now, but I wonder how broken the result may be?

Guess I see when it is all restored to a new system.

Cheers,
Eddie.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

mediawiki-client-tools

Archiving a wiki with SSL 1.0 possible? #246

{{title}}

Replies: 1 comment 12 replies

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

mediawiki-client-tools

Archiving a wiki with SSL 1.0 possible? #246

big-edd Jun 17, 2024

Replies: 1 comment · 12 replies

robkam Jun 17, 2024 Collaborator

yzqzss Jun 20, 2024

big-edd Jun 20, 2024 Author

big-edd Jun 20, 2024 Author

big-edd Jul 4, 2024 Author

big-edd Jul 4, 2024 Author

big-edd
Jun 17, 2024

Replies: 1 comment 12 replies

robkam
Jun 17, 2024
Collaborator

big-edd Jun 20, 2024
Author

big-edd Jun 20, 2024
Author

big-edd Jul 4, 2024
Author

big-edd Jul 4, 2024
Author