Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Crazy CPU consumption on blocked Thread #7462

Open
chaen opened this issue Feb 9, 2024 · 0 comments
Open

Crazy CPU consumption on blocked Thread #7462

chaen opened this issue Feb 9, 2024 · 0 comments

Comments

@chaen
Copy link
Contributor

chaen commented Feb 9, 2024

I've observed the CS going banana because it was stuck in an infinite loop

The problem in the stack trace below is packSentBytes: -70265710922 which is supposed to be positive
From a very quick look, the problem would seem to come from the process unable to allocate memory in M2Crypto.
Low priority....

    sendData (DIRAC/Core/DISET/private/Transports/BaseTransport.py:173)
        Arguments:
            self: <SSLTransport at 0x7f724c1af690>
            uData: {"OK": False, "Errno": 0, "Message": "Invalid action proposal", "CallStack": ["  File \"/opt/dirac/versions/v11.0.31-1707226432/Linux-x86_64/lib/python3.11/threading.py\", line 1002, in _bootstrap\n    self._bootstrap_i
nner()\n", "  File \"/opt/dirac/versions/v11.0.31-1707226432/Linux-x86_64/lib/python3.11/threading.py\", line 1045, in _bootstrap_inner\n    self.run()\n", "  File \"/opt/dirac/versions/v11.0.31-1707226432/Linux-x86_64/lib/python3.11/thre
ading.py\", line 982, in run\n    self._target(*self._args, **self._kwargs)\n", ...]}
            prefix: <bytes at 0x561461fe6bc8>
        Locals:
            sCodedData: <bytes at 0x7f723c02a170>
            dataToSend: <bytes at 0x7f723c02c0b0>
            index: 0
            bytesToSend: 1283
            packSentBytes: -70265710922
            result: {"OK": True, "Value": -1}
            sentBytes: -1
    sendAndClose (DIRAC/Core/DISET/private/TransportPool.py:125)
        Arguments:
            self: <TransportPool at 0x7f7251ee5210>
            trid: "2001:1458:d00:12::145:9135->2001:1458:301:52::100:79:35924"
            msg: {"OK": False, "Errno": 0, "Message": "Invalid action proposal", "CallStack": ["  File \"/opt/dirac/versions/v11.0.31-1707226432/Linux-x86_64/lib/python3.11/threading.py\", line 1002, in _bootstrap\n    self._bootstrap_inner()\n", "  File \"/opt/dirac/versions/v11.0.31-1707226432/Linux-x86_64/lib/python3.11/threading.py\", line 1045, in _bootstrap_inner\n    self.run()\n", "  File \"/opt/dirac/versions/v11.0.31-1707226432/Linux-x86_64/lib/python3.11/threading.py\", line 982, in run\n    self._target(*self._args, **self._kwargs)\n", ...]}
    _processInThread (DIRAC/Core/DISET/private/Service.py:339)
        Arguments:
            self: <Service at 0x7f725165ef90>
            clientTransport: <SSLTransport at 0x7f724c1af690>
        Locals:
            monReport: (1707262143.3921127, 3041.25, 121.546875)
            result: {"OK": False, "Errno": 0, "Message": "Invalid action proposal", "CallStack": ["  File \"/opt/dirac/versions/v11.0.31-1707226432/Linux-x86_64/lib/python3.11/threading.py\", line 1002, in _bootstrap\n    self._bootstrap_inner()\n", "  File \"/opt/dirac/versions/v11.0.31-1707226432/Linux-x86_64/lib/python3.11/threading.py\", line 1045, in _bootstrap_inner\n    self.run()\n", "  File \"/opt/dirac/versions/v11.0.31-1707226432/Linux-x86_64/lib/python3.11/threading.py\", line 982, in run\n    self._target(*self._args, **self._kwargs)\n", ...]}
            trid: "2001:1458:d00:12::145:9135->2001:1458:301:52::100:79:35924"
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant