How to disable printings about GPU/TPU

[7rick03ligh7]

How to disable this printings?

[github-actions]

Hi! thanks for your contribution!, great first issue!

[SkafteNicki]

It is currently not possible to disable printing of that. For reference it is printed by these lines:
https://github.com/PyTorchLightning/pytorch-lightning/blob/8f6b115511166e404c1419000a3bfa15865a9885/pytorch_lightning/trainer/distrib_data_parallel.py#L296-L298
and this line:
https://github.com/PyTorchLightning/pytorch-lightning/blob/8f6b115511166e404c1419000a3bfa15865a9885/pytorch_lightning/trainer/distrib_data_parallel.py#L377

[rohitgr7]

Check #2757.

[7rick03ligh7]

@rohitgr7
Thanks

These two lines helped me

import logging
logging.getLogger('lightning').setLevel(0)

[goldmyu]

This is still an issue today, especially when working with multiple GPUs and num_of_workers>0...
The amount of output log is super high and redundant

[LingxiaoShawn]

This is still an issue. This actually can be fixed easily hope someone can do this.

[max0x7ba]

Another way to disable these messages:

pytorch_lightning.utilities.distributed.log.setLevel(logging.ERROR)

[0xangelo]

It seems that the base logger for lightning has changed since @7rick03ligh7's last comment. The following does the job now

logging.getLogger("pytorch_lightning").setLevel(logging.WARNING)

[Hockey86]

As of lightning v1.9.4,

logging.getLogger("lightning.pytorch.utilities.rank_zero").setLevel(logging.WARNING) disables the following output:
GPU available: True (cuda), used: True
TPU available: False, using: 0 TPU cores
IPU available: False, using: 0 IPUs
HPU available: False, using: 0 HPUs

logging.getLogger("lightning.pytorch.accelerators.cuda").setLevel(logging.WARNING) disables the following output:
LOCAL_RANK: 0 - CUDA_VISIBLE_DEVICES: [0]

[pfk-beta]

@rohitgr7 Thanks

These two lines helped me

import logging
logging.getLogger('lightning').setLevel(0)

Let's remove all warnings, and let's use some meaningless value 0.

[youurayy]

as of PL 2.2.4:

logger = logging.getLogger('pytorch_lightning.utilities.rank_zero')
logger.setLevel(logging.ERROR)
... your code here ...
logger.setLevel(logging.INFO)

or

logger = logging.getLogger('pytorch_lightning.utilities.rank_zero')
class IgnorePLFilter(logging.Filter):
    def filter(self, record):
        return 'available:' not in record.getMessage()
logger.addFilter(IgnorePLFilter())

[G1nkgo7]

Customize the keywords according to your needs.

import logging
class IgnorePLFilter(logging.Filter):
    def filter(self, record):
        keywords = ['available:', 'CUDA', 'LOCAL_RANK:']
        return not any(keyword in record.getMessage() for keyword in keywords)
    
logging.getLogger('pytorch_lightning.utilities.rank_zero').addFilter(IgnorePLFilter())
logging.getLogger('pytorch_lightning.accelerators.cuda').addFilter(IgnorePLFilter())

[JackCaster]

With lightning 2.5.0 I had to do:

def device_info_filter(record):
    return "PU available: " not in record.getMessage()

logging.getLogger("lightning.pytorch.utilities.rank_zero").addFilter(device_info_filter)

modified from #13378 (comment)