| [NeMo W 2024-02-15 22:31:14 modelPT:165] If you intend to do training or fine-tuning, please call the ModelPT.setup_training_data() method and provide a valid configuration file to setup the train data loader. | |
| Train config : | |
| manifest_filepath: /content/datasets/ta/yaygomii/Tamil-Speech-Dialect-Corpus-Shuffled-Split/train/train_yaygomii_Tamil-Speech-Dialect-Corpus-Shuffled-Split_manifest_processed.json,/content/datasets/ta/yaygomii/Tamil-Speech-Dialect-Corpus-Shuffled-Split/valid/valid_yaygomii_Tamil-Speech-Dialect-Corpus-Shuffled-Split_manifest_processed.json | |
| sample_rate: 16000 | |
| batch_size: 16 | |
| trim_silence: true | |
| max_duration: 16.7 | |
| shuffle: true | |
| is_tarred: false | |
| tarred_audio_filepaths: null | |
| num_workers: 8 | |
| pin_memory: true | |
| use_start_end_token: true | |
| [NeMo W 2024-02-15 22:31:14 modelPT:172] If you intend to do validation, please call the ModelPT.setup_validation_data() or ModelPT.setup_multiple_validation_data() method and provide a valid configuration file to setup the validation data loader(s). | |
| Validation config : | |
| manifest_filepath: /content/datasets/ta/yaygomii/Tamil-Speech-Dialect-Corpus-Shuffled-Split/test/test_yaygomii_Tamil-Speech-Dialect-Corpus-Shuffled-Split_manifest_processed.json | |
| sample_rate: 16000 | |
| batch_size: 8 | |
| shuffle: false | |
| num_workers: 8 | |
| pin_memory: true | |
| use_start_end_token: true | |
| trim_silence: true | |
| [NeMo W 2024-02-15 22:31:14 modelPT:178] Please call the ModelPT.setup_test_data() or ModelPT.setup_multiple_test_data() method and provide a valid configuration file to setup the test data loader(s). | |
| Test config : | |
| manifest_filepath: /content/datasets/ta/yaygomii/Tamil-Speech-Dialect-Corpus-Shuffled-Split/test/test_yaygomii_Tamil-Speech-Dialect-Corpus-Shuffled-Split_manifest_processed.json | |
| sample_rate: 16000 | |
| batch_size: 8 | |
| shuffle: false | |
| num_workers: 8 | |
| pin_memory: true | |
| use_start_end_token: true | |
| trim_silence: true | |
| [NeMo W 2024-02-15 22:32:34 nemo_logging:349] /usr/local/lib/python3.10/dist-packages/torch/utils/data/dataloader.py:557: UserWarning: This DataLoader will create 8 worker processes in total. Our suggested max number of worker in current system is 2, which is smaller than what this DataLoader is going to create. Please be aware that excessive worker creation might get DataLoader running slow or even freeze, lower the worker number to avoid potential slowness/freeze if necessary. | |
| warnings.warn(_create_warning_msg( | |
| [NeMo W 2024-02-15 22:34:21 nemo_logging:349] /usr/local/lib/python3.10/dist-packages/torch/utils/data/dataloader.py:557: UserWarning: This DataLoader will create 8 worker processes in total. Our suggested max number of worker in current system is 2, which is smaller than what this DataLoader is going to create. Please be aware that excessive worker creation might get DataLoader running slow or even freeze, lower the worker number to avoid potential slowness/freeze if necessary. | |
| warnings.warn(_create_warning_msg( | |