synthetic_text_gen

[ArsalanAli915]

2023-02-27 16:48:56.505009: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer.so.7'; dlerror: libnvinfer.so.7: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /usr/lib64-nvidia
2023-02-27 16:48:56.505147: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer_plugin.so.7'; dlerror: libnvinfer_plugin.so.7: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /usr/lib64-nvidia
2023-02-27 16:48:56.505167: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Cannot dlopen some TensorRT libraries. If you would like to use Nvidia GPU with TensorRT, please make sure the missing libraries mentioned above are installed properly.
loaded iteration 0
unspecified dataset: /content/drive/MyDrive/dataset/MDdata/valid/SKMBT_75122072616550_Page_45_Image_0001.png
getting data ready
could not import datasets
Traceback (most recent call last):
File "qa_eval.py", line 595, in
main(args.checkpoint, args.data_set_name, gpu=args.gpu, config=args.config, addToConfig=addtoconfig,test=args.test,verbose=args.verbosity,run=run,smaller_set=args.smaller_set,eval_full=args.eval_full,ner_do_before=args.ner_do_before)
File "qa_eval.py", line 419, in main
data_loader, valid_data_loader = getDataLoader(data_config,'train' if not test else 'test')
File "/content/dessurt/data_loader/data_loaders.py", line 36, in getDataLoader
from data_sets import multiple_dataset
File "/content/dessurt/data_sets/multiple_dataset.py", line 16, in
from .synth_form_dataset import SynthFormDataset
File "/content/dessurt/data_sets/synth_form_dataset.py", line 11, in
from .gen_daemon import GenDaemon
File "/content/dessurt/data_sets/gen_daemon.py", line 4, in
from synthetic_text_gen import SyntheticWord
ModuleNotFoundError: No module named 'synthetic_text_gen'

I am facing above error when I run eval.py to evaluate the dataset

[ArsalanAli915]

when I train the model I found that, entire training is completed and there is no epoch numbers and metrics display. except that begin training. In addition to that when I evaluate the model. I found that mean and std deviation of edit distance and not WER or CER. please help me.

[herobd]

synthetic_text_gen can be found here https://github.com/herobd/synthetic_text_gen
(although I'd imagine it's not needed for what your doing. You could also comment imports out)

I'm sure exactly what you're asking with your second comment. Does it not train?

[ArsalanAli915]

Thank for replying and helping me out.
I just need to ask one more question.
my result are shown in edit distance and ANLS.
if I want the character error rate or or word error rate then what I need to change in config file. please let me know it would really helpful.

[herobd]

If you run qa_eval.py using the trained model it produces CER/WER for recognition datasets
python qa_eval.py -c CHECKPOINT.pth -d DATASETNAME [-g GPU#] [-T (do test set)]
If it is a custom dataset you will need to modify things a bit so it treats your dataset as a recognition dataset.