TypeError: unsupported format string passed to NoneType.__format__

[prasad-nair-amd]

I am getting this error while trying to run fmbench on EC2 instance. Please see the command line below:

fmbench --config-file /tmp/fmbench-read/configs/byoe/config-model-byo-sagemaker-endpoint.yml --local-mode yes --write-bucket placeholder > fmbench.log 2>&1

I had added my instance type as m7a.32xlarge and edited pricing.yml is edited with m7a.32 xlarge pricing but even then I am getting this error below.

[2024-07-24 19:42:03,100] p61605 {clientwrap.py:98} WARNING - INFO:main:the cost for running bring-your-own-sm-endpoint running on m7a.32xlarge for 0.4006618220009841s is $None

[2024-07-24 19:42:03,225] p61605 {clientwrap.py:91} INFO - get_inference, uuid=3429a58e3a4843d6880caff2dbd1994b, error occurred with my-own-endpoint, exception='NoneType' object has no attribute 'get'
get_inference, uuid=14188c702d3f4132816efcf23a7eb1bf, error occurred with my-own-endpoint, exception='NoneType' object has no attribute 'get'
get_inference, uuid=7fbfdc7dd51b497dad014a724eb609dd, error occurred with my-own-endpoint, exception='NoneType' object has no attribute 'get'
get_inference, uuid=033060cba8d14e9f8d91261e8bd98f21, error occurred with my-own-endpoint, exception='NoneType' object has no attribute 'get'
get_inference, uuid=2ff98b5c93304932b96c2359288751f3, error occurred with my-own-endpoint, exception='NoneType' object has no attribute 'get'
get_inference, uuid=7c79f122066c4fd78913355b655da053, error occurred with my-own-endpoint, exception='NoneType' object has no attribute 'get'
get_inference, uuid=75f5b1ec23964a7798db730438b51417, error occurred with my-own-endpoint, exception='NoneType' object has no attribute 'get'
get_inference, uuid=53a1e2d4fdf94f52b3412963e1e56979, error occurred with my-own-endpoint, exception='NoneType' object has no attribute 'get'
get_inference, uuid=826a61034a234f40bcbae9191c37f974, error occurred with my-own-endpoint, exception='NoneType' object has no attribute 'get'
get_inference, uuid=d8bd5ed8e129413a8a456f43f4551858, error occurred with my-own-endpoint, exception='NoneType' object has no attribute 'get'
get_inference, uuid=685d348a24ac4b6598e78870f4013640, error occurred with my-own-endpoint, exception='NoneType' object has no attribute 'get'
get_inference, uuid=a40973ff82374f2bb829c96fb92ae1c2, error occurred with my-own-endpoint, exception='NoneType' object has no attribute 'get'
get_inference, uuid=239f2fc046894045a2d1da2fec401fc7, error occurred with my-own-endpoint, exception='NoneType' object has no attribute 'get'
get_inference, uuid=696541e7dd614469b2f8163a327c65bc, error occurred with my-own-endpoint, exception='NoneType' object has no attribute 'get'
get_inference, uuid=12aed3eba7a34bd8a5d60b1cbd30e0e7, error occurred with my-own-endpoint, exception='NoneType' object has no attribute 'get'
get_inference, uuid=fda193122ef142e8be7b8ac255e05398, error occurred with my-own-endpoint, exception='NoneType' object has no attribute 'get'
get_inference, uuid=4a8f6537899e48d4ae76fd8cd476c6a8, error occurred with my-own-endpoint, exception='NoneType' object has no attribute 'get'

[2024-07-24 19:42:03,607] p61605 {engines.py:261} INFO - Ending Cell 25-----------------------------------------
Executing: 64%|██████▍ | 25/39 [00:05<00:03, 4.22cell/s]
[2024-07-24 19:42:04,767] p61605 {main.py:107} ERROR - Failed to execute 3_run_inference.ipynb:

Exception encountered at "In [16]":

TypeError Traceback (most recent call last)
Cell In[16], line 134
120 exp_cost = predictor.calculate_cost(exp_instance_type,
121 experiment.get('instance_count'),
122 pricing_config,
123 experiment_duration,
124 prompt_tokens_total,
125 completion_tokens_total)
126 logger.info(f"the cost for running {experiment['name']} running on "
127 f"{exp_instance_type} for {experiment_duration}s is ${exp_cost}")
129 experiment_durations.append({
130 'experiment_name': experiment['name'],
131 'instance_type': exp_instance_type,
132 'instance_count': experiment.get('instance_count'),
133 'duration_in_seconds': f"{experiment_duration:.2f}",
--> 134 'cost': f"{exp_cost:.6f}",
135 })
137 logger.info(f"experiment={e_idx+1}/{num_experiments}, name={experiment['name']}, "
138 f"duration={experiment_duration:.6f} seconds, exp_cost={exp_cost:.6f}, done")

TypeError: unsupported format string passed to NoneType.format