Assistance Needed: Error Encountered in OpenEMMA Execution

[KexianShen]

Hi Developers,

Great job on the OpenEMMA project! I’ve been working with the code and encountered an error that I’d like some help with.

Here’s the error I’m facing:

*Answer*: Keep my intent.
Observed Speed and Curvature: [2.6,0.4], [2.0,0.2], [2.1,0.7], [2.2,1.7], [2.0,1.2], [1.8,0.1], [1.7,0.3], [1.5,0.3], [1.4,0.8], [1.2,0.2]
Got 10 future actions: [[2.6, 0.4], [2.0, 0.2], [2.1, 0.7], [2.2, 1.7], [2.0, 1.2], [1.8, 0.1], [1.7, 0.3], [1.5, 0.3], [1.4, 0.8], [1.2, 0.2]]
Traceback (most recent call last):
  File "main.py", line 398, in <module>
    updated_intent) = GenerateMotion(obs_images, obs_ego_traj_world, obs_ego_velocities,
  File "main.py", line 206, in GenerateMotion
    intent_description = DescribeOrUpdateIntent(obs_images, prev_intent=given_intent, processor=processor, model=model, tokenizer=tokenizer, args=args)
  File "main.py", line 193, in DescribeOrUpdateIntent
    result = vlm_inference(text=prompt, images=obs_images, processor=processor, model=model, tokenizer=tokenizer, args=args)
  File "main.py", line 70, in vlm_inference
    output_text = re.findall(r'<\|start_header_id\|>assistant<\|end_header_id\|>(.*?)<\|eot_id\|>', output_text, re.DOTALL)[0].strip()
IndexError: list index out of range

The command I’m running is:

python main.py \
--model-path llama \
--dataroot "/data/kexian/data/v1.0-mini" \
--version "v1.0-mini" \
--method openemma

I modified the scene in main.py (line 291) to "scene-0757", which is the scene where the error occurs. Could you please help me understand why this error is happening and how to resolve it?

Thank you in advance for your support!

Best regards,
Kexian