Name		Name	Last commit message	Last commit date
parent directory ..
README.md		README.md
training-13B-28-11-23-parameter.json		training-13B-28-11-23-parameter.json
training-7B-08-12-23-parameter.json		training-7B-08-12-23-parameter.json
training-log-events-13b-28-11-23.csv		training-log-events-13b-28-11-23.csv
training-log-events-7B-08-12-23.csv		training-log-events-7B-08-12-23.csv

README.md

Log extraction

How to extract logs from AWS CloudWatch in the correct format.

Go to CloudWatch
Click on Logs Insights in the left menu
Select the correct log group and time range

Run the following query:

fields @timestamp, @message
    | filter @message like /\Q{'loss': \E.*\Q, 'learning_rate': \E.*\Q, 'epoch': \E.*\Q}\E/

Click on Export results and select CSV
Save the file as training-log-events-{MODEL-VARIANT}-DD-MM-YY.csv in the logs folder.