Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[losses] Add Scaled QL and Scaled MQL #146

Open
marcozanotti opened this issue Jan 29, 2025 · 3 comments · May be fixed by #148
Open

[losses] Add Scaled QL and Scaled MQL #146

marcozanotti opened this issue Jan 29, 2025 · 3 comments · May be fixed by #148
Labels
enhancement New feature or request feature

Comments

@marcozanotti
Copy link
Contributor

Description

Hi,
it would be beneficial to expand the losses with the two official metrics used in the M5 Uncertainty competition, namely the Scaled Quantile Loss and the Scaled Multi-Quantile Loss.

From this reference https://www.sciencedirect.com/science/article/pii/S0169207021001722
the scaling factor is simply the in-sample, one-step-ahead mean absolute error of the Naive method. However, a more general version could be implemented using the Seasonal Naive method as is the case for MASE and RMSSE.

I can try to make a PR with the basis on this if you like.

Thanks!

Use case

No response

@marcozanotti marcozanotti added enhancement New feature or request feature labels Jan 29, 2025
@marcozanotti
Copy link
Contributor Author

Hi,
any feedback on this? Would it be possible to add the two metrics in a future release?
Thank you for your work.

@jmoralez jmoralez changed the title [<Library component: losses>] Add Scaled QL and Scaled MQL [losses] Add Scaled QL and Scaled MQL Feb 12, 2025
@jmoralez
Copy link
Member

Hey. We can't work on it right now but if you want you can open a PR and we'll review.

@marcozanotti
Copy link
Contributor Author

Hi @jmoralez , ok I'll try to work on that.

@marcozanotti marcozanotti linked a pull request Feb 12, 2025 that will close this issue
@jmoralez jmoralez linked a pull request Feb 21, 2025 that will close this issue
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request feature
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants