Request to add D-FINE

[brockt96]

Model description

D-FINE is a RT-DETR based model that uses probability distributions as an intermediate representation from which bounding boxes are predicted. This model has achieved SOTA results in real-time object detection with additional training data. https://paperswithcode.com/sota/real-time-object-detection-on-coco?p=d-fine-redefine-regression-task-in-detrs-as

Open source status

• The model implementation is available
• The model weights are available

Provide useful links for the implementation

Here is the link to the repository: https://github.com/Peterande/D-FINE. The weights are present on Huggingface Hub. The only github username I know of is @Peterande.

[qubvel]

Hi @brockt96! Thanks for opening this issue 🙌. D-FINE would be an amazing addition to Transformers! If you're interested in working on it, we'd be excited to support you. Otherwise, let's see if anyone in the community is eager to contribute to integrating this model. Let me know what you think! 🤗

[VladOS95-cyber]

Hi @qubvel @brockt96! I could contribute into this model if for some reasons nobody is going to work on this.

[NielsRogge]

Hi @VladOS95-cyber that would be super cool! Feel free to open a PR. Cc'ing also @SangbumChoi who contributed RT-DETR

[SangbumChoi]

#34773
#33244
If you see these PR then it will be much more easier to do D-FINE as modular.

[qubvel]

Hi @VladOS95-cyber, that's super cool! feel free to ping me when PR is open!

Since the model is based on RT-DETR, please, use modular for the model addition. And in addition to the above PRs, mentioned by @SangbumChoi it's worth looking at:

• [Modular Transformers] Request for comments #33916
• https://huggingface.co/docs/transformers/modular_transformers
• https://github.com/huggingface/transformers/tree/main/examples/modular-transformers

[brockt96]

Hi @brockt96! Thanks for opening this issue 🙌. D-FINE would be an amazing addition to Transformers! If you're interested in working on it, we'd be excited to support you. Otherwise, let's see if anyone in the community is eager to contribute to integrating this model. Let me know what you think! 🤗

I'd love to work it! Though I hasten to add that I have no freaking clue what I'm doing.😅 But, that's part of the reason why I want to do this. I want to learn. And I want to be able to tame these "researchy" models, as y'all call them. I think this will be a good experience all things considered.

[VladOS95-cyber]

Hi @brockt96! Thanks for opening this issue 🙌. D-FINE would be an amazing addition to Transformers! If you're interested in working on it, we'd be excited to support you. Otherwise, let's see if anyone in the community is eager to contribute to integrating this model. Let me know what you think! 🤗

I'd love to work it! Though I hasten to add that I have no freaking clue what I'm doing.😅 But, that's part of the reason why I want to do this. I want to learn. And I want to be able to tame these "researchy" models, as y'all call them. I think this will be a good experience all things considered.

Hi @brockt96! Are you going to work on it then?

[brockt96]

Hi @brockt96! Thanks for opening this issue 🙌. D-FINE would be an amazing addition to Transformers! If you're interested in working on it, we'd be excited to support you. Otherwise, let's see if anyone in the community is eager to contribute to integrating this model. Let me know what you think! 🤗

I'd love to work it! Though I hasten to add that I have no freaking clue what I'm doing.😅 But, that's part of the reason why I want to do this. I want to learn. And I want to be able to tame these "researchy" models, as y'all call them. I think this will be a good experience all things considered.

Hi @brockt96! Are you going to work on it then?

Yes. Although I won't be able to do so full-time.

[bhuvanmdev]

Hi @brockt96! Thanks for opening this issue 🙌. D-FINE would be an amazing addition to Transformers! If you're interested in working on it, we'd be excited to support you. Otherwise, let's see if anyone in the community is eager to contribute to integrating this model. Let me know what you think! 🤗

I'd love to work it! Though I hasten to add that I have no freaking clue what I'm doing.😅 But, that's part of the reason why I want to do this. I want to learn. And I want to be able to tame these "researchy" models, as y'all call them. I think this will be a good experience all things considered.

Hi @brockt96! Are you going to work on it then?

Yes. Although I won't be able to do so full-time.

If you're not available to do this, do let me know. I can take it up. :)

[brockt96]

Hi @brockt96! Thanks for opening this issue 🙌. D-FINE would be an amazing addition to Transformers! If you're interested in working on it, we'd be excited to support you. Otherwise, let's see if anyone in the community is eager to contribute to integrating this model. Let me know what you think! 🤗

I'd love to work it! Though I hasten to add that I have no freaking clue what I'm doing.😅 But, that's part of the reason why I want to do this. I want to learn. And I want to be able to tame these "researchy" models, as y'all call them. I think this will be a good experience all things considered.

Hi @brockt96! Are you going to work on it then?

Yes. Although I won't be able to do so full-time.

If you're not available to do this, do let me know. I can take it up. :)

After thinking about it, truthfully, it'll probably be better if you take it up. But, I do still want to contribute. So let me know what I can do to support.

[VladOS95-cyber]

Hey @brockt96, ok, I'll take care of it

[qubvel]

@VladOS95-cyber super cool 👍 feel free to ping me for any questions

[VladOS95-cyber]

@VladOS95-cyber super cool 👍 feel free to ping me for any questions

@qubvel, sure, thank you!

[Realmbird]

@VladOS95-cyber could I try contribute if you didn't finish since there are not many first issues

[Realmbird]

@qubvel

[VladOS95-cyber]

@VladOS95-cyber could I try contribute if you didn't finish since there are not many first issues

hey, i'am currently working on it