Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

something wrong when we use encoder to process the high_frequency component #55

Open
zxp771 opened this issue Dec 29, 2023 · 0 comments

Comments

@zxp771
Copy link

zxp771 commented Dec 29, 2023

Thanks for sharing your great work!

After decomposing the image (feature map) using the wavelet transform method you provided. We input the low-frequency and high-frequency components into an encoder network separately. After getting the encoded information, we found more detailed information in the high frequencies. Then, we have the following problem after re-inverting the encoded processed low and high-frequency components back to the time domain. A very distinct grid appears in the image (feature map). We have repeatedly experimented and found that coding operations on the low-frequency components do not cause this phenomenon. At the same time, this issue occurs only when coding operations are performed on high frequencies.

The processing of our work:
image

Could you please help us analyze the reason for this "grid effect"? Is it because the encoder changes the value of the high-frequency information so that the phase information in the high-frequency information changes? Does it end up causing the grid effect when inverted? If so, is there any good way to solve this problem?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant