Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: update Python connector base image to v4.0.0 with Python 3.11 #52663

Merged
merged 9 commits into from
Feb 9, 2025

Conversation

devin-ai-integration[bot]
Copy link
Contributor

@devin-ai-integration devin-ai-integration bot commented Jan 30, 2025

Description

Updates the Python connector base image to version 4.0.0, upgrading from Python 3.10 to Python 3.11.

Changes

  • Update Python version from 3.10.14 to 3.11.8 in base image
  • Bump base image version to 4.0.0 to reflect major Python version change
  • Update Python version in sanity checks and documentation

Link to Devin run

https://app.devin.ai/sessions/7b158d1965bd493db84ea04078974ce6

Pre-merge checklist

  • Base image version bumped to 4.0.0 to reflect major Python version change
  • Python version updated to 3.11.8 in all relevant files
  • Documentation updated to reflect new Python version

- Update Python version from 3.10.14 to 3.11.8
- Bump base image version to 4.0.0 for major Python version change
- Update Python version in sanity checks and documentation

Co-Authored-By: [email protected] <[email protected]>
@devin-ai-integration devin-ai-integration bot requested review from aaronsteers and a team January 30, 2025 19:35
Copy link
Contributor Author

devin-ai-integration bot commented Jan 30, 2025

🤖 Devin AI Engineer

Original prompt from [email protected]:

@Devin can you make a PR to make a new major version of our Python connector base-image, 4.0, based on Python 3.11 instead of 3.10? AND a separate pull request that would switch all our internal packages (think airbyte-ci) to use python 3.11 in their pyproject.toml files, and in testing harnesses, and make sure the dagger testing containers come with python 3.11 as well.

I'll be helping with this pull request! Here's what you should know:

✅ I will automatically:

  • Address comments on this PR. Add "(aside)" to your comment to have me ignore it.
  • Look at CI failures and help fix them

⚙️ Control Options:

  • Disable automatic comment and CI monitoring

Copy link

vercel bot commented Jan 30, 2025

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
airbyte-docs ✅ Ready (Inspect) Visit Preview 💬 Add feedback Feb 9, 2025 5:59am

@natikgadzhi natikgadzhi requested a review from a team as a code owner February 9, 2025 05:35
@natikgadzhi natikgadzhi enabled auto-merge (squash) February 9, 2025 05:43
@@ -70,14 +70,10 @@ async def check_python_image_has_expected_env_vars(python_image_container: dagge
"""
expected_env_vars = {
"PYTHON_VERSION",
"PYTHON_PIP_VERSION",
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I have no clue where they are set, and they don't seem to be used anywhere. Code for the sake of code must die.

@@ -146,24 +146,6 @@ async def check_user_can_read_dir(container: dagger.Container, user: str, dir_pa
raise errors.SanityCheckError(f"{dir_path} is not readable by {user}.")


async def check_user_cant_write_dir(container: dagger.Container, user: str, dir_path: str):
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Dagger started outputing exit code 1, but not throwing the exception as our code assumed. Removing the whole check because I don't see how this is useful.

@@ -79,6 +79,9 @@ poetry run mypy base_images --check-untyped-defs

## CHANGELOG

### 1.6.0
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Funny, but it seems that the changelog for the package is in a template file. Pretty insane tbh.

Copy link
Contributor

@natikgadzhi natikgadzhi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall, I like the bump and I want to move forward with this. I have already published the base image itself, and I want to test it on a few connectors to see how well it's going to work.

@natikgadzhi
Copy link
Contributor

natikgadzhi commented Feb 9, 2025

/format-fix

Format-fix job started... Check job output.

✅ Changes applied successfully. (179c824)

@natikgadzhi natikgadzhi merged commit 85b4be2 into master Feb 9, 2025
25 checks passed
@natikgadzhi natikgadzhi deleted the devin/1738265666-py311-base branch February 9, 2025 05:59
yardencarmeli pushed a commit that referenced this pull request Feb 10, 2025
…52663)

Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: [email protected] <[email protected]>
Co-authored-by: Natik Gadzhi <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants