Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Testing/jenkins integration #862

Merged
merged 67 commits into from
Oct 24, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
67 commits
Select commit Hold shift + click to select a range
ad4678a
[jenkins] add node label to Jenkinsfile
fionnodonohoe-xlnx Apr 3, 2023
a14bf7e
[jenkins] introduce basic declaritive pipeline
fionnodonohoe-xlnx Apr 4, 2023
6003306
[jenkins] move into the test dir before running quicktest
fionnodonohoe-xlnx Apr 4, 2023
da54e37
[jenkins] keep 30 builds in build history
fionnodonohoe-xlnx Apr 4, 2023
da57f9b
Revert "[jenkins] move into the test dir before running quicktest"
fionnodonohoe-xlnx Apr 4, 2023
0d3d692
[jenkins] the './' was necessary to run the test, not moving into a n…
fionnodonohoe-xlnx Apr 4, 2023
caa3548
Merge branch 'dev' into testing/jenkins-integration
fionnodonohoe-xlnx Jun 13, 2023
074e6ce
Merge remote-tracking branch 'origin/dev' into testing/jenkins-integr…
fionnodonohoe-xlnx Jun 26, 2023
5180d1f
Change end2end tests to use board type as opposed to kind to allow fo…
fionnodonohoe-xlnx Jun 27, 2023
56e4315
Add test_deploy method for BNN end2end tests for Jenkins setup
fionnodonohoe-xlnx Jun 27, 2023
5c03333
Add parameterized tests for all supported boards. Split test matrix b…
fionnodonohoe-xlnx Jun 27, 2023
8c98882
Add scripts used by Jenkins to test bnn end2end hardware tests
fionnodonohoe-xlnx Jun 27, 2023
b3166e4
Add U250 xclbin for end2end bnn testing
fionnodonohoe-xlnx Jun 27, 2023
b355a6c
Forgot to add test_support_board_map inclusion into test file
fionnodonohoe-xlnx Jun 28, 2023
f2872c7
Add missing itertools library import
fionnodonohoe-xlnx Jun 29, 2023
65bb10f
Merge remote-tracking branch 'origin/dev' into testing/jenkins-integr…
fionnodonohoe-xlnx Jul 10, 2023
1d6d5ee
Remove reference to get_build_env
fionnodonohoe-xlnx Jul 11, 2023
04c96d6
Merge remote-tracking branch 'origin/dev' into testing/jenkins-integr…
fionnodonohoe-xlnx Jul 12, 2023
1e898d8
Adjust how deployment dirs are created for sanity_bnn suite
fionnodonohoe-xlnx Jul 17, 2023
a641f01
Latest dev changes has affected what tests pass or are destructive, a…
fionnodonohoe-xlnx Jul 17, 2023
ba0d58f
remove additional spacing
fionnodonohoe-xlnx Jul 21, 2023
111c873
No need for buildDiscarder function in the pipeline itself
fionnodonohoe-xlnx Jul 21, 2023
746315c
Env variables are controlled by external CI system and can be removed…
fionnodonohoe-xlnx Jul 21, 2023
91a5437
Specific agent not required when setting up pipeline
fionnodonohoe-xlnx Jul 21, 2023
8b7d781
Add boolean build parameters in order to select tests
fionnodonohoe-xlnx Jul 21, 2023
88462e1
Add sanity suite unit and fpgadataflow tests
fionnodonohoe-xlnx Jul 21, 2023
80029f1
Add sanity bitstream build tests
fionnodonohoe-xlnx Jul 21, 2023
3900428
Collect all files needed for HW testing, adding a stage to collect te…
fionnodonohoe-xlnx Jul 21, 2023
31ef8d6
Add hw testing stages - only run if build stage was successful
fionnodonohoe-xlnx Jul 21, 2023
674ef26
Only run HW tests if board is online first, fail the pipeline if boar…
fionnodonohoe-xlnx Jul 21, 2023
507a97b
Collect test result files in final stage and plot with JUnit plugin -…
fionnodonohoe-xlnx Jul 21, 2023
06a6b3d
Add post success/failure stage messages
fionnodonohoe-xlnx Jul 21, 2023
be6ed94
Add file archiving - for XML test result files
fionnodonohoe-xlnx Jul 21, 2023
d31ffca
Add end2end build tests - collecting results as well
fionnodonohoe-xlnx Jul 21, 2023
df81b04
Add end2end hardware tests - collecting results as well
fionnodonohoe-xlnx Jul 21, 2023
feb4b27
Add catchError for end2end bnn build stages to allow pipeline to cont…
fionnodonohoe-xlnx Jul 21, 2023
7e258a8
Add pytest-html library and add to all tests in Jenkinsfile. Archive …
fionnodonohoe-xlnx Jul 21, 2023
6b5e768
Add pytest-html-merger library to combine individual HTML files creat…
fionnodonohoe-xlnx Jul 21, 2023
fb9218e
Add code coverage for sanity unit tests and for fpgadataflow tests. A…
fionnodonohoe-xlnx Jul 21, 2023
c28e8f0
Forgot to add additionalOptions as a function input
fionnodonohoe-xlnx Jul 25, 2023
0a2b850
Remove postFailure() and postSuccess() functions.
fionnodonohoe-xlnx Jul 25, 2023
61cba65
Remove driver hack from BNN testing
fionnodonohoe-xlnx Jul 26, 2023
10d34b5
Add input tensor data reshaping and transposing for BNN networks
fionnodonohoe-xlnx Jul 26, 2023
fe09152
Add markers for BNN test suites to quiesce warnings when running pytest
fionnodonohoe-xlnx Jul 28, 2023
7e330ad
Merge branch 'testing/jenkins-integration-end2end' into testing/jenki…
fionnodonohoe-xlnx Jul 28, 2023
d7370db
Add pytest library version and associates plugins for HTML report cap…
fionnodonohoe-xlnx Jul 28, 2023
131e176
Merge branch 'testing/html-reports' into testing/jenkins-integration
fionnodonohoe-xlnx Jul 28, 2023
f4c50a9
Merge branch 'dev' into testing/jenkins-integration
auphelia Aug 8, 2023
8357c10
[Lint] Run pre-commit over files
auphelia Aug 8, 2023
3df0c17
[GHA] exclude bnn_pynq from quicktest
auphelia Aug 8, 2023
066d027
[CI] Split Jenkinsfiles into CI and testing
auphelia Aug 9, 2023
6f84ed9
[Tests] Rename board map for tests
auphelia Aug 9, 2023
e080625
[Tests] Fix bug in reshaping input npy for remote execution
auphelia Aug 9, 2023
fe09f06
[CI] Fix bug with build parameters and result flags sharing common names
Aug 23, 2023
99a589b
Merge pull request #877 from johnnoel-xlnx/testing/jenkins-integration
auphelia Aug 23, 2023
161544a
Move successful archive step to parallel stage instead of post
Sep 29, 2023
dd7806e
[CI] Append a space to FINN_DOCKER_EXTRA to avoid malformed docker co…
Oct 2, 2023
011a818
Merge branch 'dev' into testing/jenkins-integration
Oct 2, 2023
56b155f
[CI] Address PR comments
Oct 5, 2023
1ec9e60
Merge branch 'dev' into testing/jenkins-integration
Oct 9, 2023
b2e0473
[CI] exclude bnn_pynq from quicktest
Oct 10, 2023
98e94f7
[CI] fixing linting, lingering line left behind after resolving merge…
Oct 10, 2023
5eb535a
[NB] make all output paths absolute in advanced notebook
Oct 11, 2023
99e9b73
[CI] remove reference to unused hack script
Oct 12, 2023
07e3b39
[Tests] fix end2end bnn_pynq cnv transpose
Oct 16, 2023
1bf20d5
[Tests] Disabling end2end_bnn_pynq U250 tests failing due to routing …
Oct 18, 2023
4f51ed6
[CI] Use virtual env instead of Conda for Jenkins testing
Oct 23, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 7 additions & 0 deletions docker/Dockerfile.finn
Original file line number Diff line number Diff line change
Expand Up @@ -102,6 +102,13 @@ RUN pip install pandas==1.5.3
RUN pip install scikit-learn==1.2.1
RUN pip install tqdm==4.64.1
RUN pip install -e git+https://github.com/fbcotter/[email protected]#egg=dataset_loading
# these versions of pytest and associated plugins allow for stable collection of
# test reports and code coverage reports in HTML
RUN pip install pytest==6.2.5
RUN pip install pytest-metadata==1.7.0
RUN pip install pytest-html==3.0.0
RUN pip install pytest-html-merger==0.0.8
RUN pip install pytest-cov==4.1.0

# extra dependencies from other FINN deps
# installed in Docker image to make entrypoint script go faster
Expand Down
Loading