Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PDF Inventory where title is not PMID #23

Open
joshlawrimore opened this issue Jan 9, 2025 · 1 comment
Open

PDF Inventory where title is not PMID #23

joshlawrimore opened this issue Jan 9, 2025 · 1 comment

Comments

@joshlawrimore
Copy link
Contributor

Josh will upload PDFs where the title is NOT the PMID.

Create a identifier_conflicts table with the following columns:
document_id: filehash, can be null
has_doi_conflict: boolean
has_pmid_conflict: boolean
has_pmcid_confilct: boolean
provenance_id: bigserial, foreign key
conflicting_id_1: bigserial, foreign key (from id table)
conflicting_id_2: bigserial, foreign key (from oddpub table)
Write code that parses the S3 bucket’s inventory to create a document entry, a works entry, and an identifier entry based on the document filehash alone. There will be no PMID id for these.
Run the oddpub code on the inventory to generate the oddpub metrics table.
Write code that compares uploaded PDF identifiers (PMID, PMCID, and DOI) with identifiers from oddpub table with the same document_id. The comparison code should fill in missing entries and create a new identifier.
Conflicts between identifiers should be reported in the conflicts table.

The resultant database should be in an AWS postgres database.

@joshlawrimore
Copy link
Contributor Author

I will upload the PDFs where titles are NOT PMIDs to the osm-pdfs-uploads bucket after I upload the PMID PDFs from issue 22.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant