Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature DCAT-US v1.0 #315

Closed
wants to merge 46 commits into from
Closed

Feature DCAT-US v1.0 #315

wants to merge 46 commits into from

Conversation

jwaspin
Copy link
Contributor

@jwaspin jwaspin commented Dec 15, 2023

Closes #251

Changes

New DCAT-US v1.0 writer

Testing

Check testing deployment status here
mdEditor http://23.23.4.125:8001/
mdTranslator http://23.23.4.125:8001/

jwaspin and others added 11 commits September 11, 2023 15:59
* Add DCAT-US Writer

Migrating changes from another branch.
Unit tests and writers for most required fields
and some if-applicable fileds.

* Add DCAT-US.md

* Remove Whitespace

* New Access Level Unit Test

Fix accessLevel writer.

* Add Unit Tests Access Level

New tests for public and restricted public.

* New Unit Test For License

* New Unit Test Spatial

* Remove Comment Headers

* New Temporal Unit Test

* Remove Comment Header

* Add DCAT-US Tests to Rakefile

* Update MiniTest to Minitest

* New Distribution Unit Test

* Complete Temporal Unit Test & Writer

* Update Rights Unit Test & Writer

* Remove Sample Files
* Add DCAT-US Writer

Migrating changes from another branch.
Unit tests and writers for most required fields
and some if-applicable fileds.

* Add DCAT-US.md

* Remove Whitespace

* New Access Level Unit Test

Fix accessLevel writer.

* Add Unit Tests Access Level

New tests for public and restricted public.

* New Unit Test For License

* New Unit Test Spatial

* Remove Comment Headers

* New Temporal Unit Test

* Remove Comment Header

* Add DCAT-US Tests to Rakefile

* Update MiniTest to Minitest

* New Distribution Unit Test

* Complete Temporal Unit Test & Writer

* Update Rights Unit Test & Writer

* Remove Sample Files

* New Issued Field

Writer, unit test, and test file.
Enabled issue field in main dcat_us writer.

* New Theme Field

Writer, unit test, and test file.
Enabled theme in main dcat_us writer.

* New Landing Page Field

Writer, unit test, and test file.
Enabled landingPage in main writer.

* New IsPartOf Field

Writer, unit test, and test file.
Enabled isPartOf in main writer.

* Update DCAT-US.md

* New Described By Field

Writer, unit test, and test file.
Enabled describedBy in the main writer.

* New References Field

Writer, unit test, and test file.
Enabled references field in main writer.

* New System of Records Field

Writer, unit test, and test file.
Enabled systemOfRecords field in main writer.
includedWithDataset is the internal version of the
dictionaryIncludedWithResource field in mdJson.
Moved into its own file and fixed the mapping.
@jwaspin jwaspin marked this pull request as draft December 15, 2023 16:28
jwaspin and others added 18 commits January 10, 2024 08:45
* Updated Gemfile to work with tests.

Added test documentation.

* Added github action to run automated tests

* Updated DCAT-US to not use namespace

See examples of what DCAT-US and data.gov expect here:
https://github.com/GSA/ckanext-datajson/tree/main/ckanext/datajson/tests/datajson-samples
* change divs to headers

* fix key within qualityMeasure. change to header tags
* add geographicExtent to simple_html writer (#338)

* add geographicExtent to simple_html writer

* Fix Data Quality

Fixed checks for nil and empty.
Fixed tags.
Fixed structures.

* Fix Data Quality

* Remove bodyScript and other js

* Fix Typo referenceDocument -> referenceDocuments

---------

Co-authored-by: Johnathan Aspinwall <jwaspin@gmail.com>

* add bookmark span tags to headers (#340)

Co-authored-by: Johnathan Aspinwall <jwaspin@gmail.com>

* Increment Patch Version

* Increment Minor Version

---------

Co-authored-by: J-Oliveros <97468338+J-Oliveros@users.noreply.github.com>
* add geographicExtent to simple_html writer (#338)

* add geographicExtent to simple_html writer

* Fix Data Quality

Fixed checks for nil and empty.
Fixed tags.
Fixed structures.

* Fix Data Quality

* Remove bodyScript and other js

* Fix Typo referenceDocument -> referenceDocuments

---------

Co-authored-by: Johnathan Aspinwall <jwaspin@gmail.com>

* add bookmark span tags to headers (#340)

Co-authored-by: Johnathan Aspinwall <jwaspin@gmail.com>

* Increment Patch Version

* Increment Minor Version

* Bugfixes for Simple HTML (#343)

* change divs to headers (#337)

* change divs to headers

* fix key within qualityMeasure. change to header tags

* Simple HTML Enhancements (#339)

* add geographicExtent to simple_html writer (#338)

* add geographicExtent to simple_html writer

* Fix Data Quality

Fixed checks for nil and empty.
Fixed tags.
Fixed structures.

* Fix Data Quality

* Remove bodyScript and other js

* Fix Typo referenceDocument -> referenceDocuments

---------

Co-authored-by: Johnathan Aspinwall <jwaspin@gmail.com>

* add bookmark span tags to headers (#340)

Co-authored-by: Johnathan Aspinwall <jwaspin@gmail.com>

* Increment Patch Version

* Increment Minor Version

---------

Co-authored-by: J-Oliveros <97468338+J-Oliveros@users.noreply.github.com>

---------

Co-authored-by: J-Oliveros <97468338+J-Oliveros@users.noreply.github.com>

* Increment Patch Version

* Fix Data Quality

* Increment Patch Version

* simple_html output formatting (#344)

---------

Co-authored-by: J-Oliveros <97468338+J-Oliveros@users.noreply.github.com>
* add references to process

* redirect citation to processSteps

* revert to lineageCitation

* Fix newLineage Order

dataSources after processSteps

* Moving Methodology to Process Steps

* Restore hResourceInfo Variable

* Commented Keyword - Method Required Warning

* Upgrade adiwg-mdjson_schemas

adiwg-mdjson_schemas -> 2.9.0

* Update Gemfile.lock

* commented out mdJson reader minor version test

* Refactor lineage module and process module. Updated tests.

* Add comment about test being disabled.

* Add comment to explain why code is disabled

---------

Co-authored-by: Johnathan Aspinwall <jwaspin@gmail.com>
* Add mapping to accessLevel

* Formatting

* Update tests to reflect mapping

* remove unnecessary print statement

* fix legal and security accessLevel codes in tests

* Add test cases for accessLevel.  fix array append to accessLevelCodes.
J-Oliveros and others added 5 commits March 14, 2024 10:47
* Update accrualPeriodicity field in DCAT-US writer

* Break out accrualPeriodicity and add mapping

* add nil check to frequency
* Add primaryITInvestmentUII in DCAT-US writer

* add support for primaryITInvestmentUII

---------

Co-authored-by: Johnathan Aspinwall <jwaspin@gmail.com>
@jwaspin jwaspin changed the base branch from develop to releases/2-20-0 April 24, 2024 16:26
@jwaspin jwaspin deleted the branch releases/2-20-0 May 26, 2024 18:43
@jwaspin jwaspin closed this May 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Support DCAT-US metadata schema
3 participants