Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Extract cyhy orgs & vuln scans data #233

Merged
merged 13 commits into from
May 9, 2024
Merged

Conversation

DJensen94
Copy link
Contributor

🗣 Description

This PR creates a scan to pull org and vulns scan data from VS and saves it to the mini data lake

💭 Motivation and context

This will allow us to have all the CyHy data fields in the same data lake, more collections will follow in future PRs

🧪 Testing

✅ Pre-approval checklist

  • This PR has an informative and human-readable title.
  • Changes are limited to a single goal - eschew scope creep!
  • All future TODOs are captured in issues, which are referenced
    in code comments.
  • All relevant type-of-change labels have been added.
  • I have read the CONTRIBUTING document.
  • These code changes follow cisagov code standards.
  • All relevant repo and/or project documentation has been updated
    to reflect the changes in this PR.
  • Tests have been added and/or modified to cover the changes in this PR.
  • All new and existing tests pass.

✅ Pre-merge checklist

  • Revert dependencies to default branches.
  • Finalize version.

✅ Post-merge checklist

  • Create a release.

DJensen94 and others added 5 commits April 11, 2024 10:24
create a scan to pull vs data
update vs_sync to pull from a json
update vs_sync to save requests and vulns_scans collections
Add comments to vs_sync
backend/src/tasks/vs_sync.ts Fixed Show fixed Hide fixed
backend/src/tasks/vs_sync.ts Fixed Show fixed Hide fixed
backend/src/worker.ts Fixed Show fixed Hide fixed
backend/src/worker.ts Fixed Show fixed Hide fixed
fix typo in scanExecution
remove duplicate properties from backend worker
Run linter on files
update package lock
Use 'const' instead  prefer-const
@DJensen94 DJensen94 requested a deployment to production May 8, 2024 18:39 — with GitHub Actions Abandoned
run linter on package lock
remove unnecessary or check
Copy link
Collaborator

@rapidray12 rapidray12 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Password as the password. How inventive

@schmelz21 schmelz21 merged commit 517d4b0 into develop May 9, 2024
23 of 26 checks passed
@schmelz21 schmelz21 deleted the DJ_extract_cyhy_data_WIP branch May 9, 2024 16:19
@DJensen94 DJensen94 restored the DJ_extract_cyhy_data_WIP branch May 9, 2024 18:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants