DP Creator Analyst Mode

[sync-by-unito]

Problem Statement

The new analyst mode will give a Dataset Owner the ability to add other users – in “Analyst” roles – and delegate a portion of a dataset’s privacy budget so that these Analysts will have the ability to create DP Releases. The Dataset Owner will have the ability to manage Analysts as well as their privacy budgets.

The initial version will not require dataverse integration. So what we're discussing here will come after this first iteration.

Later, a dataverse dataset owner will need a method for delegating other dataverse users as OpenDP analysts. There is a lot of question as to what this actually means in the Dataverse world. Will there be synchronization accross the OpenDP and Dataverse systems? Also -the team understands that Dataverse is undergoing a re-architecture and this may impact how user permissions work. The design of the interactions will likely be impacted by any changes.

Owners

• Technical Stakeholder: @raprasad, Annie Wu
• End User Stakeholder: TBD

Proposed Solution

We propose to

• TBD
• TBD
• TBD

Acceptance Criteria

We will have completed this deliverable when

• TBD
• TBD
• TBD

Sizing

• TBD

Links:

• Deliverable Problem Definition Issue
• Backlog Grooming Board
• Deliverable Backlog Grooming Sidecar Issue

---

Deliverable Backlog Grooming Sidecar Issue
All daily work and progress prior to the the first sprint goes into the Deliverable Backlog Grooming Sidecar Issue

[mreekie]

RESERVED COMMENT

[mreekie]

mreekie
1 month ago
·
Member
From Annie 9 days ago:

Just so we don’t have piece-mail flying around :),
this request originally came from me and is about asking a Dataverse developer to join the dev work of the next deliverable of DP Creator, so that 1) the Dataverse developer learns about the DP Creator architecture (especially backend) first-hand, and 2) DP Creator gets the dev throughput needed for the frontend and backend work to advance in sync.

Raman can describe the technical scope of our next deliverable. We have worked with several developers on the Dataverse team, and our guess is that Leonid would have the least amount of ramping up time to join the specific work of our next deliverable. Ellen will continue to primarily focus on the frontend work on DP Creator.

Please let us know if you have any immediate questions or need any info besides the technical scope Raman can provide.

mreekie
1 month ago (edited)
·
Member
Finished setting up the Deliverable setup in the Dataverse Deliverables Backlog Prep project.
Setup an opendp team in dataverse. Has just the people on this project. Might be a temporary thing. Not sure yet.
Invited people who might be involved in fleshing this deliverable out to this issue.
Met with Annie Wu informally today. Sounds like they are in good shape. She filled me in that the team working out their top level design. This needs approval and then that will enable Raman to create a work plan and from there we get the user stories for this Deliverable.
Next steps:

The OpenDP team is working through planning for this deliverable. That could take a few weeks? Once they finish we will be able to meet and start building a backlog

[mreekie]

Met with Raman on this.
The request right now is for resources for work on OpenDP as opposed to integration work.
So this deliverable is on hold for now.
Raman is working on decomposing the work into use-cases, etc. right now.
After that is more complete, he's going to speak with Stefano again.

[mreekie]

Exchanged some information via slack.
The results are paraphrased here.

The starting point is a brief update that: There is a plan to install DP Creator on the same server of HDV. Plan is (for september) to make use of future login capabilities of the SPA for HDV that will simplify the user trust when it comes to manipulate data with DP Creator.

Talking to Annie and Raman

• There has been conversations with Stefano relating to integrating Dataverse and DP Creator in “tighter” ways than what we have at the moment
• Currently DPC and DV are in separate cloud environments and talk to each other through many servers over the Internet.
• It's been agreed that given Dataverse’s API rewrite and especially upgraded auth (OIDC), it doesn’t make sense to continue the integration above which is custom/messy/etc.
• There hasn't been a formal decision on how the tighter integration will be designed yet.

In the Short term:

• Stefano recently met with Ellen and Raman to scope/resources for a DP Creator grant deliverable due at the end of August taking into account the resource shortfall we've had.
• We are going to adjust the current demo so that DV and DPC could run on the same server. If that is not feasible, the second option will be perhaps within the same trusted network.

Next steps:

• meeting to scope this out would be a next step.

More context on a Live Demo: DP Creator (DPC) and Dataverse integration

• Since last year there has been a demo of DV and DPC applications using the Test Dataverse instance set up by Leonid
  on AWS.

• There is also the Test DP Creator instance set up by us on Azure using MS credits for hosting. https://demo.dpcreator.org/

• We have been running DP Creator with kubernetes. The setup with some work, could run on a different type of setup.

  • We use docker compose for development but once deployed it’s: Postgres, redis, nginx, python webserver

[cmbz]

2023/12/19: Closing, will monitor in: IQSS/dataverse-pm#107