Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Integrate Measurement Module #100

Open
alexb1200 opened this issue Nov 15, 2022 · 0 comments
Open

Integrate Measurement Module #100

alexb1200 opened this issue Nov 15, 2022 · 0 comments
Assignees
Labels
feature New feature to add to project icebox Tabled/archived for now, but may be revisited later on

Comments

@alexb1200
Copy link
Contributor

alexb1200 commented Nov 15, 2022

Overview

Reimplement the metrics module to support logging with mlflow, and ensure the prefect dependency graph executes the filter->preprocessing->measure->postprocessing->output stages correctly.

Features and Functionality

  • Supports batched and single data
  • Supports user defined custom metrics
  • Auto-vectorizes data transformations and metrics
  • Ability to measure and compare data from different experiments

Definition of Done

  • Compatible with all supported backends
  • All function calls are logged with mlflow
  • All data transformations are done using reusable units of work available throughout Dioptra

Revisit as part of redesign of built-in task plugins #293

@jkglasbrenner jkglasbrenner added this to the Backlog milestone Jul 18, 2023
@hbooth hbooth removed this from the Backlog milestone Oct 10, 2023
@jkglasbrenner jkglasbrenner added icebox Tabled/archived for now, but may be revisited later on feature New feature to add to project labels Nov 30, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature New feature to add to project icebox Tabled/archived for now, but may be revisited later on
Projects
None yet
Development

No branches or pull requests

3 participants