Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add generic plugin transformation ability #56

Open
wants to merge 31 commits into
base: master
Choose a base branch
from
Open

Add generic plugin transformation ability #56

wants to merge 31 commits into from

Commits on May 5, 2021

  1. Add kafka support

    @colmsnowplow
    Paul Boocock authored and colmsnowplow committed May 5, 2021
    Configuration menu
    Copy the full SHA
    4708aec View commit details
    Browse the repository at this point in the history

  2. Add transformation support

    @colmsnowplow
    colmsnowplow committed May 5, 2021
    Configuration menu
    Copy the full SHA
    ed68e90 View commit details
    Browse the repository at this point in the history

  3. Fix go.mod and go.sum

    @colmsnowplow
    colmsnowplow committed May 5, 2021
    Configuration menu
    Copy the full SHA
    34bd8cf View commit details
    Browse the repository at this point in the history

Commits on May 12, 2021

  1. Refactor transformations to have each function operate on a single event

    @colmsnowplow
    colmsnowplow committed May 12, 2021
    Configuration menu
    Copy the full SHA
    d6692db View commit details
    Browse the repository at this point in the history

  2. Introduce IntermediateState to avoid parsing event multiple times

    @colmsnowplow
    colmsnowplow committed May 12, 2021
    Configuration menu
    Copy the full SHA
    7c61cac View commit details
    Browse the repository at this point in the history

  3. Switch Kafka Target to use sarama.AsyncProducer

    @colmsnowplow
    Paul Boocock authored and colmsnowplow committed May 12, 2021
    Configuration menu
    Copy the full SHA
    6ae77ac View commit details
    Browse the repository at this point in the history

  4. Add Tests for Writing to Kafka Producers

    @colmsnowplow
    Paul Boocock authored and colmsnowplow committed May 12, 2021
    Configuration menu
    Copy the full SHA
    2b70967 View commit details
    Browse the repository at this point in the history

  5. Update go.mod and go.sum

    @colmsnowplow
    colmsnowplow committed May 12, 2021
    Configuration menu
    Copy the full SHA
    e9f1701 View commit details
    Browse the repository at this point in the history

  6. Update analytics sdk version

    @colmsnowplow
    colmsnowplow committed May 12, 2021
    Configuration menu
    Copy the full SHA
    e4ef84e View commit details
    Browse the repository at this point in the history

  7. Update Message.TimeTransformed once, in TransformationFunction

    @colmsnowplow
    colmsnowplow committed May 12, 2021
    Configuration menu
    Copy the full SHA
    7a2b26f View commit details
    Browse the repository at this point in the history

  8. Improve and cleanup transform tests

    @colmsnowplow
    colmsnowplow committed May 12, 2021
    Configuration menu
    Copy the full SHA
    7461ff1 View commit details
    Browse the repository at this point in the history

  9. Fix broken CI/CD after pushing file early by mistake

    @colmsnowplow
    colmsnowplow committed May 12, 2021
    Configuration menu
    Copy the full SHA
    4519618 View commit details
    Browse the repository at this point in the history

  10. Update comments for clarity

    @colmsnowplow
    colmsnowplow committed May 12, 2021
    Configuration menu
    Copy the full SHA
    85e19ac View commit details
    Browse the repository at this point in the history

Commits on May 13, 2021

  1. Refactor and cleanup transform tests

    @colmsnowplow
    colmsnowplow committed May 13, 2021
    Configuration menu
    Copy the full SHA
    50d657d View commit details
    Browse the repository at this point in the history

  2. Dereference in TransformationApplyFunction rather than Transformation… 

    …Function
    @colmsnowplow
    colmsnowplow committed May 13, 2021
    Configuration menu
    Copy the full SHA
    72c39e4 View commit details
    Browse the repository at this point in the history

  3. Add inline comment for clarity

    @colmsnowplow
    colmsnowplow committed May 13, 2021
    Configuration menu
    Copy the full SHA
    8426666 View commit details
    Browse the repository at this point in the history

  4. make tidy

    @colmsnowplow
    colmsnowplow committed May 13, 2021
    Configuration menu
    Copy the full SHA
    d6d265c View commit details
    Browse the repository at this point in the history

  5. Add comments to coerce indentation consistency

    @colmsnowplow
    colmsnowplow committed May 13, 2021
    Configuration menu
    Copy the full SHA
    51b14b7 View commit details
    Browse the repository at this point in the history

Commits on May 17, 2021

  1. Add version check to github workflow

    @colmsnowplow
    colmsnowplow committed May 17, 2021
    Configuration menu
    Copy the full SHA
    a80c312 View commit details
    Browse the repository at this point in the history

  2. Update VERSION file

    @colmsnowplow
    colmsnowplow committed May 17, 2021
    Configuration menu
    Copy the full SHA
    eb08fd0 View commit details
    Browse the repository at this point in the history

Commits on May 19, 2021

  1. Pass intermediateState between transformations rather than amending m… 

    …essage model
    @colmsnowplow
    colmsnowplow committed May 19, 2021
    Configuration menu
    Copy the full SHA
    acdab61 View commit details
    Browse the repository at this point in the history

  2. Tidy up go.mod

    @colmsnowplow
    colmsnowplow committed May 19, 2021
    Configuration menu
    Copy the full SHA
    a323427 View commit details
    Browse the repository at this point in the history

Commits on May 21, 2021

  1. Patch Kafka target - use the provided version if supported

    @colmsnowplow
    colmsnowplow committed May 21, 2021
    Configuration menu
    Copy the full SHA
    35c81e2 View commit details
    Browse the repository at this point in the history

  2. Pass log to sarama for improved config validation

    @colmsnowplow
    Paul Boocock authored and colmsnowplow committed May 21, 2021
    Configuration menu
    Copy the full SHA
    2fed522 View commit details
    Browse the repository at this point in the history

Commits on May 24, 2021

  1. Bump version to rc3

    @colmsnowplow
    colmsnowplow committed May 24, 2021
    Configuration menu
    Copy the full SHA
    0009211 View commit details
    Browse the repository at this point in the history

Commits on May 26, 2021

  1. Update analytics sdk to v0.1.0

    @colmsnowplow
    colmsnowplow committed May 26, 2021
    Configuration menu
    Copy the full SHA
    2cfb616 View commit details
    Browse the repository at this point in the history

Commits on May 28, 2021

  1. Always log time values in ms

    @colmsnowplow
    colmsnowplow committed May 28, 2021
    Configuration menu
    Copy the full SHA
    0f1d8fd View commit details
    Browse the repository at this point in the history

  2. Bump version to rc4

    @colmsnowplow
    colmsnowplow committed May 28, 2021
    Configuration menu
    Copy the full SHA
    08d2efb View commit details
    Browse the repository at this point in the history

Commits on Jun 4, 2021

  1. Add generic plugin transformation ability 

    - Adds both a short & long running process hook
- Short running caps at about 500 messages / sec
- Long running caps at about 8-9k messages / sec

Example scripts included!
    @jbeemster
    jbeemster committed Jun 4, 2021
    Configuration menu
    Copy the full SHA
    71601ab View commit details
    Browse the repository at this point in the history

  2. Fix long.sh example to add newline

    @lukeindykiewicz
    lukeindykiewicz committed Jun 4, 2021
    Configuration menu
    Copy the full SHA
    c1f6118 View commit details
    Browse the repository at this point in the history

  3. Add long running example in Go by Joe

    @lukeindykiewicz
    lukeindykiewicz committed Jun 4, 2021
    Configuration menu
    Copy the full SHA
    1856783 View commit details
    Browse the repository at this point in the history