Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PromptNER based Chain-of-Thought prompting for span tasks #180

Merged
merged 108 commits into from
Aug 25, 2023
Merged

Commits on Jun 15, 2023

  1. initial POC for Chain of Thought NER task

    Kabir Khan committed Jun 15, 2023
    Configuration menu
    Copy the full SHA
    a175d36 View commit details
    Browse the repository at this point in the history
  2. ruff fix

    Kabir Khan committed Jun 15, 2023
    Configuration menu
    Copy the full SHA
    820337b View commit details
    Browse the repository at this point in the history

Commits on Jun 20, 2023

  1. Merge branch 'main' of ssh://github.com/explosion/spacy-llm into kab/…

    …cot-ner
    Kabir Khan committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    ea261aa View commit details
    Browse the repository at this point in the history

Commits on Jul 4, 2023

  1. Merge branch 'develop' of ssh://github.com/explosion/spacy-llm into k…

    …ab/cot-ner
    Kabir Khan committed Jul 4, 2023
    Configuration menu
    Copy the full SHA
    6fa0b6a View commit details
    Browse the repository at this point in the history

Commits on Jul 5, 2023

  1. update template

    vinbo8 committed Jul 5, 2023
    Configuration menu
    Copy the full SHA
    4c562d9 View commit details
    Browse the repository at this point in the history
  2. consilidate approach to work with main SpanTask

    Kabir Khan committed Jul 5, 2023
    Configuration menu
    Copy the full SHA
    54a9eae View commit details
    Browse the repository at this point in the history
  3. Merge branch 'develop' of ssh://github.com/explosion/spacy-llm into k…

    …ab/cot-ner-integrate
    Kabir Khan committed Jul 5, 2023
    Configuration menu
    Copy the full SHA
    8737f4a View commit details
    Browse the repository at this point in the history
  4. fix tests around label consistency checks

    Kabir Khan committed Jul 5, 2023
    Configuration menu
    Copy the full SHA
    7a1fbdb View commit details
    Browse the repository at this point in the history

Commits on Jul 6, 2023

  1. Configuration menu
    Copy the full SHA
    2921ca9 View commit details
    Browse the repository at this point in the history
  2. merge kab/cot-ner-integrate

    vinbo8 committed Jul 6, 2023
    Configuration menu
    Copy the full SHA
    2a0b1c8 View commit details
    Browse the repository at this point in the history
  3. fix edge cases

    vinbo8 committed Jul 6, 2023
    Configuration menu
    Copy the full SHA
    4772cb2 View commit details
    Browse the repository at this point in the history
  4. merge develop

    vinbo8 committed Jul 6, 2023
    Configuration menu
    Copy the full SHA
    d95eaac View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    57a71b3 View commit details
    Browse the repository at this point in the history
  6. move label consistency checks

    vinbo8 committed Jul 6, 2023
    Configuration menu
    Copy the full SHA
    6335b3b View commit details
    Browse the repository at this point in the history
  7. handle labels in span.py

    vinbo8 committed Jul 6, 2023
    Configuration menu
    Copy the full SHA
    c565256 View commit details
    Browse the repository at this point in the history

Commits on Jul 17, 2023

  1. cleanup older NER

    vinbo8 committed Jul 17, 2023
    Configuration menu
    Copy the full SHA
    54f28d2 View commit details
    Browse the repository at this point in the history
  2. fixes

    vinbo8 committed Jul 17, 2023
    Configuration menu
    Copy the full SHA
    aa25bba View commit details
    Browse the repository at this point in the history
  3. cleanup

    vinbo8 committed Jul 17, 2023
    Configuration menu
    Copy the full SHA
    f52feb5 View commit details
    Browse the repository at this point in the history

Commits on Jul 21, 2023

  1. update NER template with label_definitions + initial description, fix…

    … parsing of SpanReason
    Kabir Khan committed Jul 21, 2023
    Configuration menu
    Copy the full SHA
    19d55cc View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    6edea90 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    9f08287 View commit details
    Browse the repository at this point in the history
  4. fix docstring

    Kabir Khan committed Jul 21, 2023
    Configuration menu
    Copy the full SHA
    e4f8195 View commit details
    Browse the repository at this point in the history
  5. rm single_match since it's always true now

    Kabir Khan committed Jul 21, 2023
    Configuration menu
    Copy the full SHA
    cb64f6a View commit details
    Browse the repository at this point in the history
  6. rm single_match since it's always true now

    Kabir Khan committed Jul 21, 2023
    Configuration menu
    Copy the full SHA
    a8c88bf View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    3e34add View commit details
    Browse the repository at this point in the history
  8. fix test

    Kabir Khan committed Jul 21, 2023
    Configuration menu
    Copy the full SHA
    c40b897 View commit details
    Browse the repository at this point in the history

Commits on Jul 24, 2023

  1. fix NER tests

    Kabir Khan committed Jul 24, 2023
    Configuration menu
    Copy the full SHA
    fc3455c View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    36579f4 View commit details
    Browse the repository at this point in the history

Commits on Jul 25, 2023

  1. fix ner to_disk test

    Kabir Khan committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    e0f2ef0 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    5a4b681 View commit details
    Browse the repository at this point in the history
  3. test fixes

    Kabir Khan committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    18e5e10 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    eddac8c View commit details
    Browse the repository at this point in the history
  5. use yaml/jsonl versions of ner examples

    Kabir Khan committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    1299787 View commit details
    Browse the repository at this point in the history
  6. actually check scoring with real LLM call

    Kabir Khan committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    b0a076d View commit details
    Browse the repository at this point in the history
  7. rename format_response to extract_span_reasons

    Kabir Khan committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    b432a50 View commit details
    Browse the repository at this point in the history
  8. move Self to compat types

    Kabir Khan committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    ee64727 View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2023

  1. fix test for serde

    Kabir Khan committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    01e1de9 View commit details
    Browse the repository at this point in the history

Commits on Jul 27, 2023

  1. Self only in 3.10+

    Kabir Khan committed Jul 27, 2023
    Configuration menu
    Copy the full SHA
    8c31b05 View commit details
    Browse the repository at this point in the history
  2. Self only in 3.11+ actually

    Kabir Khan committed Jul 27, 2023
    Configuration menu
    Copy the full SHA
    6235091 View commit details
    Browse the repository at this point in the history
  3. ner test fixes

    Kabir Khan committed Jul 27, 2023
    Configuration menu
    Copy the full SHA
    66c7377 View commit details
    Browse the repository at this point in the history
  4. convert spancat to new span task format

    Kabir Khan committed Jul 27, 2023
    Configuration menu
    Copy the full SHA
    8e5952c View commit details
    Browse the repository at this point in the history
  5. add better doc for SpanReason.to_str

    Kabir Khan committed Jul 27, 2023
    Configuration menu
    Copy the full SHA
    3fa3fbe View commit details
    Browse the repository at this point in the history
  6. fixing tests for spancat

    Kabir Khan committed Jul 27, 2023
    Configuration menu
    Copy the full SHA
    7beaf93 View commit details
    Browse the repository at this point in the history

Commits on Jul 31, 2023

  1. adjust span matching by adding an setting

    Kabir Khan committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    0e162d6 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    6894a80 View commit details
    Browse the repository at this point in the history
  3. remove dict | operator that only works in python3.9 +

    Kabir Khan committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    bb261bd View commit details
    Browse the repository at this point in the history
  4. disable test for now so CI passes

    Kabir Khan committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    dfa96c0 View commit details
    Browse the repository at this point in the history
  5. revert spanreason start_char

    Kabir Khan committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    1700849 View commit details
    Browse the repository at this point in the history
  6. fix spancat template rendering for allow_overlap

    Kabir Khan committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    ae3a545 View commit details
    Browse the repository at this point in the history
  7. clean up tests for init with spacy examples

    Kabir Khan committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    850e8ee View commit details
    Browse the repository at this point in the history
  8. fix spancat test?

    Kabir Khan committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    7242d6e View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    150d21e View commit details
    Browse the repository at this point in the history
  10. run case sensitive matching then fallback to case insensitive if the …

    …user configured it that way
    Kabir Khan committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    abd52b8 View commit details
    Browse the repository at this point in the history
  11. rm prev_span reference in parsing

    Kabir Khan committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    bde5c8d View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    c86b0e9 View commit details
    Browse the repository at this point in the history
  13. fix typing on the regression test

    Kabir Khan committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    91bffaf View commit details
    Browse the repository at this point in the history
  14. Configuration menu
    Copy the full SHA
    d02b425 View commit details
    Browse the repository at this point in the history

Commits on Aug 1, 2023

  1. add old spancat/ner versions to tasks.legacy module

    Kabir Khan committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    17a2a9a View commit details
    Browse the repository at this point in the history
  2. add deprecation warnings + test deprecation warnings

    Kabir Khan committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    16f5d04 View commit details
    Browse the repository at this point in the history
  3. update usage examples

    Kabir Khan committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    7cab77f View commit details
    Browse the repository at this point in the history
  4. update examples and readme

    Kabir Khan committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    b1a4adf View commit details
    Browse the repository at this point in the history
  5. Merge branch 'main' of ssh://github.com/explosion/spacy-llm into kab/…

    …cot-ner
    Kabir Khan committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    8b40100 View commit details
    Browse the repository at this point in the history
  6. Merge branch 'kab/cot-ner' of ssh://github.com/explosion/spacy-llm in…

    …to kab/cot-ner-legacy
    Kabir Khan committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    574c9fe View commit details
    Browse the repository at this point in the history
  7. fix usage_examples

    Kabir Khan committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    3ab56e5 View commit details
    Browse the repository at this point in the history
  8. Merge branch 'kab/cot-ner' of ssh://github.com/explosion/spacy-llm in…

    …to kab/cot-ner-legacy
    Kabir Khan committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    46802bb View commit details
    Browse the repository at this point in the history

Commits on Aug 2, 2023

  1. Merge pull request #239 from explosion/kab/cot-ner-legacy

    add old spancat/ner versions to legacy module
    Kabir Khan authored Aug 2, 2023
    Configuration menu
    Copy the full SHA
    629dc3d View commit details
    Browse the repository at this point in the history
  2. Merge branch 'develop' of ssh://github.com/explosion/spacy-llm into k…

    …ab/cot-ner
    Kabir Khan committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    12093bf View commit details
    Browse the repository at this point in the history
  3. Merge branch 'kab/cot-ner' of ssh://github.com/explosion/spacy-llm in…

    …to kab/cot-ner
    Kabir Khan committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    f824a8e View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    09533e0 View commit details
    Browse the repository at this point in the history
  5. remove separate case sensitive match step before doing case insensiti…

    …ve as a fallback
    Kabir Khan committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    a6888d4 View commit details
    Browse the repository at this point in the history
  6. fix regression test to have 3 ents

    Kabir Khan committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    d43c840 View commit details
    Browse the repository at this point in the history
  7. fix incremental parsing

    Kabir Khan committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    b42e849 View commit details
    Browse the repository at this point in the history
  8. rm extra docstring stuff

    Kabir Khan committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    47c8a75 View commit details
    Browse the repository at this point in the history

Commits on Aug 3, 2023

  1. rm extra test

    Kabir Khan committed Aug 3, 2023
    Configuration menu
    Copy the full SHA
    edbc17d View commit details
    Browse the repository at this point in the history

Commits on Aug 4, 2023

  1. consolidate new spans template and ensure valid labels appear in the …

    …prompt
    Kabir Khan committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    990edf3 View commit details
    Browse the repository at this point in the history
  2. make prompt_examples required since it's required in confection facto…

    …ry func
    Kabir Khan committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    f77b0cd View commit details
    Browse the repository at this point in the history
  3. fix template rendering tests with new optional description and defaul…

    …t content
    Kabir Khan committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    e87f1a4 View commit details
    Browse the repository at this point in the history

Commits on Aug 8, 2023

  1. Merge branch 'develop' of ssh://github.com/explosion/spacy-llm into k…

    …ab/cot-ner
    Kabir Khan committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    03ab495 View commit details
    Browse the repository at this point in the history
  2. Remove extra deprecation warning

    Kabir Khan committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    d1b1410 View commit details
    Browse the repository at this point in the history
  3. Update usage_examples/ner_v3_openai/README.md

    Co-authored-by: Sofie Van Landeghem <svlandeg@users.noreply.github.com>
    Kabir Khan and svlandeg authored Aug 8, 2023
    Configuration menu
    Copy the full SHA
    208dbd6 View commit details
    Browse the repository at this point in the history

Commits on Aug 21, 2023

  1. Sync with new task structure.

    rmitsch committed Aug 21, 2023
    Configuration menu
    Copy the full SHA
    20be25a View commit details
    Browse the repository at this point in the history
  2. Fix 3.6 Protocol import.

    rmitsch committed Aug 21, 2023
    Configuration menu
    Copy the full SHA
    e6f63f5 View commit details
    Browse the repository at this point in the history
  3. Update ignored warnings.

    rmitsch committed Aug 21, 2023
    Configuration menu
    Copy the full SHA
    af04a26 View commit details
    Browse the repository at this point in the history
  4. Fix filterwarnings.

    rmitsch committed Aug 21, 2023
    Configuration menu
    Copy the full SHA
    8a95115 View commit details
    Browse the repository at this point in the history
  5. Update filterwarnings.

    rmitsch committed Aug 21, 2023
    Configuration menu
    Copy the full SHA
    80fc6c8 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    74a8486 View commit details
    Browse the repository at this point in the history

Commits on Aug 24, 2023

  1. Add default example if none are provided to COT NER/SpanCat tasks (#270)

    * use a default example for zero-shot NER/spancat COT tasks if none are provided
    
    * add test for no examples spancat COT
    
    * Fix tests.
    
    * Update filterwarnings.
    
    * Update RELExample factory.
    
    * Comment validator.
    
    * Attempt to fix pydantic macOS error.
    
    * Attempt to fix pydantic macOS error.
    
    * Update filterwarnings.
    
    ---------
    
    Co-authored-by: Raphael Mitsch <r.mitsch@outlook.com>
    Kabir Khan and rmitsch authored Aug 24, 2023
    Configuration menu
    Copy the full SHA
    61a6ab7 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    fa4e879 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    5903a03 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    69f5111 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    4706aa7 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    134da76 View commit details
    Browse the repository at this point in the history
  7. Fix span reason extraction.

    rmitsch committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    7d27d0e View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    2979ffc View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    398652a View commit details
    Browse the repository at this point in the history
  10. Fix NER prediction test.

    rmitsch committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    b4ad4d8 View commit details
    Browse the repository at this point in the history
  11. remove errors class entirely

    svlandeg committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    66c4fae View commit details
    Browse the repository at this point in the history

Commits on Aug 25, 2023

  1. Configuration menu
    Copy the full SHA
    88a2482 View commit details
    Browse the repository at this point in the history
  2. Update .github/workflows/test.yml

    Co-authored-by: Sofie Van Landeghem <svlandeg@users.noreply.github.com>
    rmitsch and svlandeg authored Aug 25, 2023
    Configuration menu
    Copy the full SHA
    2664a47 View commit details
    Browse the repository at this point in the history
  3. Update spacy_llm/tests/tasks/test_ner.py

    Co-authored-by: Sofie Van Landeghem <svlandeg@users.noreply.github.com>
    rmitsch and svlandeg authored Aug 25, 2023
    Configuration menu
    Copy the full SHA
    ee7fcdd View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    b64bf90 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    f895343 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    c763689 View commit details
    Browse the repository at this point in the history
  7. Update spacy_llm/tasks/spancat/registry.py

    Co-authored-by: Sofie Van Landeghem <svlandeg@users.noreply.github.com>
    rmitsch and svlandeg authored Aug 25, 2023
    Configuration menu
    Copy the full SHA
    d2f2a07 View commit details
    Browse the repository at this point in the history
  8. Update spacy_llm/tasks/ner/registry.py

    Co-authored-by: Sofie Van Landeghem <svlandeg@users.noreply.github.com>
    rmitsch and svlandeg authored Aug 25, 2023
    Configuration menu
    Copy the full SHA
    48bbd3c View commit details
    Browse the repository at this point in the history
  9. Merge branch 'develop' into kab/cot-ner

    # Conflicts:
    #	usage_examples/tests/test_usage_examples.py
    rmitsch committed Aug 25, 2023
    Configuration menu
    Copy the full SHA
    68c0a55 View commit details
    Browse the repository at this point in the history
  10. Changed SpanCat prompt intro.

    rmitsch committed Aug 25, 2023
    Configuration menu
    Copy the full SHA
    1c269e0 View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    3a31530 View commit details
    Browse the repository at this point in the history