Code

Payload Implementation#828

Code

Merged

hepengfe merged 147 commits intoasyml:masterasyml/forte:masterfrom hepengfe:payloadCopy head branch name to clipboardJun 30, 2022

+646-173

Commits

Commits on Jun 8, 2022

• add payloads and its basic operations in DataStore and DataPack

  hepengfe

  committed
  bad351f

  Copy full SHA for bad351f

• Merge branch 'master' of https://github.com/feipenghe/forte into payload

  hepengfe

  committed
  3adfbef

  Copy full SHA for 3adfbef

• docstring fix

  hepengfe

  committed
  9964029

  Copy full SHA for 9964029

• add implementation of payload with interface for users writing their own loading method

  hepengfe

  committed
  41a1d44

  Copy full SHA for 41a1d44

• minor fix

  hepengfe

  committed
  c72bf60

  Copy full SHA for c72bf60

• Merge branch 'master' into payload

  hepengfe

  authored
  4da6791

  Copy full SHA for 4da6791

• add audio payload test example

  hepengfe

  committed
  0f9993c

  Copy full SHA for 0f9993c

• Merge branch 'payload' of https://github.com/feipenghe/forte into payload

  hepengfe

  committed
  8ab7033

  Copy full SHA for 8ab7033

• move SoundfileAudioPayload out

  hepengfe

  committed
  a3b42dd

  Copy full SHA for a3b42dd

Commits on Jun 9, 2022

• add Meta

  hepengfe

  committed
  84e2d62

  Copy full SHA for 84e2d62

• add the logic of adding meta

  hepengfe

  committed
  e26560f

  Copy full SHA for e26560f

• add more meta adding in DataStore

  hepengfe

  committed
  7fa2428

  Copy full SHA for 7fa2428

Commits on Jun 10, 2022

• rewrite audio reader and processor to adapt the new Payload design

  hepengfe

  committed
  520163b

  Copy full SHA for 520163b

• new Payload stores loading_function and loading_path and add Meta class and its subclasses to store data processing related metadata

  hepengfe

  committed
  9e67de2

  Copy full SHA for 9e67de2

• temporarily import Meta inside the class as there is another Meta class inside the script

  hepengfe

  committed
  3bb940e

  Copy full SHA for 3bb940e

• remove import Meta inside DataPack class

  hepengfe

  committed
  4fcc72b

  Copy full SHA for 4fcc72b

• no changes

  hepengfe

  committed
  8b647e9

  Copy full SHA for 8b647e9

• allow users to pass None to pack so that Entry won't be added to DataPack

  hepengfe

  committed
  3a9e0c7

  Copy full SHA for 3a9e0c7

• pass None as pack to AudioProcessingMeta so that AudioProcessingMeta doesn't need to be added into any DataPack

  hepengfe

  committed
  a30fb81

  Copy full SHA for a30fb81

• remove Meta importing

  hepengfe

  committed
  4eafd16

  Copy full SHA for 4eafd16

• pylint fix: fix imports

  hepengfe

  committed
  d0f0939

  Copy full SHA for d0f0939

• make Payload class variables private

  hepengfe

  committed
  35a97d3

  Copy full SHA for 35a97d3

• remove initialized DataPack

  hepengfe

  committed
  19afb61

  Copy full SHA for 19afb61

• Delete payload_test.py

  hepengfe

  authored
  7a92b28

  Copy full SHA for 7a92b28

Commits on Jun 13, 2022

• new cache and meta for payload

  hepengfe

  committed
  cec1a22

  Copy full SHA for cec1a22

• new reader test based on code changes

  hepengfe

  committed
  15009fd

  Copy full SHA for 15009fd

• pass reader configs(reading method) to AudioPayload and AudioReadingMeta

  hepengfe

  committed
  c2b61db

  Copy full SHA for c2b61db

• parse reading configs into a reading function

  hepengfe

  committed
  e2d8a7a

  Copy full SHA for e2d8a7a

• reconstruct reading meta which is bound to payload

  hepengfe

  committed
  309c102

  Copy full SHA for 309c102

Commits on Jun 14, 2022

• rewrite set text function and set audio function

  hepengfe

  committed
  1777c9e

  Copy full SHA for 1777c9e

Commits on Jun 15, 2022

• clean up unnecessary class variables and add TextReadingMeta

  hepengfe

  committed
  0f0fd75

  Copy full SHA for 0f0fd75

• test ImagePayload

  hepengfe

  committed
  9ded0d7

  Copy full SHA for 9ded0d7

• get_single with payload index

  hepengfe

  committed
  96acb05

  Copy full SHA for 96acb05

• keep reading meta in the payload

  hepengfe

  committed
  e9ac305

  Copy full SHA for e9ac305

• initialize metadata in payload

  hepengfe

  committed
  8e6e8a5

  Copy full SHA for 8e6e8a5

• ReadingMeta datastore

  hepengfe

  committed
  528a789

  Copy full SHA for 528a789

• remove meta_name

  hepengfe

  committed
  0dbba66

  Copy full SHA for 0dbba66

• payload_index -> entry_index

  hepengfe

  committed
  595a6b4

  Copy full SHA for 595a6b4

• docstring for get_single

  hepengfe

  committed
  9644b64

  Copy full SHA for 9644b64

• add payload ontology

  hepengfe

  committed
  55d4e0a

  Copy full SHA for 55d4e0a

Commits on Jun 16, 2022

• remote text, audio property and get_image_array function and remove ReadingMeta

  hepengfe

  committed
  d456417

  Copy full SHA for d456417

• remove payload ontology

  hepengfe

  committed
  9196099

  Copy full SHA for 9196099

• remove ReadingMeta

  hepengfe

  committed
  4bc7917

  Copy full SHA for 4bc7917

• remove reading meta

  hepengfe

  committed
  a0d30c2

  Copy full SHA for a0d30c2

• add enum modality

  hepengfe

  committed
  e83a633

  Copy full SHA for e83a633

• payload cache

  hepengfe

  committed
  34f5f3a

  Copy full SHA for 34f5f3a

• add docstring for payload_index

  hepengfe

  committed
  6b88c39

  Copy full SHA for 6b88c39

• payload_index docstring

  hepengfe

  committed
  9dacad2

  Copy full SHA for 9dacad2

• add docstring for payload related functions

  hepengfe

  committed
  d18b8b4

  Copy full SHA for d18b8b4

• remove unused method

  hepengfe

  committed
  20e943f

  Copy full SHA for 20e943f

Commits on Jun 17, 2022

• get_payload_at() and DataPack.payloads of three modalities

  hepengfe

  committed
  406b659

  Copy full SHA for 406b659

• remove payloads of different modalities

  hepengfe

  committed
  c854b46

  Copy full SHA for c854b46

• AudioReadingMeta -> Generics

  hepengfe

  committed
  5d225f8

  Copy full SHA for 5d225f8

• add payload ontologies of three modalities

  hepengfe

  committed
  3e13c9d

  Copy full SHA for 3e13c9d

• update generated base ontology classes

  hepengfe

  committed
  aa275e3

  Copy full SHA for aa275e3

• DataPack.audio -> pack.get_payload_data_at(audio, 0)

  hepengfe

  committed
  e0bb7b7

  Copy full SHA for e0bb7b7

• DataPack.audio -> input_pack.get_payload_at(audio, 0)

  hepengfe

  committed
  841f318

  Copy full SHA for 841f318

• adapt Modality parameter and audio -> get_payload_at(audio) in tests/forte/image_annotation_test.py

  hepengfe

  committed
  0389a59

  Copy full SHA for 0389a59

• add payload operations in data store

  hepengfe

  committed
  dd8b593

  Copy full SHA for dd8b593

• add enum

  hepengfe

  committed
  64ae4d8

  Copy full SHA for 64ae4d8

• get around an no-key-found issue with conditional popping state key

  hepengfe

  committed
  6b4c54a

  Copy full SHA for 6b4c54a

• add modality imports in forte.data init

  hepengfe

  committed
  156a924

  Copy full SHA for 156a924

• import IntEnum

  hepengfe

  committed
  e2ac2f7

  Copy full SHA for e2ac2f7

• update text operation based on TextPayload

  hepengfe

  committed
  7ce6676

  Copy full SHA for 7ce6676

• Payload serialization function

  hepengfe

  committed
  0baeb1b

  Copy full SHA for 0baeb1b

• Payload DataStore

  hepengfe

  committed
  39d663c

  Copy full SHA for 39d663c

• import Modality

  hepengfe

  committed
  10a942f

  Copy full SHA for 10a942f

• payload ontology json

  hepengfe

  committed
  2277b17

  Copy full SHA for 2277b17

• payload ontology classes

  hepengfe

  committed
  72ce2e1

  Copy full SHA for 72ce2e1

• remove Modality import

  hepengfe

  committed
  960699b

  Copy full SHA for 960699b

• revert changes in tests/forte/data/readers/audio_reader_test.py

  hepengfe

  committed
  1609a7b

  Copy full SHA for 1609a7b

• update grid tests based on the new Payload

  hepengfe

  committed
  069dd76

  Copy full SHA for 069dd76

• update test based on new Payload for tests/forte/image_annotation_test.py

  hepengfe

  committed
  1a47ef6

  Copy full SHA for 1a47ef6

• update generics count due to its function as Payload Meta data

  hepengfe

  committed
  451e085

  Copy full SHA for 451e085

• modality class

  hepengfe

  committed
  e26b37a

  Copy full SHA for e26b37a

Commits on Jun 18, 2022

• revert changes in get_single()

  hepengfe

  committed
  97d3925

  Copy full SHA for 97d3925

• revert changes in get_single()

  hepengfe

  committed
  f5d44c2

  Copy full SHA for f5d44c2

Commits on Jun 20, 2022

• pylint fix

  hepengfe

  committed
  f8a0ef6

  Copy full SHA for f8a0ef6

• pylint

  hepengfe

  committed
  cd26081

  Copy full SHA for cd26081

• pylint

  hepengfe

  committed
  544a808

  Copy full SHA for 544a808

• pylint

  hepengfe

  committed
  e716868

  Copy full SHA for e716868

• pylint

  hepengfe

  committed
  1496b40

  Copy full SHA for 1496b40

• pylint

  hepengfe

  committed
  32e770b

  Copy full SHA for 32e770b

• pylint

  hepengfe

  committed
  f71782d

  Copy full SHA for f71782d

• mypy

  hepengfe

  committed
  07a4ab2

  Copy full SHA for 07a4ab2

• update base ontology

  hepengfe

  committed
  4e7cac5

  Copy full SHA for 4e7cac5

• pylint

  hepengfe

  committed
  90c66f1

  Copy full SHA for 90c66f1

Commits on Jun 21, 2022

• remove enum installation as it's built-in

  hepengfe

  committed
  10f2b14

  Copy full SHA for 10f2b14

• fix doc build

  hepengfe

  committed
  94f180f

  Copy full SHA for 94f180f

• fix spelling

  hepengfe

  committed
  259a9a5

  Copy full SHA for 259a9a5

• add enum34

  hepengfe

  committed
  871e02c

  Copy full SHA for 871e02c

• remove meta data for payloads

  hepengfe

  committed
  eff96fc

  Copy full SHA for eff96fc

• revert empty ontology initialization change

  hepengfe

  committed
  8ba49f7

  Copy full SHA for 8ba49f7

• adjust generics count and testing state.pop(_entry__pack)

  hepengfe

  committed
  628887b

  Copy full SHA for 628887b

Commits on Jun 22, 2022

• Merge branch 'master' into payload

  hepengfe

  authored
  a127d86

  Copy full SHA for a127d86

• temporary fix

  hepengfe

  committed
  0fc42be

  Copy full SHA for 0fc42be

• remove unused Generics

  hepengfe

  committed
  c62f6e7

  Copy full SHA for c62f6e7

Commits on Jun 24, 2022

• capitalize first character in Enum

  hepengfe

  committed
  f6c3863

  Copy full SHA for f6c3863

• Merge branch 'payload' of https://github.com/feipenghe/forte into payload

  hepengfe

  committed
  3215179

  Copy full SHA for 3215179

• fix docstring for text() and change modality from str format to IntEnum

  hepengfe

  committed
  90aa217

  Copy full SHA for 90aa217

• change modality from str format to IntEnum

  hepengfe

  committed
  1596a6f

  Copy full SHA for 1596a6f

• change modality from str format to IntEnum

  hepengfe

  committed
  16a05df

  Copy full SHA for 16a05df

• change modality from str format to IntEnum

  hepengfe

  committed
  95f2e66

  Copy full SHA for 95f2e66

• change modality from str format to IntEnum

  hepengfe

  committed
  fd7558b

  Copy full SHA for fd7558b

• change modality from str format to IntEnum

  hepengfe

  committed
  b6f7bde

  Copy full SHA for b6f7bde

• change modality from str format to IntEnum

  hepengfe

  committed
  9e89f06

  Copy full SHA for 9e89f06

• correct text function

  hepengfe

  committed
  6e4aa81

  Copy full SHA for 6e4aa81

• Merge branch 'master' into payload

  hepengfe

  authored
  f139333

  Copy full SHA for f139333

• entry converter with payload support

  hepengfe

  committed
  0595676

  Copy full SHA for 0595676

• cutomized payload serialization function

  hepengfe

  committed
  861f37c

  Copy full SHA for 861f37c

Commits on Jun 27, 2022

• add_payload_raw

  hepengfe

  committed
  101111f

  Copy full SHA for 101111f

• remove extra parameter Modality

  hepengfe

  committed
  79c062f

  Copy full SHA for 79c062f

• cast entry to Payload

  hepengfe

  committed
  369e2c2

  Copy full SHA for 369e2c2

• list to sequence

  hepengfe

  committed
  808ada0

  Copy full SHA for 808ada0

• remove extra paramater Modality

  hepengfe

  committed
  4d1982c

  Copy full SHA for 4d1982c

• datapack.set_Text

  hepengfe

  committed
  b514bee

  Copy full SHA for b514bee

• remove extra imports

  hepengfe

  committed
  25cdeaa

  Copy full SHA for 25cdeaa

• remove extra paramter modality

  hepengfe

  committed
  85b52fc

  Copy full SHA for 85b52fc

• remove modality paramter

  hepengfe

  committed
  0c40f8b

  Copy full SHA for 0c40f8b

• remove duplication check for payload

  hepengfe

  committed
  2eac83f

  Copy full SHA for 2eac83f

• improve docstring for payload

  hepengfe

  committed
  be4c98c

  Copy full SHA for be4c98c

• new ontology

  hepengfe

  committed
  6f40557

  Copy full SHA for 6f40557

• set Payload._modality based on Payload class type

  hepengfe

  committed
  801b666

  Copy full SHA for 801b666

• remove set_cache not needed

  hepengfe

  committed
  8ddfd63

  Copy full SHA for 8ddfd63

• set_cache -> set_audio

  hepengfe

  committed
  98df201

  Copy full SHA for 98df201

• change self.device back

  hepengfe

  committed
  2c8e7d9

  Copy full SHA for 2c8e7d9

• set_audio(audio_data, sample_rate)

  hepengfe

  committed
  41bfd87

  Copy full SHA for 41bfd87

• get_payload_data -> self.text

  hepengfe

  committed
  e65587c

  Copy full SHA for e65587c

• Merge branch 'master' into payload

  hepengfe

  authored
  0038c71

  Copy full SHA for 0038c71

• fix modality

  hepengfe

  committed
  dd9839d

  Copy full SHA for dd9839d

• Merge branch 'payload' of https://github.com/feipenghe/forte into payload

  hepengfe

  committed
  5b5b304

  Copy full SHA for 5b5b304

• Merge branch 'master' into payload

  hepengfe

  authored
  d427c8a

  Copy full SHA for d427c8a

Commits on Jun 29, 2022

• get_modality -> modality property

  hepengfe

  committed
  42928d8

  Copy full SHA for 42928d8

• add_entry_raw for Payload

  hepengfe

  committed
  1ae7282

  Copy full SHA for 1ae7282

• remove unused imports

  hepengfe

  committed
  53bc5b1

  Copy full SHA for 53bc5b1

• remove modality parameter in ImagePayload

  hepengfe

  committed
  5aa6be0

  Copy full SHA for 5aa6be0

• Revert "remove modality parameter in ImagePayload"

  Show description for c225b42
  hepengfe

  committed
  c225b42

  Copy full SHA for c225b42

• Merge branch 'master' into payload

  hepengfe

  authored
  1051558

  Copy full SHA for 1051558

• correct ontology files

  hepengfe

  committed
  10ff586

  Copy full SHA for 10ff586

• revert base back changes

  hepengfe

  committed
  a68445d

  Copy full SHA for a68445d

• kept base_pack.py unchanged

  hepengfe

  committed
  7102b3e

  Copy full SHA for 7102b3e

• correct docstring

  hepengfe

  committed
  2a92023

  Copy full SHA for 2a92023

• revert changes in unrelevant file

  hepengfe

  committed
  69676ca

  Copy full SHA for 69676ca

• revert metric.py changes

  hepengfe

  committed
  1f8f8ed

  Copy full SHA for 1f8f8ed

• remove unused import

  hepengfe

  committed
  453dcc0

  Copy full SHA for 453dcc0

• remove unused textpayload

  hepengfe

  committed
  e1fe2bf

  Copy full SHA for e1fe2bf

• revert changes in audio reader

  hepengfe

  committed
  6758f76

  Copy full SHA for 6758f76