features after 2020.1

[kosarko]

• shortref:

  • blacklists, whitelist (url validation) (PRIO: shortref should work)

• submission:

  • type bind on various types (PRIO: status quo)

    • see e.g. https://github.com/ufal/clarin-dspace/blob/clarin/dspace/config/input-forms.xml#L570 and https://github.com/ufal/clarin-dspace/blob/clarin/dspace/config/input-forms.xml#L232

  • 2 new submission workflows in input-forms (PRIO: status quo)

    • edm types (PRIO: status quo)
    • new vocabulary values (PRIO: status quo)
    • force select dc.type if only one possible value (PRIO: nice to have)
    • regexp fix for size (PRIO: status quo)
    • dc.type picker ("no-thumbs" feature) (PRIO: need to render all below; imo don't need the images if it makes things easier...)
      • atm we have <input-type value-pairs-name="common_types">dropdown</input-type><input-type>onebox</input-type><input-type value-pairs-name="teaching_materials">dropdown</input-type>
    • autocompletes
      • on normal fields
      • on complex fields
      • languages (search in name, fill in iso code)
      • replaces/replaced by (handle+title; search by handle or title, fill in handle;471fb5b)
      • in theory you can add a query in input-forms cf. 58e8e3a (PRIO: LOW)

  • openaire feeds (PRIO: if the current api queries all the funders available in openaire; no need to make the set smaller (to just

    clarin-dspace/dspace/config/modules/openaire.cfg

    Line 3 in 8a6ba5c

    projects.url = "http://api.openaire.eu/projects/dspace/FP7/ALL/ALL###http://api.openaire.eu/projects/dspace/WT/ALL/ALL###http://api.openaire.eu/projects/dspace/H2020/ALL/ALL###http://api.openaire.eu/projects/dspace/HE/ALL/ALL"

    )

  • ShowInfoStep - message as a first step (PRIO: LOW)

  • DescribeStep - hint “english only” (PRIO: LOW)

• CLI:

  • ItemImportReplacingMetadata (see Clariah submission #922) (PRIO: needed)
  • runnables (PRIO: not need in new deployments; for upgrades, depends on the procedure) (https://github.com/ufal/clarin-dspace/tree/clarin/dspace-api/src/main/java/cz/cuni/mff/ufal/dspace/runnable) especially:
    - copy ms size
    - CheckLicenses (see Licensing issue #1062 for how It's run and other details)

• curation

  • MetadataQAChecker (PRIO: needed)
    - [ ] expected types configurable
    - [ ] items with files has all rights metadata
    - [ ] iso639-3 checking

• OAI:

  • col/com filter in oai (don’t expose certain col/com in oai results)
  • oaiindexevent consumer (and cli) → index as anonymous (see Update OAIIndexEventConsumer #996)
  • elg crosswalk
    • langUtil with real iso 693 data, get shortest lang id
  • metashare update
  • datacite_openaire update
  • formats and filter in xoai.xml

• item-view:

  • google dataset search (PRIO: needed)
  • download from cli info (PRIO: nice to have)
  • mediaType, shows next to any type (PRIO: status quo)
  • abbreviated author listing (etal...) (PRIO: needed)
  • configurable refbox (uses format defined in md) (PRIO: needed)
  • thumbnail and videotag preview (Thumbnail update #1004) (PRIO: needed)
  • previews with limited size (PRIO: depends on the previews implementation)
  • item-view links use discover, not browse (PRIO: status quo)
  • date issued formatted (incl approximateDate) (PRIO: needed) #1110
  • new featured service (TeiTok) (PRIO: needs to show the metadata; editing can be done via edit item)

• Licenses:

  • issue with anonymous confirmation (Licensing issue #1062) (PRIO: should not allow anonymous users except when allow anonymous...)
  • seznam license (PRIO: needed)
    • translatable text not just link in confirmation (PRIO: needed)

      trik je 06dac68#diff-06a9b3a5cc54ccb1654abfdc343ef91cd1c4ef8e6e537494e999aa78de62141cR166 - license url se pouzije jako klic, a pokud danej klic v katalogu (mezi prekladama) neni, pouzije (skoro) prazdnej retezec s mezerou - zbytek toho commitu je presvedcovani dspacu, aby to proslo
      tady je ceskej text licence: 55acf12#diff-7038a53c9d4b03300c3bff8b4aca10946dfcf1bd84e588586bc36b8884b23824R3310
      staticka stranka bere text taky z prekladovyho katalogu: 55acf12#diff-2efd5de166b8f91e3934f42a1f6a7c42c72870d1cae62c6f25df52fc0be1ff5aR3
      anglickej preklad je pridanej az v a68f67d

    • extra license field (ACA_ORG_NAME_AND_SEAT) (PRIO: needed)
    • monthly download reports (PRIO: needed)
  • other new licenses (for lindat repo sync static pages; update urls?)

• search
  - [ ] new facets/filters, hierarchical facets, (https://github.com/ufal/clarin-dspace/commits/clarin/dspace/config/spring/api/discovery.xml)

• configurable navigation links (deposit/cite/faq/etc.) (PRIO: ATM not needed, use footer)

• piwik
  - [ ] reports and mail queue (PRIO: depends if we have reports, and mail rate limiting....)

• db inits that work in ci (https://github.com/ufal/clarin-dspace/commits/clarin/utilities/utilities.sql)

[milanmajchrak]

@kosarko I processed all features - Created issue/Done/Question
Please can you answer every question? Thank you.
Question start with dq: Q -

• shortref:

  • blacklists, whitelist (url validation) (PRIO: shortref should work)
  • dq: Implemented, but not tested: https://github.com/dataquest-dev/DSpace/blob/dtq-dev/dspace/config/clarin-dspace.cfg#L51
  • dq: Issue for creating tests: Shortref: Create integration tests - we are not sure if it works properly dataquest-dev/DSpace#575

• submission:

  • type bind on various types (PRIO: status quo)

    • see e.g. https://github.com/ufal/clarin-dspace/blob/clarin/dspace/config/input-forms.xml#L570 and https://github.com/ufal/clarin-dspace/blob/clarin/dspace/config/input-forms.xml#L232

  • dq: Submission: type bind on various types dataquest-dev/DSpace#576

  • 2 new submission workflows in input-forms (PRIO: status quo)

  • dq: Create custom workflows for two collections: teaching_submissions, clariah_submissions. dataquest-dev/DSpace#517

    • edm types (PRIO: status quo)
    • dq: Done: edm.xml types are missing dataquest-dev/DSpace#550
    • new vocabulary values (PRIO: status quo)
    • dq: Q - which vocabulary values?
    • force select dc.type if only one possible value (PRIO: nice to have)
    • dq: Submission: force select dc.type if only one possible value dataquest-dev/DSpace#577
    • regexp fix for size (PRIO: status quo)
    • dq: Q - please more info, how it should looks like?
    • dc.type picker ("no-thumbs" feature) (PRIO: need to render all below; imo don't need the images if it makes things easier...)
      • atm we have <input-type value-pairs-name="common_types">dropdown</input-type><input-type>onebox</input-type><input-type value-pairs-name="teaching_materials">dropdown</input-type>
    • dq: Choose type of the submission by an image (during creation of an item) dataquest-dev/dspace-angular#464
    • autocompletes
      • on normal fields
      • dq: Done
      • on complex fields
      • dq: Done for Contact Person and Funding (including OpenAIRE) - is it sufficient?
      • languages (search in name, fill in iso code)
      • dq: Submission: Autocomplete - language, search in name, fill in iso code dataquest-dev/DSpace#580
      • replaces/replaced by (handle+title; search by handle or title, fill in handle;471fb5b)
      • dq: Submission: Autocomplete - isreplacedby/replaces has special autocomplete dataquest-dev/DSpace#581
      • in theory you can add a query in input-forms cf. 58e8e3a (PRIO: LOW)
        - dq: Submission: Autocomplete - you can add a query in submission-forms::autocomplete tag dataquest-dev/DSpace#579

  • openaire feeds (PRIO: if the current api queries all the funders available in openaire; no need to make the set smaller (to just

    clarin-dspace/dspace/config/modules/openaire.cfg

    Line 3 in 8a6ba5c

    projects.url = "http://api.openaire.eu/projects/dspace/FP7/ALL/ALL###http://api.openaire.eu/projects/dspace/WT/ALL/ALL###http://api.openaire.eu/projects/dspace/H2020/ALL/ALL###http://api.openaire.eu/projects/dspace/HE/ALL/ALL"

    )

  • dq: Confirm: Confirm that openaire API queries all the funders dataquest-dev/DSpace#578

  • ShowInfoStep - message as a first step (PRIO: LOW)

  • dq: Configure Special fields step dataquest-dev/DSpace#520

  • DescribeStep - hint “english only” (PRIO: LOW)

  • dq: Submission: Describe step - add hint english only dataquest-dev/DSpace#582

• CLI:

  • ItemImportReplacingMetadata (see Clariah submission #922) (PRIO: needed)
  • dq: Importing: Import only Item's metadata - without importing files dataquest-dev/DSpace#583
  • runnables (PRIO: not need in new deployments; for upgrades, depends on the procedure) (https://github.com/ufal/clarin-dspace/tree/clarin/dspace-api/src/main/java/cz/cuni/mff/ufal/dspace/runnable) especially:
    - copy ms size
    - CheckLicenses (see Licensing issue #1062 for how It's run and other details)
  • dq: Create runnable classes for special cli operations dataquest-dev/DSpace#584

• curation

  • MetadataQAChecker (PRIO: needed)
    - [ ] expected types configurable
    - [ ] items with files has all rights metadata
    - [ ] iso639-3 checking

• dq: Add missing curation taks dataquest-dev/DSpace#513

• OAI:

  • col/com filter in oai (don’t expose certain col/com in oai results)
  • dq: Q - some example?
  • oaiindexevent consumer (and cli) → index as anonymous (see Update OAIIndexEventConsumer #996)
  • dq: OAI: OaiIndexEventConsumer and cli - index as anonymous dataquest-dev/DSpace#585
  • elg crosswalk
    • langUtil with real iso 693 data, get shortest lang id
  • dq: OAI: elg crosswalk - langUtil with real iso 693 data, get shortest lang id dataquest-dev/DSpace#586
  • metashare update
  • dq: Q - Do you mean update of crosswalk?
  • datacite_openaire update
  • dq: Q - Do you mean update of crosswalk?
  • formats and filter in xoai.xml
  • dq: Q - Some example pls

• item-view:

  • google dataset search (PRIO: needed)
  • dq: Item View: Expose Item's info for google search dataquest-dev/dspace-angular#558
  • download from cli info (PRIO: nice to have)
  • dq: Done, but it is disabled I guess because of disabled previews
  • mediaType, shows next to any type (PRIO: status quo)
  • dq: Done
  • abbreviated author listing (etal...) (PRIO: needed)
  • dq: Done
  • configurable refbox (uses format defined in md) (PRIO: needed)
  • dq: Dynamic refbox dataquest-dev/dspace-angular#480
  • thumbnail and videotag preview (Thumbnail update #1004) (PRIO: needed)
  • dq: UFAL/FE-Missing TAR and Video previews dataquest-dev/dspace-angular#372
  • previews with limited size (PRIO: depends on the previews implementation)
  • dq: Done, but preview is disabled because of S3
  • item-view links use discover, not browse (PRIO: status quo)
  • dq: Done
  • date issued formatted (incl approximateDate) (PRIO: needed)
  • dq: Done
  • new featured service (TeiTok) (PRIO: needs to show the metadata; editing can be done via edit item)
  • dq: TeiTok is Done, but editing is possible only by updating Item's metadata, Edit Item / Services option is missing dataquest-dev/dspace-angular#475

• Licenses:

  • issue with anonymous confirmation (Licensing issue #1062) (PRIO: should not allow anonymous users except when allow anonymous...)
  • dq: Licenses: Should not allow anonymous users except when allow anonymous dataquest-dev/DSpace#588
  • seznam license (PRIO: needed)
    • translatable text not just link in confirmation (PRIO: needed)

      trik je 06dac68#diff-06a9b3a5cc54ccb1654abfdc343ef91cd1c4ef8e6e537494e999aa78de62141cR166 - license url se pouzije jako klic, a pokud danej klic v katalogu (mezi prekladama) neni, pouzije (skoro) prazdnej retezec s mezerou - zbytek toho commitu je presvedcovani dspacu, aby to proslo
      tady je ceskej text licence: 55acf12#diff-7038a53c9d4b03300c3bff8b4aca10946dfcf1bd84e588586bc36b8884b23824R3310
      staticka stranka bere text taky z prekladovyho katalogu: 55acf12#diff-2efd5de166b8f91e3934f42a1f6a7c42c72870d1cae62c6f25df52fc0be1ff5aR3
      anglickej preklad je pridanej az v a68f67d

    • dq: Fix License contract page (Distribution license) dataquest-dev/dspace-angular#510
    • extra license field (ACA_ORG_NAME_AND_SEAT) (PRIO: needed)
    • dq: Licenses: Add extra license field (ACA_ORG_NAME_AND_SEAT) dataquest-dev/DSpace#589
    • monthly download reports (PRIO: needed)
    • dq: Monthly download reports dataquest-dev/DSpace#591
  • other new licenses (for lindat repo sync static pages; update urls?)
  • dq: Done: Licenses text and other static content dataquest-dev/dspace-angular#559
  • dq: Q - are there more static license pages?

• search
  - [ ] new facets/filters, hierarchical facets, (https://github.com/ufal/clarin-dspace/commits/clarin/dspace/config/spring/api/discovery.xml)
  - dq: Add missing local types dataquest-dev/DSpace#531
  - dq: Solr: disable morelikethis property in the discovery.xml dataquest-dev/DSpace#590 Q - why is is disabled?

• configurable navigation links (deposit/cite/faq/etc.) (PRIO: ATM not needed, use footer)

• dq: Configurable navigation links (deposit/cite/faq/etc.) dataquest-dev/dspace-angular#560

• piwik
  - [ ] reports and mail queue (PRIO: depends if we have reports, and mail rate limiting....)
  - dq: Matomo PDF reports dataquest-dev/DSpace#511

• db inits that work in ci (https://github.com/ufal/clarin-dspace/commits/clarin/utilities/utilities.sql)

• dq: Initialize DSpace by some action - script dataquest-dev/DSpace#592

[kosarko]

@milanmajchrak answers below; sorry for mostly referring you to use git log, but that's the most precise capture of the changes...

new vocabulary values (PRIO: status quo)
dq: Q - which vocabulary values?

git clone https://github.com/ufal/clarin-dspace
git log ^2020.01 ^dspace-5.11 origin/clarin-dev -p dspace/config/input-forms.xml

and search for changes close to "pairs" or "pair"

regexp fix for size (PRIO: status quo)
dq: Q - please more info, how it should looks like?

#987

col/com filter in oai (don’t expose certain col/com in oai results)
dq: Q - some example?

ebe9829

metashare update
dq: Q - Do you mean update of crosswalk?

yes,

git log -p ^2020.01 ^dspace-5.11 origin/clarin-dev dspace/config/crosswalks/oai/metadataFormats/metasharev2.xsl

datacite_openaire update
dq: Q - Do you mean update of crosswalk?
yes

git log -p ^2020.01 ^dspace-5.11 origin/clarin-dev dspace/config/crosswalks/oai/metadataFormats/datacite_openaire.xsl

formats and filter in xoai.xml
dq: Q - Some example pls

git log -p ^2020.01 ^dspace-5.11 origin/clarin-dev dspace/config/crosswalks/oai/xoai.xml

dq: Q - are there more static license pages?

With

git log --name-status ^2020.01 ^dspace-5.11 origin/clarin-dev dspace-xmlui/src/main/webapp/themes/UFAL/lib/html/

you can see the last license ud 2.13 was added in Nov 2023, not sure if all has been migrated...

[milanmajchrak]

new vocabulary values (PRIO: status quo)

• dq: Update vocabulary values in the submission-forms.xml following the updated input-forms.xml dataquest-dev/DSpace#616

regexp fix for size (PRIO: status quo)

• dq: Submission: Define complex input fields - sizeInfo and clariahSizeInfo dataquest-dev/DSpace#617

col/com filter in oai (don’t expose certain col/com in oai results)

• dq: OAI-PMH: Don’t expose certain col/com in oai results dataquest-dev/DSpace#618

metashare update
dq: Done

datacite_openaire update
dq: Done

formats and filter in xoai.xml

• dq: OAI-PMH: Update xoai.xml dataquest-dev/DSpace#619

other new licenses (for lindat repo sync static pages; update urls?)

• dq: Update all static licenses dataquest-dev/dspace-angular#589