Skip to content

Tags: Intevation/intelmq-webinput-csv

Tags

1.2.7

Toggle 1.2.7's commit message

Verified

This tag was signed with the committer’s verified signature.
wagner-intevation Sebastian Wagner
1.2.7: UI improvements

* show classification types sorted and grouped
* vertically align checkboxes in row
* remove unused variable 'code'
* show checkboxes only for checkbox, not whole row
* fix name of CERT-Bund
* fix MIME multipart e-mail parsing
  the body part was ignored and the signature was displayed
  now display the body correctly, along the attachment and ignore the
  signature

1.2.5

Toggle 1.2.5's commit message

Verified

This tag was signed with the committer’s verified signature.
wagner-intevation Sebastian Wagner
1.2.5: Limit allowed Event fields

 ## Configuration
* New parameter `allowed_event_fields` to limit the list of allowed event field names.
  Default (unset) is to allow all fields.

 ## Backend
* Add check for `allowed_event_fields`

 ## Frontend
* Template preview
     * Add support for unsigned (plain/text) e-mails
     * Show Content Type of resulting e-mail
* Modal window for row details (events, bot logs):
     * add line-wrapping for code blocks
     * format the section headings better

 ## Documentation
* mailgen: add notes on database privs and gnupg

1.2.6

Toggle 1.2.6's commit message

Verified

This tag was signed with the committer’s verified signature.
wagner-intevation Sebastian Wagner
1.2.6 Usability Improvements

 ## Configuration
* new parameter: `mailgen_default_template_name`
  new parameter for the frontend to set a default template name
  if not set, the first template is used by default

 ## Frontend
* redesign notification section
  re-organize the elements in the "Send Notifications" section (accordion)
  one row for control elements, one row for the template input
* submit data: close auth confirm after submit
  hide the modal authConfirm directly after submission
  progress is shown in the main pane
* light grey background on input form groups
  clarity for the user the the association between label and input
* submit button text: to database/intelmq
  depending to the 'validate with bots' switch, change the text of the
  submit button for more clarity
* improve documentation link
  feedback by customer: move to right
  underline
  add link-arrow
* set hasHeader to true by default
  most CSV/TSV files have headers, use a sensible default
* fallback values: remove monospace
  for space efficiency and request by customer, use a normal font for the
  field names
* small space between target group select buttons

1.2.4

Toggle 1.2.4's commit message

Verified

This tag was signed with the committer’s verified signature.
wagner-intevation Sebastian Wagner
1.2.4: Field name selector improvements

 ## Backend
* New API endpoint to check the validity of a field name with IntelMQ.

 ## Frontend
* Updated dependencies: babel/traverse, browserify-sign
* Mail parser: handle multi-line subject/to
* yarn.lock: re-resolve all packages
* Field name drop downs:
    * prevent overflows
    * add wrapping and reduce paddings
    * improve  visibility of action buttons
    * check the validity of an entered field name with IntelMQ
* validate checkbox: show reason if no bots available
* other minor improvements

 ## Documentation
* minor changes

1.2.3

Toggle 1.2.3's commit message

Verified

This tag was signed with the committer’s verified signature.
wagner-intevation Sebastian Wagner
REL: 1.2.3: CSV special case corrections, extra data in notifications…

…, documentation

* Corrections to handling of extra data in mailgen template preview
* Corrections for special cases in CSV data
* Extended Documentation

 ## Backend
* convert example data to Event to handle extra data in database insert:
  for the mailgen preview, convert the example data to an IntelMQ event
  and before submitting it to the database, to a dict with extra as a
  string.
  Previously, extra-data provided by the user could not be inserted,
  raising an error

 ## Frontend
* frontend: detect if csv data header can be used as field name and use it:
  if the csv column name (table header) contains a legitimate IntelMQ
  field name, use this one and skip the further sanitation steps
* frontend: handle CSV data with no body, but only with a header:
  if the CSV data contains just one line and the header option is active,
  the data is body/content-less
  handle these special cases by aborting the parse and disabling the
  spinner

 ## Documentation
* docs: document format spec (mailgen) influence
* docs: change URLs to rendered sphinx docs in README

1.2.2

Toggle 1.2.2's commit message

Verified

This tag was signed with the committer’s verified signature.
wagner-intevation Sebastian Wagner
1.2.2: Validate Template Preview Data

The user data, (first line of parsed input data), used for the template content validation and preview, validated (sanitized) by IntelMQ before using it for the template preview, otherwise syntactically incorrect values could lead to PostgreSQL errors. Invalid fields are ignored and replaced by example data.

1.2.0

Toggle 1.2.0's commit message

Verified

This tag was signed with the committer’s verified signature.
wagner-intevation Sebastian Wagner
1.2.0: Single template input

 ## Frontend
- Redesign to a single template input. The multi-template editor is hidden and can be activated with the parameter `mailgen_multi_templates_enabled`
- Pass assigned columns to the backend for notification preview and data submission
- Minor style enhancement in email preview
- Minor: add more spacing between the explanation text and the subject
- Target groups: add select all/none buttons
- Separate function for converting data to table

 ## Backend
- Allow single template input and pass to mailgen
- Do not send data to the redis queue if validation/submission with bots is active (would be a double-submit)
- Refactor format_spec creation, more checks/sanitation
- Template preview: use first line of data instead of fully relying on example data, use the first line of input data if available
- Use assigned columns as default table format: the columns assigned by the user in the frontend are used as default table format for mailgen
- Compatibility changes on deprecated pkg_resources / importlib replacement, make it compatible on both Ubuntu 20.04 and 22.04, update tests and GitHub Workflows

 ## Documentation
- Add section about the behaviour of the Frontend's "Submit/Validate with Bots" parameter

1.1.0

Toggle 1.1.0's commit message

Verified

This tag was signed with the committer’s verified signature.
wagner-intevation Sebastian Wagner
1.1.0 UI Enhancements

 ## Frontend
- Notification preview: decode quoted-printable email body
- Change the display of validation errors in table
  - color the row orange for errors in this row,
  - color a cell red for an error in this cell
  - color the Actions-cell (first column) red for an unspecific error (e.g. missing field) and show a tooltip
  - show the tooltip for cells only for errors on this cell
- Make Table more compact (smaller padding)
- Show small icon to show processed row instead of long text
- Add warning on duplicate field assignments after detection
- Link docs in navbar
- Clean field names for defaults from CSV header and for entered field names:
  - trim (remove surrounding whitespace)
  - all lower case
  - replace whitespaces with underscore
  - remove all other disallowed characters
- Field assignment selection: select on tab
- packages:
  - upgrade csv parser papaparse
  - replace obsolete babel polyfill with core-js
  - remove unused requirements mutationobserver-shim, popper.js, portal-vue

 ## Backend
- Data validation: group error messages for validation per field name in a row
- format row-process error log with newlines for easier readability
- only parse time-field if value is not empty
- read configfile with encoding

 ## Package
- build-depend on hug to run the tests during build
- set `NODE_OPTIONS=--openssl-legacy-provider`
- require either yarn or yarnpkg
- package dependency fixes

 ## Tests
- Add GitHub workflow to build debian packages
- Add GitHub workflow for pycodestyle

 ## Documentation
- Add GitHub workflow to build and publish documentation
- Ass missing change log sections for 1.0.0, 1.0.1, 1.0.2
- Add screenshots
- Switch from single Markdown files Sphinx

1.0.2

Toggle 1.0.2's commit message

Verified

This tag was signed with the committer’s verified signature.
wagner-intevation Sebastian Wagner
1.0.2 Bugfixes

backend: fix method arguments causing falcon errors
backend: remove obsolete, long-running DB queries
backend: fix falcon status code calls
client: fix wrong modal on mailgen log button

1.0.1

Toggle 1.0.1's commit message

Verified

This tag was signed with the committer’s verified signature.
wagner-intevation Sebastian Wagner
1.0.1: Template Validations, UI optimizations

template name validation on name change
backend: verbose error message for empty template in preview
client: improve default column field names
client: template deletion safety question
client+backend: live feedback template syntax check
frontend, mailgen: optimize UI components placement
frontend: disable classification fields in dryrun