v5.9.7

Maintenance and security update.

This update change the Portugal thesaurus with new data, the update will match the old Portugal data to new one. This update take time to review all data in your database.

Additions

• Added records_search class missing properties
• Added feature to auto deleted blob files from CHUNK_FILES upload
• Added update to Portugal data with new administrative data
• Added diffusion method 'generate_rdf' to allow generate a column with whole RDF resolved string

Fixes

• Fixed empty calculation of locators to publish it as boolean
• Fixed diffusion rdf lang issue

Updates

• Updated master git paths from v5 to v6 as default master branch

Changes

• Renamed Ontology list export buttons labels

Note: The new v6 will assume that you had run this update. V6 do will not use old Portugal data.

V5.9.6

Maintenance and security update.

IMPORTANT: Now the master branch has the v6 code, if you sync your v5 installation with git, you can continue to use the v5 branch, but do not use the master branch (unless you want to upgrade to v6 :) ).

Additions

• Added saml error log notification to improve debug
• Added component_autocomplete_hi get_diffusion_value options ($option_obj->parent_section_tipo)) to allow filter dato locators by section tipo (see isad87 properties)
• Added relation_list->get_difusion_value related case to manage deep path resolutions. See properties case mdcat4338
• Added !! operator to find duplicated records in rsc85 and rsc86.
• Added indexing to rsc85 and rsc86 when search to duplicates.

Fixes

• Fixed autologin issue where sometimes window location was not set correctly if no full path is set (including /index.php)
• Fixed BOM header in UTF8 at import .csv files
• Fixed errors in diffusion value calculation in custom->related mode (relation_list->get_difusion_value) see mdcat4338 case
• Fixed tool_upload error where component was saved on every chunk. Now only non chunked files uploads will be logged and saved to prevent DDBB overload

Updates

• Updated swagger file version 1.0.25 to 1.0.26
• Updated ontology. Improved term edition inline

Changes

• Changed update_dedalo_code method from file_get_contents to curl_request to unify proxy management in request

V5.9.5

Maintenance and security update.

Additions

• Added set_default dato optional CONFIG_DEFAULT_FILE_PATH JSON file with precedence from properties defaults: component_common->set_dato_default(), component_filter->set_default-dato_for_user(). Update your config4.php with this new constant if you need this new functionality.
• Added basic support to v6 GIT version in build_version_from_git_master
• Added DEDALO_UPLOAD_SERVICE_CHUNK_FILES constant to sample_config. Update your config4.php with this new constant, if you need this new functionality.
• Added chunked files to be upload by tool_upload
• Fixed tool_import marc21 with old data of component_filter
• Added to get 650 values of marc21 to rsc210

Fixes

• Fixed default project (component_filter) bug were the assignation sequence order was review because was wrong (global default project was set always, instead the properties default data
• Fixed component_filter set_dato method bug were non global_admin user saving projects delete the data not accessible to itself (other projects not accessible)
• Fixed # php 8.2 added protected vars error (documents $aditional_path case)
• Fixed tool_posterframe issues with aspect video aspect calculations from FFMEG
• Fixed Ontology link issue (added final slash)
• Fixed Ontology compatibility issues with v5
• Fixed tool_upload errors and issues about upload finish managing
• Fixed search existing values in tool_import_zotero

Changes

• Increased section cache default max from 1200 to 2100
• Update ontology in json format
• Restored missing lib 'pear' in .gitignore. Used for tool_import_marc21

Comment about next releases of v5

This version will be the last version of v5 in master branch. Now v5 become a secondary versión with target security fixes only and will update only the v5 branch. The upcoming V6 Release Candidate 3 will replace the our master branch.

V5.9.4

Maintenance and security update.

Additions

• Added default_section for users to go specific section after login.
• Added time frame selection into user, component_info users_activity date range selection.
• Added component_autocomplete diffusion value control of 'is publishable'
• Added limit concurrent uploads to tool_import_files_dcnav
• Added limit concurrent uploads to tool_import_files

Fixes

• Fixed compatibility issues (tool_upload and ffmpeg class)
• Fixed search parse_search_query_object error were count fails where JOIN is used inside window frame query
• Fixed tool_diffusion error were databases did not locate databases alias
• Fixed component_json error when no value is available from component. Now, null is returned instead of error.
• Fixed redundancy data in class ontology->get_children_recursive when section is virtual

Changes

• Changed deprecated PHP method 'utf8_encode' to mb_convert_encoding alternative on read_csv_file_as_array method (tool_common)
  Cleanup Ontology code
• Changed to check tm permissions to show or hide tm_list and component_history in inspector

Deleteions

• Removed unnecessary 'htmlspecialchars' conversion in tool_export that cause html chars into csv files
• Removed tool_import_files limitConcurrentUploads param that block normal uploads when value is more than 1 (tool_import_files_dcnav too)

5.9.3

Maintenance and security update.

Additions

• Added ReturnTypeWillChange to allow php>=8.1 mismatching tentative return type should not emit a deprecation notice.
• Added Publication Server API new feature: 'resolve_dd_relations'. Updated swagger.json file to v1.0.24
• Added component_autocomplete breakdown option to export values (as component_portal do). Implemented in tool_export
• Added component_autocomplete export dataframe.

Fixes

• Fixed delete button dialog error where current_section_label it's not available when menu is disabled causing a DOM selection error
• Fixed issue in class diffusion_sql where empty values were treated as strings generating a server error
• Fixed lang import for tool_import_files_dcnav

Deleteions

5.9.2

Maintenance and security update.

Additions

• Add dataframe_search mode in component_check_box
• Add dataframe_search mode in component_common
• Add dataframe as component in search functionality
• Add literal to component_autocomplete_hi to search without parents
• Added publication server API feature: get_table_thesaurus_map and get_table_thesaurus to allow web developers easy access to server config about thesaurus. Updated swagger.json ui too (v1.0.24)
• Added 'Deprecated' label to publication API ui Thesaurus Legacy
• Added diffusion method map_locator_to_boolean
• Added component_autocomplete_hi json controller file (added 15-11-2022 to Numismatic tool sort)

Fixes

• Fix Dataframe load checkbox for search
• Fix to get permissions for dataframe_search
• Fixed class exec issue where execution aync fails on exec_sh_file
• Fixed error where tool_export values with html chars like '<10' breaks the output in standard format
• Fixed global_search error where filter 'theme' were use LIKE instead =
• Fixed time machine behavior when previous dato is not already saved. Now, time machine save previous dato if not found in time_machine table
• Fixed save_time_machine time_machine_section_id error on undefined case (new record)
• Fixed PHP v8 issues with bad json data in web_data class
• Fixed component_number to search with < operator, now it avoid the empty values, empty !== 0 when search < than any value

Deleteions

• Remove dataframe in search_autocomplete

V5.9.1

Maintenance and security update.

Additions

• Added Full-Text Search literal options to web_data
• Add latin lang
• Add default language selector to tool_import_rdf

Fixes

• Fix Dataframe load checkbox for search
• Fix dataframe click inside autocomplete
• Fixed trigger autocomplete PHP8 deprecation issues
• Fixed section_tab issue when infinite loop
• Fixed component_portal error where tool_description portals
• Fixed bug in component_portal where on add new record
• Fixed error on 'propiedades' js trigger where changes of radio_button
• Fixed bug in tool_administration generate_relations_table_data

V5.9.0

Maintenance and security update.

This version is, and will be, the last minor version of v5, it prepare Dédalo to the next major version, v6. With this version, V5 enter in the maintenance state and now, only issues or bugs will develop. New features or tools will be added only to v6.

This update add pagination feature to thesaurus tree.

Additions

• Added box elements model detection in time_machine data to prevent errors in component construction
• Added new tool_administration feature 'delete_sections' to easy delete massive sections preserving the Time Machine version
• Added support for check_safe_value -> group 'CONCAT' commands
• Add some resolution cases for diffusion RDF
• Re-added maxmind-db files
• Added resolve_indexation_fragments error control log when result is empty
• Added method get_value_code to component_select_lang class. (used from diffusion to convert locator value to lang code like 'lg-cat')
• Added subtitles optional get value 'advice_text'
• Added diffusion database_alias option to overwrite 'table' and 'table_alias' from original (numisdata catalog case for example)
• Added .htaccess old Apache versions (<2.4) compatibility
• Added ontology utils file for easy csv export
• Add link to component_iri at portal_list
• Add link render for component_iri when is caller by portals in portal_list mode
• Added class ts_object -> get_childrens_data method multi term option. Now, more than one term value can be used like name + surname cases
• Added modo='search' exception to component_common get_instance section check (debug) to allow search thesaurus components list
• Added updates.php index matrix_rsc86_gin and matrix_rsc85_gin creation scripts ready to add in next update
• Added thesaurus pagination feature
• Added thesaurus search virtual sections tipo option. Now, real section tipo is calculated in class search_development2->get_components_from_section method
• Added trigger tool_administration update_dedalo_code function new features: regenerate css files (maybe current installation structure.css file is never than git structure.css file) and regenerate js lang labels files
• Added log message to SAML login sequence to easy track user login sequence
• Add diffusion_element_alias to diffusion
• Added notes to sample.config file
• Added component_pdf and tool_pdf_versions original quality feature. Now, a source document (non PDF) can be added as original quality. - Added download mimes doc,docx,odp,odt,pages to manage this documents. Remember to add configuration new constant 'DEDALO_PDF_QUALITY_ORIGINAL' and the allowed extensions in constant 'DEDALO_PDF_EXTENSIONS_SUPPORTED'
• Add publication info components in section to be searchable

Deletions

• Removed jquery unnecessary lib files
• Removed nvd3 unnecessary lib files

Fixes

• Fixed json encode error when get_filtered_relations param 'relations_data_string' is empty
• Fixed error on normalize quotes in not string values (tool export raw get_valor_dedalo)
• Fixed error when component_input_text search's find only first value of their array value (Catalog Obulco case)
• Fixed catch error on publication web_data where invalid SQL generated string was stop the execution. Now a error response is returned (besides an error log notification)
• Fixed Ontology dd_edit small issues
• Fixed error where method process_result->resolve_indexation_fragments was not mandatory static
• Fixed rows_activity error on some wrong value context
• Fixed diffusion value issues with empty values on PHP 8.1
• Fixed section bug when section cached and same section not cached are managed as different sections overwriting data on save. Now, get_my_section method is used when is available in components
• Fixed component_common->split_query check error when try to check $query_object->q strpos
• Fixed issue on dd_init_test PSQL check with empty response
• Fixed ontology form submit duplicity issue when a new term is created. Now enter the fields, press the ENTER key, don't submit the form, just click the 'Modify' button
• Fixed ontology possible infinite loop when empty tern_id is received twice
• Fixed ontology cache bug where method tipo_to_json_item returns inconsistent cached value from previous DB call
• Fixed tool_import_dedalo_csv issue with non-utf8 files blocking tool preview of files
• Fixed auto_detect_line_endings error on method read_csv_file_as_array (class.tool_common.php)
• Fix lang import for nomisma rdf model
• Fixed issue with document encoding detection in tool_common -> read_csv_file_as_array
• Fixed export structure (Ontology) issues when master user privileges generates a import error
• Fix export when users order after search
• Fixed error on clean install sequence that creates a infinite loop
• Fixed PHP 8.1 compatibility issues in class diffusion_sql
• Fixed component_geolocation method get_diffusion_value_as_geojson check issue when value is empty
• Fixed bug search_tipos when value is array (component_relation_children, component_relation_parent)
• Fixed compare null values error on tool_ts_print
• Fixed open_data_link inspector function issues with non Apache servers
• Fixed ontology class wrong type definition
• Fixed issue with component_input_text render_list_value resolution when 'with_lang_versions' is active in thesaurus_list mode
• Fixed tool_indexation css issue where component_text_area tag selection creates a unnecessary page scrollbar
• Fixed error where no default temp preset is loaded in search init
• Fix regex to get tag with spaces
• Fixed publication API incoherence about charset encoding. Now, all connections will be use charset=utf8mb4
• Fixed minor PHP8.1 component_date issues and code clean up
• Fixed error in component_json edit mode where read only mode (permissions <2) shows data wrongly. Cleanup code too
• Fix permissions check for section publication components

Updates

• Updated sample.config4.php file with more constants and comments
• Updated core functions to_string to deal with associative array values
• Updated MySQL connection defaults from utf8 to utf8mb4 to support 4 bytes uf8 chars in publication to MySQL (legends cases for instance)
• Updated swagger.json file in publication API server docu from 1.0.21 to 1.0.23
• Updated base structure.css and langs js files
• Updated Dédalo base css and lang js files

Other changes

• Changed fallback no logged url in ontology pages to preserve v6 compatibility
• Ontology code clean and PHP8 compatibility issues fixed
• Improved build_version_from_git_master response messages for easy debug
• Clean code of build_version_from_git_master function
• Restored core_function 'to_string' null result values to '' instead 'null'
• Improved install hierarchies. Now development users can install additional hierarchies anytime
• Changed thesaurus default search limit from 10 to 100
• Revert "Added thesaurus search virtual sections tipo option. Now, real section tipo is calculated in class search_development2->get_components_from_section method"
• Clean up code ImageMagick class
• Improved button diffusion label name to able to identify publication target database
• Changed default ts_object pagination limit from 100 to 300
• Clean up class diffusion code

V5.8.5

Maintenance and security update.

This update enforce the security of Publication API.
This update improve export and add import RDF from nomisma

Additions

• Added tool_import_dedalo_csv bad JSON notification on preview list
• Added column 'death_context' in custom search global (class.diffusion_sql and class.web_data)
• Added column 'buried_type' in custom search global (class.diffusion_sql and class.web_data)
• Add posterframe for indexation tags
• Add time variable to the tag posterframe to refresh the posterframe
• Added comments of class.ontology.php
• Added library qrcode (EasyQRCodeJS)

Deletions

• Removed login user notification errors. Could be unsafe on network errors
• Remove the old class diffusion_rdf
• Remove the html tag in values for RDF

Fixes

• Fixed unique_server_check issue when the value is equal in more than one lang
• Fixed issue in tool_description where where mce editor was not available
• Fix empty lang in the component_autocomplete
• Fix the get_valor when the lang is required
• Fix get diffusion value lang when it has required
• Fix html tags in the literal text for RDF
• Fixed Swagger UI viewer vars XSS vulnerability
• Fixed issue with web_data::build_fragment margin chars in transcriptions with long pauses between time codes. Set to default zero value
• Fixed web_data::get_thesaurus_term error on calculate combined terms
• Fixed get_diffusion_value_as_geojson issues on json decode when data is empty
• Fixed missing encoding value in trigger.tool_export.php -> export_data method
• Fixed bug on tool_export when some double quote values was not properly escaped, generating JSON format errors on import. Now individual lang values quotes are normalized and escaped before create the csv string
• Fixed missing encoding value in trigger.tool_export.php -> export_data method
• Fixed bug on tool_export when some double quote values was not properly escaped, generating JSON format errors on import. Now individual lang values quotes are normalized and escaped before create the csv string
• Fixed web_data regex error in table name verification

Updates

• Updated publication API docu/ui (swagger ui) from 2.4.0 to 4.5.

Other changes

• Re-formulate the diffusion_rdf to use easyrdf library
• Change the lang of the component to get_valor()
• Revert "Fix get diffusion value lang when it has required"
• Changed from 6 secs to 180 secs the sleep time in autobackup
• Revert jquery ui from 1.13.0 to 1.11.4 because drag and drop compatibility issues
• Improved server_api web_data check_safe_value verification and errors log. Now table names with only numbers are rejected and sql_fullselect, sql_filter are more restrictive.

V5.8.4

Maintenance and security update.

This update review the code for compatibility with PHP8.1
This update change the jquery-ui

Additions

• Added IS EXACTLY EQUAL == operator to component_input_text to allow saerchches with @> operator (case Ontologies term_id dd1475)
• Added component_json read only mode controled by properties
• Added Ontology functionality (update_json_ontology_items) to save every change in structure data to the new created JSON Ontology Item field
• Added new queue sql commands to append to the next update data config
• Added Publication API docu viewer optional param 'lang' to easy sync Dédalo data lang and Publication API lang
• Added 'component_svg' as excluded search component to prevent user select this component as searchable
• Added to tool_administration the publication code
• Added try catch to JSON.parse(wrapper.dataset.dato) on recursive_groups function to prevent bad data blocks the search
• Added 'norder' and 'propiedades' to diffusion_sql on resolve_jer_dd_data
• Added component_json search mode
• Added missing property 'fragment_terms' on publication method get_fragment_from_index_locator
• Added SAML error log info to easy follow user login errors
• Added component_json escaped slashes to allow search text inside JSON data
• Added tool_docu options to hide the section inspector
• Added function 'valid_tipo' for verify some tipos like config MAIN_FALLBACK_SECTION that can cause infinite loops in the installation process or in config errors
• Added global search custom columns (MDCAT)
• Added component_semantic_node compatibility options (update_portal_dato)
• Add view_gilph_small
• Added 'is_literal' option in the publication web_data field safe control
• Added publication class.diffusion mysql check for column exists. If not exists, a new column will be created automatically
• Added method 'resolve_indexation_fragments' to class 'process_result'. Updated Publication API swagger updated file
• Added posterframe to web_data::build_fragment method

Deletions

• Removed web_data class locator dependency in method get_indexation_terms
• Removed component_filter unused methods
• Removed component_common split_query option for component_json search

Fixes

• Fixed window.opener refresh issue on dd_edit.js
• Fixed class.ontology minor msg vars errors
• Fixed web_data error when no sql filter is passed (build_sql_where). Now a empty string is return
• Fixed button publish input levels issue on Safari
• Fixed issue when ontology term edit not save empty object '{}' as expected empty value
• Fixed/Unlocked Ontology obs field to allow manual remove old values
• Fixed component_filter stats error when project values was not calculated correctly
• Fixed PHP 8.1 deprecated and more strict code issues
• Fixed error in Ontology RecordObj_dd->get_properties. Now default param 'json_decode' is restored to true
• Fixed error in web_data ar_fields check that do not it did not contemplate unicode characters like 'ñ'
• Fixed error in publication class free_node::get_free_fragments where marks were erased before indexation tags calculation
• Fixed minor ontology css and js issues
• Fixed Ontology css issues
• Fixed descriptors error on delete lang term
• Fixed minor var checks on JSON and string values
• Fixed inc/btn.php tag [/index detection issue from server REQUEST_URI when url is encoded (chars like [] are not detected)
• Fixed error on get Ontology model correctly (var 'visible' was overwritten by another script)
• Fix component_semantic_node issues in both search and edit mode
• Fixed issue with duplicate square brackets in resolve_query_object_sql. Now, first and last are removed before process
• Fixed search issue of component_semantic_node when empty value has searched as null value
• Fixed search value display error on component_json
• Fixed issue in web_data free search in literal mode. Remove possible quotes added and force add new ones
• Fixed error in web_data::get_fragment_from_index_locator where indexation_terms were not correctly passed to the next call
• Fixed error where main_dd counter is not updated when creating a new hierarchy
• Fixed diffusion_mysql error where automatic columns 'section_id', 'section_tipo,', 'lang' generating errors whe columns are added to a existing tables
• Fixed publication web_data get_PDO_connection error where port was not send into the dsn string

Updates

• Updated dd_tipos with new json_item tipo (ONTOLOGY_SECTION_TIPOS)
• Updated Publication API docu swagger ui json file from v1.0.17 to v1.0.18. Improved description about /thesaurus_root_list use
• Updated Publication API docu ui swagger file with tag 'Legacy Thesaurus'
• Updated swagger JSON file definitions
• Updated main structure.css and js lang files
• Updated login set password and install redirection from default to tool_administration
• Updated structure css and js lang files
• Updated Publication API JSON swagger definitions version to 1.0.20
• Updated process_result::sum_totals function
• Updated jquery-ui to 1.13.0

Other changes

• Clean component_input_text html code
• Clean class JSON_RecordDataBoundObject code. Removed unnecessary exceptions and clarify data flows
• Clean class backup code. Unified terminal execution calls
• Change the viewing_glyphs_small
• Clean diffusion mysql code
• Refactorized diffusion_mysql add_column method
• Clean Publication class DBi code
• Clean code web_data::get_fragment_from_index_locator method. Unified response as object
• Re-factorized web_data functions get_publication_schema, get_table_fields, get_all_tables to use DDO connection