tag:github.com,2008:https://github.com/databrickslabs/discoverx/releasesRelease notes from discoverx2024-01-15T13:44:50Ztag:github.com,2008:Repository/604719532/v0.0.82024-01-15T13:50:25Zv0.0.8<ul>
<li>Fixed bug for tables containing <code>-</code> character in the table name</li>
<li>Added example for cloning all catalog/schema content</li>
<li>Added filtering for table format (exclude views from queries by default)</li>
<li>Added support for PII detection on non-string columns</li>
<li>Updated LICENSE file</li>
</ul>edurdevictag:github.com,2008:Repository/604719532/v0.0.72023-11-13T13:29:10Zv0.0.7<ul>
<li>Added filtering for speedup intro message checks</li>
<li>Added tags metadata in table info</li>
<li>Added map function for arbitrary python code table processing support</li>
<li>Added AI example notebooks</li>
</ul>edurdevictag:github.com,2008:Repository/604719532/v0.0.62023-10-03T07:22:51Zv0.0.6<ul>
<li>Refactored scan() in order to be chainable with from_tables()</li>
<li>Improved metadata fetching speed for table information</li>
<li>Refactored to remove duplicated SQL code from scanner class</li>
<li>Updated intro messages and documentation</li>
<li>Added example for detecting tables with many small files</li>
</ul>edurdevictag:github.com,2008:Repository/604719532/v0.0.52023-08-29T01:05:05Zv0.0.5<ul>
<li>Added support for multi-table SQL execution dx.from_tables(...).apply_sql(...)</li>
<li>Added example of VACUUM command to multiple tables</li>
<li>Added example of PII detection using Presidio over multiple tables</li>
</ul>edurdevictag:github.com,2008:Repository/604719532/v0.0.42023-08-03T07:36:32Zv0.0.4<ul>
<li>Removed pydantic dependency</li>
<li>Fixed issues with special characters in column names</li>
<li>Fixed readme docs</li>
<li>Added integer and decimal rules</li>
<li>Fixed case insensitive regex expressions</li>
</ul>edurdevictag:github.com,2008:Repository/604719532/v0.0.32023-07-05T14:39:25Zv0.0.3<ul>
<li>Upgraded pydantic dependency to 2.0</li>
<li>Added support for special characters in column names</li>
<li>Updated readme</li>
</ul>edurdevictag:github.com,2008:Repository/604719532/v0.0.22023-07-03T08:14:35Zv0.0.2<ul>
<li>Improved Readme and examples</li>
<li>Added System tables permissions check with friendly message</li>
<li>Refactored save and load methods after customer feedback</li>
</ul>edurdevictag:github.com,2008:Repository/604719532/v0.0.12023-07-03T08:09:01Zv0.0.1<p>First release of DiscoverX.<br>
It includes:</p>
<ul>
<li>Lakehouse scanning with REGEX rules on string columns for 16 class types (email, IP v4, IP v6, URLs, MAC address, FQDNs, credit card numbers, credit card expiry date, ISO date, ISO datetime, US mailing address, US phone number, US social security number, US state, US state abbreviation, US zip code</li>
<li>Save and load scan result</li>
<li>Cross-table query based on semantic types of columns (rather than column names)</li>
</ul>edurdevictag:github.com,2008:Repository/604719532/v0.0.02023-03-15T09:47:13Zv0.0.0<p>Initial version to reserve PyPi project</p>david-tempelmann