MentDB Weak 4.2.4: 570 new functions, new databases and a smarter editor @ Server @ MentDB Weak
This release adds about 570 MQL functions, new SQL databases and a much richer editor.
All the existing scripts keep working, except for the points listed in the upgrade notes.
What's new
All the existing scripts keep working, except for the points listed in the upgrade notes.
What's new
- Databases: new JDBC drivers for PostgreSQL (SCRAM authentication of PostgreSQL 14+), SQL Server, Oracle, Firebird and MySQL. New connections for MariaDB, ClickHouse and Trino, with their creation links in the editor.
sqlitefunctions, andsqlite configto use a SQLite file with thesqlfunctions. - Modern APIs:
oauth(PKCE, discovery, refresh),jwt verify_jwks,graphql, WebSockets (ws), JSON lines,webhook verifyandsign,openapi(check requests and responses). - Web data:
html select,tables,links,metaandto_text; RSS and Atom feeds, sitemaps, robots.txt; SPF, DMARC and DKIM checks and DKIM signature; encoding detection and conversion; CBOR and MessagePack. - Notifications: Slack, Microsoft Teams, Discord, Telegram and Google Chat, Web Push with VAPID keys, CalDAV and CardDAV calendars and contacts.
- Devices and formats: Modbus, SNMP, WebDAV, Avro, Protobuf, TOML, international domain names, syslog, GPX, KML and WKT, LibreOffice documents (
odsandodt), Shapefiles (shp). - Geography:
geo transformbetween EPSG systems (Lambert-93, CC zones, UTM, La Réunion, Mayotte, Antilles, Guyane, Polynesia, New Caledonia), French address geocoding, communes, departments and regions, official French school holidays. - Data toolkit: Base58, Base85, BLAKE2, BLAKE3, xxHash, scrypt, Argon2, Ed25519, certificates and CSR,
semver, exactmoneyamounts with ECB rates, phone numbers, public holidays of 13 countries, country data,text diff,patchandmerge3,html sanitize, full-text search, test data withfake, in-memorycacheandrate_limit. - Business rules: DMN decision tables with
rules eval,check(overlaps and gaps) andexplain, written in JSON or in a spreadsheet. - Operations: log parsing (Apache, nginx, syslog, logfmt, grok patterns), user agents, grouped stack traces, RDAP (the successor of whois), OpenTelemetry metrics, traces and logs, StatsD, Prometheus, charts in SVG and PNG, xz and 7z archives, Git, PDF compare and redaction, EU VAT and French company checks.
- Scripts and stack:
script graph,orphansandimpact(who calls what, read from the code),script searchin all the scripts,stack tree(the real execution tree of a process with its durations),job calendar(next run times of the jobs). - Editor:
- Function search by words (Cmd/Ctrl+Shift+P), completion with one field per parameter, parameter help while typing and F1, unknown functions and wrong argument counts underlined, FUNCTIONS panel with favourites.
- Script map and Stack map: the calls between scripts and the real execution tree of the stack, with durations, in a tab of the output zone.
- Format MQL (Cmd/Ctrl+Shift+I), OUTLINE panel with the variables of the script, run the selection or the statement under the caret (Cmd/Ctrl+Shift+Enter), run time shown.
- Result grid: filter per column, Copy as CSV, JSON, SQL INSERT or Markdown, sum and average of the selection, Plot, load more than 500 rows.
- A correct diff, search in all the scripts (Cmd/Ctrl+Shift+F), server log viewer, columns of the tables in the connection tree, jobs calendar, impact preview before renaming a script, tooltips on the toolbar.
- Documentation: a summary at the top of each MQL Functions page, classes sorted alphabetically in each group, new use cases.
- From 4.2.3: copy the new
src,core,docs,licensesandMentDB_Weak_Editor_GPLv3/corefolders,MentDB_Weak_Editor_GPLv3/tools/mql.json, themql/scriptsfolder and the start and stop scripts of thebinfolder, then restart. - In the
libfolder:- Add
snmp4j-3.13.2.jar,sqlite-jdbc-3.54.1.0.jar,libphonenumber-9.0.43.jar,JavaEWAH-1.1.13.jar,xz-1.10.jar,juniversalchardet-2.5.0.jar,proj4j-1.4.3.jar,proj4j-epsg-1.4.3.jar,postgresql-42.7.14.jar,mssql-jdbc-13.6.2.jre8.jar,ojdbc8-23.26.4.0.0.jar,jaybird-5.0.13.java8.jar,mysql-connector-j-9.7.0.jar,mariadb-java-client-3.5.11.jar,clickhouse-jdbc-0.11.1-all.jarandtrino-jdbc-484.jar. - Delete
xz-1.5.jar,postgresql-jdbc-9.3-1100.jar,sqlserver-jdbc4-4.0.2206.100.jar,oracle-jdbc6-11.2.0.4.jar,jaybird-full-3.0.3.jarandmysql-connector-java-8.0.21.jar. This is required: otherwise two versions of the same driver are loaded.
- Add
- Before starting, run
python3 tools/upgrade_check.pywith the folder of your server: it lists the missing libraries. - After the restart, run once
tools/mql_dev/work/lot_drivers/import_scripts.mql: it installs the MariaDB, ClickHouse and Trino connection scripts and reloads the SQL Server, Firebird and table scripts. Reloadapp.100.scrud.build_config.exetoo (a missing;is fixed). - Before any upgrade, back up the
certandconffolders, and never delete thedatafolder. - Behavior changes:
- SQL Server: the connection is now encrypted and the certificate checked. With a self-signed certificate, add
"trustServerCertificate":"true"to the connection properties, or"encrypt":"false"on a private network. - Oracle: the new driver supports Oracle 19c and later. Keep the old driver for older databases.
- Firebird: for a server that only offers Legacy_Auth, add
"authPlugins":"Srp256,Srp,Legacy_Auth"to older connections. - New function names are checked first: no existing MQL function has been replaced by a new one.
- SQL Server: the connection is now encrypted and the certificate checked. With a self-signed certificate, add
- Good to know:
- ClickHouse and Trino connect lazily: an error appears at the first query, not at
sql connect. - A job whose script was renamed or deleted no longer breaks the administration tree: it is shown to sys as "script missing".
proj4j-epsg-1.4.3.jarcontains the EPSG dataset, under the IOGP terms of use (see thelicensesfolder).
- ClickHouse and Trino connect lazily: an error appears at the first query, not at
