Shannon-Data/ShannonBase

Summary HeatWave-style guidance: low-cardinality string columns used as JOIN / GROUP BY keys should be compared and hashed as dictionary codes (fixed-width integers) rather than as decoded strings, because it shrinks the working set, replaces string ops with integer ops, and vectorizes far better. This issue tracks closing that gap in the rapid engine. Audit result: neither the hash join nor the hash aggregate exploits dictionary codes today. Both deliberately fall back to a decoded-string path. Audited at 9294ff340d4a36d95ada87d4c597c6a89433d48a (branch main). Current state of string encoding (differs from HeatWave's model) HeatWave ShannonBase today Encoding choice VARLEN or DICTIONARY, per column CHAR/VARCHAR are always dictionary-encoded; there is no raw-VARLEN option RAPID_COLUMN=ENCODING=SORTED|VARLEN selects the storage form only selects the dictionary-entry compressor (SORTED→ZSTD, VARLEN→LZ4), and only for entries ≥ 64 B CU slot width variable / fixed-width c

Summary Seven of the 22 TPC-H queries execute with zero vectorized operators. The cause is not the join shape: it is that AccessPath::STREAM is always translated to a MySQLNative node, and MySQLNative::ToAccessPath() discards the translated subtree and walks the entire original subtree clearing vectorized. One Stream results node anywhere in the plan therefore takes everything below it native. Measurement Counting Vectorized in EXPLAIN FORMAT=TREE against Stream results, TPC-H SF0.2, hypergraph on, use_secondary_engine=FORCED: query vectorized ops Stream results q3, q5, q10, q11, q13, q16, q21 0 1 q1, q4, q12, q18 1 0 q6, q15, q19, q20 2 0 q14, q17 4 0 q22 6 0 q9 7 0 q2 8 0 q7 9 0 q8 0 0 The correlation is exact: every query containing a STREAM node vectorizes nothing, every query without one vectorizes something. (q8 is 0/0 — a separate cause, not covered here.) Mechanism Optimizer::translate_access_path(), case AccessPath::STREAM translates the child and t

Summary Description for this feature. The core version of mysql has been upgraded from 8.x to 9.7.x LTS. And ShannonBase also should do this upgrade opers.

Summary Description for this feature. in order to increase the converage, we should add more MTR cases to cover all workload scenarios.

Summary Description for this feature. Ingest Files into a Vector Store CALL sys.VECTOR_STORE_LOAD("oci://BucketName@Namespace/Path/Filename", @options); ref : https://dev.mysql.com/doc/heatwave/en/mys-hw-genai-vector-store-load.html