libfc4c / Blog: Recent posts

• Fixed: u8fi_t: alignment attribute value should be platform-dependent.
• Fixed: _print_fwstr(): no PLT call for _u8c_strnlen()
• Fixed: utf8sc_internal.h: __u8c_get_char_code(): msk_ar[] should be of u8_t type.
• Fixed: utf8sc_internal.h: typo in FC4C_U8C_INITIALIZER: .cpmap should be initialized using FC4C_DBA_INITIALIZER (and not FC4C_DAR_INITIALIZER).
• Fixed: (mislooked) removed u8c_GetChar(), which was just a remnant of testing phase.

• Added: UTF-8 string container
• Change: tri_codegen source merged with main lib project
• Fixed few BUGs

• Fixed: (BUG::untested): _uadd32_ovf_chk() fallback mode: inverted logic in overflow test; fallback mode was used for gcc versions older than v8.0
• Fixed: _umul32_ovf_chk(), _uadd32_ovf_chk(): return bool type in fallback mode, for consistency with compiler built-in functions.
• Fixed: tri_TrieStats(): using realloc() instead of reallocarray(), no overflow possible.
• Fixed: TEST: missing '--f64' and '--ict' options in help string.
• Change: CSC_MIN_BUF_SZ is now platform-dependant (16/32 bytes), matching malloc() MIN_CHUNK_SIZE.
• Change: configure.ac: added explicit checking for availability of __builtin_popcount(), __builtin_clz(), __builtin_umul_overflow(), __builtin_uadd_overflow(), __builtin_strnlen() and reallocarray(). This ensures backward-compatibility with old systems.
• Cleanup: shared.c no need to define dummy values for CT_HDR_VERSION and CT_HDR_VER_AGE while rcd_autogen is running.
• Update: rcode v4.4

• Change: '\' backslash is now used to specify numeric value of size up to 4 bytes, not just a single byte.
• Change: using tabs for indentation.
• Cleanup: parcer.c, srcgen.c: removed unused __rcd_scope variable.
• Update: rcode v4.1

Few small fixes and changes, most important: TRI: min snode size changed from 6 to 2 bytes -> useful for storing very small objects.

• Fixed: (BUG) fp32_g_str(), fp64_g_str(): incorrect switching between 'e' and 'f' representation modes for negative exponents.

• Fixed: (BUG::regression) (gcc v14.x ??) csc_xPrintf() incorrect handling of double arg and fp64_t transparent unions.
• Fixed: tri_internal.h: some functions can't be used by extensions, and should not be exposed.
• Update: rcode v4.1

• Fixed: (BUG) tri_FindPrefix(), tri_FindPrefixMT(): incorrect handling of TERM flag when LW4 of last byte in prefix is encoded in tnode link,
• Fixed: TRI: delete_or_diag_obj(MD_DIAG): for last TERM tnode change last ndds_t offs to 0 - to prevent printing of linked node, which is not part of diagnosed object,
• Change: TRI: Immediately remove zero-length string nodes, which could be created by tri_AddObject()::_chk_term ->_sterm_2 rountine.

• Update: rcode v4.0
• Change: Removed global variable fc4c_status_rcd, using new rcode scope stack
• Change: dar_Alloc(n_obj) is now a wrapper for dar_do_alloc(), what eliminates duplicated checking of dar_t.n_slots >= n_obj condition for all internal calls
• Change: TRI: added tric_t.s_stk_const, tric_t.s_stk_const: alternative const pointers for use with tri_codegen, to allow generating tries with 'const' stacks

• Fixed: (BUG) csc_Assign_cstr(): using 'ccnt' instead of 'dstlen' for new buffer size: memory corruption possible. It worked in all test cases, because csc_do_realloc() doubles the buffer size by default.
• Added: csc_Assign_bstr(), csc_Append_bstr(): assign/append exactly 'nchar' bytes: no searching for NULL byte - much faster.
• Change: tri_AddObject(), sx_append_snode(): using builtin_memcpy() for copying snode data: higher performance, epecially for long snodes.

• Fixed: (BUG) dht_internal.h must include dynhsh.h when included by client app, to have dht_hshfn and dht_cmpfn pointers defined.
• Few cosmetic changes and fixes.

• Fixed: (BUG) print_snode(): useless last byte appended to stnd_t.str, what could cause compiler warning "excess elements in array initializer".

• Fixed: (BUG): fp64_g_str(), fp32_g_str(): invalid buffer size passed to csc_realloc(): memory corruption possible.
• Fixed: (BUG): fp64_int_cnv(): insufficient number of zeros injected into buffer for special value 0.0e+0.
• Fixed: (BUG::undetected): csc_printf(): va_arg "promotes" double arg to u64_t, unless passed as fp64_t, as in the test program -> undetected.
• Added: csc_xPrintP(): parametric versions of csc_xPrintf() functions, which allow to programmatically manipulate conversion parameters.
• Change: CSC: %s, %S conversions: strings are aligned to the left side of field, i.e. spaces are appended to the output string if field width is greater than the arg. length.

Full list in the change log.

• Fixed: (BUG::no_test): DBA: dba_SetBuffer() sets invalid number of m_slots.
• Fixed: (BUG::regression): CSC: fp32_int_cnv(): accidentally removed division by 10 for normal values (but tests passed). Now the test program is checking also the binary structure of float against value produced by strtof().
• Added: CSC: csc_printf() support for %lf, %le and %lg conversion specifiers: very fast double to string conversion, including sub-normals with full precision.
• Added: CSC: csc_printf() support for 'z' length modifier (aka size_t) and '%0' flag - zero-padding of numeric values
• Change: CSC: csc_printf(): %b and %B conversions are now over 2 times faster.... read more

• Fixed: (BUG): csc_printf()->fp32_g_str() is replacing target string instead of appending conversion result (mislooked)
  Archive with 6.2.0 removed

• Added: CSC: support for %f, %e and %g conversion specifiers for floats: probably the fastest possible method (and it's not Ryu ;) ),
• Added: CSC: support for field width, precision and '+' flag,
• Change: csc_printf(): re-written as a simple state machine, using computed gotos to parse format string -> much faster

• Fixed: --auto-idx, -x option takes base index as argument (missing in v6.2.0),
• Added: Injecting code for checking target platform byte order - to prevent 'surprises' when the trie data file is not generated at compile time.

• Fixed: srcgen.c: struct stnd_fsz should have aligned(4) attribute just like stnd_t.
• Fixed: --long-options not really implemented.

• Added: Project: Util/libfc4c_tri_codegen-6.1.0.tar.gz package: tri_codegen utility takes user-provided text data file as input, creates a Trie container based on the content of the file, and then generates source code with structures describing the Trie. The sources generated by tri_codegen can be compiled into programs which need a static Trie structures, and which otherwise would have to be generated each time the the program is started.
• Change: csc_Printf() the 'l' length modifier is ignored for %p and %P conversion specifiers - pointer type size depends on __WORDSIZE.
• Change: tri_internal.h: the header is now installed, to allow writing extensions to the trie container.
• Change: dht_t is now opaque type, but can be accessed by including dht_internal.h. Functions related to hmap_t are also moved to dht_internal.h.
• Fixed: Symbols do_hash_data(), read(), write() should not be exported.

• Added: DBA: dba_ShiftRight(), dba_ShiftLeft(): shifting array bits right/left starting at given bit index,
• Added: DBA: dba_InsertBitF(), dba_InsertLongBitF(), dba_DeleteBitF(): inserting and removing bitfields from array,
• Added: DBA: dba_PushMask(), dba_PopMask(): push/pop 1..32 bits to/from the array,
• Added: DBA: dba_PushLongMask(), dba_PopLongMask(): push/pop bit masks of arbitrary size,
• Added: DBA: dba_Copy(): copy data between bit arrays,
• Added: CSC: csc_sPrintf(), csc_aPrintf(): printing to CSC string replacing or appending the text,
• Added: CSC: csc_dPrintf(): printing to file descriptor, using CSC as a temp buffer,
• Added: CSC: csc_printf() support for non-standard conversion specifier "%S": CSC string,
• Added: CSC: csc_printf() support for non-standard conversion specifier "%B": DBA array,
• Added: CSC: csc_printf() support for 'l' length modifier, which assures consistent behaviour on both 32bit and 64bit platforms: without 'l' all conversions are 32bit, and 64bit otherwise,
• Added: DAR: dar_PopObjCopy(): returns the object "by value" - i.e. a copy,
• Change: TRI: tri_Save() now takes 'flags' argument, currently used for TRI_REBUILD only - rebuild the trie before saving.
• Change: new versioning method for saved containers, similar to libtool's system - allows to precisely define supported versions range, by using "age" value,
• Fixed few BUGS.

• Fixed: (BUG::LEAK) tri_AddObjectKey(), tri_DeleteKey(): a trivial BUG: using malloc() instead of realloc() for trip->ndstk.tmp_buf.
• Fixed: (BUG::old): csc_Printf() invalid result for signed 64bit integers if the value is above 32bit range.
• Change: csc_Append_cstr(): added support for self-appending of the CSC buffer.
• Change: csc_Printf(): dynamically extends target CSC size if needed.
• Added: csc_Printf(): support for "%o" (octal) conversion specifier and "%%" - percent sign.
• Fixed: TEST::DRB: missing support for "--vrb" option.... read more

• Fixed: (BUG::regression) max configurable snode length should be 122 bytes (244 4bit words), limited by stnd_t.pos/epos,
• Fixed: (BUG) dar_Clone(), dar_Copy(): handle cases when source DAR is empty,
• Fixed: dar_Clone(), dar_Copy(): added checking for buffer overflow on 32bit platform,
• Fixed: DBA: 32bit mask operations: offset verification should be performed against dba_t.u_slots, not dba_t.m_slots.
• Fixed: TEST::DHT: missing support for "--vrb" option.
• Update: rcode v3.3

Most important changes:

• Fixed: (BUG::TRI) in some special cases tri_FindObject() could return RCD_TRUE for partial match
• Added: TRI: support for MT-safe parallel search operations,
• Added: TRI: configurable string node size: 6..250 bytes,
• Added: DBA: bitwise operations on masks of arbitrary size,
• Change: CSC can be statically allocated, removed 32-bit padding,
• Added: support for Large Files (with size over 2GiB)... read more

Fixed: (BUG::undetected_in_TEST_program) tri_GetKey() could return wrong object key in some special cases.

• Fixed: _gen_suffix_ar(), tri_AddObjectKey(), tri_DeleteKey(), tri_ObjectKeyDiag_Write(): unaligned key r/w opertions are now handled in a portable way.
• Fixed: tri_ExtractObjects(obj_sz != 0) returns error if target object size is greater than obj_sz (smaller size is allowed).