Embedding files in programs - Printable Version +- QB64 Phoenix Edition (https://staging.qb64phoenix.com) +-- Forum: QB64 Rising (https://staging.qb64phoenix.com/forumdisplay.php?fid=1) +--- Forum: Prolific Programmers (https://staging.qb64phoenix.com/forumdisplay.php?fid=26) +---- Forum: RhoSigma (https://staging.qb64phoenix.com/forumdisplay.php?fid=32) +---- Thread: Embedding files in programs (/showthread.php?tid=497) |
Embedding files in programs - RhoSigma - 05-27-2022 Embedding any files into your programs by converting it into DATA lines or an C-Array The following two small programs are meant to convert any file (eg. Images, Sounds, Databases etc.) into an easy embedable format. Embedding is then as simple as putting a $INCLUDE line at the end of your program. But note, this feature is not meant to save you from the task of loading a file and instead directly using the embedded data. It's designed only for the convenience of delivering just one file (your program's EXE), and hence also making sure all required files are always available on any user's computer, but the embedded data must be written out there again to be usable. The converted files will therefore have a "Ready to use" writeback function, which will rebuild the embedded file on disk, from where you then eg. _LOADIMAGE regularly. The first converter tool is named MakeDATA, as you may imagine by its name, it will convert the given file into a block of DATA lines. This is easy to use and absolutly BASIC only. It's best to embed small files like icons or sprites. However, for large files like fullsize digital photos or MP3 music it has a big drawback at the compiling speed of your program and the final EXE size on one side and also to the writeback speed on the other side. So for bigger files the second tool MakeCARR should be your choice, which its advantages are detailed below the MakeDATA codebox. Note for Windows users: The codeboxes below contain simple SCREEN 0 (text) based versions of the converter tools. You may have to go in to change your default paths, but they should work reliable on all OS's supported by QB64. If you're on Windows, then you may rather wish to use the more convenient GuiTools based versions, just move on to The GuiTools Framework here: https://staging.qb64phoenix.com/forumdisplay.php?fid=32 Both converter tools are available as part of the QB64GuiTools.7z source archive. And now for the simple (SCREEN 0) people: Both of the following tools require the 'lzwpacker.bm' file available from my Libraries Collection here: https://staging.qb64phoenix.com/forumdisplay.php?fid=23 If you're using at least QB64 v1.4 or any Phoenix Edition version and don't wanna use the extra Lzw packer libarary, but the QB64 built-in zlib compression instead, then simply substitute the LzwPack$ call (line 84) with the respective _DEFLATE$ call and the LzwUnpack$ call (line 187) with an _INFLATE$ call. Also delete the $INCLUDE line at the end. MakeDATA.bas Code: (Select All)
' --' -'-'- -|' ' --' - | And now the second tool MakeCARR. It will do the whole thing in an array on C/C++ level, rather then in DATAs on the BASIC level. Although it's handling is a bit more tricky, as you get not only a .bm file, but also a .h file, and both must match (ie. the DECLARE LIBRARY path in the .bm must point to the .h), this approch has several advantages especially for big files:
MakeCARR.bas Code: (Select All)
-. . .-...--.--. .-. |'| ###### ## | | \ | |( )( ) | ( || | |( ) | '| ## ## | ' '- -'-'-' -- |' '- -'- | '| ## ## # | ._.' | '| ## ###### | Sources & Documents placed in the Public Domain. | '+---------------+---------------------------------------------------+ '| | '| === MakeCARR.bas === | '| | '| == Create a C/C++ array out of the given file, so you can embed | '| == it in your program and write it back when needed. | '| | '| == Two files are created, the .h file, which contains the array(s)| '| == and some functions, and a respective .bm file which needs to | '| == be $INCLUDEd with your program and does provide the FUNCTION | '| == to write back the array(s) into any file. All used functions | '| == are standard library calls, no API calls are involved, so the | '| == writeback should work on all QB64 supported platforms. | '| | '| == Make sure to adjust the path for the .h file for your personal | '| == needs in the created .bm files (DECLARE LIBRARY), if required. | '| == You may specify default paths right below this header. | '| | '| == This program needs the 'lzwpacker.bm' file available from the | '| == Libraries Collection here: | '| == https://staging.qb64phoenix.com/forumdisplay.php?fid=23 | '| == as it will try to pack the given file to keep the array(s) as | '| == small as possible. If compression is successful, then your | '| == program also must $INCLUDE 'lzwpacker.bm' to be able to unpack | '| == the file data again for write back. MakeCARR.bas is printing | '| == a reminder message in such a case. | '| | '+-------------------------------------------------------------------+ '| Done by RhoSigma, R.Heyder, provided AS IS, use at your own risk. | '| Find me in the QB64 Forum or mail to support@rhosigma-cw.net for | '| any questions or suggestions. Thanx for your interest in my work. | '+-------------------------------------------------------------------+ '--- if you wish, set any default paths, end with a backslash --- srcPath$ = "" 'source path tarPath$ = "" 'target path '----- IF srcPath$ <> "" THEN COLOR 15: PRINT "Default source path: ": COLOR 7: PRINT srcPath$: PRINT END IF IF tarPath$ <> "" THEN COLOR 15: PRINT "Default target path: ": COLOR 7: PRINT tarPath$: PRINT END IF '--- collect inputs (relative paths allowed, based on default paths) --- source: LINE INPUT "Source Filename: "; src$ 'any file you want to put into a C/C++ array IF src$ = "" GOTO source target: LINE INPUT "Target Basename: "; tar$ 'write stuff into this file(s) (.h/.bm is added) IF tar$ = "" GOTO target '----- ON ERROR GOTO abort OPEN "I", #1, srcPath$ + src$: CLOSE #1 'file exist check OPEN "O", #2, tarPath$ + tar$ + ".bm": CLOSE #2 'path exist check ON ERROR GOTO 0 '--- separate source filename part --- FOR po% = LEN(src$) TO 1 STEP -1 IF MID$(src$, po%, 1) = "\" OR MID$(src$, po%, 1) = "/" THEN srcName$ = MID$(src$, po% + 1) EXIT FOR ELSEIF po% = 1 THEN srcName$ = src$ END IF NEXT po% '--- separate target filename part --- FOR po% = LEN(tar$) TO 1 STEP -1 IF MID$(tar$, po%, 1) = "\" OR MID$(tar$, po%, 1) = "/" THEN tarName$ = MID$(tar$, po% + 1) EXIT FOR ELSEIF po% = 1 THEN tarName$ = tar$ END IF NEXT po% MID$(tarName$, 1, 1) = UCASE$(MID$(tarName$, 1, 1)) 'capitalize 1st letter '--------------------------------------------------------------------- ' Depending on the source file's size, one or more array(s) are ' created. This is because some C/C++ compilers seem to have problems ' with arrays with more than 65535 elements. This does not affect the ' write back, as the write function will take this behavior into account. '--------------------------------------------------------------------- '--- init --- OPEN "B", #1, srcPath$ + src$ filedata$ = SPACE$(LOF(1)) GET #1, , filedata$ CLOSE #1 rawdata$ = LzwPack$(filedata$, 20) IF rawdata$ <> "" THEN OPEN "O", #1, tarPath$ + tar$ + ".lzw" CLOSE #1 OPEN "B", #1, tarPath$ + tar$ + ".lzw" PUT #1, , rawdata$ CLOSE #1 packed% = -1 OPEN "B", #1, tarPath$ + tar$ + ".lzw" ELSE packed% = 0 OPEN "B", #1, srcPath$ + src$ END IF fl& = LOF(1) cntL& = INT(fl& / 32) cntV& = INT(cntL& / 8180) cntB& = (fl& - (cntL& * 32)) '--- .h include file --- OPEN "O", #2, tarPath$ + tar$ + ".h" PRINT #2, "// ============================================================" PRINT #2, "// === This file was created with MakeCARR.bas by RhoSigma, ===" PRINT #2, "// === use it in conjunction with its respective .bm file. ===" PRINT #2, "// ============================================================" PRINT #2, "" PRINT #2, "// --- Array(s) representing the contents of file "; srcName$ PRINT #2, "// ---------------------------------------------------------------------" '--- read LONGs --- tmpI$ = SPACE$(32) FOR vc& = 0 TO cntV& IF vc& = cntV& THEN numL& = (cntL& MOD 8180): ELSE numL& = 8180 PRINT #2, "static const uint32_t "; tarName$; "L"; LTRIM$(STR$(vc&)); "[] = {" PRINT #2, " "; LTRIM$(STR$(numL& * 8)); "," FOR z& = 1 TO numL& GET #1, , tmpI$: offI% = 1 tmpO$ = " " + STRING$(88, ","): offO% = 5 DO tmpL& = CVL(MID$(tmpI$, offI%, 4)): offI% = offI% + 4 MID$(tmpO$, offO%, 10) = "0x" + RIGHT$("00000000" + HEX$(tmpL&), 8) offO% = offO% + 11 LOOP UNTIL offO% > 92 IF z& < numL& THEN PRINT #2, tmpO$: ELSE PRINT #2, LEFT$(tmpO$, 91) NEXT z& PRINT #2, "};" PRINT #2, "" NEXT vc& '--- read remaining BYTEs --- IF cntB& > 0 THEN PRINT #2, "static const uint8_t "; tarName$; "B[] = {" PRINT #2, " "; LTRIM$(STR$(cntB&)); "," PRINT #2, " "; FOR x% = 1 TO cntB& GET #1, , tmpB%% PRINT #2, "0x" + RIGHT$("00" + HEX$(tmpB%%), 2); IF x% <> 16 THEN IF x% <> cntB& THEN PRINT #2, ","; ELSE IF x% <> cntB& THEN PRINT #2, "," PRINT #2, " "; END IF END IF NEXT x% PRINT #2, "" PRINT #2, "};" PRINT #2, "" END IF '--- some functions --- PRINT #2, "// --- Saved full qualified output path and filename, so we've no troubles" PRINT #2, "// --- when cleaning up, even if the current working folder was changed" PRINT #2, "// --- during program runtime." PRINT #2, "// ---------------------------------------------------------------------" PRINT #2, "char "; tarName$; "Name[8192]; // it's a safe size for any current OS" PRINT #2, "" PRINT #2, "// --- Cleanup function to delete the written file, called by the atexit()" PRINT #2, "// --- handler at program termination time, if requested by user." PRINT #2, "// ---------------------------------------------------------------------" PRINT #2, "void Kill"; tarName$; "Data(void)" PRINT #2, "{" PRINT #2, " remove("; tarName$; "Name);" PRINT #2, "}" PRINT #2, "" PRINT #2, "// --- Function to write the array(s) back into a file, will return the" PRINT #2, "// --- full qualified output path and filename on success, otherwise an" PRINT #2, "// --- empty string is returned (access/write errors, file truncated)." PRINT #2, "// ---------------------------------------------------------------------" PRINT #2, "const char *Write"; tarName$; "Data(const char *FileName, int16_t AutoClean)" PRINT #2, "{" PRINT #2, " FILE *han = NULL; // file handle" PRINT #2, " int32_t num = NULL; // written elements" PRINT #2, "" PRINT #2, " #ifdef QB64_WINDOWS" PRINT #2, " if (!_fullpath("; tarName$; "Name, FileName, 8192)) return "; CHR$(34); CHR$(34); ";" PRINT #2, " #else" PRINT #2, " if (!realpath(FileName, "; tarName$; "Name)) return "; CHR$(34); CHR$(34); ";" PRINT #2, " #endif" PRINT #2, "" PRINT #2, " if (!(han = fopen("; tarName$; "Name, "; CHR$(34); "wb"; CHR$(34); "))) return "; CHR$(34); CHR$(34); ";" PRINT #2, " if (AutoClean) atexit(Kill"; tarName$; "Data);" PRINT #2, "" FOR vc& = 0 TO cntV& PRINT #2, " num = fwrite(&"; tarName$; "L"; LTRIM$(STR$(vc&)); "[1], 4, "; tarName$; "L"; LTRIM$(STR$(vc&)); "[0], han);" PRINT #2, " if (num != "; tarName$; "L"; LTRIM$(STR$(vc&)); "[0]) {fclose(han); return "; CHR$(34); CHR$(34); ";}" PRINT #2, "" NEXT vc& IF cntB& > 0 THEN PRINT #2, " num = fwrite(&"; tarName$; "B[1], 1, "; tarName$; "B[0], han);" PRINT #2, " if (num != "; tarName$; "B[0]) {fclose(han); return "; CHR$(34); CHR$(34); ";}" PRINT #2, "" END IF PRINT #2, " fclose(han);" PRINT #2, " return "; tarName$; "Name;" PRINT #2, "}" PRINT #2, "" '--- ending --- CLOSE #2 CLOSE #1 '--- .bm include file --- OPEN "O", #2, tarPath$ + tar$ + ".bm" PRINT #2, "'============================================================" PRINT #2, "'=== This file was created with MakeCARR.bas by RhoSigma, ===" PRINT #2, "'=== you must $INCLUDE this at the end of your program. ===" IF packed% THEN PRINT #2, "'=== ---------------------------------------------------- ===" PRINT #2, "'=== If your program is NOT a GuiTools based application, ===" PRINT #2, "'=== then it must also $INCLUDE: 'lzwpacker.bm' available ===" PRINT #2, "'=== from the Libraries Collection here: ===" PRINT #2, "'=== https://staging.qb64phoenix.com/forumdisplay.php?fid=23 ===" END IF PRINT #2, "'============================================================" PRINT #2, "" PRINT #2, "'-----------------" PRINT #2, "'--- Important ---" PRINT #2, "'-----------------" PRINT #2, "' If you need to move around this .bm file and its respective .h file" PRINT #2, "' to fit in your project, then make sure the path in the DECLARE LIBRARY" PRINT #2, "' statement below does match the actual .h file location. It's best to" PRINT #2, "' specify a relative path assuming your QB64 installation folder as root." PRINT #2, "'---------------------------------------------------------------------" PRINT #2, "" '--- writeback function --- PRINT #2, "'"; STRING$(LEN(tarName$) + 19, "-") PRINT #2, "'--- Write"; tarName$; "Array$ ---" PRINT #2, "'"; STRING$(LEN(tarName$) + 19, "-") PRINT #2, "' This function will write the array(s) you've created with MakeCARR.bas" PRINT #2, "' back to disk and so it rebuilds the original file." PRINT #2, "'" PRINT #2, "' After the writeback call, only use the returned realFile$ to access the" PRINT #2, "' written file. It's the full qualified absolute path and filename, which" PRINT #2, "' is made by expanding your maybe given relative path and an maybe altered" PRINT #2, "' filename (number added) in order to avoid the overwriting of an already" PRINT #2, "' existing file with the same name in the given location. By this means" PRINT #2, "' you'll always have safe access to the file, no matter how your current" PRINT #2, "' working folder changes during runtime." PRINT #2, "'" PRINT #2, "' If you wish, the written file can automatically be deleted for you when" PRINT #2, "' your program will end, so you don't need to do the cleanup yourself." PRINT #2, "'----------" PRINT #2, "' SYNTAX:" PRINT #2, "' realFile$ = Write"; tarName$; "Array$ (wantFile$, autoDel%)" PRINT #2, "'----------" PRINT #2, "' INPUTS:" PRINT #2, "' --- wantFile$ ---" PRINT #2, "' The filename you would like to write the array(s) to, can contain" PRINT #2, "' a full or relative path." PRINT #2, "' --- autoDel% ---" PRINT #2, "' Shows whether you want the auto cleanup (see description above) at" PRINT #2, "' the program end or not (-1 = delete file, 0 = don't delete file)." PRINT #2, "'----------" PRINT #2, "' RESULT:" PRINT #2, "' --- realFile$ ---" PRINT #2, "' - On success this is the full qualified path and filename finally" PRINT #2, "' used after all applied checks, use only this returned filename" PRINT #2, "' to access the written file." PRINT #2, "' - On failure (write/access) this will be an empty string, so you" PRINT #2, "' should check for this before trying to access/open the file." PRINT #2, "'---------------------------------------------------------------------" PRINT #2, "FUNCTION Write"; tarName$; "Array$ (file$, clean%)" PRINT #2, "'--- declare C/C++ function ---" PRINT #2, "DECLARE LIBRARY "; CHR$(34); tarPath$; tar$; CHR$(34); " 'Do not add .h here !!" PRINT #2, " FUNCTION Write"; tarName$; "Data$ (FileName$, BYVAL AutoClean%)" PRINT #2, "END DECLARE" PRINT #2, "'--- option _explicit requirements ---" PRINT #2, "DIM po%, body$, ext$, num%"; IF packed% THEN PRINT #2, ", real$, ff%, rawdata$, filedata$": ELSE PRINT #2, "" PRINT #2, "'--- separate filename body & extension ---" PRINT #2, "FOR po% = LEN(file$) TO 1 STEP -1" PRINT #2, " IF MID$(file$, po%, 1) = "; CHR$(34); "."; CHR$(34); " THEN" PRINT #2, " body$ = LEFT$(file$, po% - 1)" PRINT #2, " ext$ = MID$(file$, po%)" PRINT #2, " EXIT FOR" PRINT #2, " ELSEIF MID$(file$, po%, 1) = "; CHR$(34); "\"; CHR$(34); " OR MID$(file$, po%, 1) = "; CHR$(34); "/"; CHR$(34); " OR po% = 1 THEN" PRINT #2, " body$ = file$" PRINT #2, " ext$ = "; CHR$(34); CHR$(34) PRINT #2, " EXIT FOR" PRINT #2, " END IF" PRINT #2, "NEXT po%" PRINT #2, "'--- avoid overwriting of existing files ---" PRINT #2, "num% = 1" PRINT #2, "WHILE _FILEEXISTS(file$)" PRINT #2, " file$ = body$ + "; CHR$(34); "("; CHR$(34); " + LTRIM$(STR$(num%)) + "; CHR$(34); ")"; CHR$(34); " + ext$" PRINT #2, " num% = num% + 1" PRINT #2, "WEND" PRINT #2, "'--- write array & set result ---" IF NOT packed% THEN PRINT #2, "Write"; tarName$; "Array$ = Write"; tarName$; "Data$(file$ + CHR$(0), clean%)" ELSE PRINT #2, "real$ = Write"; tarName$; "Data$(file$ + CHR$(0), clean%)" PRINT #2, "IF real$ <> "; CHR$(34); CHR$(34); " THEN" PRINT #2, " ff% = FREEFILE" PRINT #2, " OPEN real$ FOR BINARY AS ff%" PRINT #2, " rawdata$ = SPACE$(LOF(ff%))" PRINT #2, " GET #ff%, , rawdata$" PRINT #2, " filedata$ = LzwUnpack$(rawdata$)" PRINT #2, " PUT #ff%, 1, filedata$" PRINT #2, " CLOSE ff%" PRINT #2, "END IF" PRINT #2, "Write"; tarName$; "Array$ = real$" END IF PRINT #2, "END FUNCTION" PRINT #2, "" '--- ending --- CLOSE #2 '--- finish message --- COLOR 10: PRINT: PRINT "file successfully processed..." COLOR 9: PRINT: PRINT "You must $INCLUDE the created file (target name + .bm extension) at" PRINT "the end of your program and call the function 'Write"; tarName$; "Array$(...)'" PRINT "in an appropriate place to write the file back to disk." IF packed% THEN COLOR 12: PRINT: PRINT "Your program must also $INCLUDE 'lzwpacker.bm' available from" PRINT "the Libraries Collection here:" PRINT " https://staging.qb64phoenix.com/forumdisplay.php?fid=23" PRINT "to be able to write back the just processed file." KILL tarPath$ + tar$ + ".lzw" END IF done: COLOR 7 END '--- error handler --- abort: COLOR 12: PRINT: PRINT "something is wrong with path/file access, check your inputs and try again..." RESUME done '$INCLUDE: 'QB64Library\LZW-Compress\lzwpacker.bm' |