--- freem/doc/freem.texi 2025/03/06 18:33:26 1.3 +++ freem/doc/freem.texi 2025/05/19 12:45:01 1.61 @@ -4,10 +4,11 @@ @settitle The FreeM Manual @copying -This manual is for FreeM, (version cvs-current), which is a free and open-source implementation of the M programming language. +This manual is for FreeM, (version 0.65.1-rc0), which is a free software implementation of the M programming language. +Print-optimized versions of this book are typeset in @emph{Computer Modern} by the author using the @emph{GNU Texinfo} tools. -Copyright @copyright{} 2014-2024 Coherent Logic Development LLC +Copyright @copyright{} 2014-2025 Coherent Logic Development LLC @quotation Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.3 or any later version published by the Free Software Foundation; with no Invariant Sections, with no Front-Cover texts, and with no Back-Cover Texts. @@ -18,7 +19,7 @@ Permission is granted to copy, distribut @title The FreeM Manual @subtitle @sc{The Official Manual of FreeM} -@subtitle Version cvs-current +@subtitle Version 0.65.1-rc0 @c@vskip 10pt @c@center @image{freem-logo-sm,,,,.png} @author Serena Willis @@ -42,9 +43,13 @@ This is the official manual for the Free @menu * Introduction:: About the FreeM Project, its history, and its goals. +* Document Conventions:: Conventions used in this manual. +* A Note on Standards:: FreeM positioning regarding the M Development Committee. * FreeM Invocation:: How to invoke FreeM from the command line. -* The FreeM Daemon:: Managing shared resources in the FreeM environment. +* The FreeM Environment Daemon:: Managing shared resources in the FreeM environment. * The FreeM Direct-Mode Environment:: Executing M programs interactively. +* Debugging:: The program development cycle of FreeM. +* Program Development Cycle:: How to create, edit, test, and run FreeM programs. * Directives:: Per-Routine Language Directives. * Intrinsic Special Variables:: Intrinsic Special Variables. @@ -73,7 +78,6 @@ This is the official manual for the Free * Global Aliasing:: Defining alternate names for globals. * Global Mappings:: Mapping global names to non-default namespaces. -* Transaction Processing:: Transactions in FreeM. * Asynchronous Event Handling:: Handling asynchronous events in FreeM. * Global Triggers:: Responding to global accesses in M code. * Synchronous Event Handling:: Synchronous events in FreeM. @@ -92,13 +96,11 @@ This is the official manual for the Free * Interrupt Handling:: How FreeM handles interrupts. * Error Processing:: How to handle errors in M program code. * FreeM Error Codes:: Explanations of each FreeM error code. -* Debugging:: The program development cycle of FreeM. * System Configuration:: Configuring your FreeM installation. * Accessing FreeM from C Programs:: How to use the mlib interface. * FreeM Administrator:: The fmadm system manager tool. -* FreeM Legacy Utilities:: FreeM legacy system manager utilities. * FreeM VIEW Commands and Functions:: Getting and setting info about FreeM internals. * Implementation Limits:: FreeM limitations. * US-ASCII Character Set:: The US-ASCII character set. @@ -110,12 +112,13 @@ This is the official manual for the Free @node Introduction @unnumbered Introduction - -FreeM started its life as @emph{FreeMUMPS}, written for MS-DOS and ported to SCO UNIX by a mysterious individual going by the name of "Shalom ha-Ashkenaz". It was released to MUG Deutschland in 1998. In 1999, Ronald L. Fox ported FreeM to the Red Hat Linux 5 of the GNU/Linux operating system. Thereafter, maintenance was taken over by the Generic Universal M Project, which changed its name first to Public Standard MUMPS and then by popular request to FreeM. +FreeM started its life as @emph{FreeMUMPS}, written for MS-DOS and ported to SCO UNIX by a mysterious individual going by the name of "Shalom ha-Ashkenaz". It was released to MUG Deutschland in 1998. In 1999, Ronald L. Fox ported FreeM to the Red Hat Linux 5 distribution of the GNU/Linux operating system. Thereafter, maintenance was taken over by the Generic Universal M Project, which changed its name first to Public Standard MUMPS and then by popular request to FreeM. When GT.M was open-sourced in late 1999, FreeM and GUMP were essentially abandoned. L.D. Landis, the owner of the original GUMP SourceForge project, and one of FreeM's significant contributors, passed maintenance of FreeM and ownership of its SourceForge project to Serena Willis in 2014. At this point, FreeM would not compile or run on modern Linux systems, so steps were taken to remedy the most pressing issues in the codebase. Limitations on the terminal size (previously hard-coded to 80x25) were lifted, and new @code{$VIEW} functions were added to retrieve the terminal size information. @code{$X} and @code{$Y} intrinsic special variables were updated to support arbitrary terminal sizes, and FreeM was once again able to build and run. -In February of 2020, work began in earnest to build a development and support infrastructure for FreeM and begin the careful process of refining it into a more stable and robust product. +In February of 2020, work began in earnest to build a development and support infrastructure for FreeM and begin the careful process of refining it into a more stable and robust application. + +For more information on FreeM history, see @code{@emph{$PREFIX}/share/freem/doc/freem_history.*} (distributed in PostScript, PDF, and plain text formats). @section Production Readiness @@ -146,6 +149,7 @@ Current contributors denoted with a @emp @cindex contributors, Gerum, Winfried @cindex contributors, Kreis, Greg @cindex contributors, Landis, Larry +@cindex contributors, McGlothlen, Ken @cindex contributors, Milligan, Lloyd @cindex contributors, Morris, Steve @cindex contributors, Murray, John @@ -187,6 +191,9 @@ Larry Landis (Coordination, Code, Docume Rick Marshall (Testing, MDC Conformance) @emph{+} @item +Ken McGlothlen (Apple Silicon build/test environment, proofreading of documentation) @emph{+} + +@item Lloyd Milligan (Code, Testing, Documentation) @item @@ -226,6 +233,72 @@ Serena Willis (Current Maintainer and Pr Steve Zeck (Code) @end itemize + +@node Document Conventions +@chapter Document Conventions +@cindex document conventions +@cindex conventions + +@section Formatting Conventions + +This manual uses the following formatting conventions: +@itemize +@item Code examples, filesystem paths, and commands are presented in @code{monospace} +@item Placeholders where the reader is expected to supply a replacement value are presented in @code{@emph{monospace italics}}, and depending on context, may be surrounded by angle brackets +@item New terminology is introduced in @emph{proportional italics} +@end itemize + +@section Definitions + +FreeM uses abbreviations for common language elements: + +@table @asis +@item @emph{$PREFIX} +Refers to the base filesystem location within which FreeM is installed. For most distribution methods of FreeM, @emph{$PREFIX} represents either @code{/} or @code{/usr/local}. +@item @emph{dlabel} +Refers to a label in an M routine, beginning in the first column of the line. Can be a @emph{name} or an @emph{intlit}. +@item @emph{entryref} +Refers to an M routine entry point, denoted in the format @code{@emph{dlabel} [+@emph{intexpr}][^@emph{routine}]}. +@item @emph{expr} +Refers to any expression. Often presented in the format @emph{expr V }, where @emph{V} means @emph{giving}; e.g., @emph{expr V lvn} means @emph{expression giving local variable name}. +@item @emph{glvn} +Refers to the name of an M global, local, or structured system variable. +@item @emph{gvn} +Refers to the name of an M global variable. +@item @emph{intexpr} +Refers to an integer expression. +@item @emph{intlit} +Refers to an integer literal. +@item @emph{ISV}, @emph{isv} +Refers to an M intrinsic special variable; @code{$JOB} and @code{$IO} are examples of ISVs. +@item @emph{L} +Indicates a @emph{list} of the following item, e.g., @emph{L gvn} means @emph{list of global variable names}. +@item @emph{lvn} +Refers to the name of an M local variable. +@item @emph{postcondition} +A @emph{tvexpr} immediately following a command verb affecting that command's execution. +@item @emph{strlit} +Refers to an M string literal. +@item @emph{ssvn} +Refers to the name of an M structured system variable. +@item @emph{tvexpr} +Refers to a truth-valued expression, i.e., an expression interpreted as a truth value. +@end table + +@node A Note on Standards +@chapter A Note on Standards +@cindex MDC +@cindex M Development Committee +@cindex ANSI X11.1 +@cindex standards, ANSI +@cindex standards, MDC + +FreeM attempts to implement as many features as possible from the M Development Committee's unpublished @emph{Millennium Draft Standard}, as well as its predecessors. + +The maintainer of FreeM (who is also the author of this book) is largely in favor of standardization efforts, and hopes that the MDC will resume activities, and will happily participate if it does so in an open, public, transparent, and democratic manner. Until then, however, FreeM will attempt to improve the M language, in cooperation with other free software M implementers where possible. Any breaking changes introduced in future MDC releases of the @emph{Standard} (such as the rumored @emph{M5}) which prove incompatible with FreeM will be handled via the @code{$DIALECT} special variable (to be changed to @code{$ZDIALECT} in a coming release). + +The conformance document required per the @emph{Standard} should be installed as a @code{man} page on any computer system where FreeM is made available. Simply type @code{man freem_conformance} to access. + @node FreeM Invocation @chapter FreeM Invocation @cindex invocation, command-line @@ -236,25 +309,29 @@ Steve Zeck (Code) $ @command{./freem} [@emph{OPTIONS}...] [[-r ] | [--routine=]] @end example -When FreeM loads, it searches the @code{SYSTEM} namespace for the @code{^%SYSINIT} routine, and begins executing it. +When FreeM loads, it searches the @code{SYSTEM} namespace for the @code{%SYSINIT} routine, and begins executing it. + +When @code{-r} or @code{--routine} are passed on the command line, FreeM will load and run the specified routine after running @code{%SYSINIT}. Beginning with FreeM 0.1.7, routines invoked in this manner are no longer required to perform their own namespace setup with @code{VIEW} commands. + +@section %SYSINIT Routine -When @code{-r} or @code{--routine} are passed on the command line, FreeM will load and run the specified routine instead of @code{^%SYSINIT}. Beginning with FreeM 0.1.7, routines invoked in this manner are no longer required to perform their own namespace setup with @code{VIEW} commands. +The @code{%SYSINIT} routine runs every time a FreeM interpreter process starts. This routine defines some useful constants, enables handling of @code{TRIGGER} events, and handles the execution of code passed via the @code{-x|--execute} or routines passed via @code{-r|--routine}. + +Do not modify the supplied @code{%SYSINIT} routine to add site-specific startup items. Instead, create a @code{LCLINIT} routine in the @code{USER} namespace of one or more environments. @code{%SYSINIT} will automatically run @code{LCLINIT} each time it starts. @section Command-Line Options +@cindex options, command-line @table @asis @item @option{-d}, @option{--daemon} -Starts the FreeM daemon, exactly one of which must be running at all times in order for FreeM interpreter and fmadm processes to function. +Starts the FreeM environment daemon, exactly one of which must be running at all times in order for FreeM interpreter and fmadm processes to function. @item @option{-e}, @option{--environment} Selects the environment to be used. If no environment is specified, @code{DEFAULT} is used. @item @option{-k}, @option{--nofork} -When used with @option{-d} or @option{--daemon}, causes the FreeM daemon to run instead in the foreground. Useful for debugging. - -@item @option{-p}, @option{--pidfile} -When used with @option{-d} or @option{--daemon}, sets the file in which the PID of the running daemon is stored. +When used with @option{-d} or @option{--daemon}, causes the FreeM environment daemon to run instead in the foreground. Useful for debugging. @item @option{-S}, @option{--shmsize} When used with @option{-d} or @option{--daemon}, specifies the number of bytes of shared memory FreeM will allocate for the @code{LOCK} table, job table, and IPC table. This will determine the maximum number of concurrent FreeM processes and @code{LOCK}s available in this environment. @@ -272,10 +349,10 @@ Causes your UNIX environment variables t Allows your M routines to be used as UNIX filters. @item @option{-n @emph{}}, @option{--namespace=@emph{}} -Selects the FreeM namespace to be entered on startup. Must be defined in @file{/etc/freem.conf}. +Selects the FreeM namespace to be entered on startup. Must be defined in @file{/etc//freem.conf}. @item @option{-r @emph{}}, @option{--routine=@emph{}} -Causes @code{} to be executed at load, instead of @code{^%SYSINIT}. +Causes @code{} to be executed at load, instead of @code{%SYSINIT}. @item @option{--standard=@emph{}} Sets the default FreeM dialect to use for new routine buffers. @@ -305,7 +382,7 @@ Please note that FreeM is not entirely s Displays FreeM version information. @item @option{-x @emph{}}, @option{--execute=@emph{}} -Executes M code @code{} at startup instead of the startup routine. +Executes M code @code{} at startup. @end table @@ -333,28 +410,27 @@ You will also need to set the script's p $ chmod +x @emph{myscript.m} @end example -@node The FreeM Daemon -@chapter The FreeM Daemon +@node The FreeM Environment Daemon +@chapter The FreeM Environment Daemon @cindex daemon, freem -The FreeM daemon manages shared resources for a given FreeM environment. These include the lock table, job table, inter-process communication, and concurrency control for transaction processing. Unlike some M implementations, the FreeM daemon does @emph{not} function as a write daemon for global storage. +The FreeM environment daemon manages shared resources for a given FreeM environment. These include the lock table, job table, inter-process communication, and concurrency control for transaction processing. Unlike some M implementations, the FreeM environment daemon does @emph{not} function as a write daemon for global storage. -One daemon process is required per FreeM environment, and can be started as follows: +One daemon process is required per FreeM environment, and can be started in the following ways, in order of preference: @example -$ freem --daemon [--nofork] [--environment=] [--user=] \ - [--group=] [--pidfile=] [--shmsize=] +$ sudo fmadm start environment [-e=] +@end example + +@example +$ freem --daemon [--nofork] [--environment=] [--shmsize=] @end example If the daemon is started with @option{--nofork}, it will run in the foreground and its output will be reflected on the terminal. Otherwise, the daemon will run as a child process in the background and immediately return terminal control to the shell. The latter option is recommended in most cases. The @option{--environment} option will start the daemon for the specified @emph{environment-name}. The default environment, if unspecified, is called @code{DEFAULT}. If using an environment other than @code{DEFAULT}, interpreter processes that wish to also connect to the same environment must also use the @option{--environment} option when starting, and @code{libfreem} clients must also pass the environment name as the first argument to the @code{freem_init()} function. Environments allow you to run multiple, isolated instances of FreeM on the same machine, whose globals and routines are distinct and unique. -The @option{--user} and @option{--group} options are only valid when the FreeM daemon is started by the superuser, and will cause the daemon to reduce its runtime privileges to those of the specified user and group, and run as that user and/or group. We recommend creating a @code{freem} user and group and running the FreeM daemon with @code{--user=freem --group=freem}. - -The @option{--pidfile} option specifies the file in which the FreeM daemon will store its own PID. If running as the superuser, the FreeM daemon will store the PID file in @code{/var/run/freem.pid}. Otherwise, the PID file will be stored as @code{.freem.pid} in the home directory of the user account which owns the FreeM daemon process. - -The @option{--shmsize} option specifies the size in bytes of the FreeM shared memory segment. The default is 4194304 bytes. Increasing the size of the FreeM shared memory segment will, at the cost of increased memory usage, increase the number of concurrent jobs and lock table entries available to the environment; decreasing the size of the segment will have the expected opposite effect. Note that you must also pass @option{--shmsize} with the same number of bytes to any interpreter process to be used with an environment whose daemon uses a non-default shared memory segment size. +The @option{--shmsize} option specifies the size in bytes of the FreeM shared memory segment. The default is 16,777,216 bytes (16 megabytes). Increasing the size of the FreeM shared memory segment will, at the cost of increased memory usage, increase the number of concurrent jobs and lock table entries available to the environment; decreasing the size of the segment will have the expected opposite effect. Note that you must also pass @option{--shmsize} with the same number of bytes to any interpreter process to be used with an environment whose daemon uses a non-default shared memory segment size. Attempting to start a FreeM interpreter process without a daemon running with the same environment name will result in an error. @@ -369,17 +445,17 @@ Attempting to start a FreeM interpreter The FreeM direct-mode environment is the mode entered when FreeM is invoked without the use of @option{-r @emph{}} or @option{--routine=@emph{}}: @example -Coherent Logic Development FreeM version cvs-current (x86_64-pc-linux-gnu) +Coherent Logic Development FreeM version 0.65.1-rc0 (x86_64-pc-linux-gnu) Copyright (C) 2014, 2020, 2021 Coherent Logic Development LLC USER> @end example -The prompt (@code{USER>}) indicates the currently-active namespace. If any uncommitted direct-mode transactions have been started, the prompt will change to reflect the current value of @code{@ref{$TLEVEL}}: +The prompt (@code{DEFAULT.USER>}) displays the current environment and namespace, @code{DEFAULT} and @code{USER}, respsectively. If any uncommitted direct-mode transactions have been started, the prompt will change to reflect the current value of @code{@ref{$TLEVEL}}: @example -TL1:USER> +TL1:DEFAULT.USER> @end example In the above example, @code{TL1} indicates that @code{@ref{$TLEVEL}} is currently @emph{1}. @@ -397,7 +473,7 @@ Accesses FreeM online help. Requires GNU Writes a list of @emph{event classes} and their @code{ABLOCK} counts: @example -USER> events +DEFAULT.USER> events Event Class Processing Mode ABLOCK Count ----------- --------------- ------------ @@ -417,6 +493,10 @@ TRIGGER Disabled 0 @item @command{trantab} Displays information about any uncommitted transactions currently in-flight for this process. +@anchor{glstat} +@item @command{trantab} +Displays statistics about globals that have been opened in the current FreeM process. + @anchor{jobtab} @item @command{jobtab} Displays a summary of the FreeM job table. @@ -429,10 +509,6 @@ Displays a list of @code{LOCK}s held in @item @command{rbuf} Lists the status of all FreeM routine buffers. -@anchor{dbstats} -@item @command{dbstats} -Shows statistics for the BerkeleyDB global handler. - @anchor{wh} @item @command{wh} Forces an immediate flush of this process's @code{readline} history buffer to disk. @@ -457,18 +533,18 @@ Allows you to recall command number @emp Launches a subshell within the FreeM direct mode, allowing the user to run operating system commands. @example -USER> !! +DEFAULT.USER> !! Type Ctrl-D to exit from the shell $ uname -a Linux hesperos 4.19.0-17-amd64 #1 SMP Debian 4.19.194-3 (2021-07-18) x86_64 GNU/Linux $ exit -USER> +DEFAULT.USER> @end example @item @command{!@emph{}} -Invokes a shell to run @emph{} from within FreeM. This temporarily disables @command{SIGALRM} handling in FreeM, which may interrupt the use of event-driven M programming commands including @command{ESTART} and @command{ESTOP}. +Invokes a shell to run @emph{} from within FreeM. This temporarily disables @command{SIGALRM} handling in FreeM, which may interrupt the use of event-driven M programming commands including @command{ASTART} and @command{ASTOP}. If the @command{>} character is supplied immediately preceding @emph{}, FreeM will append the contents of an M local or global variable referenced in @code{^$JOB($JOB,"PIPE_GLVN")} to the standard input stream of @emph{}. @@ -482,13 +558,13 @@ The data value in the unsubscripted M lo If you issue a @code{@ref{HALT}} command at the direct-mode prompt, you will exit out of FreeM. However, if you issue a @code{@ref{HALT}} command when @code{@ref{$TLEVEL}} is greater than zero, you will be given the opportunity to commit or rollback any pending transactions: @example -USER> TSTART +DEFAULT.USER> TSTART -TL1:USER> SET ^MYGLOBAL=1 +TL1:DEFAULT.USER> SET ^MYGLOBAL=1 -TL1:USER> HALT +TL1:DEFAULT.USER> HALT UNCOMMITTED TRANSACTIONS EXIST: @@ -510,17 +586,60 @@ In the above example, the user selected FreeM direct mode allows you to enter M expressions directly from the direct-mode prompt, as long as they begin with a number: @example -USER> S DENOM=10 +DEFAULT.USER> S DENOM=10 -USER> 100/DENOM +DEFAULT.USER> 100/DENOM 10 -USER> +DEFAULT.USER> @end example Such expressions will be immediately evaluated, and the result printed on @code{@ref{$IO}}. +@node Debugging +@chapter Debugging +@cindex debugging + +@section Debugging Synopsis +FreeM includes an interactive debugger, entered using the @code{BREAK "DEBUG"} command. The debugger is also entered if @code{Ctrl-C} is pressed, @code{Ctrl-C} handling is enabled, and you are in direct mode. + +If you would like to enter the debugger automatically each time an error is encountered, add the following to your @code{LCLINIT} routine: + +@example +S $ETRAP="B ""DEBUG""" +@end example + +@section Debugging Commands +The debugger uses its own unique command language, where M commands are unavailable. Commands are as follows: + +@table @asis +@item @code{exit}, @code{quit} +Exits the debugger and returns to direct mode or normal program execution. +@item @code{e} @emph{glvn}, @code{examine} @emph{glvn} +Prints the value of @emph{glvn} to the terminal. +@item @code{t}, @code{trace} +Toggles @emph{trace mode} on and off. When trace mode is on, FreeM will display information about each @code{DO} or @code{GOTO} command encountered, including the routine which invoked the branch, which type of branch was invoked, and the target of the branch. +@item @code{s}, @code{step} +Single-steps through FreeM code command-by-command. +@item @code{n}, @code{next} +Single-steps through FreeM code line-by-line. +@item @code{c}, @code{cont}, @code{continue} +Resumes normal program execution, disabling single-step mode. +@item @code{bt}, @code{backtrace} +Produces a stack trace. +@item @code{h}, @code{halt} +Halts the process being debugged and returns control to the operating system. +@item @code{w [[+|-|?]@emph{}]}, @code{watch [[+|-|?]@emph{}]} +With no arguments, toggles watchpoints on and off. With @code{+}, adds @emph{} to the watchlist. With @code{-}, removes @emph{} from the watchlist. With @code{?}, queries the watch status of @emph{}. +@end table + +@node Program Development Cycle +@chapter Program Development Cycle +@cindex program development + +This chapter covers the essential activities of program development in the FreeM environment, including viewing, creating, editing, and running routines. + @node Directives @chapter Directives @cindex directives @@ -591,7 +710,7 @@ Please note that FreeM is not entirely s * $SYSTEM:: MDC system ID of FreeM. * $TEST:: Truth value of last conditional expression or result of certain @code{LOCK} operations. * $TLEVEL:: Current level of transaction nesting. -* $WITH:: Current variable prefix set by @code{WITH} command. +* $WITH:: Current variable prefix set by @code{ZWITH} command. * $X:: Current horizontal screen position. * $Y:: Current vertical screen position. * $ZA:: Current position of file on @code{$IO}. @@ -657,6 +776,8 @@ Please note that FreeM is not entirely s Returns a comma-delimited list of error conditions currently present, and is writable. An empty @code{$ECODE} indicates no errors. +Writing a value in the format @code{,,} into @code{$ECODE} will raise that error condition. + @node $ESTACK @section $ESTACK @cindex $ESTACK @@ -785,7 +906,7 @@ uncommitted transactions exist. @cindex $WITH @cindex intrinsic special variables, $WITH -Returns the variable prefix set by the @code{@ref{WITH}} command. +Returns the variable prefix set by the @code{@ref{ZWITH}} command. @node $X @section $X @@ -1004,7 +1125,7 @@ See @emph{https://wiki.osdev.org/Target_ * $ZLSD():: Compute Levenshtein distance between two arguments. * $ZM():: Unknown. * $ZNAME():: Unknown. -* $ZNEXT():: Unknown. +* $ZNEXT():: Return glvn of next numeric subscript following given glvn. * $ZORDER():: Unknown. * $ZPIECE():: Unknown. * $ZPREVIOUS():: Unknown. @@ -1081,13 +1202,13 @@ SET M=$EXTRACT(NAME,1,5) It is also possible to use @code{$EXTRACT} on the left-hand side of a @code{SET} assignment in order to modify a substring: @example -USER> SET FOO="ABCDEFG" +DEFAULT.USER> SET FOO="ABCDEFG" -USER> SET $EXTRACT(FOO,1,3)="XYZ" +DEFAULT.USER> SET $EXTRACT(FOO,1,3)="XYZ" -USER> WRITE FOO +DEFAULT.USER> WRITE FOO XYZDEFG @end example @@ -1114,7 +1235,22 @@ Formats a number according to a particul The first argument is the number to format. -The second argument is the series of formatting codes. +The second argument is the series of formatting codes: + +@table @asis +@item 'P' or 'p' +Will display negative numbers within parentheses instead of showing a minus sign. +@item , (comma) +Will add commas as thousands separators. +@item + +Will include a plus sign for positive numbers. Not compatible with 'P' or 'p'. +@item - +Will remove the minus sign from negative numbers. Not compatible with 'p' or 'P'. +@item 't' or 'T' +Will place the sign after the number instead of before the number. +@end table + +The optional third argument is a number indicating how many digits to which the fractional part of the number will be zero-padded. @node $GET() @section $GET @@ -1139,12 +1275,10 @@ The first argument is a string represent The second argument is a string representing a valid FreeM class. - - @example -USER> N STR=$$^%STRING +DEFAULT.USER> N STR=$$^%STRING -USER> W $INSTANCEOF("STR","^%STRING") +DEFAULT.USER> W $INSTANCEOF("STR","^%STRING") 1 @end example @@ -1188,11 +1322,41 @@ The optional second argument indicates t @cindex $NEXT @cindex intrinsic functions, $NEXT +Deprecated. Use @code{$ORDER} instead. +Returns the next numeric subscript of the specified glvn. + +@emph{Syntax} + +@example +$NEXT(@emph{glvn}) +@end example + +@emph{Example} + +Assume the following array: + +@example +^foo(1)="" +^foo(2)="" +@end example + +And the following code: + +@example + W $ZNEXT(^foo(1)) ; => 2 +@end example + @node $ORDER() @section $ORDER @cindex $ORDER @cindex intrinsic functions, $ORDER +Returns the previous subscript or next subscript in a local, global, or a subset of structured system variables. + +The first argument is the subscripted local, global, or SSVN. + +The optional second argument can be @code{1} to retrieve the next subscript, or @code{-1} to return the previous. + @node $PIECE() @section $PIECE @cindex $PIECE @@ -1215,8 +1379,8 @@ The optional fourth argument is the fina Can be used on the left-hand side of an expression in order to @code{@ref{SET}} a value into a @code{d}-delimited piece of @code{s}, as in: @example -; ^jpw="this^is^a^piece" -SET $PIECE(^jpw,"^",2)="isn't" ; => "this^isn't^a^piece" +; ^snw="this^is^a^piece" +SET $PIECE(^snw,"^",2)="isn't" ; => "this^isn't^a^piece" @end example @node $QLENGTH() @@ -1248,7 +1412,7 @@ Returns the number of subscripts in @emp @code{$QSUBSCRIPT(@emph{expr V glvn},@emph{expr V n})} @end example -Returns the @emph{n}th subscript of @emph{glvn}. +In the RHS form, returns the @emph{n}th subscript of @emph{glvn}. @emph{Example} @@ -1256,6 +1420,14 @@ Returns the @emph{n}th subscript of @emp @code{SET SUB=$QSUBSCRIPT("^GBL(1,2,3)",2) ; => 2} @end example +@emph{Syntax} + +@example +@code{SET $QSUBSCRIPT(@emph{expr V glvn},@emph{expr V n})=@emph{expr} ; => ^GBL(1,4,3)} +@end example + +In the LHS form, sets the @emph{n}th subscript of @emph{glvn} to @emph{expr}. + @node $QUERY() @section $QUERY @cindex $QUERY @@ -1273,16 +1445,16 @@ Returns the next subscripted reference i We will assume the following data structure exists: @example -^jpw(1)=1 -^jpw(1,2)="foo" -^jpw(2)=3 -^jpw(3)="" +^snw(1)=1 +^snw(1,2)="foo" +^snw(2)=3 +^snw(3)="" @end example -The following code will retrieve the next subscripted name after @code{^jpw(1)}: +The following code will retrieve the next subscripted name after @code{^snw(1)}: @example -@code{SET NEXTNAM=$QUERY(^jpw(1)) ; => ^jpw(1,2)} +@code{SET NEXTNAM=$QUERY(^snw(1)) ; => ^snw(1,2)} @end example @node $RANDOM() @@ -1379,6 +1551,21 @@ Returns a line of code from a routine. @cindex $TRANSLATE @cindex intrinsic functions, $TRANSLATE +Replaces characters in a string. + +The first argument is a string expression representing the text to be changed. + +The second argument is a list of characters to replace. + +The third argument is a list of characters to use as the replacements for the characters in the second argument. + +@emph{Example} + +@example + DEFAULT.USER> W $TRANSLATE("twig","wt","rb") + brig +@end example + @node $TYPE() @section $TYPE @cindex $TYPE @@ -1452,6 +1639,8 @@ Always @emph{true} @cindex intrinsic functions, $ZCALL @cindex intrinsic functions, implementation-specific +Purpose unknown. + @node $ZCRC() @section $ZCRC @cindex $ZCRC @@ -1472,6 +1661,8 @@ Returns a checksum of @code{arg1}. @cindex intrinsic functions, $ZDATA @cindex intrinsic functions, implementation-specific +Purpose unknown. + @node $ZDATE() @section $ZDATE @cindex $ZDATE @@ -1496,6 +1687,8 @@ The optional @emph{} foll @cindex intrinsic functions, $ZEDIT @cindex intrinsic functions, implementation-specific +Purpose unknown. + @node $ZHOROLOG() @section $ZHOROLOG @cindex $ZHOROLOG @@ -1520,12 +1713,16 @@ $ZHOROLOG(@emph{},@emph{ ^foo(2) +@end example + +This function relies on the value of @code{$VIEW(71)} being @code{1} (this is the default). + @node $ZORDER() @section $ZORDER @cindex $ZORDER @cindex intrinsic functions, $ZORDER @cindex intrinsic functions, implementation-specific +Purpose unknown. + @node $ZPIECE() @section $ZPIECE @cindex $ZPIECE @cindex intrinsic functions, $ZPIECE @cindex intrinsic functions, implementation-specific +Purpose unknown. + @node $ZPREVIOUS() @section $ZPREVIOUS @cindex $ZPREVIOUS @cindex intrinsic functions, $ZPREVIOUS @cindex intrinsic functions, implementation-specific +Purpose unknown. + @node $ZREPLACE() @section $ZREPLACE @cindex $ZREPLACE @@ -1749,36 +1983,86 @@ $$.EXTRACT(,) @node $$FIND @section $$FIND +Finds the character immediately following the first occurence of a substring within a string. + +The first argument is the substring to be located. + +The second argument is the position within the string at which to begin searching. + +See @ref{$FIND()}. + @node $$FNUMBER @section $$FNUMBER +Formats a number according to a set of formatting codes. + +The argument is a series of formatting codes. See @ref{$FNUMBER()} for details. + @node $$JUSTIFY @section $$JUSTIFY +Right-justifies a string based on a specified fixed length. + +The first argument is the character length of the output. + +The second argument controls the number of fractional digits to be included in the output, and defaults to the number of digits specified in the first argument. + +See @ref{$JUSTIFY()} for details. + @node $$LENGTH @section $$LENGTH +Returns the length of the string. + @node $$PIECECOUNT @section $$PIECECOUNT +Returns the number of items in a list delimited by the character specified in the argument. + @node $$PIECE @section $$PIECE +@emph{Syntax} + +@code{$PIECE(@emph{d}[,@emph{n}[,@emph{end}]])} + +Accesses the @code{n}th through @code{end} @code{d}-delimited pieces of the string. + +The first argument is the delimiter to be used. + +The optional second argument is the first @code{d}-delimited piece to access, and defaults to @code{1}. + +The optional third argument is the final @code{d}-delimited piece to access, and defaults to the value of the third argument (@code{n}). + + @node $$REPLACE @section $$REPLACE +@emph{Syntax} +@code{myString.$$REPLACE(@emph{arg1},@emph{arg2})} + +Replaces all instances of @code{arg2} with @code{arg3} in @code{myString}. + @node $$REVERSE @section $$REVERSE +Returns the reverse of the string. + @node $$TOLOWER @section $$TOLOWER +Returns an all-lowercase version of the string. + @node $$TOUPPER @section $$TOUPPER +Returns an all-uppercase version of the string. + @node $$TRANSLATE @section $$TRANSLATE +Identical to @ref{$TRANSLATE()}, except that the arguments are shifted left by one, and the input string is implicit (the object). + @node Commands @chapter Commands @cindex commands @@ -1788,13 +2072,11 @@ $$.EXTRACT(,) * !:: Run an external program or command. * !!:: Launch a subshell from FreeM direct mode. * ABLOCK:: Increment the block counter for one or more event classes. -* ASSERT:: Raise error when a conditional expression evaluates @emph{false}. * ASTART:: Enable asynchronous event handling for one or more event classes. * ASTOP:: Disable asynchronous event handling for one or more event classes. * AUNBLOCK:: Decrement the block counter for one or more event classes. * BREAK:: Interrupt a running routine to allow interactive debugging. * CLOSE:: Close an input/output device. -* CONST:: Define a constant that cannot be altered after initial definition. * DO:: Transfer program control to one or more subroutines or introduces a new execution level. * ELSE:: Execute the remainder of a line if @code{@ref{$TEST}} evaluates @emph{false}. * FOR:: Repeat execution of a line or block of code. @@ -1807,7 +2089,6 @@ $$.EXTRACT(,) * KSUBSCRIPTS:: Kill only the descendant subscripts of a local, global, global, or structured system variable. * KVALUE:: Kill only the value of a local, global, or structured system variable. * LOCK:: Control advisory locking for concurrency control. -* MAP:: Map a global name to a non-default namespace. * MERGE:: Merge contents of one local, global, or structured system variable into another. * NEW:: Introduce a new scope for a specified local variable or intrinsic special variable or instantiate an object. * OPEN:: Open a sequential or socket input/output device. @@ -1816,30 +2097,32 @@ $$.EXTRACT(,) * SET:: Set the value of a local variable, global, intrinsic special variable, or structured system variable. * TCOMMIT:: Commit a transaction. * THEN:: Preserve @code{@ref{$TEST}} until the end of the current line. -* THROW:: Programmatically raise an error condition. * TROLLBACK:: Roll back all pending transactions. * TSTART:: Introduce a new transaction processing level. -* UNMAP:: Remove a mapping of a global to a non-default namespace. * USE:: Set the currently-active input/output device. * VIEW:: Modify FreeM internal parameters. -* WATCH:: Enable or disable watchpoints, or set or clear watchpoints on specified globals, locals, or structured system variables. -* WITH:: Set prefix for future variable references. * WRITE:: Write output to current input/output device. * XECUTE:: Interpret string as M code. -* ZALLOCATE:: Alternative to @code{LOCK}. -* ZBREAK:: Unknown. -* ZDEALLOCATE:: Alternative to @code{LOCK}. -* ZGO:: Unknown. -* ZHALT:: Unknown. +* ZASSERT:: Raise error when a conditional expression evaluates @emph{false}. +* ZBREAK:: Enable/disable ZBREAK mode. +* ZCONST:: Define a constant that cannot be altered after initial definition. +* ZEDIT:: Edit a routine using an external editor. +* ZGOTO:: @code{GOTO} with @code{BREAK} control. +* ZHALT:: Exit FreeM job with return value. * ZINSERT:: Insert code into routine buffer. -* ZJOB:: Unknown. +* ZJOB:: Invoke job, ignoring any timeouts. * ZLOAD:: Load routine into routine buffer. +* ZMAP:: Map a global name to a non-default namespace. * ZNEW:: Unknown. * ZPRINT:: Print contents of routine buffer. -* ZQUIT:: Unknown. +* ZQUIT:: Quit multiple stack levels at once. * ZREMOVE:: Remove code from routine buffer. * ZSAVE:: Save routine buffer to disk. -* ZTRAP:: Unknown. +* ZTHROW:: Programmatically raise an error condition. +* ZTRAP:: Raise a FreeM error. +* ZUNMAP:: Remove a mapping of a global to a non-default namespace. +* ZWATCH:: Enable or disable watchpoints, or set or clear watchpoints on specified globals, locals, or structured system variables. +* ZWITH:: Set prefix for future variable references. * ZWRITE:: Write local variable, global, or structured system variable to @code{@ref{$IO}}. @end menu @@ -1861,36 +2144,36 @@ Executes FreeM code @emph{expr V mcode}. @emph{Example (Using Variable)} @example -USER> SET FOO="WRITE ""HELLO WORLD"",!" -USER> @@FOO +DEFAULT.USER> SET FOO="WRITE ""HELLO WORLD"",!" +DEFAULT.USER> @@FOO HELLO WORLD -USER> +DEFAULT.USER> @end example @emph{Example (Using String Literal)} @example -USER> @@"WRITE ""HELLO WORLD"",!" +DEFAULT.USER> @@"WRITE ""HELLO WORLD"",!" HELLO WORLD -USER> +DEFAULT.USER> @end example @emph{Example (Using Indirection)} @example -USER> SET FOO="BAR" +DEFAULT.USER> SET FOO="BAR" -USER> SET BAR="WRITE ""HELLO WORLD"",!" +DEFAULT.USER> SET BAR="WRITE ""HELLO WORLD"",!" -USER> @@@@FOO +DEFAULT.USER> @@@@FOO HELLO WORLD -USER> +DEFAULT.USER> @end example @@ -1921,14 +2204,14 @@ If the @command{>} character is supplied Launches a subshell within the FreeM direct mode, allowing the user to run operating system commands. @example -USER> !! +DEFAULT.USER> !! Type Ctrl-D to exit from the shell $ uname -a Linux hesperos 4.19.0-17-amd64 #1 SMP Debian 4.19.194-3 (2021-07-18) x86_64 GNU/Linux $ exit -USER> +DEFAULT.USER> @end example @@ -1961,41 +2244,6 @@ In its inclusive form, @code{ABLOCK} inc In its exclusive form, @code{ABLOCK} increments the block counters for all event classes @emph{except for} those named in the list, provided the optional @emph{postcondition} is either @emph{true} or omitted. -@node ASSERT -@section ASSERT -@cindex ASSERT -@cindex commands, ASSERT -@cindex commands, debugging -@cindex commands, implementation-specific -@cindex commands, non-standard -@emph{FreeM Extension} - -Triggers error @code{ASSERT} if the supplied truth-valued expression @emph{tvexpr} is @emph{false} (@emph{1} is @emph{true}, and @emph{0} is @emph{false}), and that the optional @emph{postcondition} evaluates to @emph{true} or is omitted. - -The @code{ASSERT} error is catchable whether using standard-style, FreeM-style, or DSM 2.0-style error processing. - -@emph{Syntax} - -@example - ASSERT@emph{:postcondition} @emph{} -@end example - -@emph{Example} - -@example -USER> SET DEBUG=1 - - -USER> ASSERT:DEBUG 1=1 - - -USER> ASSERT:DEBUG 1=0 - - ->> Error ZASSERT: programmer assertion failed in SYSTEM::^%SYSINIT [$STACK = 0] ->> ASSERT:DEBUG 1=0 - ^ -@end example @node ASTART @section ASTART @@ -2100,10 +2348,12 @@ In its argumentless form, @code{BREAK} s @emph{FreeM Extension} -In its single-argument form, @code{BREAK} sets @emph{Ctrl-C} handling and error handling characteristics, provided the optional @emph{postcondition} is @emph{true} or omitted. +In its single-argument form, @code{BREAK} enters the interactive debugger or sets @emph{Ctrl-C} handling and error handling characteristics, provided the optional @emph{postcondition} is @emph{true} or omitted. The following table enumerates the possible values of @emph{breakflag} @table @code +@item "DEBUG" +Enters the interactive debugger @item 0 Disables @emph{Ctrl-C} handling @item -2 @@ -2135,23 +2385,6 @@ In its argumentless form, @code{CLOSE} c In its single-argument form, @code{CLOSE} closes the I/O device associated with channel @emph{channel}, provided that @emph{channel} represents a currently-open device, and the optional @emph{postcondition} is @emph{true} or omitted. -@node CONST -@section CONST -@cindex CONST -@cindex commands, CONST -@cindex commands, non-standard -@emph{FreeM Extension} - -Defines a local @emph{constant}, or variable that cannot be altered after its initial definition, provided the optional @emph{postcondition} is @emph{true} or omitted. - -Constants must only be locals, and globals are not supported. - -@emph{Syntax} - -@example -@code{CONST@emph{:postcondition} @emph{mref1}=@emph{initial-value1},...,@emph{mrefN}=@emph{initial-valueN}} -@end example - @node DO @section DO @cindex DO @@ -2165,6 +2398,14 @@ In its inclusive form, transfers program DO[@emph{:postcondition}] @emph{entryref}[@emph{:postcondition}[,...]] @end example +@cartouche +@quotation +@emph{Non-Standard Behavior} + +FreeM allows @code{DO} @emph{entryref}s to follow the format of @code{+@emph{intexpr}}. In this case, the value of @emph{intexpr} will be interpreted as an offset from the first line of the current routine. +@end quotation +@end cartouche + In its argumentless form, transfers control to the following block of code where the line level is one greater than the level at which @code{DO} was encountered, provided the optional @emph{postcondition} evaluates to @emph{true} or is omitted. @emph{Syntax} @@ -2190,9 +2431,9 @@ ELSE[@emph{:postcondition}] @quotation @emph{Non-Standard Behavior} -FreeM allows a @emph{postcondition} on @code{ELSE}. While explicitly forbidden in the @emph{standard}--and for good reason--it was decided that FreeM should allow postconditions everywhere, both for the sake of foolish consistency (the likes of which Emerson warned against), and for the benefit of entrants to a hypothetical future obfuscated M contest, and those with a Machiavellian predisposition to wicked perversions and undue cleverness. +FreeM allows a @emph{postcondition} on @code{ELSE}. While explicitly forbidden in the @emph{Standard}, it was decided that FreeM should allow postconditions everywhere, both for the sake of foolish consistency (the likes of which Emerson warned against), and for the benefit of entrants to a hypothetical future obfuscated M contest, and those with a Machiavellian predisposition to wicked perversions and undue cleverness. -Using postconditions on @code{ELSE} should be strictly avoided in production code, as they have no practical use, and may contribute to technical debt, hardening of the arteries, hobgoblins, a small mind, a surfeit of logic, climate change, Daily WTF rants, or meltdown of global financial markets. +Using postconditions on @code{ELSE} should be strictly avoided in production code, as they have no practical use, and may contribute to technical debt, hardening of the arteries, hobgoblins, a small mind, a surfeit of logic, climate change, @emph{Daily WTF} rants, or the meltdown of global financial markets. @end quotation @end cartouche @@ -2232,7 +2473,7 @@ FOR[@emph{:postcondition}] @emph{glvn}=@ @emph{Example} @example -USER> FOR I=1:1:10 WRITE I,! +DEFAULT.USER> FOR I=1:1:10 WRITE I,! 1 2 @@ -2245,7 +2486,7 @@ USER> FOR I=1:1:10 WRITE I,! 9 10 -USER> FOR I=2:2:10 WRITE I,! +DEFAULT.USER> FOR I=2:2:10 WRITE I,! 2 4 @@ -2265,7 +2506,7 @@ FOR[@emph{:postcondition}] @emph{glvn}=@ @emph{Example} @example -USER> FOR I=60,"FOO",-3,"George",1450,$HOROLOG WRITE I,! +DEFAULT.USER> FOR I=60,"FOO",-3,"George",1450,$HOROLOG WRITE I,! 60 FOO @@ -2288,6 +2529,15 @@ Transfers program execution to another l GOTO[@emph{:postcondition}] @emph{entryref} @end example +@cartouche +@quotation +@emph{Non-Standard Behavior} + +FreeM allows @code{GOTO} @emph{entryref}s to follow the format of @code{+@emph{intexpr}}. In this case, the value of @emph{intexpr} will be interpreted as an offset from the first line of the current routine. +@end quotation +@end cartouche + + @node HALT @section HALT @cindex HALT @@ -2336,11 +2586,22 @@ IF[@emph{:postcondition}] @emph{tvexpr}[ In its argumentless form, allows the remainder of the line of code following @code{IF} to execute only if @code{$TEST} evaluates to @emph{1}, provided the optional @emph{postcondition} evaluates to @emph{true} or is omitted. + @emph{Syntax} @example -IF[@emph{:postcondition}] +IF[@emph{:postcondition}] @emph{command...} @end example +@cartouche +@quotation +@emph{Style Recommendation} + +In the interest of readability and maintainability, we recommend avoiding the argumentless form of @code{IF} in new code. It is an obsolete relic of an era when routine sizes were severely limited, and can be difficult to spot, as the use of whitespace (@code{IF @emph{command}}) makes the intent of its use non-obvious at a glance. It is also far too easy to inadvertently delete the extra space, leading to program errors easily avoided otherwise. + +We recommend explicitly checking the value of @code{$TEST} instead, as in @code{IF $TEST @emph{command}} or @code{@emph{command}:$TEST ...}, as this makes the intent immediately clear both to M newcomers and seasoned experts, and sacrifices nothing of value, even on the oldest computer systems where FreeM can be used today. +@end quotation +@end cartouche + @node JOB @section JOB @cindex JOB @@ -2399,7 +2660,7 @@ In the above @emph{inclusive} form, @cod @cartouche @quotation @emph{Note} -The below @emph{argumentless} and @emph{exclusive} forms of @code{KSUBSCRIPTS} are not implemented in FreeM, as of version 0.3.3, but are planned for a future release. +The below @emph{argumentless} and @emph{exclusive} forms of @code{KSUBSCRIPTS} are not implemented in FreeM, as of version 0.65.1-rc0, but are planned for a future release. @end quotation @end cartouche @@ -2434,7 +2695,7 @@ In the above @emph{inclusive} form, @cod @cartouche @quotation @emph{Note} -The below @emph{argumentless} and @emph{exclusive} forms of @code{KVALUE} are not implemented in FreeM, as of version cvs-current, but are planned for a future release. +The below @emph{argumentless} and @emph{exclusive} forms of @code{KVALUE} are not implemented in FreeM, as of version 0.65.1-rc0, but are planned for a future release. @end quotation @end cartouche @@ -2475,10 +2736,10 @@ LOCK[@emph{:postcondition}] [+|-]@emph{n @emph{Example} -This example will increment the lock counter for @code{^JPW} and decrement the lock counter for @code{^MJR}. +This example will increment the lock counter for @code{^SNW} and decrement the lock counter for @code{^MJR}. @example -LOCK +^JPW,-^MJR +LOCK +^SNW,-^MJR @end example In its non-incremental form, @code{LOCK} releases all @code{LOCK}s held by the current process, and then attempts to acquire a lock on each @emph{name}, provided the optional @emph{postcondition} evaluates to @emph{true} or is omitted. If @emph{timeout} is supplied, FreeM will attempt to lock @emph{name} for no more than @emph{timeout} seconds. @@ -2490,21 +2751,6 @@ If @code{LOCK} succeeds within @emph{tim LOCK[@emph{:postcondition}] @emph{name}[:@emph{timeout}][,...@emph{name}[:@emph{timeout}]] @end example -@node MAP -@section MAP -@cindex MAP -@cindex commands, MAP -@cindex commands, implementation-specific -@cindex commands, non-standard - -Maps global name @code{gvn} to be mapped to the non-default namespace @emph{expr V namespace}, provided the optional @emph{postcondition} evaluates to @emph{true} or is omitted. - -@emph{Syntax} - -@example -MAP[@emph{:postcondition}] GLOBAL @emph{gvn}=@emph{expr V namespace} -@end example - @node MERGE @section MERGE @cindex MERGE @@ -2551,6 +2797,13 @@ NEW@emph{:postcondition} @emph{name}=@em In its initializing form, @code{NEW} stacks variable @emph{name} and sets its value to @emph{expr}, provided the optional @emph{postcondition} evaluates to @emph{true} or is omitted. When the current stack frame is exited, the previous value is restored. +@emph{Syntax} +@example +NEW@emph{:postcondition} @emph{name}=$%@emph{^CLASS}(@emph{initializer-list}) +@end example + +In its object-oriented form, @code{NEW} creates an instance of class @emph{^CLASS} in local variable @emph{name} and calls the constructor of @emph{^CLASS}, passing @emph{initializer-list} as its argument(s). + @node OPEN @section OPEN @cindex OPEN @@ -2747,27 +3000,6 @@ Saves the value of @code{$TEST} until th IF 1 THEN WRITE "HELLO!",! @end example -@node THROW -@section THROW -@cindex THROW -@cindex commands, THROW -@cindex commands, non-standard -@emph{FreeM Extension} - -Raises an error condition as long as the optional @emph{postcondition} is @emph{true} or omitted. - -@emph{Syntax} - -@example -@code{THROW@emph{:postcondition} @emph{expr V error-code}} -@end example - -@emph{Example} - -@example -@code{THROW "M102"} -@end example - @node TROLLBACK @section TROLLBACK @cindex TROLLBACK @@ -2832,20 +3064,6 @@ If you are using more than one transacti TSTART (FOO,BAR):(SERIAL,TRANSACTIONID="FOO") @end example -@node UNMAP -@section UNMAP -@cindex UNMAP -@cindex commands, UNMAP -@cindex commands, implementation-specific -@cindex commands, non-standard - -Removes any mapping connecting @emph{gvn} to a non-default namespace, provided the optional @emph{postcondition} evaluates to @emph{true} or is omitted. - -@emph{Syntax} - -@example -UNMAP GLOBAL @emph{gvn} -@end example @node USE @section USE @@ -2914,14 +3132,6 @@ Closes all global data files open in the VIEW 21 @end example -@item @code{29} - Symbol Table Copy -Copies the primary symbol table's contents to the alternate symbol table. Takes no arguments. - -@emph{Syntax} -@example -VIEW 29 -@end example - @item @code{52} - Set G0 Input Translation Table for @code{$IO} @emph{Syntax} @@ -3070,30 +3280,6 @@ If @emph{tvexpr} evaluates to @emph{true VIEW 83:@emph{tvexpr} @end example -@item @code{87} - Date Type Definition -We believe this defines date formats for @code{$ZDATE}, but we have not yet figured out how it works. - -@emph{Syntax} -@example -; Syntax unknown -@end example - -@item @code{88} - Time Type Definition -We believe this defines time formats for @code{$ZTIME}, but we have not yet figured out how it works. - -@emph{Syntax} -@example -; Syntax unknown -@end example - -@item @code{91} - Set Default Expression for Missing @code{QUIT} Expression -Sets the default expression to be printed when a @code{QUIT} is encountered where a @code{QUIT} argument would be expected, but was not provided. We're not entirely sure what this does. - -@emph{Syntax} -@example -; Syntax unknown -@end example - @item @code{92} - Set Type Mismatch Error Flag on @code{EUR2DEM} If @emph{tvexpr} evaluates to @emph{true}, a type mismatch error will be thrown in @code{EUR2DEM} currency conversions in certain situations that we do not yet understand. @@ -3182,136 +3368,142 @@ VIEW 133:@emph{tvexpr} @end table -@node WATCH -@section WATCH -@cindex WATCH -@cindex commands, WATCH + + +@node WRITE +@section WRITE +@cindex WRITE +@cindex commands, WRITE + +@node XECUTE +@section XECUTE +@cindex XECUTE +@cindex commands, XECUTE + +@node ZASSERT +@section ZASSERT +@cindex ZASSERT +@cindex commands, ZASSERT @cindex commands, debugging @cindex commands, implementation-specific @cindex commands, non-standard @emph{FreeM Extension} -Sets a watchpoint on a global, local, or SSVN node. - -@emph{Syntax} +Triggers error @code{ZASSERT} if the supplied truth-valued expression @emph{tvexpr} is @emph{false} (@emph{1} is @emph{true}, and @emph{0} is @emph{false}), and that the optional @emph{postcondition} evaluates to @emph{true} or is omitted. +The @code{ZASSERT} error is catchable whether using standard-style, FreeM-style, or DSM 2.0-style error processing. -In its @emph{argumentless} form, @code{WATCH} toggles watchpoints on and off, provided the optional @emph{postcondition} is @emph{true} or omitted. +@emph{Syntax} @example -WATCH[@emph{:postcondition}] + ZASSERT@emph{:postcondition} @emph{} @end example -In its @emph{inclusive} form, @code{WATCH} adds, removes, or examines watchpoints, provided the optional @emph{postcondition} is @emph{true} or omitted. +@emph{Example} -A @code{+} adds a new watchpoint to the following variable. +@example +DEFAULT.USER> SET DEBUG=1 -A @code{-} removes an existing watchpoint for the following variable. -A @code{?} examines the status of a watchpoint for the following variable. +DEFAULT.USER> ZASSERT:DEBUG 1=1 -@example -WATCH[@emph{:postcondition}] [+|-|?]@emph{var1}...,[+|-|?]@emph{varN} + +DEFAULT.USER> ZASSERT:DEBUG 1=0 + + +>> Error ZASSERT: programmer assertion failed in SYSTEM::^%SYSINIT [$STACK = 0] +>> ZASSERT:DEBUG 1=0 + ^ @end example +@node ZBREAK +@section ZBREAK +@cindex ZBREAK +@cindex commands, ZBREAK +@cindex commands, debugging +@cindex commands, implementation-specific +@cindex commands, non-standard +@emph{FreeM Extension} + +Sets or clears the @code{ZBREAK} flag@footnote{NOTE: FreeM team needs to investigate how @code{zbreakon} and @code{zbflag} affect program execution.}, based on the result of evaluating @emph{tvexpr}. -The following example demonstrates turning watchpoint processing on and adding a watchpoint for global variable @code{^jpw(1)}. It then changes the value of @code{^jpw(1)}. +@emph{Syntax} @example -USER> WATCH - -Watchpoints enabled. - -USER> WATCH +^JPW(1) - -Added '^JPW("1")' to the watchlist. - -USER> SET ^JPW(1)="new value" - ->> WATCHPOINT: ^JPW("1") => 'new value' (changed 1 times) - +ZBREAK @emph{tvexpr} @end example -The following example will remove that watchpoint: +@node ZCONST +@section ZCONST +@cindex ZCONST +@cindex commands, ZCONST +@cindex commands, non-standard +@emph{FreeM Extension} + +Defines a local @emph{constant}, or variable that cannot be altered after its initial definition, provided the optional @emph{postcondition} is @emph{true} or omitted. + +Constants must only be locals, and globals are not supported. + +@emph{Syntax} @example -USER> WATCH -^JPW(1) - -Removed '^JPW("1")' from the watchlist. - -USER> WATCH ?^JPW(1) - -'^JPW("1")' is not being watched. +@code{ZCONST@emph{:postcondition} @emph{mref1}=@emph{initial-value1},...,@emph{mrefN}=@emph{initial-valueN}} @end example -@node WITH -@section WITH -@cindex WITH -@cindex commands, WITH +@node ZEDIT +@section ZEDIT +@cindex ZEDIT +@cindex commands, ZEDIT @cindex commands, non-standard @emph{FreeM Extension} -Sets a prefix to be applied to all subsequent local variable or constant references. +Edits a routine using an external editor. Uses environment variable @code{$EDITOR} if defined; otherwise, uses @code{vi}. @emph{Syntax} @example -@code{WITH@emph{:postcondition} @emph{var-prefix}} +ZEDIT@emph{[:postcondition]} @end example -In the above single-argument form, sets the @code{$WITH} prefix to @emph{var-prefix}, provided that the optional @emph{postcondition} is either @emph{true} or omitted. +In its argumentless form, edits the currently-active routine, provided the optional @emph{postcondition} is @emph{true} or omitted. -The @emph{var-prefix} argument may be a string literal or any valid FreeM expression. +@emph{Syntax} @example -@code{WITH@emph{:postcondition}} +ZEDIT@emph{[:postcondition]} @emph{} @end example -In the above argumentless form, clears the @code{$WITH} prefix, provided the optional @emph{postcondition} is either @emph{true} or omitted. Equivalent to @code{WITH ""}. +In its single-argument form, edits @emph{}, provided the optional @emph{postcondition} is @emph{true} or omitted. +Routine names must not be quoted, and must not included a leading caret (@code{^}). -@node WRITE -@section WRITE -@cindex WRITE -@cindex commands, WRITE +@emph{Errors} -@node XECUTE -@section XECUTE -@cindex XECUTE -@cindex commands, XECUTE +@code{ZEDIT} will raise @code{ZNOPGM} if the routine cannot be found, or there is no routine currently loaded in argumentless form. -@node ZALLOCATE -@section ZALLOCATE -@cindex ZALLOCATE -@cindex commands, ZALLOCATE +@node ZGOTO +@section ZGOTO +@cindex ZGOTO +@cindex commands, ZGOTO @cindex commands, implementation-specific @cindex commands, non-standard @emph{FreeM Extension} -@node ZBREAK -@section ZBREAK -@cindex ZBREAK -@cindex commands, ZBREAK -@cindex commands, debugging -@cindex commands, implementation-specific -@cindex commands, non-standard -@emph{FreeM Extension} +In its single-argument form, enables @code{BREAK} mode and branches unconditionally to @emph{entryref}. -@node ZDEALLOCATE -@section ZDEALLOCATE -@cindex ZDEALLOCATE -@cindex commands, ZDEALLOCATE -@cindex commands, implementation-specific -@cindex commands, non-standard -@emph{FreeM Extension} +@emph{Syntax} -@node ZGO -@section ZGO -@cindex ZGO -@cindex commands, ZGO -@cindex commands, implementation-specific -@cindex commands, non-standard -@emph{FreeM Extension} +@example +ZGOTO @emph{entryref} +@end example + +In its argumentless form, resumes execution after a @code{BREAK}. + +@emph{Syntax} + +@example +ZGOTO +@end example @node ZHALT @section ZHALT @@ -3321,6 +3513,22 @@ In the above argumentless form, clears t @cindex commands, non-standard @emph{FreeM Extension} +In its single-argumented form, @code{ZHALT} command is used to exit the FreeM process with a specific return value @emph{intexpr}. + +@emph{Syntax} + +@example +ZHALT @emph{intexpr} +@end example + +In its argumentless form, @code{ZHALT} is synonymous with @code{HALT}. + +@emph{Syntax} + +@example +ZHALT +@end example + @node ZINSERT @section ZINSERT @cindex ZINSERT @@ -3329,6 +3537,16 @@ In the above argumentless form, clears t @cindex commands, non-standard @emph{FreeM Extension} +Inserts a line of M code into the currently-active routine buffer, provided the optional @emph{postcondition} is @emph{true} or omitted. + +@emph{Syntax} + +@example +ZINSERT@emph{:postcondition} @emph{expr V mcode}[:@emph{label}] +@end example + +Above, @emph{expr V mcode} is an expression returning a string giving M code. If @emph{label} is omitted, the code will be inserted at the insertion point, which is typically the end of the routine. Otherwise, the code will be inserted at the line immediately following @emph{label}. + @node ZJOB @section ZJOB @cindex ZJOB @@ -3357,6 +3575,22 @@ Loads routine @emph{} into ZLOAD@emph{:postcondition} @emph{} @end example + +@node ZMAP +@section ZMAP +@cindex ZMAP +@cindex commands, ZMAP +@cindex commands, implementation-specific +@cindex commands, non-standard + +Maps global name @code{gvn} to be mapped to the non-default namespace @emph{expr V namespace}, provided the optional @emph{postcondition} evaluates to @emph{true} or is omitted. + +@emph{Syntax} + +@example +ZMAP[@emph{:postcondition}] GLOBAL @emph{gvn}=@emph{expr V namespace} +@end example + @node ZNEW @section ZNEW @cindex ZNEW @@ -3373,7 +3607,7 @@ ZLOAD@emph{:postcondition} @emph{ ZWATCH + +Watchpoints enabled. + +DEFAULT.USER> ZWATCH +^SNW(1) + +Added '^SNW("1")' to the watchlist. + +DEFAULT.USER> SET ^SNW(1)="new value" + +>> WATCHPOINT: ^SNW("1") => 'new value' (changed 1 times) + +@end example + +The following example will remove that watchpoint: + +@example +DEFAULT.USER> ZWATCH -^SNW(1) + +Removed '^SNW("1")' from the watchlist. + +DEFAULT.USER> ZWATCH ?^SNW(1) + +'^SNW("1")' is not being watched. +@end example + +@node ZWITH +@section ZWITH +@cindex ZWITH +@cindex commands, ZWITH +@cindex commands, non-standard +@emph{FreeM Extension} + +NOTE: This command may be deprecated and removed in future FreeM releases. + +Sets a prefix to be applied to all subsequent local variable or constant references. + +@emph{Syntax} + +@example +@code{ZWITH@emph{:postcondition} @emph{var-prefix}} +@end example + +In the above single-argument form, sets the @code{$WITH} prefix to @emph{var-prefix}, provided that the optional @emph{postcondition} is either @emph{true} or omitted. + +The @emph{var-prefix} argument may be a string literal or any valid FreeM expression. + +@example +@code{ZWITH@emph{:postcondition}} +@end example + +In the above argumentless form, clears the @code{$WITH} prefix, provided the optional @emph{postcondition} is either @emph{true} or omitted. Equivalent to @code{ZWITH ""}. + + + + + + + + @node ZWRITE @section ZWRITE @cindex ZWRITE @@ -3793,9 +4190,9 @@ Returns or sets the maximum number of ch Returns or sets the maximum number of characters of a single global subscript, from 1-255. @item @code{SINGLE_USER} +R +U -D -If set to @code{1}, FreeM will skip all file locking operations on globals, as well as the @code{LOCK} and @code{ZALLOCATE} tables. If set to @code{0}, FreeM will enforce file locking on both. +If set to @code{1}, FreeM will skip all file locking operations on globals. If set to @code{0}, FreeM will enforce file locking on both. -Setting @code{SINGLE_USER} to @code{1} will improve FreeM performance, but you must @emph{ONLY} use this on systems where you are absolutely sure that only one FreeM process will run at any given time, as running multiple instances of FreeM concurrently when any of them are set to @code{SINGLE_USER} mode @emph{will} cause global data and @code{LOCK}/@code{ZALLOCATE} table corruption! +Setting @code{SINGLE_USER} to @code{1} will improve FreeM performance, but you must @emph{ONLY} use this on systems where you are absolutely sure that only one FreeM process will run at any given time, as running multiple instances of FreeM concurrently when any of them are set to @code{SINGLE_USER} mode @emph{will} cause global data corruption. @item @code{CHARACTER} +R -U -D Returns the character set of the job. @@ -3806,25 +4203,6 @@ Returns or sets the current working dire @item @code{OPEN} +R -U -D The @code{^$JOB($JOB,"OPEN",} subscripts list the open I/O channels in the specified job. -@item @code{ENGINES} +R -U -D -Returns or sets the storage engines for various FreeM subsystems. - -The following table lists the types of storage engines that can be defined. - -@table @asis - -@item @code{GLOBAL} +R +U -D -Returns or sets the global handler for a particular FreeM namespace: - -The following code would set the global handler for the @code{SYSTEM} namespace to @code{BERKELEYDB}: - -@code{SET ^$JOB($JOB,"ENGINES","GLOBAL","SYSTEM")="BERKELEYDB"} - -@item @code{LOCAL} +R -U -D -Returns the local handler for a particular FreeM namespace. Always @code{BUILTIN} in the current FreeM release. - -@end table - @item @code{BERKELEYDB,FLUSH_THRESHOLD} +R +U -D Returns or sets the number of write operations that will be cached in the BerkeleyDB global handler prior to flushing BerkeleyDB's cache to disk. @@ -4114,38 +4492,76 @@ Forces a number to positive, whether pos @section Unary - @cindex operators, unary - +Forces a number to negative, whether positive or negative. Also forces numeric coercion of strings. + @node + @section + (Add) @cindex operators, + +@emph{Syntax} + +@example +S X=1+2 ; => 3 +@end example + +Adds numbers together. + @node += @section += (Add/Assign) @cindex operators, += +@emph{Syntax} + +@example +S X=5 +S X+=3 ; => 8 +@end example + +Increments the variable on the LHS by the value on the RHS. + @node ++ @section ++ (Postfix Increment) @cindex operators, ++ +Increments a variable by 1. + @node - @section - (Subtract) @cindex operators, - +Subtracts one number from another. + @node -= @section -= (Subtract/Assign) @cindex operators, -= +@emph{Syntax} + +@example +S X=5 +S X-=3 ; => 2 +@end example + +Decrements the variable on the LHS by the value on the RHS. + @node -- @section -- (Postfix Decrement) @cindex operators, -- +Decrements the variable by one. + @node * @section * (Multiply) @cindex operators, * +Multiplies one number by another. + @node *= @section *= (Multiply/Assign) @cindex operators, *= + + @node / @section / (Divide) @cindex operators, / @@ -4309,18 +4725,45 @@ An @code{INTEGER} is an interpretation o @cindex data types, REAL @cindex types, REAL +A @code{REAL} is a numeric interpretation of data including a fractional part. + @node STRING @section STRING @cindex data types, STRING @cindex types, STRING +The @code{STRING} is the fundamental FreeM data type. Other types are inferred from the context of their usage. + +@subsection String Rules + +The following rules apply to all FreeM strings: + +@itemize +@item Must not exceed 255 characters +@item Must not contain @code{$C(0)}, @code{$C(201)}, or @code{$C(202)} +@end itemize + +@subsection String Quoting Rules +Strings in FreeM must be surrounded in double quotes: + +@example +SET MYSTRING="This is a string literal" +@end example + +If you want to include double quotes inside of a string, simply double them: + +@example +SET MYSTRING="This is a ""string literal"" with embedded double quotes" +@end example + + @node Custom Types (Classes) @section Custom Types (Classes) @cindex data types, custom @cindex types, custom @cindex classes -See @ref{Classes}. +See @ref{Object-Oriented Programming}. @node Globals @chapter Globals @@ -4328,21 +4771,311 @@ See @ref{Classes}. @cindex variables, global @cindex data +@menu +* Globals Overview:: Basics of FreeM persistent storage. +* Creating Globals:: How to create globals. +* Removing Globals:: How to remove globals. +* Global Storage:: How globals are stored. +@end menu + +@node Globals Overview +@section Globals Overview + +FreeM supports typical M globals, which are often described as persistent, hierachical sparse arrays. Globals make it relatively simple to include persistent data in an application without requiring the developer to use an external database management system, and offer syntax and semantics so similar to M local variables and structured system variables that moving from one to the other is seamless. + +Each global comprises three elements: + +@itemize @bullet +@item +An alphabetic name beginning with a caret (@code{^}) or a caret and a percent sign (@code{^%}) +@item +Optionally, one or more comma-delimited subscripts, enclosed in parentheses +@item +A value of up to 255 characters in length +@end itemize + +A leading percent sign in the global name will force the named global into the @code{SYSTEM} namespace of the current FreeM environment. + +@node Creating Globals +@section Creating Globals +@cindex globals, creating + +To create a global, you can use the @code{SET} command: + +@example +SET ^MYGLOBAL("foo","bar")="this is the data value" +@end example + +@node Removing Globals +@section Removing Globals +@cindex globals, removing + +To remove an entire global, you can use the @code{KILL} command with the unsubscripted name of the global: + +@example +KILL ^MYGLOBAL +@end example + +If you only want to remove part of a global, i.e., beginning at a certain subscript level, use the @code{KILL} command with a subscripted name: + +@example +KILL ^MYGLOBAL("foo") +@end example + +This will remove only the @code{"foo"} subscript and all of its children. + +If you only want to remove the data value at a specific subscript level, leaving the subscript itself intact, use @code{KVALUE}: + +@example +KVALUE ^MYGLOBAL("foo") +@end example + +@node Global Storage +@section Global Storage +@cindex globals, storage + +FreeM globals are stored in @code{$PREFIX/var/freem/@emph{}/@emph{}/globals} in a binary format. + +Global files have a header of the following format: + +@verbatim +typedef struct global_header { + + char magic[5]; /* FRMGL */ + int format_version; + char host_triplet[40]; + char host_id[256]; + + unsigned long block_size; + unsigned long last_transaction_id; + + long created; + long last_backup; + +} global_header; +@end verbatim + @node Concurrency Control @chapter Concurrency Control @cindex concurrency control @cindex locking @cindex transaction processing +@menu +* Concurrency Control Overview:: Basics of concurrency control. +* Advisory Locks:: Coordinating access voluntarily. +* Transaction Processing:: Ensuring logical consistency. +@end menu + +@node Concurrency Control Overview +@section Concurrency Control Overview + +Multitasking, multi-user FreeM applications must concern themselves with conscientious management of concurrent access to globals in order to maintain logical consistency and prevent concurrent reads and writes from conflicting with each other. + +In FreeM, there are two mechanisms provided for managing concurrent global access: @emph{advisory locks}, and @emph{transaction processing}. + +Advisory locks allow applications to voluntarily coordinate concurrent access to globals with the @code{LOCK} command, and require each application to check the @code{LOCK} status prior to accessing a global. + +Transaction processing allows applications to delineate sets of global operations (sets, kills, etc.) as being part of a transaction, in which no operations are performed against the globals contained within the transaction until the transaction is committed. In addition, processes other than the one running the transaction will be forced to wait to access globals for either the duration of the commit phase (@emph{batch mode}), or for the entire duration of the transaction (@emph{serial mode}). + +@node Advisory Locks +@section Advisory Locks + +@node Transaction Processing +@section Transaction Processing +@cindex transaction processing + +FreeM implements a significant subset of the transaction processing features from @emph{ANSI X11.1-1995}. This allows a series of global operations to be conducted all at once, either in batch mode (where concurrent operation is not interrupted until the last possible moment), or in serial mode (where writes are guaranteed to be atomic, consistent, isolated, and durable). + +@subsection Theory of Operation + +FreeM uses a pessimistic concurrency control mechanism for @code{SERIAL} transactions, meaning that any @code{TSTART} command that includes the @code{SERIAL} transaction parameter will cause the process to acquire the transaction processing mutex, which prevents any process but the one holding the mutex from performing any data access (read or write) until either @code{TCOMMIT} or @code{TROLLBACK} is called, either committing or rolling back the transaction, respectively. + +Any transaction in between its @code{TSTART} and @code{TCOMMIT}/@code{TROLLBACK} is said to be @emph{in-flight}. During the in-flight stage, pending global operations are held only in memory and after-image journals. + +FreeM maintains a list of all globals affected during a transaction in-flight. When a @code{TCOMMIT} is reached, FreeM will generate a @emph{checkpoint} of each global data file to be changed by the transaction. These checkpoints allow all FreeM globals to be restored to their pre-transaction state if a @code{TCOMMIT} should fail part of the way through its operation. + +Checkpoints can have one of two modes: + +@table @asis + +@item @code{CP_REMOVE} +Used for globals that did not exist prior to the beginning of this transaction. Simply marks the entire global data file for deletion in case of @code{TCOMMIT} failure. + +@item @code{CP_RESTORE} +Used for globals that @emph{did} exist prior to the beginning of this transaction. In this case, the entire global data file is copied to a new file with a @code{.chk} extension. In cases of @code{TCOMMIT} failure, @code{CP_RESTORE} checkpoint files will be restored over the partially-modified live data file. + +@end table + +The below example shows a few global operations and checkpoints for a transaction in-flight using the @code{trantab} direct-mode command: + +@verbatim +TL1:DEFAULT.USER> trantab + $TLEVEL 1* + Operations for Transaction ID: 6ea14aad-b8f1-47f9-9f52-4f513f892bc0 [RESTARTABLE SERIAL] + + OP. NO. ACTION KEY/DATA + ------- ------ -------- + 1 SET ^FOO=3 + 2 KILL ^FOO + 3 SET ^snw=10 + 4 SET ^BRANDNEW=6 + + Global checkpoints: + + GLOBAL MODE FILES + ------ ---- ----- + ^BRANDNEW CP_REMOVE IN: /usr/local/var/freem/USER/globals/^BRANDNEW + ^snw CP_RESTORE IN: /usr/local/var/freem/USER/globals/^snw + OUT: /usr/local/var/freem/USER/globals/^snw.23390.1.chk + ^FOO CP_RESTORE IN: /usr/local/var/freem/USER/globals/^FOO + OUT: /usr/local/var/freem/USER/globals/^FOO.23390.1.chk +@end verbatim + +In the above example, @code{IN} files are the live data file that will be overwritten or removed, and @code{OUT} files are the checkpoints themselves. Note that @code{OUT} files are only used for @code{CP_RESTORE} checkpoints. + +@subsection Using Transaction Processing + +To use transactions in FreeM, you need to be familiar with three commands: + +@itemize @bullet +@item +@code{TSTART} +@item +@code{TCOMMIT} +@item +@code{TROLLBACK} +@end itemize + +With transaction processing, global variable operations occurring between @code{TSTART} and @code{TCOMMIT} commands will be contained within the transaction. + +The atomicity, consistency, isolation, and durability facets of FreeM transaction hinge on the transaction mode. + +@subsubsection BATCH Transactions +@code{BATCH} transactions offer higher performance, and allow other applications aside from the one doing the transaction to continue normal operations until the transaction is committed with @code{TCOMMIT}. In batch mode, other processes are only locked out of normal operation during the commit phase of the transaction. + +The effect of this is that the operations within the batch transaction will not be interleaved with global writes from other applications, but the entire lifetime of the transaction is not guaranteed to be serialized with respect to the transaction processing activities of other running applications in the environment. + +@subsubsection SERIAL Transactions +@code{SERIAL} transactions offer full ACID compliance at the expense of multiprocessing performance. In serial mode, a @code{TSTART} blocks all activity from all other FreeM processes in the environment, and this blocking effect is not released until the transaction is committed with @code{TCOMMIT} or rolled back with @code{TROLLBACK} (or due to abnormal conditions in the environment that preclude the successful completion of the transaction). + @node Local Variables @chapter Local Variables @cindex variables, local @cindex local variables +@menu +* Local Variables Overview:: The basics of locals. +* Creating Local Variables:: Creating locals with SET. +* Removing Local Variables:: Removing locals with KILL. +@end menu + +@node Local Variables Overview +@section Local Variables Overview + +FreeM @emph{local variables} have the same data structure as global variables, but are scoped to a single FreeM process, and stored in memory. + +Each local comprises three elements: + +@itemize @bullet +@item +An alphabetic name beginning with a letter or a percent sign (@code{%}) +@item +Optionally, one or more comma-delimited subscripts, enclosed in parentheses +@item +A value of up to 255 characters in length +@end itemize + +@node Creating Local Variables +@section Creating Local Variables +@cindex local variables, creating + +To create a local variable, use the @code{SET} command: + +@example +SET MYLOCAL("foo","bar")="this is the data value" +@end example + +@node Removing Local Variables +@section Removing Local Variables +@cindex local variables, removing + +To remove an entire local variable, you can use the @code{KILL} command with the unsubscripted name of the variable: + +@example +KILL MYLOCAL +@end example + +If you only want to remove part of a local variable, i.e., beginning at a certain subscript level, use the @code{KILL} command with a subscripted name: + +@example +KILL MYLOCAL("foo") +@end example + +This will remove only the @code{"foo"} subscript and all of its children. + +If you only want to remove the data value at a specific subscript level, leaving the subscript itself intact, use @code{KVALUE}: + +@example +KVALUE MYLOCAL("foo") +@end example + @node Scoping @chapter Scoping @cindex scoping +By default, FreeM local variables and their values are scoped to the entire process, meaning that any function or subroutine can access and modify their values. This can lead to pernicious bugs. + +M provides the @code{NEW} command to work around these issues. When @code{NEW} is called with a local variable as its argument, FreeM will scope the variable to the process stack frame in which the @code{NEW} command occured. When exiting the stack frame (i.e. with the @code{QUIT} command), FreeM will restore the variable to its value prior to being @code{NEW}ed. + +@emph{Example} + +@example +MYRTN ; + S J=1 ; set local variable J to 1 + W J,! ; this will output "1" + D X ; execute subroutine X + W J,! ; this will output "1", as the value of J was restored + Q + ;; +X ; + N J ; stack J + S J=6 ; set its value to 6 + W J,! ; this will output "6" + Q ; quit from the subroutine, destroying its stack frame + ;; +@end example + +@section Scoping Considerations for $TEST + +In M, the truth value of comparisons, logic operations, and certain forms of @code{LOCK} is stored in the @code{$TEST} intrinsic special variable, which follows the same rules as any M local variable. + +This is probably the most significant design flaw of the language, as the side effects of logic on @code{$TEST} lead to incredibly difficult bugs. However, M allows @code{$TEST} to be @code{NEW}ed, and FreeM provides the @code{THEN} command@footnote{From MDC Type A extension X11/1998-31} to help in the case of conditionals. @code{THEN} stacks @code{$TEST} to the end of the line. + +When writing new M code in FreeM, we strongly suggest using @code{THEN} as follows: + +@example +MYRTN ; + IF MYVAR=1 THEN DO SUBRT +@end example + +This is instead of the traditional form: + +@example +MYRTN ; + IF MYVAR=1 DO SUBR +@end example + +@cartouche +@quotation +@emph{Style Recommendation} + +Note that @code{THEN} is not in any currently published version of the @emph{Standard}, but is part of MDC Type A extension X11/1998-31. However, we recommend using @code{THEN} instead of favoring portability, as there is no defensible reason for this incredibly simple feature @emph{not} to be ubiquitous. + +If you use other M implementations, you should bug the implementers to implement @code{THEN}, as it at least partially mitigates an inexcusable flaw in the design of M. +@end quotation +@end cartouche + @node Decision Constructs @chapter Decision Constructs @cindex decision constructs @@ -4386,30 +5119,155 @@ See @ref{Classes}. @cindex programming, object-oriented @menu -* Classes:: The basis of object-oriented programming. +* Classes:: The organizing concept of object-oriented programming. +* Inheritance:: Making one class derive from another. +* Methods:: Attach code to classes. +* Public and Private Variables:: Determining accessibility. +* Instantiating Objects:: Creating instances of classes. @end menu @node Classes @section Classes +@subsection Class Overview -@menu -* Inheritance:: Basing one class upon another. -* Methods:: Attaching code to a class. -* Public Variables:: Variables visible outside of a class. -* Private Variables:: Variables only visible within a class. -@end menu +A @emph{class} is the primary organizing concept of FreeM support for object-oriented programming, and in FreeM, is simply an M routine with a few special properties: + +@example +MYCLASS(THIS,INIT):OBJECT ; Constructor for MYCLASS, inherits OBJECT + ; two private variables + S THIS("NUMERATOR"):PRIVATE=$P(INIT,"/",1) + S THIS("DENOMINATOR"):PRIVATE=$P(INIT,"/",2) + Q + ; +DESTROY(THIS) ; This is the destructor + Q +@end example + +The above example demonstrates general class syntax. + +@subsection Constructors + +A @emph{constructor} is an M entry point that is called when a new instance of a class is created. + +A constructor must be the first entry point in a class routine, its tag must match the class/routine name, and it must take two arguments, @code{THIS} and @code{INIT}. + +@code{THIS} represents the instance of the object being accessed, and @code{INIT} represents an initializer that can be used to assign an initial value to the object when instantiating the class. + +A constructor looks like this: + +@example +%FRACTION(THIS,INIT):OBJECT ; + S THIS("NUMERATOR"):PRIVATE=$P(INIT,"/",1) + S THIS("DENOMINATOR"):PRIVATE=$P(INIT,"/",2) + Q +@end example + +@emph{Syntax} +@example +@emph{}(THIS,INIT)[:@emph{}] +@end example + +In the above example, @emph{} represents the name of a class from which this class should inherit. In this case, the @code{FRACTION} class inherits from the @code{OBJECT} class. Note that this is not strictly necessary in this case, as all classes in FreeM automatically inherit from @code{OBJECT}. + +@subsection Destructors +A @code{destructor} is called when you @code{KILL} an instance variable. Its tag must be @code{DESTROY}, and it must take one argument (@code{THIS}). + +The destructor should be used to clean up any resources used by class methods. + +A destructor looks like this: + +@example +DESTROY(THIS) ; + ; free any resources that should be freed at the end of the object's lifetime + Q +@end example @node Inheritance -@subsection Inheritance +@section Inheritance + +Every class you create will automatically inherit the methods and functionality of the @code{OBJECT} class, supplied with FreeM. + +When attempting to call a method, FreeM will first search the class routine for a matching entry point, and then follow the inheritance chain upwards until a matching entry point is found. If the final class in the chain does not have a matching entry point, FreeM will try to find a matching entry point in the @code{OBJECT} class. + +Inheritance is achieved by specifying the name of the superclass in the constructor: + +@example +CLASS(THIS,INIT):SUPERCLASS +@end example + +@subsection Runtime Polymorphism + +You can achieve runtime polymorphism by subclassing, and defining methods in the subclass that match the names of existing methods in the superclass. Following FreeM inheritance rules, the overridden method in the subclass will be called, and the method in the superclass will not. + +Note that the overridden method in the subclass can take a different set or number of arguments than the @emph{formallist} of the superclass method would specify. @node Methods -@subsection Methods +@section Methods +Class methods are defined as tags with @emph{formallist}s in a class routine, and per the typical FreeM object pattern, must take at least one argument, being @code{THIS} (representing a reference to the object instance being accessed). -@node Public Variables -@subsection Public Variables +The following class (@code{MYCLASS}) has a constructor, a destructor, and a method called @code{MYMETHOD}: + +@example +%MYCLASS(THIS,INIT) ; + Q THIS +DESTROY(THIS) ; + Q +MYMETHOD(THIS) ; + Q "VALUE" +@end example -@node Private Variables -@subsection Private Variables +The dot operator is used to invoke class methods: + +@example +DEFAULT.USER> N MYOBJ=$#^%MYCLASS("") +DEFAULT.USER> W MYOBJ.MYMETHOD() +VALUE +@end example + +@node Public and Private Variables +@section Public and Private Variables + +FreeM supports private fields with the @code{:PRIVATE} specifier in the @code{SET} command, enforcing classical object-oriented data encapsulation. The @code{:PUBLIC} specifier is provided for completeness, and is the default. + +The below constructor for a @code{FRACTION} class defines two private fields: + +@example +%FRACTION(THIS,INIT):OBJECT ; + S THIS("NUMERATOR"):PRIVATE=$P(INIT,"/",1) + S THIS("DENOMINATOR"):PRIVATE=$P(INIT,"/",2) + Q +@end example + +Either of the following commands will create a public field: + +@example + S THIS("VARNAM")="Initial Value" + S THIS("VARNAM"):PUBLIC="Initial Value" +@end example + +Attempting to access private fields from outside of the class will raise error condition @code{ZOBJFLDACCV}. + +@node Instantiating Objects +@section Instantiating Objects + +To instantiate an object (i.e., create an object from a certain class), you will use the @code{NEW} command as follows: + +@example +NEW MYSTR=$#^%STRING("myString") +@end example + +This will create a local variable called MYSTR of type STRING, and initialize it with the value myString. + +@subsection Determining Object Class + +To determine the class of any FreeM local variable, you will use the @code{$$TYPE()} method: + +@example +USER> W MYSTR.$$TYPE() +^%STRING +@end example + +The @code{$$TYPE()} method is a member of the @code{OBJECT} class. @node Libraries @chapter Libraries @@ -4477,18 +5335,6 @@ You may also use an expression that reso WRITE ^|NS|VA(200,0),! @end example -@section File Path Extended Global References -@cindex extended global references, file path - -If a namespace is configured to use the @code{BUILTIN} global handler, FreeM supports accessing a global data file by way of its filesystem path. - -The following file path extended global reference will write the value of @code{^VA(200,0)}, assuming the @code{^VA} data file exists at path @code{/home/jpw/^VA}: - -@example - WRITE ^/home/jpw/VA(200,0),! -@end example - - @node Global Aliasing @chapter Global Aliasing @cindex aliasing, global @@ -4529,58 +5375,6 @@ To remove the above mapping, any of the KILL ^$SYSTEM("MAPPINGS","GLOBAL","^FOO") @end example -@node Transaction Processing -@chapter Transaction Processing -@cindex transaction processing - -FreeM implements a significant subset of the transaction processing features from @emph{ANSI X11.1-1995}. This allows a series of global operations to be conducted all at once, either in batch mode (where concurrency is not disturbed), or in serial mode (where writes are guaranteed to be atomic, consistent, isolated, and durable). - -@section Theory of Operation - -FreeM uses a pessimistic concurrency control mechanism for @code{SERIAL} transactions, meaning that any @code{TSTART} command that includes the @code{SERIAL} transaction parameter will cause the process to acquire the transaction processing mutex, which prevents any process but the one holding the mutex from performing any data access (read or write) until either @code{TCOMMIT} or @code{TROLLBACK} is called, either committing or rolling back the transaction, respectively. - -Any transaction in between its @code{TSTART} and @code{TCOMMIT}/@code{TROLLBACK} is said to be @emph{in-flight}. During the in-flight stage, pending global operations are held only in memory and after-image journals. - -FreeM maintains a list of all globals affected during a transaction in-flight. When a @code{TCOMMIT} is reached, FreeM will generate a @emph{checkpoint} of each global data file to be changed by the transaction. These checkpoints allow all FreeM globals to be restored to their pre-transaction state if a @code{TCOMMIT} should fail part of the way through its operation. - -Checkpoints can have one of two modes: - -@table @asis - -@item @code{CP_REMOVE} -Used for globals that did not exist prior to the beginning of this transaction. Simply marks the entire global data file for deletion in case of @code{TCOMMIT} failure. - -@item @code{CP_RESTORE} -Used for globals that @emph{did} exist prior to the beginning of this transaction. In this case, the entire global data file is copied to a new file with a @code{.chk} extension. In cases of @code{TCOMMIT} failure, @code{CP_RESTORE} checkpoint files will be restored over the partially-modified live data file. - -@end table - -The below example shows a few global operations and checkpoints for a transaction in-flight using the @code{trantab} direct-mode command: - -@verbatim -TL1:USER> trantab - $TLEVEL 1* - Operations for Transaction ID: 6ea14aad-b8f1-47f9-9f52-4f513f892bc0 [RESTARTABLE SERIAL] - - OP. NO. ACTION KEY/DATA - ------- ------ -------- - 1 SET ^FOO=3 - 2 KILL ^FOO - 3 SET ^jpw=10 - 4 SET ^BRANDNEW=6 - - Global checkpoints: - - GLOBAL MODE FILES - ------ ---- ----- - ^BRANDNEW CP_REMOVE IN: /usr/local/var/freem/USER/globals/^BRANDNEW - ^jpw CP_RESTORE IN: /usr/local/var/freem/USER/globals/^jpw - OUT: /usr/local/var/freem/USER/globals/^jpw.23390.1.chk - ^FOO CP_RESTORE IN: /usr/local/var/freem/USER/globals/^FOO - OUT: /usr/local/var/freem/USER/globals/^FOO.23390.1.chk -@end verbatim - -In the above example, @code{IN} files are the live data file that will be overwritten or removed, and @code{OUT} files are the checkpoints themselves. Note that @code{OUT} files are only used for @code{CP_RESTORE} checkpoints. @node Asynchronous Event Handling @@ -4794,9 +5588,9 @@ You can also set up a trigger that appli This routine is the implementation of the @code{$ZCOLUMNS} intrinsic special variable. -@section ^%SYSINIT -@cindex ^%SYSINIT -@cindex system library routines, ^%SYSINIT +@section %SYSINIT +@cindex %SYSINIT +@cindex system library routines, %SYSINIT This routine is the default startup routine for FreeM running in direct mode. @@ -4818,7 +5612,7 @@ This routine is the implementation of th @chapter Interrupt Handling @cindex interrupt handling -When FreeM receives the @code{SIGINT} signal, either by pressing @code{Ctrl-C} during program execution, or by external signal from the operating system, the FreeM daemon, or another external process, one of two things can happen, depending on the state of the @code{$ZI} special variable: +When FreeM receives the @code{SIGINT} signal, either by pressing @code{Ctrl-C} during program execution, or by external signal from the operating system, the FreeM environment daemon, or another external process, one of two things can happen, depending on the state of the @code{$ZI} special variable: @table @asis @item @code{$ZI} evaluates @emph{true} @@ -5061,7 +5855,7 @@ Raised when you attempt to use multiple Raised when attempts are made to set @code{$ECODE} to an invalid error code value. Obsolete and replaced by standard error code @code{M101}. @item @code{ZASSERT} - @emph{programmer assertion failed} -Raised when an @code{ASSERT} expression's result is not true. +Raised when an @code{ZASSERT} expression's result is not true. @item @code{ZUSERERR} - @emph{user-defined error} Raised when program code calls @code{THROW} with an error code argument for which the first character is @code{U}, or when @code{$ECODE} is set to an error code for which the first character is @code{U}. @@ -5071,10 +5865,10 @@ Custom error messages for @code{ZUSERERR For example: @example -USER> S ^$JOB($JOB,"USER_ERRORS","UBLACKHOLE")="black hole encountered" +DEFAULT.USER> S ^$JOB($JOB,"USER_ERRORS","UBLACKHOLE")="black hole encountered" -USER> THROW UBLACKHOLE +DEFAULT.USER> THROW UBLACKHOLE >> Error UBLACKHOLE: black hole encountered in SYSTEM::^%SYSINIT [$STACK = 0] @@ -5246,9 +6040,6 @@ Raised when an attempt is made to use a @end table -@node Debugging -@chapter Debugging -@cindex debugging @node System Configuration @chapter System Configuration @@ -5257,56 +6048,115 @@ Raised when an attempt is made to use a @section Installing FreeM @cindex installation -@section Build Configuration -@cindex build configuration - -When configuring FreeM with the supplied @code{configure} script, there are some FreeM-specific options that may be used to compile in optional features, or exclude default ones: +@subsection Installation Methods +FreeM allows the following installation methods: @table @asis +@item Binary Repository +For recent versions of the Ubuntu and Debian distributions of GNU/Linux, we provide package repositories from which FreeM may easily be installed. See the @emph{FreeM Wiki} for more information, and @emph{https://packages.coherent-logic.com} for instructions. -@item @code{--enable-mwapigtk} (EXPERIMENTAL) -Enables experimental support for the M Windowing API using the GTK3 libraries. Requires that you have GTK 3 libraries, their headers, and their dependencies installed on your system. +If available, this is the simplest method of installing FreeM. +@item Binary Packages +We provide binary packages of FreeM for @emph{dpkg} and @emph{rpm}-based distributions of GNU/Linux, and @emph{pkgadd} packages for Solaris 8-10. If you cannot use repositories, this is the easiest option. + +See @emph{https://freem.coherent-logic.com/binaries.cfm} for downloads and instructions. +@item Source Tarball +If you prefer installing from source, we recommend that you download the latest @emph{.tar.gz} file from @emph{https://freem.coherent-logic.com/downloads.cfm}, and follow these steps: + +@example +$ gunzip freem-@emph{}.tar.gz +$ tar xf freem-@emph{}.tar +$ cd freem +$ ./configure # see the Build Configuration section for optional flags +$ make +$ sudo make install +@end example -Please consult your operating system's documentation for the correct commands to install the required libraries. +Once this process has been completed, you may proceed to @emph{Initial Configuration}. -@emph{Example} +Installation from source archive is the most challenging but flexible supported option for advanced users. +@item CVS Repository +If you wish to try the bleeding-edge development version of FreeM, you may do so by following these steps: -@example -$ ./configure --enable-mwapigtk +@verbatim +$ cvs -d :pserver:anonymous@cvs.coherent-logic.com:/home/cvsroot co freem +$ cd freem +$ ./autogen.sh +$ ./configure # see the Build Configuration section for optional flags $ make $ sudo make install -@end example +@end verbatim + +Once this process has been completed, you may proceed to @emph{Initial Configuration}. + +This installation method is by far the most complicated, and is intended only for those who wish to contribute to FreeM development. It is not intended for end users, and no technical support will be provided. + +See the @emph{Contributor Guide} on the @emph{FreeM Wiki} for more information. +@end table +@subsection Build Configuration +@cindex build configuration -@item @code{--enable-berkeleydb} (EXPERIMENTAL) -Enables experimental support for using the BerkeleyDB database as a global handler for FreeM global namespaces. Requires that you have the @code{libdb} library, headers, and dependencies installed on your system. +When configuring FreeM with the supplied @code{configure} script, there are some FreeM-specific options that may be used to compile in optional features, or exclude default ones: + +@table @asis + +@item @code{--enable-mwapi} (EXPERIMENTAL) +Enables experimental support for the M Windowing API (ANSI @emph{X11.6-1995}) using the OSF/Motif widget toolkit. Requires that you have the @code{X11}, @code{Xt}, @code{ICE}, and @code{Xm} libraries, as well as all of their C header files. Please consult your operating system's documentation for the correct commands to install the required libraries. @emph{Example} @example -$ ./configure --enable-berkeleydb +$ ./configure --enable-mwapi $ make $ sudo make install @end example +@item @code{--enable-newglobals} (EXPERIMENTAL) +Enables a new and modernized global handler. This global handler has a number of known bugs, and thus should be used with caution. -@item @code{--without-readline} -Builds FreeM without GNU @code{readline} support, even if @code{readline} is installed on your system. +Note that global files created in the default global handler are incompatible with the new global handler, and vice-versa. You will need to back up and remove all globals in your environments when switching global handlers. -Please note that building FreeM without GNU @code{readline} will also exclude REPL functionality and all direct-mode utility commands, i.e. @code{events}, @code{tdump}, @code{shmstat}, and @code{shmpages}. @emph{Example} @example -$ ./configure --without-readline +$ ./configure --enable-newglobals $ make $ sudo make install @end example - @end table +@subsection Initial Configuration +Once FreeM is installed, you will need to configure it: + +@enumerate +@item Create a user and group, each named @emph{freem}, under which FreeM will run +@item Add any user accounts that will need to run FreeM to the @emph{freem} group +@item Have all users added in step 2 sign out and sign in for the new group membership to take effect +@item Run @code{fmadm configure} with superuser privileges to create the @code{DEFAULT} environment with @code{SYSTEM} and @code{USER} namespaces and default after-image journal settings, and populate the bundled vendor routines +@item Run @code{fmadm start environment} with superuser privileges to start the @code{DEFAULT} environment +@item Make sure the environment is ready by running @code{fmadm status environment} with superuser privileges +@end enumerate + +@subsubsection Creating Additional Environments +To create additional environments, do the following steps: + +@enumerate +@item Create a new user and group for the environment @emph{(optional)} +@item Run @code{fmadm configure -e=@emph{} -u=@emph{} -g=@emph{} [-E=@emph{true|false}]} @emph{(the @code{-E} flag enables or disables the environment)} +@item Run @code{fmadm start environment -e=@emph{}} to start the environment +@item Run @code{fmadm status environment} to make sure the environment is healthy +@end enumerate + +@subsubsection Additional Customization + +See the FreeM @emph{environment catalog} at @code{@emph{$PREFIX}/etc/freem/env.conf}, and the @emph{fmadm}(1) @code{man} page for more information. + +@emph{$PREFIX} represents the root location of your FreeM installation. This can be @code{/usr/local}, @code{/}, or others, depending on how FreeM was built and installed. + @node Accessing FreeM from C Programs @chapter Accessing FreeM from C Programs @@ -5735,8 +6585,8 @@ int main(int argc, char **argv, char **e @cindex fmadm The @code{fmadm} utility is the preferred method of managing a FreeM installation, and will eventually replace all of the existing utilities. -Unlike the existing, legacy utilities, @code{fmadm} presents a consistent, simple interface for all FreeM management tasks, and is namespace-aware. -This appendix will document each @code{fmadm} facility as it is implemented, until all of the legacy utilities have been replaced. +In support of FreeM operators, @code{fmadm} presents a consistent, simple interface for all FreeM management tasks, and is namespace-aware. +This appendix will document each @code{fmadm} facility as it is implemented. The @code{fmadm} utility's functions all follow the below, consistent syntax: @@ -5798,11 +6648,6 @@ The FreeM @code{LOCK} table. Supported actions are @code{list} and @code{remove}. -@item zallocate -The FreeM @code{ZALLOCATE} table. - -No actions yet implemented. - @item journal FreeM after-image journaling. @@ -5835,43 +6680,6 @@ Supported actions are @code{list} and @c @end table -@node FreeM Legacy Utilities -@appendix FreeM Legacy Utilities -@cindex utilities, legacy - -@section Global Compactor (gcompact) -@cindex utilities, legacy, gcompact - -Compacts the specified global in place. - -@emph{Syntax} - -@example -gcompact @emph{/path/to/global/file} -@end example - -@section Block Examiner (gfix) -@cindex utilities, gfix - -The @emph{gfix} interactive utility program permits navigation of the B-tree structure of the specified global a block at a time. - -@emph{Syntax} - -@example -gfix @emph{} -@end example - -@section Global Repair Tool (grestore) -@cindex utilities, legacy, grestore - -This utility will fix problems with the specified global. - -@emph{Syntax} - -@example -grestore @emph{} -@end example - @node FreeM VIEW Commands and Functions @appendix FreeM VIEW Commands and Functions @@ -6015,37 +6823,40 @@ WRITE $VIEW(31),! @section Module Headers @cindex coding standards, module headers -Module headers should adhere to the following format: +Module headers should adhere to the following format (where @code{Dollar} should be replaced with a dollar sign): @verbatim /* - * * - * * * - * * * - * *************** - * * * * * - * * MUMPS * - * * * * * - * *************** - * * * - * * * - * * - * - * mlib.h + * DollarIdDollar * Function prototypes, structs, and macros for FreeM * binding library * * - * Author: Serena Willis + * Author: Serena Willis * Copyright (C) 1998 MUG Deutschland - * Copyright (C) 2020 Coherent Logic Development LLC + * Copyright (C) Coherent Logic Development LLC + * + * This file is part of FreeM. + * + * FreeM is free software: you can redistribute it and/or modify + * it under the terms of the GNU Affero Public License as published by + * the Free Software Foundation, either version 3 of the License, or + * (at your option) any later version. + * + * FreeM is distributed in the hope that it will be useful, + * but WITHOUT ANY WARRANTY; without even the implied warranty of + * MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the + * GNU Affero Public License for more details. + * + * You should have received a copy of the GNU Affero Public License + * along with FreeM. If not, see . + * + * DollarLogDollar * - * Last modified: 29 February 2020 - * + * SPDX-FileCopyrightText: (C) 2025 Coherent Logic Development LLC + * SPDX-License-Identifier: AGPL-3.0-or-later **/ @end verbatim -@cindex ha-Ashkenaz, Shalom -The Star of David in module headers is a convention started by Shalom ha-Ashkenaz, the unidentified original author of FreeMUMPS/FreeM. We will continue to employ it in honor of his most valuable contribution to the M community. @section Variable Naming @cindex coding standards, variable naming