]> code.delx.au - gnu-emacs/blob - doc/lispref/internals.texi
; Merge from origin/emacs-25
[gnu-emacs] / doc / lispref / internals.texi
1 @c -*-texinfo-*-
2 @c This is part of the GNU Emacs Lisp Reference Manual.
3 @c Copyright (C) 1990-1993, 1998-1999, 2001-2016 Free Software
4 @c Foundation, Inc.
5 @c See the file elisp.texi for copying conditions.
6 @node GNU Emacs Internals
7 @appendix GNU Emacs Internals
8
9 This chapter describes how the runnable Emacs executable is dumped with
10 the preloaded Lisp libraries in it, how storage is allocated, and some
11 internal aspects of GNU Emacs that may be of interest to C programmers.
12
13 @menu
14 * Building Emacs:: How the dumped Emacs is made.
15 * Pure Storage:: Kludge to make preloaded Lisp functions shareable.
16 * Garbage Collection:: Reclaiming space for Lisp objects no longer used.
17 * Stack-allocated Objects:: Temporary conses and strings on C stack.
18 * Memory Usage:: Info about total size of Lisp objects made so far.
19 * C Dialect:: What C variant Emacs is written in.
20 * Writing Emacs Primitives:: Writing C code for Emacs.
21 * Object Internals:: Data formats of buffers, windows, processes.
22 * C Integer Types:: How C integer types are used inside Emacs.
23 @end menu
24
25 @node Building Emacs
26 @section Building Emacs
27 @cindex building Emacs
28 @pindex temacs
29
30 This section explains the steps involved in building the Emacs
31 executable. You don't have to know this material to build and install
32 Emacs, since the makefiles do all these things automatically. This
33 information is pertinent to Emacs developers.
34
35 Building Emacs requires GNU Make version 3.81 or later.
36
37 Compilation of the C source files in the @file{src} directory
38 produces an executable file called @file{temacs}, also called a
39 @dfn{bare impure Emacs}. It contains the Emacs Lisp interpreter and
40 I/O routines, but not the editing commands.
41
42 @cindex @file{loadup.el}
43 The command @w{@command{temacs -l loadup}} would run @file{temacs}
44 and direct it to load @file{loadup.el}. The @code{loadup} library
45 loads additional Lisp libraries, which set up the normal Emacs editing
46 environment. After this step, the Emacs executable is no longer
47 @dfn{bare}.
48
49 @cindex dumping Emacs
50 Because it takes some time to load the standard Lisp files, the
51 @file{temacs} executable usually isn't run directly by users.
52 Instead, as one of the last steps of building Emacs, the command
53 @samp{temacs -batch -l loadup dump} is run. The special @samp{dump}
54 argument causes @command{temacs} to dump out an executable program,
55 called @file{emacs}, which has all the standard Lisp files preloaded.
56 (The @samp{-batch} argument prevents @file{temacs} from trying to
57 initialize any of its data on the terminal, so that the tables of
58 terminal information are empty in the dumped Emacs.)
59
60 @cindex preloaded Lisp files
61 @vindex preloaded-file-list
62 The dumped @file{emacs} executable (also called a @dfn{pure} Emacs)
63 is the one which is installed. The variable
64 @code{preloaded-file-list} stores a list of the Lisp files preloaded
65 into the dumped Emacs. If you port Emacs to a new operating system,
66 and are not able to implement dumping, then Emacs must load
67 @file{loadup.el} each time it starts.
68
69 @cindex build details
70 @cindex deterministic build
71 @cindex @option{--disable-build-details} option to @command{configure}
72 By default the dumped @file{emacs} executable records details such
73 as the build time and host name. Use the
74 @option{--disable-build-details} option of @command{configure} to
75 suppress these details, so that building and installing Emacs twice
76 from the same sources is more likely to result in identical copies of
77 Emacs.
78
79 @cindex @file{site-load.el}
80 You can specify additional files to preload by writing a library named
81 @file{site-load.el} that loads them. You may need to rebuild Emacs
82 with an added definition
83
84 @example
85 #define SITELOAD_PURESIZE_EXTRA @var{n}
86 @end example
87
88 @noindent
89 to make @var{n} added bytes of pure space to hold the additional files;
90 see @file{src/puresize.h}.
91 (Try adding increments of 20000 until it is big enough.) However, the
92 advantage of preloading additional files decreases as machines get
93 faster. On modern machines, it is usually not advisable.
94
95 After @file{loadup.el} reads @file{site-load.el}, it finds the
96 documentation strings for primitive and preloaded functions (and
97 variables) in the file @file{etc/DOC} where they are stored, by
98 calling @code{Snarf-documentation} (@pxref{Definition of
99 Snarf-documentation,, Accessing Documentation}).
100
101 @cindex @file{site-init.el}
102 @cindex preloading additional functions and variables
103 You can specify other Lisp expressions to execute just before dumping
104 by putting them in a library named @file{site-init.el}. This file is
105 executed after the documentation strings are found.
106
107 If you want to preload function or variable definitions, there are
108 three ways you can do this and make their documentation strings
109 accessible when you subsequently run Emacs:
110
111 @itemize @bullet
112 @item
113 Arrange to scan these files when producing the @file{etc/DOC} file,
114 and load them with @file{site-load.el}.
115
116 @item
117 Load the files with @file{site-init.el}, then copy the files into the
118 installation directory for Lisp files when you install Emacs.
119
120 @item
121 Specify a @code{nil} value for @code{byte-compile-dynamic-docstrings}
122 as a local variable in each of these files, and load them with either
123 @file{site-load.el} or @file{site-init.el}. (This method has the
124 drawback that the documentation strings take up space in Emacs all the
125 time.)
126 @end itemize
127
128 @cindex change @code{load-path} at configure time
129 @cindex @option{--enable-locallisppath} option to @command{configure}
130 It is not advisable to put anything in @file{site-load.el} or
131 @file{site-init.el} that would alter any of the features that users
132 expect in an ordinary unmodified Emacs. If you feel you must override
133 normal features for your site, do it with @file{default.el}, so that
134 users can override your changes if they wish. @xref{Startup Summary}.
135 Note that if either @file{site-load.el} or @file{site-init.el} changes
136 @code{load-path}, the changes will be lost after dumping.
137 @xref{Library Search}. To make a permanent change to
138 @code{load-path}, use the @option{--enable-locallisppath} option
139 of @command{configure}.
140
141 In a package that can be preloaded, it is sometimes necessary (or
142 useful) to delay certain evaluations until Emacs subsequently starts
143 up. The vast majority of such cases relate to the values of
144 customizable variables. For example, @code{tutorial-directory} is a
145 variable defined in @file{startup.el}, which is preloaded. The default
146 value is set based on @code{data-directory}. The variable needs to
147 access the value of @code{data-directory} when Emacs starts, not when
148 it is dumped, because the Emacs executable has probably been installed
149 in a different location since it was dumped.
150
151 @defun custom-initialize-delay symbol value
152 This function delays the initialization of @var{symbol} to the next
153 Emacs start. You normally use this function by specifying it as the
154 @code{:initialize} property of a customizable variable. (The argument
155 @var{value} is unused, and is provided only for compatibility with the
156 form Custom expects.)
157 @end defun
158
159 In the unlikely event that you need a more general functionality than
160 @code{custom-initialize-delay} provides, you can use
161 @code{before-init-hook} (@pxref{Startup Summary}).
162
163 @defun dump-emacs to-file from-file
164 @cindex unexec
165 This function dumps the current state of Emacs into an executable file
166 @var{to-file}. It takes symbols from @var{from-file} (this is normally
167 the executable file @file{temacs}).
168
169 If you want to use this function in an Emacs that was already dumped,
170 you must run Emacs with @samp{-batch}.
171 @end defun
172
173 @node Pure Storage
174 @section Pure Storage
175 @cindex pure storage
176
177 Emacs Lisp uses two kinds of storage for user-created Lisp objects:
178 @dfn{normal storage} and @dfn{pure storage}. Normal storage is where
179 all the new data created during an Emacs session are kept
180 (@pxref{Garbage Collection}). Pure storage is used for certain data
181 in the preloaded standard Lisp files---data that should never change
182 during actual use of Emacs.
183
184 Pure storage is allocated only while @command{temacs} is loading the
185 standard preloaded Lisp libraries. In the file @file{emacs}, it is
186 marked as read-only (on operating systems that permit this), so that
187 the memory space can be shared by all the Emacs jobs running on the
188 machine at once. Pure storage is not expandable; a fixed amount is
189 allocated when Emacs is compiled, and if that is not sufficient for
190 the preloaded libraries, @file{temacs} allocates dynamic memory for
191 the part that didn't fit. The resulting image will work, but garbage
192 collection (@pxref{Garbage Collection}) is disabled in this situation,
193 causing a memory leak. Such an overflow normally won't happen unless
194 you try to preload additional libraries or add features to the
195 standard ones. Emacs will display a warning about the overflow when
196 it starts. If this happens, you should increase the compilation
197 parameter @code{SYSTEM_PURESIZE_EXTRA} in the file
198 @file{src/puresize.h} and rebuild Emacs.
199
200 @defun purecopy object
201 This function makes a copy in pure storage of @var{object}, and returns
202 it. It copies a string by simply making a new string with the same
203 characters, but without text properties, in pure storage. It
204 recursively copies the contents of vectors and cons cells. It does
205 not make copies of other objects such as symbols, but just returns
206 them unchanged. It signals an error if asked to copy markers.
207
208 This function is a no-op except while Emacs is being built and dumped;
209 it is usually called only in preloaded Lisp files.
210 @end defun
211
212 @defvar pure-bytes-used
213 The value of this variable is the number of bytes of pure storage
214 allocated so far. Typically, in a dumped Emacs, this number is very
215 close to the total amount of pure storage available---if it were not,
216 we would preallocate less.
217 @end defvar
218
219 @defvar purify-flag
220 This variable determines whether @code{defun} should make a copy of the
221 function definition in pure storage. If it is non-@code{nil}, then the
222 function definition is copied into pure storage.
223
224 This flag is @code{t} while loading all of the basic functions for
225 building Emacs initially (allowing those functions to be shareable and
226 non-collectible). Dumping Emacs as an executable always writes
227 @code{nil} in this variable, regardless of the value it actually has
228 before and after dumping.
229
230 You should not change this flag in a running Emacs.
231 @end defvar
232
233 @node Garbage Collection
234 @section Garbage Collection
235
236 @cindex memory allocation
237 When a program creates a list or the user defines a new function
238 (such as by loading a library), that data is placed in normal storage.
239 If normal storage runs low, then Emacs asks the operating system to
240 allocate more memory. Different types of Lisp objects, such as
241 symbols, cons cells, small vectors, markers, etc., are segregated in
242 distinct blocks in memory. (Large vectors, long strings, buffers and
243 certain other editing types, which are fairly large, are allocated in
244 individual blocks, one per object; small strings are packed into blocks
245 of 8k bytes, and small vectors are packed into blocks of 4k bytes).
246
247 @cindex vector-like objects, storage
248 @cindex storage of vector-like Lisp objects
249 Beyond the basic vector, a lot of objects like window, buffer, and
250 frame are managed as if they were vectors. The corresponding C data
251 structures include the @code{struct vectorlike_header} field whose
252 @code{size} member contains the subtype enumerated by @code{enum pvec_type}
253 and an information about how many @code{Lisp_Object} fields this structure
254 contains and what the size of the rest data is. This information is
255 needed to calculate the memory footprint of an object, and used
256 by the vector allocation code while iterating over the vector blocks.
257
258 @cindex garbage collection
259 It is quite common to use some storage for a while, then release it
260 by (for example) killing a buffer or deleting the last pointer to an
261 object. Emacs provides a @dfn{garbage collector} to reclaim this
262 abandoned storage. The garbage collector operates by finding and
263 marking all Lisp objects that are still accessible to Lisp programs.
264 To begin with, it assumes all the symbols, their values and associated
265 function definitions, and any data presently on the stack, are
266 accessible. Any objects that can be reached indirectly through other
267 accessible objects are also accessible.
268
269 When marking is finished, all objects still unmarked are garbage. No
270 matter what the Lisp program or the user does, it is impossible to refer
271 to them, since there is no longer a way to reach them. Their space
272 might as well be reused, since no one will miss them. The second
273 (sweep) phase of the garbage collector arranges to reuse them.
274
275 @c ??? Maybe add something describing weak hash tables here?
276
277 @cindex free list
278 The sweep phase puts unused cons cells onto a @dfn{free list}
279 for future allocation; likewise for symbols and markers. It compacts
280 the accessible strings so they occupy fewer 8k blocks; then it frees the
281 other 8k blocks. Unreachable vectors from vector blocks are coalesced
282 to create largest possible free areas; if a free area spans a complete
283 4k block, that block is freed. Otherwise, the free area is recorded
284 in a free list array, where each entry corresponds to a free list
285 of areas of the same size. Large vectors, buffers, and other large
286 objects are allocated and freed individually.
287
288 @cindex CL note---allocate more storage
289 @quotation
290 @b{Common Lisp note:} Unlike other Lisps, GNU Emacs Lisp does not
291 call the garbage collector when the free list is empty. Instead, it
292 simply requests the operating system to allocate more storage, and
293 processing continues until @code{gc-cons-threshold} bytes have been
294 used.
295
296 This means that you can make sure that the garbage collector will not
297 run during a certain portion of a Lisp program by calling the garbage
298 collector explicitly just before it (provided that portion of the
299 program does not use so much space as to force a second garbage
300 collection).
301 @end quotation
302
303 @deffn Command garbage-collect
304 This command runs a garbage collection, and returns information on
305 the amount of space in use. (Garbage collection can also occur
306 spontaneously if you use more than @code{gc-cons-threshold} bytes of
307 Lisp data since the previous garbage collection.)
308
309 @code{garbage-collect} returns a list with information on amount of space in
310 use, where each entry has the form @samp{(@var{name} @var{size} @var{used})}
311 or @samp{(@var{name} @var{size} @var{used} @var{free})}. In the entry,
312 @var{name} is a symbol describing the kind of objects this entry represents,
313 @var{size} is the number of bytes used by each one, @var{used} is the number
314 of those objects that were found live in the heap, and optional @var{free} is
315 the number of those objects that are not live but that Emacs keeps around for
316 future allocations. So an overall result is:
317
318 @example
319 ((@code{conses} @var{cons-size} @var{used-conses} @var{free-conses})
320 (@code{symbols} @var{symbol-size} @var{used-symbols} @var{free-symbols})
321 (@code{miscs} @var{misc-size} @var{used-miscs} @var{free-miscs})
322 (@code{strings} @var{string-size} @var{used-strings} @var{free-strings})
323 (@code{string-bytes} @var{byte-size} @var{used-bytes})
324 (@code{vectors} @var{vector-size} @var{used-vectors})
325 (@code{vector-slots} @var{slot-size} @var{used-slots} @var{free-slots})
326 (@code{floats} @var{float-size} @var{used-floats} @var{free-floats})
327 (@code{intervals} @var{interval-size} @var{used-intervals} @var{free-intervals})
328 (@code{buffers} @var{buffer-size} @var{used-buffers})
329 (@code{heap} @var{unit-size} @var{total-size} @var{free-size}))
330 @end example
331
332 Here is an example:
333
334 @example
335 (garbage-collect)
336 @result{} ((conses 16 49126 8058) (symbols 48 14607 0)
337 (miscs 40 34 56) (strings 32 2942 2607)
338 (string-bytes 1 78607) (vectors 16 7247)
339 (vector-slots 8 341609 29474) (floats 8 71 102)
340 (intervals 56 27 26) (buffers 944 8)
341 (heap 1024 11715 2678))
342 @end example
343
344 Below is a table explaining each element. Note that last @code{heap} entry
345 is optional and present only if an underlying @code{malloc} implementation
346 provides @code{mallinfo} function.
347
348 @table @var
349 @item cons-size
350 Internal size of a cons cell, i.e., @code{sizeof (struct Lisp_Cons)}.
351
352 @item used-conses
353 The number of cons cells in use.
354
355 @item free-conses
356 The number of cons cells for which space has been obtained from
357 the operating system, but that are not currently being used.
358
359 @item symbol-size
360 Internal size of a symbol, i.e., @code{sizeof (struct Lisp_Symbol)}.
361
362 @item used-symbols
363 The number of symbols in use.
364
365 @item free-symbols
366 The number of symbols for which space has been obtained from
367 the operating system, but that are not currently being used.
368
369 @item misc-size
370 Internal size of a miscellaneous entity, i.e.,
371 @code{sizeof (union Lisp_Misc)}, which is a size of the
372 largest type enumerated in @code{enum Lisp_Misc_Type}.
373
374 @item used-miscs
375 The number of miscellaneous objects in use. These include markers
376 and overlays, plus certain objects not visible to users.
377
378 @item free-miscs
379 The number of miscellaneous objects for which space has been obtained
380 from the operating system, but that are not currently being used.
381
382 @item string-size
383 Internal size of a string header, i.e., @code{sizeof (struct Lisp_String)}.
384
385 @item used-strings
386 The number of string headers in use.
387
388 @item free-strings
389 The number of string headers for which space has been obtained
390 from the operating system, but that are not currently being used.
391
392 @item byte-size
393 This is used for convenience and equals to @code{sizeof (char)}.
394
395 @item used-bytes
396 The total size of all string data in bytes.
397
398 @item vector-size
399 Internal size of a vector header, i.e., @code{sizeof (struct Lisp_Vector)}.
400
401 @item used-vectors
402 The number of vector headers allocated from the vector blocks.
403
404 @item slot-size
405 Internal size of a vector slot, always equal to @code{sizeof (Lisp_Object)}.
406
407 @item used-slots
408 The number of slots in all used vectors.
409
410 @item free-slots
411 The number of free slots in all vector blocks.
412
413 @item float-size
414 Internal size of a float object, i.e., @code{sizeof (struct Lisp_Float)}.
415 (Do not confuse it with the native platform @code{float} or @code{double}.)
416
417 @item used-floats
418 The number of floats in use.
419
420 @item free-floats
421 The number of floats for which space has been obtained from
422 the operating system, but that are not currently being used.
423
424 @item interval-size
425 Internal size of an interval object, i.e., @code{sizeof (struct interval)}.
426
427 @item used-intervals
428 The number of intervals in use.
429
430 @item free-intervals
431 The number of intervals for which space has been obtained from
432 the operating system, but that are not currently being used.
433
434 @item buffer-size
435 Internal size of a buffer, i.e., @code{sizeof (struct buffer)}.
436 (Do not confuse with the value returned by @code{buffer-size} function.)
437
438 @item used-buffers
439 The number of buffer objects in use. This includes killed buffers
440 invisible to users, i.e., all buffers in @code{all_buffers} list.
441
442 @item unit-size
443 The unit of heap space measurement, always equal to 1024 bytes.
444
445 @item total-size
446 Total heap size, in @var{unit-size} units.
447
448 @item free-size
449 Heap space which is not currently used, in @var{unit-size} units.
450 @end table
451
452 If there was overflow in pure space (@pxref{Pure Storage}),
453 @code{garbage-collect} returns @code{nil}, because a real garbage
454 collection cannot be done.
455 @end deffn
456
457 @defopt garbage-collection-messages
458 If this variable is non-@code{nil}, Emacs displays a message at the
459 beginning and end of garbage collection. The default value is
460 @code{nil}.
461 @end defopt
462
463 @defvar post-gc-hook
464 This is a normal hook that is run at the end of garbage collection.
465 Garbage collection is inhibited while the hook functions run, so be
466 careful writing them.
467 @end defvar
468
469 @defopt gc-cons-threshold
470 The value of this variable is the number of bytes of storage that must
471 be allocated for Lisp objects after one garbage collection in order to
472 trigger another garbage collection. You can use the result returned by
473 @code{garbage-collect} to get an information about size of the particular
474 object type; space allocated to the contents of buffers does not count.
475 Note that the subsequent garbage collection does not happen immediately
476 when the threshold is exhausted, but only the next time the Lisp interpreter
477 is called.
478
479 The initial threshold value is @code{GC_DEFAULT_THRESHOLD}, defined in
480 @file{alloc.c}. Since it's defined in @code{word_size} units, the value
481 is 400,000 for the default 32-bit configuration and 800,000 for the 64-bit
482 one. If you specify a larger value, garbage collection will happen less
483 often. This reduces the amount of time spent garbage collecting, but
484 increases total memory use. You may want to do this when running a program
485 that creates lots of Lisp data.
486
487 You can make collections more frequent by specifying a smaller value, down
488 to 1/10th of @code{GC_DEFAULT_THRESHOLD}. A value less than this minimum
489 will remain in effect only until the subsequent garbage collection, at which
490 time @code{garbage-collect} will set the threshold back to the minimum.
491 @end defopt
492
493 @defopt gc-cons-percentage
494 The value of this variable specifies the amount of consing before a
495 garbage collection occurs, as a fraction of the current heap size.
496 This criterion and @code{gc-cons-threshold} apply in parallel, and
497 garbage collection occurs only when both criteria are satisfied.
498
499 As the heap size increases, the time to perform a garbage collection
500 increases. Thus, it can be desirable to do them less frequently in
501 proportion.
502 @end defopt
503
504 The value returned by @code{garbage-collect} describes the amount of
505 memory used by Lisp data, broken down by data type. By contrast, the
506 function @code{memory-limit} provides information on the total amount of
507 memory Emacs is currently using.
508
509 @defun memory-limit
510 This function returns the address of the last byte Emacs has allocated,
511 divided by 1024. We divide the value by 1024 to make sure it fits in a
512 Lisp integer.
513
514 You can use this to get a general idea of how your actions affect the
515 memory usage.
516 @end defun
517
518 @defvar memory-full
519 This variable is @code{t} if Emacs is nearly out of memory for Lisp
520 objects, and @code{nil} otherwise.
521 @end defvar
522
523 @defun memory-use-counts
524 This returns a list of numbers that count the number of objects
525 created in this Emacs session. Each of these counters increments for
526 a certain kind of object. See the documentation string for details.
527 @end defun
528
529 @defun memory-info
530 This functions returns an amount of total system memory and how much
531 of it is free. On an unsupported system, the value may be @code{nil}.
532 @end defun
533
534 @defvar gcs-done
535 This variable contains the total number of garbage collections
536 done so far in this Emacs session.
537 @end defvar
538
539 @defvar gc-elapsed
540 This variable contains the total number of seconds of elapsed time
541 during garbage collection so far in this Emacs session, as a
542 floating-point number.
543 @end defvar
544
545 @node Stack-allocated Objects
546 @section Stack-allocated Objects
547
548 @cindex stack allocated Lisp objects
549 @cindex Lisp objects, stack-allocated
550 The garbage collector described above is used to manage data visible
551 from Lisp programs, as well as most of the data internally used by the
552 Lisp interpreter. Sometimes it may be useful to allocate temporary
553 internal objects using the C stack of the interpreter. This can help
554 performance, as stack allocation is typically faster than using heap
555 memory to allocate and the garbage collector to free. The downside is
556 that using such objects after they are freed results in undefined
557 behavior, so uses should be well thought out and carefully debugged by
558 using the @code{GC_CHECK_MARKED_OBJECTS} feature (see
559 @file{src/alloc.c}). In particular, stack-allocated objects should
560 never be made visible to user Lisp code.
561
562 Currently, cons cells and strings can be allocated this way. This
563 is implemented by C macros like @code{AUTO_CONS} and
564 @code{AUTO_STRING} that define a named @code{Lisp_Object} with block
565 lifetime. These objects are not freed by the garbage collector;
566 instead, they have automatic storage duration, i.e., they are
567 allocated like local variables and are automatically freed at the end
568 of execution of the C block that defined the object.
569
570 For performance reasons, stack-allocated strings are limited to
571 @acronym{ASCII} characters, and many of these strings are immutable,
572 i.e., calling @code{ASET} on them produces undefined behavior.
573
574 @node Memory Usage
575 @section Memory Usage
576 @cindex memory usage
577
578 These functions and variables give information about the total amount
579 of memory allocation that Emacs has done, broken down by data type.
580 Note the difference between these and the values returned by
581 @code{garbage-collect}; those count objects that currently exist, but
582 these count the number or size of all allocations, including those for
583 objects that have since been freed.
584
585 @defvar cons-cells-consed
586 The total number of cons cells that have been allocated so far
587 in this Emacs session.
588 @end defvar
589
590 @defvar floats-consed
591 The total number of floats that have been allocated so far
592 in this Emacs session.
593 @end defvar
594
595 @defvar vector-cells-consed
596 The total number of vector cells that have been allocated so far
597 in this Emacs session.
598 @end defvar
599
600 @defvar symbols-consed
601 The total number of symbols that have been allocated so far
602 in this Emacs session.
603 @end defvar
604
605 @defvar string-chars-consed
606 The total number of string characters that have been allocated so far
607 in this session.
608 @end defvar
609
610 @defvar misc-objects-consed
611 The total number of miscellaneous objects that have been allocated so
612 far in this session. These include markers and overlays, plus
613 certain objects not visible to users.
614 @end defvar
615
616 @defvar intervals-consed
617 The total number of intervals that have been allocated so far
618 in this Emacs session.
619 @end defvar
620
621 @defvar strings-consed
622 The total number of strings that have been allocated so far in this
623 Emacs session.
624 @end defvar
625
626 @node C Dialect
627 @section C Dialect
628 @cindex C programming language
629
630 The C part of Emacs is portable to C99 or later: C11-specific features such
631 as @samp{<stdalign.h>} and @samp{_Noreturn} are not used without a check,
632 typically at configuration time, and the Emacs build procedure
633 provides a substitute implementation if necessary. Some C11 features,
634 such as anonymous structures and unions, are too difficult to emulate,
635 so they are avoided entirely.
636
637 At some point in the future the base C dialect will no doubt change to C11.
638
639 @node Writing Emacs Primitives
640 @section Writing Emacs Primitives
641 @cindex primitive function internals
642 @cindex writing Emacs primitives
643
644 Lisp primitives are Lisp functions implemented in C@. The details of
645 interfacing the C function so that Lisp can call it are handled by a few
646 C macros. The only way to really understand how to write new C code is
647 to read the source, but we can explain some things here.
648
649 An example of a special form is the definition of @code{or}, from
650 @file{eval.c}. (An ordinary function would have the same general
651 appearance.)
652
653 @smallexample
654 @group
655 DEFUN ("or", For, Sor, 0, UNEVALLED, 0,
656 doc: /* Eval args until one of them yields non-nil, then return
657 that value.
658 The remaining args are not evalled at all.
659 If all args return nil, return nil.
660 @end group
661 @group
662 usage: (or CONDITIONS...) */)
663 (Lisp_Object args)
664 @{
665 Lisp_Object val = Qnil;
666 @end group
667
668 @group
669 while (CONSP (args))
670 @{
671 val = eval_sub (XCAR (args));
672 if (!NILP (val))
673 break;
674 args = XCDR (args);
675 QUIT;
676 @}
677 @end group
678
679 @group
680 return val;
681 @}
682 @end group
683 @end smallexample
684
685 @cindex @code{DEFUN}, C macro to define Lisp primitives
686 Let's start with a precise explanation of the arguments to the
687 @code{DEFUN} macro. Here is a template for them:
688
689 @example
690 DEFUN (@var{lname}, @var{fname}, @var{sname}, @var{min}, @var{max}, @var{interactive}, @var{doc})
691 @end example
692
693 @table @var
694 @item lname
695 This is the name of the Lisp symbol to define as the function name; in
696 the example above, it is @code{or}.
697
698 @item fname
699 This is the C function name for this function. This is the name that
700 is used in C code for calling the function. The name is, by
701 convention, @samp{F} prepended to the Lisp name, with all dashes
702 (@samp{-}) in the Lisp name changed to underscores. Thus, to call
703 this function from C code, call @code{For}.
704
705 @item sname
706 This is a C variable name to use for a structure that holds the data for
707 the subr object that represents the function in Lisp. This structure
708 conveys the Lisp symbol name to the initialization routine that will
709 create the symbol and store the subr object as its definition. By
710 convention, this name is always @var{fname} with @samp{F} replaced with
711 @samp{S}.
712
713 @item min
714 This is the minimum number of arguments that the function requires. The
715 function @code{or} allows a minimum of zero arguments.
716
717 @item max
718 This is the maximum number of arguments that the function accepts, if
719 there is a fixed maximum. Alternatively, it can be @code{UNEVALLED},
720 indicating a special form that receives unevaluated arguments, or
721 @code{MANY}, indicating an unlimited number of evaluated arguments (the
722 equivalent of @code{&rest}). Both @code{UNEVALLED} and @code{MANY} are
723 macros. If @var{max} is a number, it must be more than @var{min} but
724 less than 8.
725
726 @cindex interactive specification in primitives
727 @item interactive
728 This is an interactive specification, a string such as might be used
729 as the argument of @code{interactive} in a Lisp function. In the case
730 of @code{or}, it is 0 (a null pointer), indicating that @code{or}
731 cannot be called interactively. A value of @code{""} indicates a
732 function that should receive no arguments when called interactively.
733 If the value begins with a @samp{"(}, the string is evaluated as a
734 Lisp form. For example:
735
736 @example
737 @group
738 DEFUN ("foo", Ffoo, Sfoo, 0, UNEVALLED,
739 "(list (read-char-by-name \"Insert character: \")\
740 (prefix-numeric-value current-prefix-arg)\
741 t))",
742 doc: /* @dots{} /*)
743 @end group
744 @end example
745
746 @item doc
747 This is the documentation string. It uses C comment syntax rather
748 than C string syntax because comment syntax requires nothing special
749 to include multiple lines. The @samp{doc:} identifies the comment
750 that follows as the documentation string. The @samp{/*} and @samp{*/}
751 delimiters that begin and end the comment are not part of the
752 documentation string.
753
754 If the last line of the documentation string begins with the keyword
755 @samp{usage:}, the rest of the line is treated as the argument list
756 for documentation purposes. This way, you can use different argument
757 names in the documentation string from the ones used in the C code.
758 @samp{usage:} is required if the function has an unlimited number of
759 arguments.
760
761 All the usual rules for documentation strings in Lisp code
762 (@pxref{Documentation Tips}) apply to C code documentation strings
763 too.
764 @end table
765
766 After the call to the @code{DEFUN} macro, you must write the
767 argument list for the C function, including the types for the
768 arguments. If the primitive accepts a fixed maximum number of Lisp
769 arguments, there must be one C argument for each Lisp argument, and
770 each argument must be of type @code{Lisp_Object}. (Various macros and
771 functions for creating values of type @code{Lisp_Object} are declared
772 in the file @file{lisp.h}.) If the primitive has no upper limit on
773 the number of Lisp arguments, it must have exactly two C arguments:
774 the first is the number of Lisp arguments, and the second is the
775 address of a block containing their values. These have types
776 @code{int} and @w{@code{Lisp_Object *}} respectively. Since
777 @code{Lisp_Object} can hold any Lisp object of any data type, you
778 can determine the actual data type only at run time; so if you want
779 a primitive to accept only a certain type of argument, you must check
780 the type explicitly using a suitable predicate (@pxref{Type Predicates}).
781 @cindex type checking internals
782
783 @cindex garbage collection protection
784 @cindex protect C variables from garbage collection
785 Within the function @code{For} itself, the local variable
786 @code{args} refers to objects controlled by Emacs's stack-marking
787 garbage collector. Although the garbage collector does not reclaim
788 objects reachable from C @code{Lisp_Object} stack variables, it may
789 move non-object components of an object, such as string contents; so
790 functions that access non-object components must take care to refetch
791 their addresses after performing Lisp evaluation. Lisp evaluation can
792 occur via calls to @code{eval_sub} or @code{Feval}, either directly or
793 indirectly.
794
795 @cindex @code{QUIT}, use in Lisp primitives
796 Note the call to the @code{QUIT} macro inside the loop: this macro
797 checks whether the user pressed @kbd{C-g}, and if so, aborts the
798 processing. You should do that in any loop that can potentially
799 require a large number of iterations; in this case, the list of
800 arguments could be very long. This increases Emacs responsiveness and
801 improves user experience.
802
803 You must not use C initializers for static or global variables unless
804 the variables are never written once Emacs is dumped. These variables
805 with initializers are allocated in an area of memory that becomes
806 read-only (on certain operating systems) as a result of dumping Emacs.
807 @xref{Pure Storage}.
808
809 @cindex @code{defsubr}, Lisp symbol for a primitive
810 Defining the C function is not enough to make a Lisp primitive
811 available; you must also create the Lisp symbol for the primitive and
812 store a suitable subr object in its function cell. The code looks like
813 this:
814
815 @example
816 defsubr (&@var{sname});
817 @end example
818
819 @noindent
820 Here @var{sname} is the name you used as the third argument to @code{DEFUN}.
821
822 If you add a new primitive to a file that already has Lisp primitives
823 defined in it, find the function (near the end of the file) named
824 @code{syms_of_@var{something}}, and add the call to @code{defsubr}
825 there. If the file doesn't have this function, or if you create a new
826 file, add to it a @code{syms_of_@var{filename}} (e.g.,
827 @code{syms_of_myfile}). Then find the spot in @file{emacs.c} where all
828 of these functions are called, and add a call to
829 @code{syms_of_@var{filename}} there.
830
831 @anchor{Defining Lisp variables in C}
832 @vindex byte-boolean-vars
833 @cindex defining Lisp variables in C
834 @cindex @code{DEFVAR_INT}, @code{DEFVAR_LISP}, @code{DEFVAR_BOOL}
835 The function @code{syms_of_@var{filename}} is also the place to define
836 any C variables that are to be visible as Lisp variables.
837 @code{DEFVAR_LISP} makes a C variable of type @code{Lisp_Object} visible
838 in Lisp. @code{DEFVAR_INT} makes a C variable of type @code{int}
839 visible in Lisp with a value that is always an integer.
840 @code{DEFVAR_BOOL} makes a C variable of type @code{int} visible in Lisp
841 with a value that is either @code{t} or @code{nil}. Note that variables
842 defined with @code{DEFVAR_BOOL} are automatically added to the list
843 @code{byte-boolean-vars} used by the byte compiler.
844
845 @cindex defining customization variables in C
846 If you want to make a Lisp variables that is defined in C behave
847 like one declared with @code{defcustom}, add an appropriate entry to
848 @file{cus-start.el}.
849
850 @cindex @code{staticpro}, protection from GC
851 If you define a file-scope C variable of type @code{Lisp_Object},
852 you must protect it from garbage-collection by calling @code{staticpro}
853 in @code{syms_of_@var{filename}}, like this:
854
855 @example
856 staticpro (&@var{variable});
857 @end example
858
859 Here is another example function, with more complicated arguments.
860 This comes from the code in @file{window.c}, and it demonstrates the use
861 of macros and functions to manipulate Lisp objects.
862
863 @smallexample
864 @group
865 DEFUN ("coordinates-in-window-p", Fcoordinates_in_window_p,
866 Scoordinates_in_window_p, 2, 2, 0,
867 doc: /* Return non-nil if COORDINATES are in WINDOW.
868 ...
869 @end group
870 @group
871 or `right-margin' is returned. */)
872 (register Lisp_Object coordinates, Lisp_Object window)
873 @{
874 struct window *w;
875 struct frame *f;
876 int x, y;
877 Lisp_Object lx, ly;
878 @end group
879
880 @group
881 CHECK_LIVE_WINDOW (window);
882 w = XWINDOW (window);
883 f = XFRAME (w->frame);
884 CHECK_CONS (coordinates);
885 lx = Fcar (coordinates);
886 ly = Fcdr (coordinates);
887 CHECK_NUMBER_OR_FLOAT (lx);
888 CHECK_NUMBER_OR_FLOAT (ly);
889 x = FRAME_PIXEL_X_FROM_CANON_X (f, lx) + FRAME_INTERNAL_BORDER_WIDTH(f);
890 y = FRAME_PIXEL_Y_FROM_CANON_Y (f, ly) + FRAME_INTERNAL_BORDER_WIDTH(f);
891 @end group
892
893 @group
894 switch (coordinates_in_window (w, x, y))
895 @{
896 case ON_NOTHING: /* NOT in window at all. */
897 return Qnil;
898 @end group
899
900 ...
901
902 @group
903 case ON_MODE_LINE: /* In mode line of window. */
904 return Qmode_line;
905 @end group
906
907 ...
908
909 @group
910 case ON_SCROLL_BAR: /* On scroll-bar of window. */
911 /* Historically we are supposed to return nil in this case. */
912 return Qnil;
913 @end group
914
915 @group
916 default:
917 abort ();
918 @}
919 @}
920 @end group
921 @end smallexample
922
923 Note that C code cannot call functions by name unless they are defined
924 in C@. The way to call a function written in Lisp is to use
925 @code{Ffuncall}, which embodies the Lisp function @code{funcall}. Since
926 the Lisp function @code{funcall} accepts an unlimited number of
927 arguments, in C it takes two: the number of Lisp-level arguments, and a
928 one-dimensional array containing their values. The first Lisp-level
929 argument is the Lisp function to call, and the rest are the arguments to
930 pass to it.
931
932 The C functions @code{call0}, @code{call1}, @code{call2}, and so on,
933 provide handy ways to call a Lisp function conveniently with a fixed
934 number of arguments. They work by calling @code{Ffuncall}.
935
936 @file{eval.c} is a very good file to look through for examples;
937 @file{lisp.h} contains the definitions for some important macros and
938 functions.
939
940 If you define a function which is side-effect free, update the code
941 in @file{byte-opt.el} that binds @code{side-effect-free-fns} and
942 @code{side-effect-and-error-free-fns} so that the compiler optimizer
943 knows about it.
944
945 @node Object Internals
946 @section Object Internals
947 @cindex object internals
948
949 Emacs Lisp provides a rich set of the data types. Some of them, like cons
950 cells, integers and strings, are common to nearly all Lisp dialects. Some
951 others, like markers and buffers, are quite special and needed to provide
952 the basic support to write editor commands in Lisp. To implement such
953 a variety of object types and provide an efficient way to pass objects between
954 the subsystems of an interpreter, there is a set of C data structures and
955 a special type to represent the pointers to all of them, which is known as
956 @dfn{tagged pointer}.
957
958 In C, the tagged pointer is an object of type @code{Lisp_Object}. Any
959 initialized variable of such a type always holds the value of one of the
960 following basic data types: integer, symbol, string, cons cell, float,
961 vectorlike or miscellaneous object. Each of these data types has the
962 corresponding tag value. All tags are enumerated by @code{enum Lisp_Type}
963 and placed into a 3-bit bitfield of the @code{Lisp_Object}. The rest of the
964 bits is the value itself. Integers are immediate, i.e., directly
965 represented by those @dfn{value bits}, and all other objects are represented
966 by the C pointers to a corresponding object allocated from the heap. Width
967 of the @code{Lisp_Object} is platform- and configuration-dependent: usually
968 it's equal to the width of an underlying platform pointer (i.e., 32-bit on
969 a 32-bit machine and 64-bit on a 64-bit one), but also there is a special
970 configuration where @code{Lisp_Object} is 64-bit but all pointers are 32-bit.
971 The latter trick was designed to overcome the limited range of values for
972 Lisp integers on a 32-bit system by using 64-bit @code{long long} type for
973 @code{Lisp_Object}.
974
975 The following C data structures are defined in @file{lisp.h} to represent
976 the basic data types beyond integers:
977
978 @table @code
979 @item struct Lisp_Cons
980 Cons cell, an object used to construct lists.
981
982 @item struct Lisp_String
983 String, the basic object to represent a sequence of characters.
984
985 @item struct Lisp_Vector
986 Array, a fixed-size set of Lisp objects which may be accessed by an index.
987
988 @item struct Lisp_Symbol
989 Symbol, the unique-named entity commonly used as an identifier.
990
991 @item struct Lisp_Float
992 Floating-point value.
993
994 @item union Lisp_Misc
995 Miscellaneous kinds of objects which don't fit into any of the above.
996 @end table
997
998 These types are the first-class citizens of an internal type system.
999 Since the tag space is limited, all other types are the subtypes of either
1000 @code{Lisp_Vectorlike} or @code{Lisp_Misc}. Vector subtypes are enumerated
1001 by @code{enum pvec_type}, and nearly all complex objects like windows, buffers,
1002 frames, and processes fall into this category. The rest of special types,
1003 including markers and overlays, are enumerated by @code{enum Lisp_Misc_Type}
1004 and form the set of subtypes of @code{Lisp_Misc}.
1005
1006 Below there is a description of a few subtypes of @code{Lisp_Vectorlike}.
1007 Buffer object represents the text to display and edit. Window is the part
1008 of display structure which shows the buffer or used as a container to
1009 recursively place other windows on the same frame. (Do not confuse Emacs Lisp
1010 window object with the window as an entity managed by the user interface
1011 system like X; in Emacs terminology, the latter is called frame.) Finally,
1012 process object is used to manage the subprocesses.
1013
1014 @menu
1015 * Buffer Internals:: Components of a buffer structure.
1016 * Window Internals:: Components of a window structure.
1017 * Process Internals:: Components of a process structure.
1018 @end menu
1019
1020 @node Buffer Internals
1021 @subsection Buffer Internals
1022 @cindex internals, of buffer
1023 @cindex buffer internals
1024
1025 Two structures (see @file{buffer.h}) are used to represent buffers
1026 in C@. The @code{buffer_text} structure contains fields describing the
1027 text of a buffer; the @code{buffer} structure holds other fields. In
1028 the case of indirect buffers, two or more @code{buffer} structures
1029 reference the same @code{buffer_text} structure.
1030
1031 Here are some of the fields in @code{struct buffer_text}:
1032
1033 @table @code
1034 @item beg
1035 The address of the buffer contents.
1036
1037 @item gpt
1038 @itemx gpt_byte
1039 The character and byte positions of the buffer gap. @xref{Buffer
1040 Gap}.
1041
1042 @item z
1043 @itemx z_byte
1044 The character and byte positions of the end of the buffer text.
1045
1046 @item gap_size
1047 The size of buffer's gap. @xref{Buffer Gap}.
1048
1049 @item modiff
1050 @itemx save_modiff
1051 @itemx chars_modiff
1052 @itemx overlay_modiff
1053 These fields count the number of buffer-modification events performed
1054 in this buffer. @code{modiff} is incremented after each
1055 buffer-modification event, and is never otherwise changed;
1056 @code{save_modiff} contains the value of @code{modiff} the last time
1057 the buffer was visited or saved; @code{chars_modiff} counts only
1058 modifications to the characters in the buffer, ignoring all other
1059 kinds of changes; and @code{overlay_modiff} counts only modifications
1060 to the overlays.
1061
1062 @item beg_unchanged
1063 @itemx end_unchanged
1064 The number of characters at the start and end of the text that are
1065 known to be unchanged since the last complete redisplay.
1066
1067 @item unchanged_modified
1068 @itemx overlay_unchanged_modified
1069 The values of @code{modiff} and @code{overlay_modiff}, respectively,
1070 after the last complete redisplay. If their current values match
1071 @code{modiff} or @code{overlay_modiff}, that means
1072 @code{beg_unchanged} and @code{end_unchanged} contain no useful
1073 information.
1074
1075 @item markers
1076 The markers that refer to this buffer. This is actually a single
1077 marker, and successive elements in its marker @code{chain} are the other
1078 markers referring to this buffer text.
1079
1080 @item intervals
1081 The interval tree which records the text properties of this buffer.
1082 @end table
1083
1084 Some of the fields of @code{struct buffer} are:
1085
1086 @table @code
1087 @item header
1088 A header of type @code{struct vectorlike_header} is common to all
1089 vectorlike objects.
1090
1091 @item own_text
1092 A @code{struct buffer_text} structure that ordinarily holds the buffer
1093 contents. In indirect buffers, this field is not used.
1094
1095 @item text
1096 A pointer to the @code{buffer_text} structure for this buffer. In an
1097 ordinary buffer, this is the @code{own_text} field above. In an
1098 indirect buffer, this is the @code{own_text} field of the base buffer.
1099
1100 @item next
1101 A pointer to the next buffer, in the chain of all buffers, including
1102 killed buffers. This chain is used only for allocation and garbage
1103 collection, in order to collect killed buffers properly.
1104
1105 @item pt
1106 @itemx pt_byte
1107 The character and byte positions of point in a buffer.
1108
1109 @item begv
1110 @itemx begv_byte
1111 The character and byte positions of the beginning of the accessible
1112 range of text in the buffer.
1113
1114 @item zv
1115 @itemx zv_byte
1116 The character and byte positions of the end of the accessible range of
1117 text in the buffer.
1118
1119 @item base_buffer
1120 In an indirect buffer, this points to the base buffer. In an ordinary
1121 buffer, it is null.
1122
1123 @item local_flags
1124 This field contains flags indicating that certain variables are local
1125 in this buffer. Such variables are declared in the C code using
1126 @code{DEFVAR_PER_BUFFER}, and their buffer-local bindings are stored
1127 in fields in the buffer structure itself. (Some of these fields are
1128 described in this table.)
1129
1130 @item modtime
1131 The modification time of the visited file. It is set when the file is
1132 written or read. Before writing the buffer into a file, this field is
1133 compared to the modification time of the file to see if the file has
1134 changed on disk. @xref{Buffer Modification}.
1135
1136 @item auto_save_modified
1137 The time when the buffer was last auto-saved.
1138
1139 @item last_window_start
1140 The @code{window-start} position in the buffer as of the last time the
1141 buffer was displayed in a window.
1142
1143 @item clip_changed
1144 This flag indicates that narrowing has changed in the buffer.
1145 @xref{Narrowing}.
1146
1147 @item prevent_redisplay_optimizations_p
1148 This flag indicates that redisplay optimizations should not be used to
1149 display this buffer.
1150
1151 @item overlay_center
1152 This field holds the current overlay center position. @xref{Managing
1153 Overlays}.
1154
1155 @item overlays_before
1156 @itemx overlays_after
1157 These fields hold, respectively, a list of overlays that end at or
1158 before the current overlay center, and a list of overlays that end
1159 after the current overlay center. @xref{Managing Overlays}.
1160 @code{overlays_before} is sorted in order of decreasing end position,
1161 and @code{overlays_after} is sorted in order of increasing beginning
1162 position.
1163
1164 @c FIXME? the following are now all Lisp_Object BUFFER_INTERNAL_FIELD (foo).
1165
1166 @item name
1167 A Lisp string that names the buffer. It is guaranteed to be unique.
1168 @xref{Buffer Names}.
1169
1170 @item save_length
1171 The length of the file this buffer is visiting, when last read or
1172 saved. This and other fields concerned with saving are not kept in
1173 the @code{buffer_text} structure because indirect buffers are never
1174 saved.
1175
1176 @item directory
1177 The directory for expanding relative file names. This is the value of
1178 the buffer-local variable @code{default-directory} (@pxref{File Name Expansion}).
1179
1180 @item filename
1181 The name of the file visited in this buffer, or @code{nil}. This is
1182 the value of the buffer-local variable @code{buffer-file-name}
1183 (@pxref{Buffer File Name}).
1184
1185 @item undo_list
1186 @itemx backed_up
1187 @itemx auto_save_file_name
1188 @itemx auto_save_file_format
1189 @itemx read_only
1190 @itemx file_format
1191 @itemx file_truename
1192 @itemx invisibility_spec
1193 @itemx display_count
1194 @itemx display_time
1195 These fields store the values of Lisp variables that are automatically
1196 buffer-local (@pxref{Buffer-Local Variables}), whose corresponding
1197 variable names have the additional prefix @code{buffer-} and have
1198 underscores replaced with dashes. For instance, @code{undo_list}
1199 stores the value of @code{buffer-undo-list}.
1200
1201 @item mark
1202 The mark for the buffer. The mark is a marker, hence it is also
1203 included on the list @code{markers}. @xref{The Mark}.
1204
1205 @item local_var_alist
1206 The association list describing the buffer-local variable bindings of
1207 this buffer, not including the built-in buffer-local bindings that
1208 have special slots in the buffer object. (Those slots are omitted
1209 from this table.) @xref{Buffer-Local Variables}.
1210
1211 @item major_mode
1212 Symbol naming the major mode of this buffer, e.g., @code{lisp-mode}.
1213
1214 @item mode_name
1215 Pretty name of the major mode, e.g., @code{"Lisp"}.
1216
1217 @item keymap
1218 @itemx abbrev_table
1219 @itemx syntax_table
1220 @itemx category_table
1221 @itemx display_table
1222 These fields store the buffer's local keymap (@pxref{Keymaps}), abbrev
1223 table (@pxref{Abbrev Tables}), syntax table (@pxref{Syntax Tables}),
1224 category table (@pxref{Categories}), and display table (@pxref{Display
1225 Tables}).
1226
1227 @item downcase_table
1228 @itemx upcase_table
1229 @itemx case_canon_table
1230 These fields store the conversion tables for converting text to lower
1231 case, upper case, and for canonicalizing text for case-fold search.
1232 @xref{Case Tables}.
1233
1234 @item minor_modes
1235 An alist of the minor modes of this buffer.
1236
1237 @item pt_marker
1238 @itemx begv_marker
1239 @itemx zv_marker
1240 These fields are only used in an indirect buffer, or in a buffer that
1241 is the base of an indirect buffer. Each holds a marker that records
1242 @code{pt}, @code{begv}, and @code{zv} respectively, for this buffer
1243 when the buffer is not current.
1244
1245 @item mode_line_format
1246 @itemx header_line_format
1247 @itemx case_fold_search
1248 @itemx tab_width
1249 @itemx fill_column
1250 @itemx left_margin
1251 @itemx auto_fill_function
1252 @itemx truncate_lines
1253 @itemx word_wrap
1254 @itemx ctl_arrow
1255 @itemx bidi_display_reordering
1256 @itemx bidi_paragraph_direction
1257 @itemx selective_display
1258 @itemx selective_display_ellipses
1259 @itemx overwrite_mode
1260 @itemx abbrev_mode
1261 @itemx mark_active
1262 @itemx enable_multibyte_characters
1263 @itemx buffer_file_coding_system
1264 @itemx cache_long_line_scans
1265 @itemx point_before_scroll
1266 @itemx left_fringe_width
1267 @itemx right_fringe_width
1268 @itemx fringes_outside_margins
1269 @itemx scroll_bar_width
1270 @itemx indicate_empty_lines
1271 @itemx indicate_buffer_boundaries
1272 @itemx fringe_indicator_alist
1273 @itemx fringe_cursor_alist
1274 @itemx scroll_up_aggressively
1275 @itemx scroll_down_aggressively
1276 @itemx cursor_type
1277 @itemx cursor_in_non_selected_windows
1278 These fields store the values of Lisp variables that are automatically
1279 buffer-local (@pxref{Buffer-Local Variables}), whose corresponding
1280 variable names have underscores replaced with dashes. For instance,
1281 @code{mode_line_format} stores the value of @code{mode-line-format}.
1282
1283 @item last_selected_window
1284 This is the last window that was selected with this buffer in it, or @code{nil}
1285 if that window no longer displays this buffer.
1286 @end table
1287
1288 @node Window Internals
1289 @subsection Window Internals
1290 @cindex internals, of window
1291 @cindex window internals
1292
1293 The fields of a window (for a complete list, see the definition of
1294 @code{struct window} in @file{window.h}) include:
1295
1296 @table @code
1297 @item frame
1298 The frame that this window is on.
1299
1300 @item mini_p
1301 Non-@code{nil} if this window is a minibuffer window.
1302
1303 @item parent
1304 Internally, Emacs arranges windows in a tree; each group of siblings has
1305 a parent window whose area includes all the siblings. This field points
1306 to a window's parent.
1307
1308 Parent windows do not display buffers, and play little role in display
1309 except to shape their child windows. Emacs Lisp programs usually have
1310 no access to the parent windows; they operate on the windows at the
1311 leaves of the tree, which actually display buffers.
1312
1313 @c FIXME: These two slots and the 'buffer' slot below were replaced
1314 @c with a single slot 'contents' on 2013-03-28. --xfq
1315 @item hchild
1316 @itemx vchild
1317 These fields contain the window's leftmost child and its topmost child
1318 respectively. @code{hchild} is used if the window is subdivided
1319 horizontally by child windows, and @code{vchild} if it is subdivided
1320 vertically. In a live window, only one of @code{hchild}, @code{vchild},
1321 and @code{buffer} (q.v.@:) is non-@code{nil}.
1322
1323 @item next
1324 @itemx prev
1325 The next sibling and previous sibling of this window. @code{next} is
1326 @code{nil} if the window is the right-most or bottom-most in its group;
1327 @code{prev} is @code{nil} if it is the left-most or top-most in its
1328 group.
1329
1330 @item left_col
1331 The left-hand edge of the window, measured in columns, relative to the
1332 leftmost column in the frame (column 0).
1333
1334 @item top_line
1335 The top edge of the window, measured in lines, relative to the topmost
1336 line in the frame (line 0).
1337
1338 @item total_cols
1339 @itemx total_lines
1340 The width and height of the window, measured in columns and lines
1341 respectively. The width includes the scroll bar and fringes, and/or
1342 the separator line on the right of the window (if any).
1343
1344 @item buffer
1345 The buffer that the window is displaying.
1346
1347 @item start
1348 A marker pointing to the position in the buffer that is the first
1349 character displayed in the window.
1350
1351 @item pointm
1352 @cindex window point internals
1353 This is the value of point in the current buffer when this window is
1354 selected; when it is not selected, it retains its previous value.
1355
1356 @item force_start
1357 If this flag is non-@code{nil}, it says that the window has been
1358 scrolled explicitly by the Lisp program. This affects what the next
1359 redisplay does if point is off the screen: instead of scrolling the
1360 window to show the text around point, it moves point to a location that
1361 is on the screen.
1362
1363 @item frozen_window_start_p
1364 This field is set temporarily to 1 to indicate to redisplay that
1365 @code{start} of this window should not be changed, even if point
1366 gets invisible.
1367
1368 @item start_at_line_beg
1369 Non-@code{nil} means current value of @code{start} was the beginning of a line
1370 when it was chosen.
1371
1372 @item use_time
1373 This is the last time that the window was selected. The function
1374 @code{get-lru-window} uses this field.
1375
1376 @item sequence_number
1377 A unique number assigned to this window when it was created.
1378
1379 @item last_modified
1380 The @code{modiff} field of the window's buffer, as of the last time
1381 a redisplay completed in this window.
1382
1383 @item last_overlay_modified
1384 The @code{overlay_modiff} field of the window's buffer, as of the last
1385 time a redisplay completed in this window.
1386
1387 @item last_point
1388 The buffer's value of point, as of the last time a redisplay completed
1389 in this window.
1390
1391 @item last_had_star
1392 A non-@code{nil} value means the window's buffer was modified when the
1393 window was last updated.
1394
1395 @item vertical_scroll_bar
1396 This window's vertical scroll bar.
1397
1398 @item left_margin_cols
1399 @itemx right_margin_cols
1400 The widths of the left and right margins in this window. A value of
1401 @code{nil} means no margin.
1402
1403 @item left_fringe_width
1404 @itemx right_fringe_width
1405 The widths of the left and right fringes in this window. A value of
1406 @code{nil} or @code{t} means use the values of the frame.
1407
1408 @item fringes_outside_margins
1409 A non-@code{nil} value means the fringes outside the display margins;
1410 othersize they are between the margin and the text.
1411
1412 @item window_end_pos
1413 This is computed as @code{z} minus the buffer position of the last glyph
1414 in the current matrix of the window. The value is only valid if
1415 @code{window_end_valid} is not @code{nil}.
1416
1417 @item window_end_bytepos
1418 The byte position corresponding to @code{window_end_pos}.
1419
1420 @item window_end_vpos
1421 The window-relative vertical position of the line containing
1422 @code{window_end_pos}.
1423
1424 @item window_end_valid
1425 This field is set to a non-@code{nil} value if @code{window_end_pos} is truly
1426 valid. This is @code{nil} if nontrivial redisplay is pre-empted, since in that
1427 case the display that @code{window_end_pos} was computed for did not get
1428 onto the screen.
1429
1430 @item cursor
1431 A structure describing where the cursor is in this window.
1432
1433 @item last_cursor
1434 The value of @code{cursor} as of the last redisplay that finished.
1435
1436 @item phys_cursor
1437 A structure describing where the cursor of this window physically is.
1438
1439 @item phys_cursor_type
1440 @c FIXME What is this?
1441 @c itemx phys_cursor_ascent
1442 @itemx phys_cursor_height
1443 @itemx phys_cursor_width
1444 The type, height, and width of the cursor that was last displayed on
1445 this window.
1446
1447 @item phys_cursor_on_p
1448 This field is non-zero if the cursor is physically on.
1449
1450 @item cursor_off_p
1451 Non-zero means the cursor in this window is logically off. This is
1452 used for blinking the cursor.
1453
1454 @item last_cursor_off_p
1455 This field contains the value of @code{cursor_off_p} as of the time of
1456 the last redisplay.
1457
1458 @item must_be_updated_p
1459 This is set to 1 during redisplay when this window must be updated.
1460
1461 @item hscroll
1462 This is the number of columns that the display in the window is scrolled
1463 horizontally to the left. Normally, this is 0.
1464
1465 @item vscroll
1466 Vertical scroll amount, in pixels. Normally, this is 0.
1467
1468 @item dedicated
1469 Non-@code{nil} if this window is dedicated to its buffer.
1470
1471 @item display_table
1472 The window's display table, or @code{nil} if none is specified for it.
1473
1474 @item update_mode_line
1475 Non-@code{nil} means this window's mode line needs to be updated.
1476
1477 @item base_line_number
1478 The line number of a certain position in the buffer, or @code{nil}.
1479 This is used for displaying the line number of point in the mode line.
1480
1481 @item base_line_pos
1482 The position in the buffer for which the line number is known, or
1483 @code{nil} meaning none is known. If it is a buffer, don't display
1484 the line number as long as the window shows that buffer.
1485
1486 @item column_number_displayed
1487 The column number currently displayed in this window's mode line, or @code{nil}
1488 if column numbers are not being displayed.
1489
1490 @item current_matrix
1491 @itemx desired_matrix
1492 Glyph matrices describing the current and desired display of this window.
1493 @end table
1494
1495 @node Process Internals
1496 @subsection Process Internals
1497 @cindex internals, of process
1498 @cindex process internals
1499
1500 The fields of a process (for a complete list, see the definition of
1501 @code{struct Lisp_Process} in @file{process.h}) include:
1502
1503 @table @code
1504 @item name
1505 A string, the name of the process.
1506
1507 @item command
1508 A list containing the command arguments that were used to start this
1509 process. For a network or serial process, it is @code{nil} if the
1510 process is running or @code{t} if the process is stopped.
1511
1512 @item filter
1513 A function used to accept output from the process.
1514
1515 @item sentinel
1516 A function called whenever the state of the process changes.
1517
1518 @item buffer
1519 The associated buffer of the process.
1520
1521 @item pid
1522 An integer, the operating system's process @acronym{ID}.
1523 Pseudo-processes such as network or serial connections use a value of 0.
1524
1525 @item childp
1526 A flag, @code{t} if this is really a child process. For a network or
1527 serial connection, it is a plist based on the arguments to
1528 @code{make-network-process} or @code{make-serial-process}.
1529
1530 @item mark
1531 A marker indicating the position of the end of the last output from this
1532 process inserted into the buffer. This is often but not always the end
1533 of the buffer.
1534
1535 @item kill_without_query
1536 If this is non-zero, killing Emacs while this process is still running
1537 does not ask for confirmation about killing the process.
1538
1539 @item raw_status
1540 The raw process status, as returned by the @code{wait} system call.
1541
1542 @item status
1543 The process status, as @code{process-status} should return it.
1544
1545 @item tick
1546 @itemx update_tick
1547 If these two fields are not equal, a change in the status of the process
1548 needs to be reported, either by running the sentinel or by inserting a
1549 message in the process buffer.
1550
1551 @item pty_flag
1552 Non-@code{nil} if communication with the subprocess uses a pty;
1553 @code{nil} if it uses a pipe.
1554
1555 @item infd
1556 The file descriptor for input from the process.
1557
1558 @item outfd
1559 The file descriptor for output to the process.
1560
1561 @item tty_name
1562 The name of the terminal that the subprocess is using,
1563 or @code{nil} if it is using pipes.
1564
1565 @item decode_coding_system
1566 Coding-system for decoding the input from this process.
1567
1568 @item decoding_buf
1569 A working buffer for decoding.
1570
1571 @item decoding_carryover
1572 Size of carryover in decoding.
1573
1574 @item encode_coding_system
1575 Coding-system for encoding the output to this process.
1576
1577 @item encoding_buf
1578 A working buffer for encoding.
1579
1580 @item inherit_coding_system_flag
1581 Flag to set @code{coding-system} of the process buffer from the
1582 coding system used to decode process output.
1583
1584 @item type
1585 Symbol indicating the type of process: @code{real}, @code{network},
1586 @code{serial}.
1587
1588 @end table
1589
1590 @node C Integer Types
1591 @section C Integer Types
1592 @cindex integer types (C programming language)
1593
1594 Here are some guidelines for use of integer types in the Emacs C
1595 source code. These guidelines sometimes give competing advice; common
1596 sense is advised.
1597
1598 @itemize @bullet
1599 @item
1600 Avoid arbitrary limits. For example, avoid @code{int len = strlen
1601 (s);} unless the length of @code{s} is required for other reasons to
1602 fit in @code{int} range.
1603
1604 @item
1605 Do not assume that signed integer arithmetic wraps around on overflow.
1606 This is no longer true of Emacs porting targets: signed integer
1607 overflow has undefined behavior in practice, and can dump core or
1608 even cause earlier or later code to behave illogically. Unsigned
1609 overflow does wrap around reliably, modulo a power of two.
1610
1611 @item
1612 Prefer signed types to unsigned, as code gets confusing when signed
1613 and unsigned types are combined. Many other guidelines assume that
1614 types are signed; in the rarer cases where unsigned types are needed,
1615 similar advice may apply to the unsigned counterparts (e.g.,
1616 @code{size_t} instead of @code{ptrdiff_t}, or @code{uintptr_t} instead
1617 of @code{intptr_t}).
1618
1619 @item
1620 Prefer @code{int} for Emacs character codes, in the range 0 ..@: 0x3FFFFF@.
1621 More generally, prefer @code{int} for integers known to be in
1622 @code{int} range, e.g., screen column counts.
1623
1624 @item
1625 Prefer @code{ptrdiff_t} for sizes, i.e., for integers bounded by the
1626 maximum size of any individual C object or by the maximum number of
1627 elements in any C array. This is part of Emacs's general preference
1628 for signed types. Using @code{ptrdiff_t} limits objects to
1629 @code{PTRDIFF_MAX} bytes, but larger objects would cause trouble
1630 anyway since they would break pointer subtraction, so this does not
1631 impose an arbitrary limit.
1632
1633 @item
1634 Avoid @code{ssize_t} except when communicating to low-level APIs that
1635 have @code{ssize_t}-related limitations. Although it's equivalent to
1636 @code{ptrdiff_t} on typical platforms, @code{ssize_t} is occasionally
1637 narrower, so using it for size-related calculations could overflow.
1638 Also, @code{ptrdiff_t} is more ubiquitous and better-standardized, has
1639 standard @code{printf} formats, and is the basis for Emacs's internal
1640 size-overflow checking. When using @code{ssize_t}, please note that
1641 POSIX requires support only for values in the range @minus{}1 ..@:
1642 @code{SSIZE_MAX}.
1643
1644 @item
1645 Prefer @code{intptr_t} for internal representations of pointers, or
1646 for integers bounded only by the number of objects that can exist at
1647 any given time or by the total number of bytes that can be allocated.
1648 Currently Emacs sometimes uses other types when @code{intptr_t} would
1649 be better; fixing this is lower priority, as the code works as-is on
1650 Emacs's current porting targets.
1651
1652 @item
1653 Prefer the Emacs-defined type @code{EMACS_INT} for representing values
1654 converted to or from Emacs Lisp fixnums, as fixnum arithmetic is based
1655 on @code{EMACS_INT}.
1656
1657 @item
1658 When representing a system value (such as a file size or a count of
1659 seconds since the Epoch), prefer the corresponding system type (e.g.,
1660 @code{off_t}, @code{time_t}). Do not assume that a system type is
1661 signed, unless this assumption is known to be safe. For example,
1662 although @code{off_t} is always signed, @code{time_t} need not be.
1663
1664 @item
1665 Prefer the Emacs-defined type @code{printmax_t} for representing
1666 values that might be any signed integer that can be printed,
1667 using a @code{printf}-family function.
1668
1669 @item
1670 Prefer @code{intmax_t} for representing values that might be any
1671 signed integer value.
1672
1673 @item
1674 Prefer @code{bool}, @code{false} and @code{true} for booleans.
1675 Using @code{bool} can make programs easier to read and a bit faster than
1676 using @code{int}. Although it is also OK to use @code{int}, @code{0}
1677 and @code{1}, this older style is gradually being phased out. When
1678 using @code{bool}, respect the limitations of the replacement
1679 implementation of @code{bool}, as documented in the source file
1680 @file{lib/stdbool.in.h}. In particular, boolean bitfields should be of type
1681 @code{bool_bf}, not @code{bool}, so that they work correctly even when
1682 compiling Objective C with standard GCC.
1683
1684 @item
1685 In bitfields, prefer @code{unsigned int} or @code{signed int} to
1686 @code{int}, as @code{int} is less portable: it might be signed, and
1687 might not be. Single-bit bit fields should be @code{unsigned int} or
1688 @code{bool_bf} so that their values are 0 or 1.
1689 @end itemize
1690
1691 @c FIXME Mention src/globals.h somewhere in this file?