New URL for NEMO forge!   http://forge.nemo-ocean.eu

Since March 2022 along with NEMO 4.2 release, the code development moved to a self-hosted GitLab.
This present forge is now archived and remained online for history.
Changeset 12065 for NEMO/branches/2019/dev_r10742_ENHANCE-12_SimonM-Tides/doc/latex/NEMO/subfiles/chap_LBC.tex – NEMO

Ignore:
Timestamp:
2019-12-05T12:06:36+01:00 (4 years ago)
Author:
smueller
Message:

Synchronizing with /NEMO/trunk@12055 (ticket #2194)

Location:
NEMO/branches/2019/dev_r10742_ENHANCE-12_SimonM-Tides/doc
Files:
5 edited

Legend:

Unmodified
Added
Removed
  • NEMO/branches/2019/dev_r10742_ENHANCE-12_SimonM-Tides/doc

    • Property svn:ignore deleted
    • Property svn:externals set to
      ^/utils/badges badges
      ^/utils/logos logos
  • NEMO/branches/2019/dev_r10742_ENHANCE-12_SimonM-Tides/doc/latex

    • Property svn:ignore deleted
  • NEMO/branches/2019/dev_r10742_ENHANCE-12_SimonM-Tides/doc/latex/NEMO

    • Property svn:ignore deleted
    • Property svn:externals set to
      ^/utils/figures/NEMO figures
  • NEMO/branches/2019/dev_r10742_ENHANCE-12_SimonM-Tides/doc/latex/NEMO/subfiles

    • Property svn:ignore
      •  

        old new  
        1 *.aux 
        2 *.bbl 
        3 *.blg 
        4 *.dvi 
        5 *.fdb* 
        6 *.fls 
        7 *.idx 
         1*.ind 
        82*.ilg 
        9 *.ind 
        10 *.log 
        11 *.maf 
        12 *.mtc* 
        13 *.out 
        14 *.pdf 
        15 *.toc 
        16 _minted-* 
  • NEMO/branches/2019/dev_r10742_ENHANCE-12_SimonM-Tides/doc/latex/NEMO/subfiles/chap_LBC.tex

    r10614 r12065  
    22 
    33\begin{document} 
    4 % ================================================================ 
    5 % Chapter — Lateral Boundary Condition (LBC)  
    6 % ================================================================ 
     4 
    75\chapter{Lateral Boundary Condition (LBC)} 
    86\label{chap:LBC} 
    97 
    10 \minitoc 
    11  
    12 \newpage 
    13  
    14 %gm% add here introduction to this chapter 
    15  
    16 % ================================================================ 
    17 % Boundary Condition at the Coast 
    18 % ================================================================ 
    19 \section{Boundary condition at the coast (\protect\np{rn\_shlat})} 
     8\thispagestyle{plain} 
     9 
     10\chaptertoc 
     11 
     12\paragraph{Changes record} ~\\ 
     13 
     14{\footnotesize 
     15  \begin{tabularx}{\textwidth}{l||X|X} 
     16    Release & Author(s) & Modifications \\ 
     17    \hline 
     18    {\em   4.0} & {\em ...} & {\em ...} \\ 
     19    {\em   3.6} & {\em ...} & {\em ...} \\ 
     20    {\em   3.4} & {\em ...} & {\em ...} \\ 
     21    {\em <=3.4} & {\em ...} & {\em ...} 
     22  \end{tabularx} 
     23} 
     24 
     25\clearpage 
     26 
     27\cmtgm{Add here introduction to this chapter} 
     28 
     29%% ================================================================================================= 
     30\section[Boundary condition at the coast (\forcode{rn_shlat})]{Boundary condition at the coast (\protect\np{rn_shlat}{rn\_shlat})} 
    2031\label{sec:LBC_coast} 
    21 %--------------------------------------------nam_lbc------------------------------------------------------- 
    22  
    23 \nlst{namlbc}  
    24 %-------------------------------------------------------------------------------------------------------------- 
    25  
    26 %The lateral ocean boundary conditions contiguous to coastlines are Neumann conditions for heat and salt (no flux across boundaries) and Dirichlet conditions for momentum (ranging from free-slip to "strong" no-slip). They are handled automatically by the mask system (see \autoref{subsec:DOM_msk}).  
    27  
    28 %OPA allows land and topography grid points in the computational domain due to the presence of continents or islands, and includes the use of a full or partial step representation of bottom topography. The computation is performed over the whole domain, \ie we do not try to restrict the computation to ocean-only points. This choice has two motivations. Firstly, working on ocean only grid points overloads the code and harms the code readability. Secondly, and more importantly, it drastically reduces the vector portion of the computation, leading to a dramatic increase of CPU time requirement on vector computers.  The current section describes how the masking affects the computation of the various terms of the equations with respect to the boundary condition at solid walls. The process of defining which areas are to be masked is described in \autoref{subsec:DOM_msk}. 
    29  
    30 Options are defined through the \ngn{namlbc} namelist variables. 
     32 
     33\begin{listing} 
     34  \nlst{namlbc} 
     35  \caption{\forcode{&namlbc}} 
     36  \label{lst:namlbc} 
     37\end{listing} 
     38 
     39%The lateral ocean boundary conditions contiguous to coastlines are Neumann conditions for heat and salt 
     40%(no flux across boundaries) and Dirichlet conditions for momentum (ranging from free-slip to "strong" no-slip). 
     41%They are handled automatically by the mask system (see \autoref{subsec:DOM_msk}). 
     42 
     43%OPA allows land and topography grid points in the computational domain due to the presence of continents or islands, 
     44%and includes the use of a full or partial step representation of bottom topography. 
     45%The computation is performed over the whole domain, \ie\ we do not try to restrict the computation to ocean-only points. 
     46%This choice has two motivations. 
     47%Firstly, working on ocean only grid points overloads the code and harms the code readability. 
     48%Secondly, and more importantly, it drastically reduces the vector portion of the computation, 
     49%leading to a dramatic increase of CPU time requirement on vector computers. 
     50%The current section describes how the masking affects the computation of the various terms of the equations 
     51%with respect to the boundary condition at solid walls. 
     52%The process of defining which areas are to be masked is described in \autoref{subsec:DOM_msk}. 
     53 
     54Options are defined through the \nam{lbc}{lbc} namelist variables. 
    3155The discrete representation of a domain with complex boundaries (coastlines and bottom topography) leads to 
    3256arrays that include large portions where a computation is not required as the model variables remain at zero. 
     
    4064Since most of the boundary conditions consist of a zero flux across the solid boundaries, 
    4165they can be simply applied by multiplying variables by the correct mask arrays, 
    42 \ie the mask array of the grid point where the flux is evaluated. 
     66\ie\ the mask array of the grid point where the flux is evaluated. 
    4367For example, the heat flux in the \textbf{i}-direction is evaluated at $u$-points. 
    4468Evaluating this quantity as, 
    4569 
    4670\[ 
    47   % \label{eq:lbc_aaaa} 
     71  % \label{eq:LBC_aaaa} 
    4872  \frac{A^{lT} }{e_1 }\frac{\partial T}{\partial i}\equiv \frac{A_u^{lT} 
    4973  }{e_{1u} } \; \delta_{i+1 / 2} \left[ T \right]\;\;mask_u 
     
    5175(where mask$_{u}$ is the mask array at a $u$-point) ensures that the heat flux is zero inside land and 
    5276at the boundaries, since mask$_{u}$ is zero at solid boundaries which in this case are defined at $u$-points 
    53 (normal velocity $u$ remains zero at the coast) (\autoref{fig:LBC_uv}).  
    54  
    55 %>>>>>>>>>>>>>>>>>>>>>>>>>>>> 
     77(normal velocity $u$ remains zero at the coast) (\autoref{fig:LBC_uv}). 
     78 
    5679\begin{figure}[!t] 
    57   \begin{center} 
    58     \includegraphics[width=0.90\textwidth]{Fig_LBC_uv} 
    59     \caption{ 
    60       \protect\label{fig:LBC_uv} 
    61       Lateral boundary (thick line) at T-level. 
    62       The velocity normal to the boundary is set to zero. 
    63     } 
    64   \end{center} 
     80  \centering 
     81  \includegraphics[width=0.66\textwidth]{LBC_uv} 
     82  \caption[Lateral boundary at $T$-level]{ 
     83    Lateral boundary (thick line) at T-level. 
     84    The velocity normal to the boundary is set to zero.} 
     85  \label{fig:LBC_uv} 
    6586\end{figure} 
    66 %>>>>>>>>>>>>>>>>>>>>>>>>>>>> 
    6787 
    6888For momentum the situation is a bit more complex as two boundary conditions must be provided along the coast 
     
    7898and is required in order to compute the vorticity at the coast. 
    7999Four different types of lateral boundary condition are available, 
    80 controlled by the value of the \np{rn\_shlat} namelist parameter 
     100controlled by the value of the \np{rn_shlat}{rn\_shlat} namelist parameter 
    81101(The value of the mask$_{f}$ array along the coastline is set equal to this parameter). 
    82102These are: 
    83103 
    84 %>>>>>>>>>>>>>>>>>>>>>>>>>>>> 
    85104\begin{figure}[!p] 
    86   \begin{center} 
    87     \includegraphics[width=0.90\textwidth]{Fig_LBC_shlat} 
    88     \caption{ 
    89       \protect\label{fig:LBC_shlat} 
    90       lateral boundary condition 
    91       (a) free-slip ($rn\_shlat=0$); 
    92       (b) no-slip ($rn\_shlat=2$); 
    93       (c) "partial" free-slip ($0<rn\_shlat<2$) and 
    94       (d) "strong" no-slip ($2<rn\_shlat$). 
    95       Implied "ghost" velocity inside land area is display in grey. 
    96     } 
    97   \end{center} 
     105  \centering 
     106  \includegraphics[width=0.66\textwidth]{LBC_shlat} 
     107  \caption[Lateral boundary conditions]{ 
     108    Lateral boundary conditions 
     109    (a) free-slip                       (\protect\np[=0]{rn_shlat}{rn\_shlat}); 
     110    (b) no-slip                         (\protect\np[=2]{rn_shlat}{rn\_shlat}); 
     111    (c) "partial" free-slip (\forcode{0<}\protect\np[<2]{rn_shlat}{rn\_shlat}) and 
     112    (d) "strong" no-slip    (\forcode{2<}\protect\np{rn_shlat}{rn\_shlat}). 
     113    Implied "ghost" velocity inside land area is display in grey.} 
     114  \label{fig:LBC_shlat} 
    98115\end{figure} 
    99 %>>>>>>>>>>>>>>>>>>>>>>>>>>>> 
    100116 
    101117\begin{description} 
    102118 
    103 \item[free-slip boundary condition (\np{rn\_shlat}\forcode{ = 0}):] the tangential velocity at 
     119\item [free-slip boundary condition ({\np[=0]{rn_shlat}{rn\_shlat}})] the tangential velocity at 
    104120  the coastline is equal to the offshore velocity, 
    105   \ie the normal derivative of the tangential velocity is zero at the coast, 
     121  \ie\ the normal derivative of the tangential velocity is zero at the coast, 
    106122  so the vorticity: mask$_{f}$ array is set to zero inside the land and just at the coast 
    107123  (\autoref{fig:LBC_shlat}-a). 
    108124 
    109 \item[no-slip boundary condition (\np{rn\_shlat}\forcode{ = 2}):] the tangential velocity vanishes at the coastline. 
     125\item [no-slip boundary condition ({\np[=2]{rn_shlat}{rn\_shlat}})] the tangential velocity vanishes at the coastline. 
    110126  Assuming that the tangential velocity decreases linearly from 
    111127  the closest ocean velocity grid point to the coastline, 
     
    113129  the closest ocean velocity gridpoint were of the same magnitude but in the opposite direction 
    114130  (\autoref{fig:LBC_shlat}-b). 
    115   Therefore, the vorticity along the coastlines is given by:  
     131  Therefore, the vorticity along the coastlines is given by: 
    116132 
    117133  \[ 
     
    122138  the no-slip boundary condition, simply by multiplying it by the mask$_{f}$ : 
    123139  \[ 
    124     % \label{eq:lbc_bbbb} 
     140    % \label{eq:LBC_bbbb} 
    125141    \zeta \equiv \frac{1}{e_{1f} {\kern 1pt}e_{2f} }\left( {\delta_{i+1/2} 
    126142        \left[ {e_{2v} \,v} \right]-\delta_{j+1/2} \left[ {e_{1u} \,u} \right]} 
     
    128144  \] 
    129145 
    130 \item["partial" free-slip boundary condition (0$<$\np{rn\_shlat}$<$2):] the tangential velocity at 
    131   the coastline is smaller than the offshore velocity, \ie there is a lateral friction but 
     146\item ["partial" free-slip boundary condition (0$<$\np{rn_shlat}{rn\_shlat}$<$2)] the tangential velocity at 
     147  the coastline is smaller than the offshore velocity, \ie\ there is a lateral friction but 
    132148  not strong enough to make the tangential velocity at the coast vanish (\autoref{fig:LBC_shlat}-c). 
    133149  This can be selected by providing a value of mask$_{f}$ strictly inbetween $0$ and $2$. 
    134150 
    135 \item["strong" no-slip boundary condition (2$<$\np{rn\_shlat}):] the viscous boundary layer is assumed to 
     151\item ["strong" no-slip boundary condition (2$<$\np{rn_shlat}{rn\_shlat})] the viscous boundary layer is assumed to 
    136152  be smaller than half the grid size (\autoref{fig:LBC_shlat}-d). 
    137153  The friction is thus larger than in the no-slip case. 
     
    139155\end{description} 
    140156 
    141 Note that when the bottom topography is entirely represented by the $s$-coor-dinates (pure $s$-coordinate), 
     157Note that when the bottom topography is entirely represented by the $s$-coordinates (pure $s$-coordinate), 
    142158the lateral boundary condition on tangential velocity is of much less importance as 
    143159it is only applied next to the coast where the minimum water depth can be quite shallow. 
    144160 
    145  
    146 % ================================================================ 
    147 % Boundary Condition around the Model Domain 
    148 % ================================================================ 
    149 \section{Model domain boundary condition (\protect\np{jperio})} 
     161%% ================================================================================================= 
     162\section[Model domain boundary condition (\forcode{jperio})]{Model domain boundary condition (\protect\jp{jperio})} 
    150163\label{sec:LBC_jperio} 
    151164 
     
    153166closed, cyclic east-west, cyclic north-south, a north-fold, and combination closed-north fold or 
    154167bi-cyclic east-west and north-fold. 
    155 The north-fold boundary condition is associated with the 3-pole ORCA mesh.  
    156  
    157 % ------------------------------------------------------------------------------------------------------------- 
    158 %        Closed, cyclic (\np{jperio}\forcode{ = 0..2})  
    159 % ------------------------------------------------------------------------------------------------------------- 
    160 \subsection{Closed, cyclic (\protect\np{jperio}\forcode{= [0127]})} 
     168The north-fold boundary condition is associated with the 3-pole ORCA mesh. 
     169 
     170%% ================================================================================================= 
     171\subsection[Closed, cyclic (\forcode{=0,1,2,7})]{Closed, cyclic (\protect\jp{jperio}\forcode{=0,1,2,7})} 
    161172\label{subsec:LBC_jperio012} 
    162173 
    163174The choice of closed or cyclic model domain boundary condition is made by 
    164 setting \np{jperio} to 0, 1, 2 or 7 in namelist \ngn{namcfg}. 
     175setting \jp{jperio} to 0, 1, 2 or 7 in namelist \nam{cfg}{cfg}. 
    165176Each time such a boundary condition is needed, it is set by a call to routine \mdl{lbclnk}. 
    166177The computation of momentum and tracer trends proceeds from $i=2$ to $i=jpi-1$ and from $j=2$ to $j=jpj-1$, 
    167 \ie in the model interior. 
     178\ie\ in the model interior. 
    168179To choose a lateral model boundary condition is to specify the first and last rows and columns of 
    169 the model variables.  
     180the model variables. 
    170181 
    171182\begin{description} 
    172183 
    173 \item[For closed boundary (\np{jperio}\forcode{ = 0})], 
    174   solid walls are imposed at all model boundaries: 
     184\item [For closed boundary (\jp{jperio}\forcode{=0})], solid walls are imposed at all model boundaries: 
    175185  first and last rows and columns are set to zero. 
    176186 
    177 \item[For cyclic east-west boundary (\np{jperio}\forcode{ = 1})], 
    178   first and last rows are set to zero (closed) whilst the first column is set to 
     187\item [For cyclic east-west boundary (\jp{jperio}\forcode{=1})], first and last rows are set to zero (closed) whilst the first column is set to 
    179188  the value of the last-but-one column and the last column to the value of the second one 
    180189  (\autoref{fig:LBC_jperio}-a). 
    181190  Whatever flows out of the eastern (western) end of the basin enters the western (eastern) end. 
    182191 
    183 \item[For cyclic north-south boundary (\np{jperio}\forcode{ = 2})], 
    184   first and last columns are set to zero (closed) whilst the first row is set to 
     192\item [For cyclic north-south boundary (\jp{jperio}\forcode{=2})], first and last columns are set to zero (closed) whilst the first row is set to 
    185193  the value of the last-but-one row and the last row to the value of the second one 
    186194  (\autoref{fig:LBC_jperio}-a). 
    187195  Whatever flows out of the northern (southern) end of the basin enters the southern (northern) end. 
    188196 
    189 \item[Bi-cyclic east-west and north-south boundary (\np{jperio}\forcode{ = 7})] combines cases 1 and 2. 
     197\item [Bi-cyclic east-west and north-south boundary (\jp{jperio}\forcode{=7})] combines cases 1 and 2. 
    190198 
    191199\end{description} 
    192200 
    193 %>>>>>>>>>>>>>>>>>>>>>>>>>>>> 
    194201\begin{figure}[!t] 
    195   \begin{center} 
    196     \includegraphics[width=1.0\textwidth]{Fig_LBC_jperio} 
    197     \caption{ 
    198       \protect\label{fig:LBC_jperio} 
    199       setting of (a) east-west cyclic  (b) symmetric across the equator boundary conditions. 
    200     } 
    201   \end{center} 
     202  \centering 
     203  \includegraphics[width=0.66\textwidth]{LBC_jperio} 
     204  \caption[Setting of east-west cyclic and symmetric across the Equator boundary conditions]{ 
     205    Setting of (a) east-west cyclic (b) symmetric across the Equator boundary conditions} 
     206  \label{fig:LBC_jperio} 
    202207\end{figure} 
    203 %>>>>>>>>>>>>>>>>>>>>>>>>>>>> 
    204  
    205 % ------------------------------------------------------------------------------------------------------------- 
    206 %        North fold (\textit{jperio = 3 }to $6)$  
    207 % ------------------------------------------------------------------------------------------------------------- 
    208 \subsection{North-fold (\protect\np{jperio}\forcode{ = 3..6})} 
     208 
     209%% ================================================================================================= 
     210\subsection[North-fold (\forcode{=3,6})]{North-fold (\protect\jp{jperio}\forcode{=3,6})} 
    209211\label{subsec:LBC_north_fold} 
    210212 
    211213The north fold boundary condition has been introduced in order to handle the north boundary of 
    212214a three-polar ORCA grid. 
    213 Such a grid has two poles in the northern hemisphere (\autoref{fig:MISC_ORCA_msh}, 
    214 and thus requires a specific treatment illustrated in \autoref{fig:North_Fold_T}.  
     215Such a grid has two poles in the northern hemisphere (\autoref{fig:CFGS_ORCA_msh}, 
     216and thus requires a specific treatment illustrated in \autoref{fig:LBC_North_Fold_T}. 
    215217Further information can be found in \mdl{lbcnfd} module which applies the north fold boundary condition. 
    216218 
    217 %>>>>>>>>>>>>>>>>>>>>>>>>>>>> 
    218219\begin{figure}[!t] 
    219   \begin{center} 
    220     \includegraphics[width=0.90\textwidth]{Fig_North_Fold_T} 
    221     \caption{ 
    222       \protect\label{fig:North_Fold_T} 
    223       North fold boundary with a $T$-point pivot and cyclic east-west boundary condition ($jperio=4$), 
    224       as used in ORCA 2, 1/4, and 1/12. 
    225       Pink shaded area corresponds to the inner domain mask (see text). 
    226     } 
    227   \end{center} 
     220  \centering 
     221  \includegraphics[width=0.66\textwidth]{LBC_North_Fold_T} 
     222  \caption[North fold boundary in ORCA 2\deg, 1/4\deg and 1/12\deg]{ 
     223    North fold boundary with a $T$-point pivot and cyclic east-west boundary condition ($jperio=4$), 
     224    as used in ORCA 2\deg, 1/4\deg and 1/12\deg. 
     225    Pink shaded area corresponds to the inner domain mask (see text).} 
     226  \label{fig:LBC_North_Fold_T} 
    228227\end{figure} 
    229 %>>>>>>>>>>>>>>>>>>>>>>>>>>>> 
    230  
    231 % ==================================================================== 
    232 % Exchange with neighbouring processors  
    233 % ==================================================================== 
    234 \section{Exchange with neighbouring processors (\protect\mdl{lbclnk}, \protect\mdl{lib\_mpp})} 
     228 
     229%% ================================================================================================= 
     230\section[Exchange with neighbouring processors (\textit{lbclnk.F90}, \textit{lib\_mpp.F90})]{Exchange with neighbouring processors (\protect\mdl{lbclnk}, \protect\mdl{lib\_mpp})} 
    235231\label{sec:LBC_mpp} 
    236232 
     233\begin{listing} 
     234  \nlst{nammpp} 
     235  \caption{\forcode{&nammpp}} 
     236  \label{lst:nammpp} 
     237\end{listing} 
     238 
    237239For massively parallel processing (mpp), a domain decomposition method is used. 
    238 The basic idea of the method is to split the large computation domain of a numerical experiment into 
    239 several smaller domains and solve the set of equations by addressing independent local problems. 
     240The basic idea of the method is to split the large computation domain of a numerical experiment into several smaller domains and 
     241solve the set of equations by addressing independent local problems. 
    240242Each processor has its own local memory and computes the model equation over a subdomain of the whole model domain. 
    241 The subdomain boundary conditions are specified through communications between processors which 
    242 are organized by explicit statements (message passing method). 
    243  
    244 A big advantage is that the method does not need many modifications of the initial \fortran code. 
    245 From the modeller's point of view, each sub domain running on a processor is identical to the "mono-domain" code. 
    246 In addition, the programmer manages the communications between subdomains, 
    247 and the code is faster when the number of processors is increased. 
    248 The porting of OPA code on an iPSC860 was achieved during Guyon's PhD [Guyon et al. 1994, 1995] 
    249 in collaboration with CETIIS and ONERA. 
    250 The implementation in the operational context and the studies of performance on 
    251 a T3D and T3E Cray computers have been made in collaboration with IDRIS and CNRS. 
     243The subdomain boundary conditions are specified through communications between processors which are organized by 
     244explicit statements (message passing method). 
    252245The present implementation is largely inspired by Guyon's work [Guyon 1995]. 
    253246 
     
    256249depend at the very most on one neighbouring point. 
    257250The only non-local computations concern the vertical physics 
    258 (implicit diffusion, turbulent closure scheme, ...) (delocalization over the whole water column), 
    259 and the solving of the elliptic equation associated with the surface pressure gradient computation 
    260 (delocalization over the whole horizontal domain). 
     251(implicit diffusion, turbulent closure scheme, ...). 
    261252Therefore, a pencil strategy is used for the data sub-structuration: 
    262253the 3D initial domain is laid out on local processor memories following a 2D horizontal topological splitting. 
     
    267258After a computation, a communication phase starts: 
    268259each processor sends to its neighbouring processors the update values of the points corresponding to 
    269 the interior overlapping area to its neighbouring sub-domain (\ie the innermost of the two overlapping rows). 
    270 The communication is done through the Message Passing Interface (MPI). 
     260the interior overlapping area to its neighbouring sub-domain (\ie\ the innermost of the two overlapping rows). 
     261Communications are first done according to the east-west direction and next according to the north-south direction. 
     262There is no specific communications for the corners. 
     263The communication is done through the Message Passing Interface (MPI) and requires \key{mpp\_mpi}. 
     264Use also \key{mpi2} if MPI3 is not available on your computer. 
    271265The data exchanges between processors are required at the very place where 
    272266lateral domain boundary conditions are set in the mono-domain computation: 
    273267the \rou{lbc\_lnk} routine (found in \mdl{lbclnk} module) which manages such conditions is interfaced with 
    274 routines found in \mdl{lib\_mpp} module when running on an MPP computer (\ie when \key{mpp\_mpi} defined). 
    275 It has to be pointed out that when using the MPP version of the model, 
    276 the east-west cyclic boundary condition is done implicitly, 
    277 whilst the south-symmetric boundary condition option is not available. 
    278  
    279 %>>>>>>>>>>>>>>>>>>>>>>>>>>>> 
     268routines found in \mdl{lib\_mpp} module. 
     269The output file \textit{communication\_report.txt} provides the list of which routines do how 
     270many communications during 1 time step of the model.\\ 
     271 
    280272\begin{figure}[!t] 
    281   \begin{center} 
    282     \includegraphics[width=0.90\textwidth]{Fig_mpp} 
    283     \caption{ 
    284       \protect\label{fig:mpp} 
    285       Positioning of a sub-domain when massively parallel processing is used. 
    286     } 
    287   \end{center} 
     273  \centering 
     274  \includegraphics[width=0.66\textwidth]{LBC_mpp} 
     275  \caption{Positioning of a sub-domain when massively parallel processing is used} 
     276  \label{fig:LBC_mpp} 
    288277\end{figure} 
    289 %>>>>>>>>>>>>>>>>>>>>>>>>>>>> 
    290  
    291 In the standard version of \NEMO, the splitting is regular and arithmetic. 
    292 The i-axis is divided by \jp{jpni} and 
    293 the j-axis by \jp{jpnj} for a number of processors \jp{jpnij} most often equal to $jpni \times jpnj$ 
    294 (parameters set in  \ngn{nammpp} namelist). 
    295 Each processor is independent and without message passing or synchronous process, 
    296 programs run alone and access just its own local memory. 
    297 For this reason, the main model dimensions are now the local dimensions of the subdomain (pencil) that 
    298 are named \jp{jpi}, \jp{jpj}, \jp{jpk}. 
     278 
     279In \NEMO, the splitting is regular and arithmetic. 
     280The total number of subdomains corresponds to the number of MPI processes allocated to \NEMO\ when the model is launched 
     281(\ie\ mpirun -np x ./nemo will automatically give x subdomains). 
     282The i-axis is divided by \np{jpni}{jpni} and the j-axis by \np{jpnj}{jpnj}. 
     283These parameters are defined in \nam{mpp}{mpp} namelist. 
     284If \np{jpni}{jpni} and \np{jpnj}{jpnj} are < 1, they will be automatically redefined in the code to give the best domain decomposition 
     285(see bellow). 
     286 
     287Each processor is independent and without message passing or synchronous process, programs run alone and access just its own local memory. 
     288For this reason, 
     289the main model dimensions are now the local dimensions of the subdomain (pencil) that are named \jp{jpi}, \jp{jpj}, \jp{jpk}. 
    299290These dimensions include the internal domain and the overlapping rows. 
    300 The number of rows to exchange (known as the halo) is usually set to one (\jp{jpreci}=1, in \mdl{par\_oce}). 
    301 The whole domain dimensions are named \np{jpiglo}, \np{jpjglo} and \jp{jpk}. 
     291The number of rows to exchange (known as the halo) is usually set to one (nn\_hls=1, in \mdl{par\_oce}, 
     292and must be kept to one until further notice). 
     293The whole domain dimensions are named \jp{jpiglo}, \jp{jpjglo} and \jp{jpk}. 
    302294The relationship between the whole domain and a sub-domain is: 
     295\begin{gather*} 
     296  jpi = ( jpiglo-2\times nn\_hls + (jpni-1) ) / jpni + 2\times nn\_hls \\ 
     297  jpj = ( jpjglo-2\times nn\_hls + (jpnj-1) ) / jpnj + 2\times nn\_hls 
     298\end{gather*} 
     299 
     300One also defines variables nldi and nlei which correspond to the internal domain bounds, and the variables nimpp and njmpp which are the position of the (1,1) grid-point in the global domain (\autoref{fig:LBC_mpp}). Note that since the version 4, there is no more extra-halo area as defined in \autoref{fig:LBC_mpp} so \jp{jpi} is now always equal to nlci and \jp{jpj} equal to nlcj. 
     301 
     302An element of $T_{l}$, a local array (subdomain) corresponds to an element of $T_{g}$, 
     303a global array (whole domain) by the relationship: 
    303304\[ 
    304   jpi = ( jpiglo-2*jpreci + (jpni-1) ) / jpni + 2*jpreci 
    305   jpj = ( jpjglo-2*jprecj + (jpnj-1) ) / jpnj + 2*jprecj 
    306 \] 
    307 where \jp{jpni}, \jp{jpnj} are the number of processors following the i- and j-axis. 
    308  
    309 One also defines variables nldi and nlei which correspond to the internal domain bounds,  
    310 and the variables nimpp and njmpp which are the position of the (1,1) grid-point in the global domain.  
    311 An element of $T_{l}$, a local array (subdomain) corresponds to an element of $T_{g}$, 
    312 a global array (whole domain) by the relationship:  
    313 \[ 
    314   % \label{eq:lbc_nimpp} 
     305  % \label{eq:LBC_nimpp} 
    315306  T_{g} (i+nimpp-1,j+njmpp-1,k) = T_{l} (i,j,k), 
    316307\] 
    317 with  $1 \leq i \leq jpi$, $1  \leq j \leq jpj $ , and  $1  \leq k \leq jpk$. 
    318  
    319 Processors are numbered from 0 to $jpnij-1$, the number is saved in the variable nproc. 
    320 In the standard version, a processor has no more than 
    321 four neighbouring processors named nono (for north), noea (east), noso (south) and nowe (west) and 
    322 two variables, nbondi and nbondj, indicate the relative position of the processor: 
    323 \begin{itemize} 
    324 \item       nbondi = -1    an east neighbour, no west processor, 
    325 \item       nbondi =  0 an east neighbour, a west neighbour, 
    326 \item       nbondi =  1    no east processor, a west neighbour, 
    327 \item       nbondi =  2    no splitting following the i-axis. 
    328 \end{itemize} 
    329 During the simulation, processors exchange data with their neighbours. 
    330 If there is effectively a neighbour, the processor receives variables from this processor on its overlapping row, 
    331 and sends the data issued from internal domain corresponding to the overlapping row of the other processor. 
    332  
    333  
    334 The \NEMO model computes equation terms with the help of mask arrays (0 on land points and 1 on sea points). 
    335 It is easily readable and very efficient in the context of a computer with vectorial architecture. 
    336 However, in the case of a scalar processor, computations over the land regions become more expensive in 
    337 terms of CPU time.  
    338 It is worse when we use a complex configuration with a realistic bathymetry like the global ocean where 
    339 more than 50 \% of points are land points. 
    340 For this reason, a pre-processing tool can be used to choose the mpp domain decomposition with a maximum number of 
    341 only land points processors, which can then be eliminated (\autoref{fig:mppini2}) 
    342 (For example, the mpp\_optimiz tools, available from the DRAKKAR web site). 
    343 This optimisation is dependent on the specific bathymetry employed. 
    344 The user then chooses optimal parameters \jp{jpni}, \jp{jpnj} and \jp{jpnij} with $jpnij < jpni \times jpnj$, 
    345 leading to the elimination of $jpni \times jpnj - jpnij$ land processors. 
    346 When those parameters are specified in \ngn{nammpp} namelist, 
    347 the algorithm in the \rou{inimpp2} routine sets each processor's parameters (nbound, nono, noea,...) so that 
    348 the land-only processors are not taken into account. 
    349  
    350 \gmcomment{Note that the inimpp2 routine is general so that the original inimpp  
    351 routine should be suppressed from the code.} 
    352  
    353 When land processors are eliminated, 
    354 the value corresponding to these locations in the model output files is undefined. 
    355 Note that this is a problem for the meshmask file which requires to be defined over the whole domain. 
    356 Therefore, user should not eliminate land processors when creating a meshmask file 
    357 (\ie when setting a non-zero value to \np{nn\_msh}). 
    358  
    359 %>>>>>>>>>>>>>>>>>>>>>>>>>>>> 
     308with $1 \leq i \leq jpi$, $1  \leq j \leq jpj $ , and  $1  \leq k \leq jpk$. 
     309 
     310The 1-d arrays $mig(1:\jp{jpi})$ and $mjg(1:\jp{jpj})$, defined in \rou{dom\_glo} routine (\mdl{domain} module), should be used to get global domain indices from local domain indices. The 1-d arrays, $mi0(1:\jp{jpiglo})$, $mi1(1:\jp{jpiglo})$ and $mj0(1:\jp{jpjglo})$, $mj1(1:\jp{jpjglo})$ have the reverse purpose and should be used to define loop indices expressed in global domain indices (see examples in \mdl{dtastd} module).\\ 
     311 
     312The \NEMO\ model computes equation terms with the help of mask arrays (0 on land points and 1 on sea points). It is therefore possible that an MPI subdomain contains only land points. To save ressources, we try to supress from the computational domain as much land subdomains as possible. For example if $N_{mpi}$ processes are allocated to NEMO, the domain decomposition will be given by the following equation: 
     313\[ 
     314  N_{mpi} = jpni \times jpnj - N_{land} + N_{useless} 
     315\] 
     316$N_{land}$ is the total number of land subdomains in the domain decomposition defined by \np{jpni}{jpni} and \np{jpnj}{jpnj}. $N_{useless}$ is the number of land subdomains that are kept in the compuational domain in order to make sure that $N_{mpi}$ MPI processes are indeed allocated to a given subdomain. The values of $N_{mpi}$, \np{jpni}{jpni}, \np{jpnj}{jpnj},  $N_{land}$ and $N_{useless}$ are printed in the output file \texttt{ocean.output}. $N_{useless}$ must, of course, be as small as possible to limit the waste of ressources. A warning is issued in  \texttt{ocean.output} if $N_{useless}$ is not zero. Note that non-zero value of $N_{useless}$ is uselly required when using AGRIF as, up to now, the parent grid and each of the child grids must use all the $N_{mpi}$ processes. 
     317 
     318If the domain decomposition is automatically defined (when \np{jpni}{jpni} and \np{jpnj}{jpnj} are < 1), the decomposition chosen by the model will minimise the sub-domain size (defined as $max_{all domains}(jpi \times jpj)$) and maximize the number of eliminated land subdomains. This means that no other domain decomposition (a set of \np{jpni}{jpni} and \np{jpnj}{jpnj} values) will use less processes than $(jpni  \times  jpnj - N_{land})$ and get a smaller subdomain size. 
     319In order to specify $N_{mpi}$ properly (minimize $N_{useless}$), you must run the model once with \np{ln_list}{ln\_list} activated. In this case, the model will start the initialisation phase, print the list of optimum decompositions ($N_{mpi}$, \np{jpni}{jpni} and \np{jpnj}{jpnj}) in \texttt{ocean.output} and directly abort. The maximum value of $N_{mpi}$ tested in this list is given by $max(N_{MPI\_tasks}, jpni \times jpnj)$. For example, run the model on 40 nodes with ln\_list activated and $jpni = 10000$ and $jpnj = 1$, will print the list of optimum domains decomposition from 1 to about 10000. 
     320 
     321Processors are numbered from 0 to $N_{mpi} - 1$. Subdomains containning some ocean points are numbered first from 0 to $jpni * jpnj - N_{land} -1$. The remaining $N_{useless}$ land subdomains are numbered next, which means that, for a given (\np{jpni}{jpni}, \np{jpnj}{jpnj}), the numbers attributed to he ocean subdomains do not vary with $N_{useless}$. 
     322 
     323When land processors are eliminated, the value corresponding to these locations in the model output files is undefined. \np{ln_mskland}{ln\_mskland} must be activated in order avoid Not a Number values in output files. Note that it is better to not eliminate land processors when creating a meshmask file (\ie\ when setting a non-zero value to \np{nn_msh}{nn\_msh}). 
     324 
    360325\begin{figure}[!ht] 
    361   \begin{center} 
    362     \includegraphics[width=0.90\textwidth]{Fig_mppini2} 
    363     \caption { 
    364       \protect\label{fig:mppini2} 
    365       Example of Atlantic domain defined for the CLIPPER projet. 
    366       Initial grid is composed of 773 x 1236 horizontal points. 
    367       (a) the domain is split onto 9 \time 20 subdomains (jpni=9, jpnj=20). 
    368       52 subdomains are land areas. 
    369       (b) 52 subdomains are eliminated (white rectangles) and 
    370       the resulting number of processors really used during the computation is jpnij=128. 
    371     } 
    372   \end{center} 
     326  \centering 
     327  \includegraphics[width=0.66\textwidth]{LBC_mppini2} 
     328  \caption[Atlantic domain defined for the CLIPPER projet]{ 
     329    Example of Atlantic domain defined for the CLIPPER projet. 
     330    Initial grid is composed of 773 x 1236 horizontal points. 
     331    (a) the domain is split onto 9 $times$ 20 subdomains (jpni=9, jpnj=20). 
     332    52 subdomains are land areas. 
     333    (b) 52 subdomains are eliminated (white rectangles) and 
     334    the resulting number of processors really used during the computation is jpnij=128.} 
     335  \label{fig:LBC_mppini2} 
    373336\end{figure} 
    374 %>>>>>>>>>>>>>>>>>>>>>>>>>>>> 
    375  
    376  
    377 % ==================================================================== 
    378 % Unstructured open boundaries BDY  
    379 % ==================================================================== 
     337 
     338%% ================================================================================================= 
    380339\section{Unstructured open boundary conditions (BDY)} 
    381340\label{sec:LBC_bdy} 
    382341 
    383 %-----------------------------------------nambdy-------------------------------------------- 
    384  
    385 \nlst{nambdy}  
    386 %----------------------------------------------------------------------------------------------- 
    387 %-----------------------------------------nambdy_dta-------------------------------------------- 
    388  
    389 \nlst{nambdy_dta}  
    390 %----------------------------------------------------------------------------------------------- 
    391  
    392 Options are defined through the \ngn{nambdy} \ngn{nambdy\_dta} namelist variables. 
    393 The BDY module is the core implementation of open boundary conditions for regional configurations on  
    394 temperature, salinity, barotropic and baroclinic velocities, as well as ice concentration, ice and snow thicknesses). 
    395  
    396 The BDY module was modelled on the OBC module (see NEMO 3.4) and shares many features and 
    397 a similar coding structure \citep{Chanut2005}. 
     342\begin{listing} 
     343  \nlst{nambdy} 
     344  \caption{\forcode{&nambdy}} 
     345  \label{lst:nambdy} 
     346\end{listing} 
     347 
     348\begin{listing} 
     349  \nlst{nambdy_dta} 
     350  \caption{\forcode{&nambdy_dta}} 
     351  \label{lst:nambdy_dta} 
     352\end{listing} 
     353 
     354Options are defined through the \nam{bdy}{bdy} and \nam{bdy_dta}{bdy\_dta} namelist variables. 
     355The BDY module is the core implementation of open boundary conditions for regional configurations on 
     356ocean temperature, salinity, barotropic-baroclinic velocities, ice-snow concentration, thicknesses, temperatures, salinity and melt ponds concentration and thickness. 
     357 
     358The BDY module was modelled on the OBC module (see \NEMO\ 3.4) and shares many features and 
     359a similar coding structure \citep{chanut_rpt05}. 
    398360The specification of the location of the open boundary is completely flexible and 
    399 allows for example the open boundary to follow an isobath or other irregular contour.  
    400 Boundary data files used with versions of NEMO prior to Version 3.4 may need to be re-ordered to work with this version. 
     361allows any type of setup, from regular boundaries to irregular contour (it includes the possibility to set an open boundary able to follow an isobath). 
     362Boundary data files used with versions of \NEMO\ prior to Version 3.4 may need to be re-ordered to work with this version. 
    401363See the section on the Input Boundary Data Files for details. 
    402364 
    403 %---------------------------------------------- 
     365%% ================================================================================================= 
    404366\subsection{Namelists} 
    405 \label{subsec:BDY_namelist} 
    406  
    407 The BDY module is activated by setting \np{ln\_bdy}\forcode{ = .true.} . 
     367\label{subsec:LBC_bdy_namelist} 
     368 
     369The BDY module is activated by setting \np[=.true.]{ln_bdy}{ln\_bdy} . 
    408370It is possible to define more than one boundary ``set'' and apply different boundary conditions to each set. 
    409 The number of boundary sets is defined by \np{nb\_bdy}. 
    410 Each boundary set may be defined as a set of straight line segments in a namelist 
    411 (\np{ln\_coords\_file}\forcode{ = .false.}) or read in from a file (\np{ln\_coords\_file}\forcode{ = .true.}). 
    412 If the set is defined in a namelist, then the namelists \ngn{nambdy\_index} must be included separately, one for each set. 
    413 If the set is defined by a file, then a ``\ifile{coordinates.bdy}'' file must be provided. 
    414 The coordinates.bdy file is analagous to the usual NEMO ``\ifile{coordinates}'' file. 
     371The number of boundary sets is defined by \np{nb_bdy}{nb\_bdy}. 
     372Each boundary set can be either defined as a series of straight line segments directly in the namelist 
     373(\np[=.false.]{ln_coords_file}{ln\_coords\_file}, and a namelist block \nam{bdy_index}{bdy\_index} must be included for each set) or read in from a file (\np[=.true.]{ln_coords_file}{ln\_coords\_file}, and a ``\ifile{coordinates.bdy}'' file must be provided). 
     374The coordinates.bdy file is analagous to the usual \NEMO\ ``\ifile{coordinates}'' file. 
    415375In the example above, there are two boundary sets, the first of which is defined via a file and 
    416 the second is defined in a namelist. 
    417 For more details of the definition of the boundary geometry see section \autoref{subsec:BDY_geometry}. 
     376the second is defined in the namelist. 
     377For more details of the definition of the boundary geometry see section \autoref{subsec:LBC_bdy_geometry}. 
    418378 
    419379For each boundary set a boundary condition has to be chosen for the barotropic solution 
    420 (``u2d'':sea-surface height and barotropic velocities), for the baroclinic velocities (``u3d''),  
    421 for the active tracers \footnote{The BDY module does not deal with passive tracers at this version} (``tra''), and sea-ice (``ice''). 
    422 For each set of variables there is a choice of algorithm and a choice for the data, 
    423 eg. for the active tracers the algorithm is set by \np{cn\_tra} and the choice of data is set by \np{nn\_tra\_dta}.\\  
     380(``u2d'':sea-surface height and barotropic velocities), for the baroclinic velocities (``u3d''), 
     381for the active tracers \footnote{The BDY module does not deal with passive tracers at this version} (``tra''), and for sea-ice (``ice''). 
     382For each set of variables one has to choose an algorithm and the boundary data (set resp. by \np{cn_tra}{cn\_tra} and \np{nn_tra_dta}{nn\_tra\_dta} for tracers).\\ 
    424383 
    425384The choice of algorithm is currently as follows: 
    426385 
    427386\begin{description} 
    428 \item[\forcode{'none'}:] No boundary condition applied. 
     387\item [\forcode{'none'}:] No boundary condition applied. 
    429388  So the solution will ``see'' the land points around the edge of the edge of the domain. 
    430 \item[\forcode{'specified'}:] Specified boundary condition applied (only available for baroclinic velocity and tracer variables). 
    431 \item[\forcode{'neumann'}:] Value at the boundary are duplicated (No gradient). Only available for baroclinic velocity and tracer variables. 
    432 \item[\forcode{'frs'}:] Flow Relaxation Scheme (FRS) available for all variables. 
    433 \item[\forcode{'Orlanski'}:] Orlanski radiation scheme (fully oblique) for barotropic, baroclinic and tracer variables.  
    434 \item[\forcode{'Orlanski_npo'}:] Orlanski radiation scheme for barotropic, baroclinic and tracer variables.  
    435 \item[\forcode{'flather'}:] Flather radiation scheme for the barotropic variables only. 
     389\item [\forcode{'specified'}:] Specified boundary condition applied (only available for baroclinic velocity and tracer variables). 
     390\item [\forcode{'neumann'}:] Value at the boundary are duplicated (No gradient). Only available for baroclinic velocity and tracer variables. 
     391\item [\forcode{'frs'}:] Flow Relaxation Scheme (FRS) available for all variables. 
     392\item [\forcode{'Orlanski'}:] Orlanski radiation scheme (fully oblique) for barotropic, baroclinic and tracer variables. 
     393\item [\forcode{'Orlanski_npo'}:] Orlanski radiation scheme for barotropic, baroclinic and tracer variables. 
     394\item [\forcode{'flather'}:] Flather radiation scheme for the barotropic variables only. 
    436395\end{description} 
    437396 
    438 The main choice for the boundary data is to use initial conditions as boundary data 
    439 (\np{nn\_tra\_dta}\forcode{ = 0}) or to use external data from a file (\np{nn\_tra\_dta}\forcode{ = 1}). 
    440 In case the 3d velocity data contain the total velocity (ie, baroclinic and barotropic velocity),  
    441 the bdy code can derived baroclinic and barotropic velocities by setting \np{ln\_full\_vel}\forcode{ = .true. } 
     397The boundary data is either set to initial conditions 
     398(\np[=0]{nn_tra_dta}{nn\_tra\_dta}) or forced with external data from a file (\np[=1]{nn_tra_dta}{nn\_tra\_dta}). 
     399In case the 3d velocity data contain the total velocity (ie, baroclinic and barotropic velocity), 
     400the bdy code can derived baroclinic and barotropic velocities by setting \np[=.true.]{ln_full_vel}{ln\_full\_vel} 
    442401For the barotropic solution there is also the option to use tidal harmonic forcing either by 
    443 itself (\np{nn\_dyn2d\_dta}\forcode{ = 2}) or in addition to other external data (\np{nn\_dyn2d\_dta}\forcode{ = 3}).\\ 
    444 Sea-ice salinity, temperature and age data at the boundary are constant and defined repectively by \np{rn\_ice\_sal}, \np{rn\_ice\_tem} and \np{rn\_ice\_age}.  
    445  
    446 If external boundary data is required then the \ngn{nambdy\_dta} namelist must be defined. 
    447 One \ngn{nambdy\_dta} namelist is required for each boundary set in the order in which 
    448 the boundary sets are defined in nambdy. 
    449 In the example given, two boundary sets have been defined. The first one is reading data file in the \ngn{nambdy\_dta} namelist shown above  
    450 and the second one is using data from intial condition (no namelist bloc needed). 
     402itself (\np[=2]{nn_dyn2d_dta}{nn\_dyn2d\_dta}) or in addition to other external data (\np[=3]{nn_dyn2d_dta}{nn\_dyn2d\_dta}).\\ 
     403If not set to initial conditions, sea-ice salinity, temperatures and melt ponds data at the boundary can either be read in a file or defined as constant (by \np{rn_ice_sal}{rn\_ice\_sal}, \np{rn_ice_tem}{rn\_ice\_tem}, \np{rn_ice_apnd}{rn\_ice\_apnd}, \np{rn_ice_hpnd}{rn\_ice\_hpnd}). Ice age is constant and defined by \np{rn_ice_age}{rn\_ice\_age}. 
     404 
     405If external boundary data is required then the \nam{bdy_dta}{bdy\_dta} namelist must be defined. 
     406One \nam{bdy_dta}{bdy\_dta} namelist is required for each boundary set, adopting the same order of indexes in which the boundary sets are defined in nambdy. 
     407In the example given, two boundary sets have been defined. The first one is reading data file in the \nam{bdy_dta}{bdy\_dta} namelist shown above 
     408and the second one is using data from intial condition (no namelist block needed). 
    451409The boundary data is read in using the fldread module, 
    452 so the \ngn{nambdy\_dta} namelist is in the format required for fldread. 
    453 For each variable required, the filename, the frequency of the files and 
    454 the frequency of the data in the files is given. 
    455 Also whether or not time-interpolation is required and whether the data is climatological (time-cyclic) data.\\ 
     410so the \nam{bdy_dta}{bdy\_dta} namelist is in the format required for fldread. 
     411For each required variable, the filename, the frequency of the files and 
     412the frequency of the data in the files are given. 
     413Also whether or not time-interpolation is required and whether the data is climatological (time-cyclic) data. 
     414For sea-ice salinity, temperatures and melt ponds, reading the files are skipped and constant values are used if filenames are defined as {'NOT USED'}.\\ 
    456415 
    457416There is currently an option to vertically interpolate the open boundary data onto the native grid at run-time. 
    458 If \np{nn\_bdy\_jpk} $< -1$, it is assumed that the lateral boundary data are already on the native grid.  
    459 However, if \np{nn\_bdy\_jpk} is set to the number of vertical levels present in the boundary data,  
    460 a bilinear interpolation onto the native grid will be triggered at runtime.  
    461 For this to be successful the additional variables: $gdept$, $gdepu$, $gdepv$, $e3t$, $e3u$ and $e3v$, are required to be present in the lateral boundary files.  
    462 These correspond to the depths and scale factors of the input data,  
     417If \np{nn_bdy_jpk}{nn\_bdy\_jpk}$<-1$, it is assumed that the lateral boundary data are already on the native grid. 
     418However, if \np{nn_bdy_jpk}{nn\_bdy\_jpk} is set to the number of vertical levels present in the boundary data, 
     419a bilinear interpolation onto the native grid will be triggered at runtime. 
     420For this to be successful the additional variables: $gdept$, $gdepu$, $gdepv$, $e3t$, $e3u$ and $e3v$, are required to be present in the lateral boundary files. 
     421These correspond to the depths and scale factors of the input data, 
    463422the latter used to make any adjustment to the velocity fields due to differences in the total water depths between the two vertical grids.\\ 
    464423 
    465 In the example namelists given, two boundary sets are defined. 
     424In the example of given namelists, two boundary sets are defined. 
    466425The first set is defined via a file and applies FRS conditions to temperature and salinity and 
    467426Flather conditions to the barotropic variables. No condition specified for the baroclinic velocity and sea-ice. 
     
    469428Tidal harmonic forcing is also used. 
    470429The second set is defined in a namelist. 
    471 FRS conditions are applied on temperature and salinity and climatological data is read from initial condition files.  
    472  
    473 %---------------------------------------------- 
     430FRS conditions are applied on temperature and salinity and climatological data is read from initial condition files. 
     431 
     432%% ================================================================================================= 
    474433\subsection{Flow relaxation scheme} 
    475 \label{subsec:BDY_FRS_scheme} 
    476  
    477 The Flow Relaxation Scheme (FRS) \citep{Davies_QJRMS76,Engerdahl_Tel95}, 
     434\label{subsec:LBC_bdy_FRS_scheme} 
     435 
     436The Flow Relaxation Scheme (FRS) \citep{davies_QJRMS76,engedahl_T95}, 
    478437applies a simple relaxation of the model fields to externally-specified values over 
    479438a zone next to the edge of the model domain. 
    480439Given a model prognostic variable $\Phi$ 
    481440\[ 
    482   % \label{eq:bdy_frs1} 
     441  % \label{eq:LBC_bdy_frs1} 
    483442  \Phi(d) = \alpha(d)\Phi_{e}(d) + (1-\alpha(d))\Phi_{m}(d)\;\;\;\;\; d=1,N 
    484443\] 
     
    489448the prognostic equation for $\Phi$ of the form: 
    490449\[ 
    491   % \label{eq:bdy_frs2} 
     450  % \label{eq:LBC_bdy_frs2} 
    492451  -\frac{1}{\tau}\left(\Phi - \Phi_{e}\right) 
    493452\] 
    494453where the relaxation time scale $\tau$ is given by a function of $\alpha$ and the model time step $\Delta t$: 
    495454\[ 
    496   % \label{eq:bdy_frs3} 
     455  % \label{eq:LBC_bdy_frs3} 
    497456  \tau = \frac{1-\alpha}{\alpha}  \,\rdt 
    498457\] 
     
    500459is relaxed towards the external conditions over the rest of the FRS zone. 
    501460The application of a relaxation zone helps to prevent spurious reflection of 
    502 outgoing signals from the model boundary.  
     461outgoing signals from the model boundary. 
    503462 
    504463The function $\alpha$ is specified as a $tanh$ function: 
    505464\[ 
    506   % \label{eq:bdy_frs4} 
     465  % \label{eq:LBC_bdy_frs4} 
    507466  \alpha(d) = 1 - \tanh\left(\frac{d-1}{2}\right),       \quad d=1,N 
    508467\] 
    509 The width of the FRS zone is specified in the namelist as \np{nn\_rimwidth}. 
     468The width of the FRS zone is specified in the namelist as \np{nn_rimwidth}{nn\_rimwidth}. 
    510469This is typically set to a value between 8 and 10. 
    511470 
    512 %---------------------------------------------- 
     471%% ================================================================================================= 
    513472\subsection{Flather radiation scheme} 
    514 \label{subsec:BDY_flather_scheme} 
    515  
    516 The \citet{Flather_JPO94} scheme is a radiation condition on the normal, 
     473\label{subsec:LBC_bdy_flather_scheme} 
     474 
     475The \citet{flather_JPO94} scheme is a radiation condition on the normal, 
    517476depth-mean transport across the open boundary. 
    518477It takes the form 
    519 \begin{equation}  \label{eq:bdy_fla1} 
    520 U = U_{e} + \frac{c}{h}\left(\eta - \eta_{e}\right), 
     478\begin{equation} 
     479  \label{eq:LBC_bdy_fla1} 
     480  U = U_{e} + \frac{c}{h}\left(\eta - \eta_{e}\right), 
    521481\end{equation} 
    522482where $U$ is the depth-mean velocity normal to the boundary and $\eta$ is the sea surface height, 
     
    527487the external depth-mean normal velocity, 
    528488plus a correction term that allows gravity waves generated internally to exit the model boundary. 
    529 Note that the sea-surface height gradient in \autoref{eq:bdy_fla1} is a spatial gradient across the model boundary, 
     489Note that the sea-surface height gradient in \autoref{eq:LBC_bdy_fla1} is a spatial gradient across the model boundary, 
    530490so that $\eta_{e}$ is defined on the $T$ points with $nbr=1$ and $\eta$ is defined on the $T$ points with $nbr=2$. 
    531 $U$ and $U_{e}$ are defined on the $U$ or $V$ points with $nbr=1$, \ie between the two $T$ grid points. 
    532  
    533 %---------------------------------------------- 
     491$U$ and $U_{e}$ are defined on the $U$ or $V$ points with $nbr=1$, \ie\ between the two $T$ grid points. 
     492 
     493%% ================================================================================================= 
    534494\subsection{Orlanski radiation scheme} 
    535 \label{subsec:BDY_orlanski_scheme} 
    536  
    537 The Orlanski scheme is based on the algorithm described by \citep{Marchesiello2001}, hereafter MMS. 
     495\label{subsec:LBC_bdy_orlanski_scheme} 
     496 
     497The Orlanski scheme is based on the algorithm described by \citep{marchesiello.mcwilliams.ea_OM01}, hereafter MMS. 
    538498 
    539499The adaptive Orlanski condition solves a wave plus relaxation equation at the boundary: 
    540500\begin{equation} 
    541 \frac{\partial\phi}{\partial t} + c_x \frac{\partial\phi}{\partial x} + c_y \frac{\partial\phi}{\partial y} = 
    542                                                 -\frac{1}{\tau}(\phi - \phi^{ext}) 
    543 \label{eq:wave_continuous} 
     501  \label{eq:LBC_wave_continuous} 
     502  \frac{\partial\phi}{\partial t} + c_x \frac{\partial\phi}{\partial x} + c_y \frac{\partial\phi}{\partial y} = 
     503  -\frac{1}{\tau}(\phi - \phi^{ext}) 
    544504\end{equation} 
    545505 
     
    547507velocities are diagnosed from the model fields as: 
    548508 
    549 \begin{equation} \label{eq:cx} 
    550 c_x = -\frac{\partial\phi}{\partial t}\frac{\partial\phi / \partial x}{(\partial\phi /\partial x)^2 + (\partial\phi /\partial y)^2} 
     509\begin{equation} 
     510  \label{eq:LBC_cx} 
     511  c_x = -\frac{\partial\phi}{\partial t}\frac{\partial\phi / \partial x}{(\partial\phi /\partial x)^2 + (\partial\phi /\partial y)^2} 
    551512\end{equation} 
    552513\begin{equation} 
    553 \label{eq:cy} 
    554 c_y = -\frac{\partial\phi}{\partial t}\frac{\partial\phi / \partial y}{(\partial\phi /\partial x)^2 + (\partial\phi /\partial y)^2} 
     514  \label{eq:LBC_cy} 
     515  c_y = -\frac{\partial\phi}{\partial t}\frac{\partial\phi / \partial y}{(\partial\phi /\partial x)^2 + (\partial\phi /\partial y)^2} 
    555516\end{equation} 
    556517 
    557518(As noted by MMS, this is a circular diagnosis of the phase speeds which only makes sense on a discrete grid). 
    558 Equation (\autoref{eq:wave_continuous}) is defined adaptively depending on the sign of the phase velocity normal to the boundary $c_x$. 
     519Equation (\autoref{eq:LBC_wave_continuous}) is defined adaptively depending on the sign of the phase velocity normal to the boundary $c_x$. 
    559520For $c_x$ outward, we have 
    560521 
     
    566527 
    567528\begin{equation} 
    568 \tau = \tau_{in}\,\,\,;\,\,\, c_x = c_y = 0 
    569 \label{eq:tau_in} 
     529  \label{eq:LBC_tau_in} 
     530  \tau = \tau_{in}\,\,\,;\,\,\, c_x = c_y = 0 
    570531\end{equation} 
    571532 
    572 Generally the relaxation time scale at inward propagation points \np{(rn\_time\_dmp}) is set much shorter than the time scale at outward propagation 
    573 points (\np{rn\_time\_dmp\_out}) so that the solution is constrained more strongly by the external data at inward propagation points. 
    574 See \autoref{subsec:BDY_relaxation} for detailed on the spatial shape of the scaling.\\  
    575 The ``normal propagation of oblique radiation'' or NPO approximation (called \forcode{'orlanski_npo'}) involves assuming  
    576 that $c_y$ is zero in equation (\autoref{eq:wave_continuous}), but including 
    577 this term in the denominator of equation (\autoref{eq:cx}). Both versions of the scheme are options in BDY. Equations 
    578 (\autoref{eq:wave_continuous}) - (\autoref{eq:tau_in}) correspond to equations (13) - (15) and (2) - (3) in MMS.\\ 
    579  
    580 %---------------------------------------------- 
     533Generally the relaxation time scale at inward propagation points (\np{rn_time_dmp}{rn\_time\_dmp}) is set much shorter than the time scale at outward propagation 
     534points (\np{rn_time_dmp_out}{rn\_time\_dmp\_out}) so that the solution is constrained more strongly by the external data at inward propagation points. 
     535See \autoref{subsec:LBC_bdy_relaxation} for detailed on the spatial shape of the scaling.\\ 
     536The ``normal propagation of oblique radiation'' or NPO approximation (called \forcode{'orlanski_npo'}) involves assuming 
     537that $c_y$ is zero in equation (\autoref{eq:LBC_wave_continuous}), but including 
     538this term in the denominator of equation (\autoref{eq:LBC_cx}). Both versions of the scheme are options in BDY. Equations 
     539(\autoref{eq:LBC_wave_continuous}) - (\autoref{eq:LBC_tau_in}) correspond to equations (13) - (15) and (2) - (3) in MMS.\\ 
     540 
     541%% ================================================================================================= 
    581542\subsection{Relaxation at the boundary} 
    582 \label{subsec:BDY_relaxation} 
    583  
    584 In addition to a specific boundary condition specified as \np{cn\_tra} and \np{cn\_dyn3d}, relaxation on baroclinic velocities and tracers variables are available.  
    585 It is control by the namelist parameter \np{ln\_tra\_dmp} and \np{ln\_dyn3d\_dmp} for each boundary set. 
    586  
    587 The relaxation time scale value (\np{rn\_time\_dmp} and \np{rn\_time\_dmp\_out}, $\tau$) are defined at the boundaries itself.  
    588 This time scale ($\alpha$) is weighted by the distance ($d$) from the boundary over \np{nn\_rimwidth} cells ($N$): 
     543\label{subsec:LBC_bdy_relaxation} 
     544 
     545In addition to a specific boundary condition specified as \np{cn_tra}{cn\_tra} and \np{cn_dyn3d}{cn\_dyn3d}, relaxation on baroclinic velocities and tracers variables are available. 
     546It is control by the namelist parameter \np{ln_tra_dmp}{ln\_tra\_dmp} and \np{ln_dyn3d_dmp}{ln\_dyn3d\_dmp} for each boundary set. 
     547 
     548The relaxation time scale value (\np{rn_time_dmp}{rn\_time\_dmp} and \np{rn_time_dmp_out}{rn\_time\_dmp\_out}, $\tau$) are defined at the boundaries itself. 
     549This time scale ($\alpha$) is weighted by the distance ($d$) from the boundary over \np{nn_rimwidth}{nn\_rimwidth} cells ($N$): 
    589550 
    590551\[ 
     
    592553\] 
    593554 
    594 The same scaling is applied in the Orlanski damping.  
    595  
    596 %---------------------------------------------- 
     555The same scaling is applied in the Orlanski damping. 
     556 
     557%% ================================================================================================= 
    597558\subsection{Boundary geometry} 
    598 \label{subsec:BDY_geometry} 
     559\label{subsec:LBC_bdy_geometry} 
    599560 
    600561Each open boundary set is defined as a list of points. 
    601562The information is stored in the arrays $nbi$, $nbj$, and $nbr$ in the $idx\_bdy$ structure. 
    602 The $nbi$ and $nbj$ arrays define the local $(i,j)$ indices of each point in the boundary zone and 
    603 the $nbr$ array defines the discrete distance from the boundary with $nbr=1$ meaning that 
    604 the point is next to the edge of the model domain and $nbr>1$ showing that 
    605 the point is increasingly further away from the edge of the model domain. 
     563The $nbi$ and $nbj$ arrays define the local $(i,j)$ indexes of each point in the boundary zone and 
     564the $nbr$ array defines the discrete distance from the boundary: $nbr=1$ means that 
     565the boundary point is next to the edge of the model domain, while $nbr>1$ means that 
     566the boundary point is increasingly further away from the edge of the model domain. 
    606567A set of $nbi$, $nbj$, and $nbr$ arrays is defined for each of the $T$, $U$ and $V$ grids. 
    607 Figure \autoref{fig:LBC_bdy_geom} shows an example of an irregular boundary.  
     568\autoref{fig:LBC_bdy_geom} shows an example of an irregular boundary. 
    608569 
    609570The boundary geometry for each set may be defined in a namelist nambdy\_index or 
    610571by reading in a ``\ifile{coordinates.bdy}'' file. 
    611572The nambdy\_index namelist defines a series of straight-line segments for north, east, south and west boundaries. 
    612 One nambdy\_index namelist bloc is needed for each boundary condition defined by indexes.  
    613 For the northern boundary, \np{nbdysegn} gives the number of segments, 
    614 \np{jpjnob} gives the $j$ index for each segment and \np{jpindt} and 
    615 \np{jpinft} give the start and end $i$ indices for each segment with similar for the other boundaries. 
     573One nambdy\_index namelist block is needed for each boundary condition defined by indexes. 
     574For the northern boundary, \texttt{nbdysegn} gives the number of segments, 
     575\jp{jpjnob} gives the $j$ index for each segment and \jp{jpindt} and 
     576\jp{jpinft} give the start and end $i$ indices for each segment with similar for the other boundaries. 
    616577These segments define a list of $T$ grid points along the outermost row of the boundary ($nbr\,=\, 1$). 
    617 The code deduces the $U$ and $V$ points and also the points for $nbr\,>\, 1$ if \np{nn\_rimwidth}\forcode{ > 1}. 
     578The code deduces the $U$ and $V$ points and also the points for $nbr\,>\, 1$ if \np[>1]{nn_rimwidth}{nn\_rimwidth}. 
    618579 
    619580The boundary geometry may also be defined from a ``\ifile{coordinates.bdy}'' file. 
    620 Figure \autoref{fig:LBC_nc_header} gives an example of the header information from such a file. 
     581\autoref{fig:LBC_nc_header} gives an example of the header information from such a file, based on the description of geometrical setup given above. 
    621582The file should contain the index arrays for each of the $T$, $U$ and $V$ grids. 
    622583The arrays must be in order of increasing $nbr$. 
     
    624585Typically this file will be used to generate external boundary data via interpolation and so 
    625586will also contain the latitudes and longitudes of each point as shown. 
    626 However, this is not necessary to run the model.  
     587However, this is not necessary to run the model. 
    627588 
    628589For some choices of irregular boundary the model domain may contain areas of ocean which 
    629590are not part of the computational domain. 
    630 For example if an open boundary is defined along an isobath, say at the shelf break, 
     591For example, if an open boundary is defined along an isobath, say at the shelf break, 
    631592then the areas of ocean outside of this boundary will need to be masked out. 
    632 This can be done by reading a mask file defined as \np{cn\_mask\_file} in the nam\_bdy namelist. 
     593This can be done by reading a mask file defined as \np{cn_mask_file}{cn\_mask\_file} in the nam\_bdy namelist. 
    633594Only one mask file is used even if multiple boundary sets are defined. 
    634595 
    635 %>>>>>>>>>>>>>>>>>>>>>>>>>>>> 
    636596\begin{figure}[!t] 
    637   \begin{center} 
    638     \includegraphics[width=1.0\textwidth]{Fig_LBC_bdy_geom} 
    639     \caption { 
    640       \protect\label{fig:LBC_bdy_geom} 
    641       Example of geometry of unstructured open boundary 
    642     } 
    643   \end{center} 
     597  \centering 
     598  \includegraphics[width=0.66\textwidth]{LBC_bdy_geom} 
     599  \caption[Geometry of unstructured open boundary]{Example of geometry of unstructured open boundary} 
     600  \label{fig:LBC_bdy_geom} 
    644601\end{figure} 
    645 %>>>>>>>>>>>>>>>>>>>>>>>>>>>> 
    646  
    647 %---------------------------------------------- 
     602 
     603%% ================================================================================================= 
    648604\subsection{Input boundary data files} 
    649 \label{subsec:BDY_data} 
     605\label{subsec:LBC_bdy_data} 
    650606 
    651607The data files contain the data arrays in the order in which the points are defined in the $nbi$ and $nbj$ arrays. 
     
    653609a time dimension; 
    654610$xb$ which is the index of the boundary data point in the horizontal; 
    655 and $yb$ which is a degenerate dimension of 1 to enable the file to be read by the standard NEMO I/O routines. 
    656 The 3D fields also have a depth dimension.  
     611and $yb$ which is a degenerate dimension of 1 to enable the file to be read by the standard \NEMO\ I/O routines. 
     612The 3D fields also have a depth dimension. 
    657613 
    658614From Version 3.4 there are new restrictions on the order in which the boundary points are defined 
     
    665621\item All the data for a particular boundary set must be in the same order. 
    666622  (Prior to 3.4 it was possible to define barotropic data in a different order to 
    667   the data for tracers and baroclinic velocities).  
     623  the data for tracers and baroclinic velocities). 
    668624\end{enumerate} 
    669625 
    670626These restrictions mean that data files used with versions of the 
    671627model prior to Version 3.4 may not work with Version 3.4 onwards. 
    672 A \fortran utility {\it bdy\_reorder} exists in the TOOLS directory which 
     628A \fortran\ utility {\itshape bdy\_reorder} exists in the TOOLS directory which 
    673629will re-order the data in old BDY data files. 
    674630 
    675 %>>>>>>>>>>>>>>>>>>>>>>>>>>>> 
    676631\begin{figure}[!t] 
    677   \begin{center} 
    678     \includegraphics[width=1.0\textwidth]{Fig_LBC_nc_header} 
    679     \caption { 
    680       \protect\label{fig:LBC_nc_header} 
    681       Example of the header for a \protect\ifile{coordinates.bdy} file 
    682     } 
    683   \end{center} 
     632  \centering 
     633  \includegraphics[width=0.66\textwidth]{LBC_nc_header} 
     634  \caption[Header for a \protect\ifile{coordinates.bdy} file]{ 
     635    Example of the header for a \protect\ifile{coordinates.bdy} file} 
     636  \label{fig:LBC_nc_header} 
    684637\end{figure} 
    685 %>>>>>>>>>>>>>>>>>>>>>>>>>>>> 
    686  
    687 %---------------------------------------------- 
     638 
     639%% ================================================================================================= 
    688640\subsection{Volume correction} 
    689 \label{subsec:BDY_vol_corr} 
     641\label{subsec:LBC_bdy_vol_corr} 
    690642 
    691643There is an option to force the total volume in the regional model to be constant. 
    692 This is controlled  by the \np{ln\_vol} parameter in the namelist. 
    693 A value of \np{ln\_vol}\forcode{ = .false.} indicates that this option is not used. 
    694 Two options to control the volume are available (\np{nn\_volctl}).  
    695 If \np{nn\_volctl}\forcode{ = 0} then a correction is applied to the normal barotropic velocities around the boundary at 
     644This is controlled  by the \np{ln_vol}{ln\_vol} parameter in the namelist. 
     645A value of \np[=.false.]{ln_vol}{ln\_vol} indicates that this option is not used. 
     646Two options to control the volume are available (\np{nn_volctl}{nn\_volctl}). 
     647If \np[=0]{nn_volctl}{nn\_volctl} then a correction is applied to the normal barotropic velocities around the boundary at 
    696648each timestep to ensure that the integrated volume flow through the boundary is zero. 
    697 If \np{nn\_volctl}\forcode{ = 1} then the calculation of the volume change on 
     649If \np[=1]{nn_volctl}{nn\_volctl} then the calculation of the volume change on 
    698650the timestep includes the change due to the freshwater flux across the surface and 
    699651the correction velocity corrects for this as well. 
     
    702654applied to all boundaries at once. 
    703655 
    704 %---------------------------------------------- 
     656%% ================================================================================================= 
    705657\subsection{Tidal harmonic forcing} 
    706 \label{subsec:BDY_tides} 
    707  
    708 %-----------------------------------------nambdy_tide-------------------------------------------- 
    709  
    710 \nlst{nambdy_tide}  
    711 %----------------------------------------------------------------------------------------------- 
     658\label{subsec:LBC_bdy_tides} 
     659 
     660\begin{listing} 
     661  \nlst{nambdy_tide} 
     662  \caption{\forcode{&nambdy_tide}} 
     663  \label{lst:nambdy_tide} 
     664\end{listing} 
    712665 
    713666Tidal forcing at open boundaries requires the activation of surface 
    714 tides (i.e., in \ngn{nam\_tide}, \np{ln\_tide} needs to be set to 
     667tides (i.e., in \nam{_tide}{\_tide}, \np{ln_tide}{ln\_tide} needs to be set to 
    715668\forcode{.true.} and the required constituents need to be activated by 
    716 including their names in the \np{cname} array; see 
     669including their names in the \np{clname}{clname} array; see 
    717670\autoref{sec:SBC_tide}). Specific options related to the reading in of 
    718671the complex harmonic amplitudes of elevation (SSH) and barotropic 
    719672velocity (u,v) at open boundaries are defined through the 
    720 \ngn{nambdy\_tide} namelist parameters.\\ 
     673\nam{bdy_tide}{bdy\_tide} namelist parameters.\\ 
    721674 
    722675The tidal harmonic data at open boundaries can be specified in two 
    723676different ways, either on a two-dimensional grid covering the entire 
    724677model domain or along open boundary segments; these two variants can 
    725 be selected by setting \np{ln\_bdytide\_2ddta } to \forcode{.true.} or 
     678be selected by setting \np{ln_bdytide_2ddta }{ln\_bdytide\_2ddta } to \forcode{.true.} or 
    726679\forcode{.false.}, respectively. In either case, the real and 
    727680imaginary parts of SSH and the two barotropic velocity components for 
     
    729682separately: when two-dimensional data is used, variables 
    730683\textit{tcname\_z1} and \textit{tcname\_z2} for real and imaginary SSH, 
    731 respectively, are expected in input file \np{filtide} with suffix 
     684respectively, are expected in input file \np{filtide}{filtide} with suffix 
    732685\ifile{\_grid\_T}, variables \textit{tcname\_u1} and 
    733686\textit{tcname\_u2} for real and imaginary u, respectively, are 
    734 expected in input file \np{filtide} with suffix \ifile{\_grid\_U}, and 
     687expected in input file \np{filtide}{filtide} with suffix \ifile{\_grid\_U}, and 
    735688\textit{tcname\_v1} and \textit{tcname\_v2} for real and imaginary v, 
    736 respectively, are expected in input file \np{filtide} with suffix 
     689respectively, are expected in input file \np{filtide}{filtide} with suffix 
    737690\ifile{\_grid\_V}; when data along open boundary segments is used, 
    738691variables \textit{z1} and \textit{z2} (real and imaginary part of SSH) 
    739 are expected to be available from file \np{filtide} with suffix 
     692are expected to be available from file \np{filtide}{filtide} with suffix 
    740693\ifile{tcname\_grid\_T}, variables \textit{u1} and \textit{u2} (real 
    741694and imaginary part of u) are expected to be available from file 
    742 \np{filtide} with suffix \ifile{tcname\_grid\_U}, and variables 
     695\np{filtide}{filtide} with suffix \ifile{tcname\_grid\_U}, and variables 
    743696\textit{v1} and \textit{v2} (real and imaginary part of v) are 
    744 expected to be available from file \np{filtide} with suffix 
    745 \ifile{tcname\_grid\_V}. If \np{ln\_bdytide\_conj} is set to 
     697expected to be available from file \np{filtide}{filtide} with suffix 
     698\ifile{tcname\_grid\_V}. If \np{ln_bdytide_conj}{ln\_bdytide\_conj} is set to 
    746699\forcode{.true.}, the data is expected to be in complex conjugate 
    747700form. 
     
    755708direction of rotation). %, e.g. anticlockwise or clockwise. 
    756709 
    757 \biblio 
    758  
    759 \pindex 
     710\subinc{\input{../../global/epilogue}} 
    760711 
    761712\end{document} 
Note: See TracChangeset for help on using the changeset viewer.