OGS
MathLib::PETScVector Class Reference

Detailed Description

Wrapper class for PETSc vector.

Definition at line 32 of file PETScVector.h.

#include <PETScVector.h>

Public Types

using IndexType = PetscInt
 
using PETSc_Vec = Vec
 

Public Member Functions

 PETScVector ()
 
 PETScVector (const PetscInt vec_size, const bool is_global_size=true)
 Constructor.
 
 PETScVector (const PetscInt vec_size, const std::vector< PetscInt > &ghost_ids, const bool is_global_size=true)
 Constructor.
 
 PETScVector (const PETScVector &existing_vec, const bool deep_copy=true)
 Copy constructor.
 
 PETScVector (PETScVector &&other)
 
 ~PETScVector ()
 
void finalizeAssembly ()
 Perform MPI collection of assembled entries in buffer.
 
PetscInt size () const
 Get the global size of the vector.
 
PetscInt getLocalSize () const
 Get the number of entries in the same rank.
 
PetscInt getGhostSize () const
 Get the number of ghost entries in the same rank.
 
PetscInt getRangeBegin () const
 Get the start index of the local vector.
 
PetscInt getRangeEnd () const
 Get the end index of the local vector.
 
void set (const PetscInt i, const PetscScalar value)
 
void add (const PetscInt i, const PetscScalar value)
 
template<class T_SUBVEC >
void add (const std::vector< PetscInt > &e_idxs, const T_SUBVEC &sub_vec)
 
template<class T_SUBVEC >
void set (const std::vector< PetscInt > &e_idxs, const T_SUBVEC &sub_vec)
 
void setZero ()
 
PETScVectoroperator= (PETScVector &&)=delete
 
void setLocalAccessibleVector () const
 
std::vector< PetscScalarget (std::vector< IndexType > const &indices) const
 
PetscScalar operator[] (PetscInt idx) const
 
void getGlobalVector (std::vector< PetscScalar > &u) const
 
PetscScalar get (const PetscInt idx) const
 
PETSc_VecgetRawVector ()
 Exposes the underlying PETSc vector.
 
PETSc_Vec constgetRawVector () const
 
void copyValues (std::vector< PetscScalar > &u) const
 
void viewer (const std::string &file_name, const PetscViewerFormat vw_format=PETSC_VIEWER_ASCII_MATLAB) const
 
void shallowCopy (const PETScVector &v)
 

Private Member Functions

void destroy ()
 
void gatherLocalVectors (PetscScalar local_array[], PetscScalar global_array[]) const
 Collect local vectors.
 
PetscScalargetLocalVector () const
 
PetscInt getLocalIndex (const PetscInt global_index) const
 Get local index by a global index.
 
void restoreArray (PetscScalar *array) const
 
void config ()
 A function called by constructors to configure members.
 

Private Attributes

PETSc_Vec v_ = nullptr
 
PETSc_Vec v_loc_ = nullptr
 
PetscInt start_rank_
 Starting index in a rank.
 
PetscInt end_rank_
 Ending index in a rank.
 
PetscInt size_
 Size of the vector.
 
PetscInt size_loc_
 Size of local entries.
 
PetscInt size_ghosts_ = 0
 Size of local ghost entries.
 
bool has_ghost_id_ = false
 Flag to indicate whether the vector is created with ghost entry indices.
 
std::vector< PetscScalarentry_array_
 Array containing the entries of the vector. If the vector is created without given ghost IDs, the array contains all entries of the global vector, v_. Otherwise it only contains the entries of the global vector owned by the current rank.
 
std::map< PetscInt, PetscIntglobal_ids2local_ids_ghost_
 Map global indices of ghost entries to local indices.
 

Friends

void finalizeVectorAssembly (PETScVector &vec)
 Function to finalize the vector assembly.
 

Member Typedef Documentation

◆ IndexType

◆ PETSc_Vec

Definition at line 38 of file PETScVector.h.

Constructor & Destructor Documentation

◆ PETScVector() [1/5]

MathLib::PETScVector::PETScVector ( )
inline

Definition at line 41 of file PETScVector.h.

41{}

◆ PETScVector() [2/5]

MathLib::PETScVector::PETScVector ( const PetscInt vec_size,
const bool is_global_size = true )

Constructor.

Parameters
vec_sizeThe size of the vector, either global or local
is_global_sizeThe flag of the type of vec_size, i.e. whether it is a global size or local size. The default is true. If is_global_size is true, the vector is created by the global size, the local size of the vector is determined by PETSc, and vice versa is the same.

Definition at line 30 of file PETScVector.cpp.

31{
32 if (is_global_size)
33 {
36 }
37 else
38 {
39 // Fix size partitioning
40 // the size can be associated to specific memory allocation of a matrix
42 }
43
44 config();
45}
void config()
A function called by constructors to configure members.
void set(const PetscInt i, const PetscScalar value)
Definition PETScVector.h:97

References config(), set(), and v_.

◆ PETScVector() [3/5]

MathLib::PETScVector::PETScVector ( const PetscInt vec_size,
const std::vector< PetscInt > & ghost_ids,
const bool is_global_size = true )

Constructor.

Parameters
vec_sizeThe size of the vector, either global or local
ghost_idsThe global indices of ghost entries
is_global_sizeThe flag of the type of vec_size, i.e. whether it is a global size or local size. The default is true.

Definition at line 47 of file PETScVector.cpp.

50 : size_ghosts_{static_cast<PetscInt>(ghost_ids.size())}, has_ghost_id_{true}
51{
52 PetscInt nghosts = static_cast<PetscInt>(ghost_ids.size());
53 if (is_global_size)
54 {
56 ghost_ids.data(), &v_);
57 }
58 else
59 {
64 }
65
66 config();
67
68 for (PetscInt i = 0; i < nghosts; i++)
69 {
71 }
72}
bool has_ghost_id_
Flag to indicate whether the vector is created with ghost entry indices.
PetscInt size_loc_
Size of local entries.
PetscInt size_ghosts_
Size of local ghost entries.
std::map< PetscInt, PetscInt > global_ids2local_ids_ghost_
Map global indices of ghost entries to local indices.

References config(), global_ids2local_ids_ghost_, set(), size_loc_, and v_.

◆ PETScVector() [4/5]

MathLib::PETScVector::PETScVector ( const PETScVector & existing_vec,
const bool deep_copy = true )
explicit

Copy constructor.

Parameters
existing_vecThe vector to be copied
deep_copyThe flag for a deep copy, which means to copy the values as well, the default is true

Definition at line 74 of file PETScVector.cpp.

75{
77
78 // Copy values
79 if (deep_copy)
80 {
82 }
83}
void shallowCopy(const PETScVector &v)

References set(), shallowCopy(), and v_.

◆ PETScVector() [5/5]

MathLib::PETScVector::PETScVector ( PETScVector && other)

Definition at line 85 of file PETScVector.cpp.

86 : v_{std::move(other.v_)},
87 v_loc_{std::move(other.v_loc_)},
88 start_rank_{other.start_rank_},
89 end_rank_{other.end_rank_},
90 size_{other.size_},
91 size_loc_{other.size_loc_},
92 size_ghosts_{other.size_ghosts_},
93 has_ghost_id_{other.has_ghost_id_},
94 global_ids2local_ids_ghost_{other.global_ids2local_ids_ghost_}
95{
96}
PetscInt start_rank_
Starting index in a rank.
PetscInt size_
Size of the vector.
PetscInt end_rank_
Ending index in a rank.

◆ ~PETScVector()

MathLib::PETScVector::~PETScVector ( )
inline

Definition at line 77 of file PETScVector.h.

77{ destroy(); }

References destroy().

Member Function Documentation

◆ add() [1/2]

void MathLib::PETScVector::add ( const PetscInt i,
const PetscScalar value )
inline

Add a value to an entry.

Parameters
iNumber of the entry
valueValue.

Definition at line 107 of file PETScVector.h.

108 {
109 VecSetValue(v_, i, value, ADD_VALUES);
110 }

References set(), and v_.

◆ add() [2/2]

template<class T_SUBVEC >
void MathLib::PETScVector::add ( const std::vector< PetscInt > & e_idxs,
const T_SUBVEC & sub_vec )
inline

Add values to several entries.

Parameters
e_idxsIndices of entries to be added Note: std::size_t cannot be the type of e_idxs template argument.
sub_vecEntries to be added.

Definition at line 120 of file PETScVector.h.

121 {
122 VecSetValues(v_, e_idxs.size(), &e_idxs[0], &sub_vec[0], ADD_VALUES);
123 }

References set(), and v_.

◆ config()

void MathLib::PETScVector::config ( )
private

A function called by constructors to configure members.

Definition at line 98 of file PETScVector.cpp.

References end_rank_, set(), size_, size_loc_, start_rank_, and v_.

Referenced by PETScVector(), PETScVector(), and shallowCopy().

◆ copyValues()

void MathLib::PETScVector::copyValues ( std::vector< PetscScalar > & u) const

Copy local entries including ghost ones to a vector.

Parameters
ua vector for the values of local entries. It will be resized to hold the current vector data.

Definition at line 184 of file PETScVector.cpp.

185{
186 u.resize(getLocalSize() + getGhostSize());
187
189 std::copy_n(loc_x, getLocalSize() + getGhostSize(), u.begin());
191}
void restoreArray(PetscScalar *array) const
PetscInt getLocalSize() const
Get the number of entries in the same rank.
Definition PETScVector.h:84
PetscScalar * getLocalVector() const
PetscInt getGhostSize() const
Get the number of ghost entries in the same rank.
Definition PETScVector.h:86
static const double u

References getGhostSize(), getLocalSize(), getLocalVector(), restoreArray(), set(), and MathLib::u.

Referenced by setLocalAccessibleVector().

◆ destroy()

void MathLib::PETScVector::destroy ( )
inlineprivate

Definition at line 222 of file PETScVector.h.

223 {
224 if (v_ != nullptr)
225 {
226 VecDestroy(&v_);
227 }
228 v_ = nullptr;
229 }

References set(), and v_.

Referenced by ~PETScVector(), and shallowCopy().

◆ finalizeAssembly()

void MathLib::PETScVector::finalizeAssembly ( )

Perform MPI collection of assembled entries in buffer.

Definition at line 109 of file PETScVector.cpp.

110{
113}

References set(), and v_.

Referenced by MathLib::applyKnownSolution(), and MathLib::LinAlg::finalizeAssembly().

◆ gatherLocalVectors()

void MathLib::PETScVector::gatherLocalVectors ( PetscScalar local_array[],
PetscScalar global_array[] ) const
private

Collect local vectors.

Parameters
local_arrayLocal array
global_arrayGlobal array

Definition at line 115 of file PETScVector.cpp.

117{
118 // Collect vectors from processors.
119 int size_rank;
121
122 // number of elements to be sent for each rank
123 std::vector<PetscInt> i_cnt(size_rank);
124
127
128 // collect local array
129 PetscInt offset = 0;
130 // offset in the receive vector of the data from each rank
131 std::vector<PetscInt> i_disp(size_rank);
132 for (PetscInt i = 0; i < size_rank; i++)
133 {
134 i_disp[i] = offset;
135 offset += i_cnt[i];
136 }
137
140}

References set(), and size_loc_.

Referenced by getGlobalVector().

◆ get() [1/2]

PetscScalar MathLib::PETScVector::get ( const PetscInt idx) const

Definition at line 193 of file PETScVector.cpp.

194{
195 if (!global_ids2local_ids_ghost_.empty())
196 {
198 }
199
200 // Ghost entries, and its original index is 0.
201 const PetscInt id_p = (idx == -size_) ? 0 : std::abs(idx);
202 return entry_array_[id_p];
203}
std::vector< PetscScalar > entry_array_
Array containing the entries of the vector. If the vector is created without given ghost IDs,...
PetscInt getLocalIndex(const PetscInt global_index) const
Get local index by a global index.

References entry_array_, getLocalIndex(), global_ids2local_ids_ghost_, set(), and size_.

◆ get() [2/2]

std::vector< PetscScalar > MathLib::PETScVector::get ( std::vector< IndexType > const & indices) const

Get several entries. setLocalAccessibleVector() must be called beforehand.

Definition at line 205 of file PETScVector.cpp.

207{
208 std::vector<PetscScalar> local_x(indices.size());
209 // If VecGetValues can get values from different processors,
210 // use VecGetValues(v_, indices.size(), indices.data(),
211 // local_x.data());
212
213 if (!global_ids2local_ids_ghost_.empty())
214 {
215 for (std::size_t i = 0; i < indices.size(); i++)
216 {
217 local_x[i] = entry_array_[getLocalIndex(indices[i])];
218 }
219 }
220 else
221 {
222 for (std::size_t i = 0; i < indices.size(); i++)
223 {
224 // Ghost entries, and its original index is 0.
225 const IndexType id_p =
226 (indices[i] == -size_) ? 0 : std::abs(indices[i]);
228 }
229 }
230
231 return local_x;
232}

References entry_array_, getLocalIndex(), global_ids2local_ids_ghost_, set(), and size_.

Referenced by operator[]().

◆ getGhostSize()

PetscInt MathLib::PETScVector::getGhostSize ( ) const
inline

Get the number of ghost entries in the same rank.

Definition at line 86 of file PETScVector.h.

86{ return size_ghosts_; }

References size_ghosts_.

Referenced by copyValues().

◆ getGlobalVector()

void MathLib::PETScVector::getGlobalVector ( std::vector< PetscScalar > & u) const

Get global vector

Parameters
uArray to store the global vector. Memory allocation is needed in advance

Definition at line 142 of file PETScVector.cpp.

143{
144#ifdef TEST_MEM_PETSC
147#endif
148
149 assert(static_cast<PetscInt>(u.size()) == size_);
150
153 if (state != 0)
154 {
155 OGS_FATAL("PETSc vector is already locked for {:s} access.",
156 state > 0 ? "read" : "write");
157 }
158 PetscScalar* xp = nullptr;
159 VecGetArray(v_, &xp);
160
161 gatherLocalVectors(xp, u.data());
162
163 // This following line may be needed late on
164 // for a communication load balance:
165 // MPI_Barrier(PETSC_COMM_WORLD);
166
168
169// TEST
170#ifdef TEST_MEM_PETSC
174 "### Memory usage by Updating. Before :%f After:%f Increase:%d\n", mem1,
175 mem2, (int)(mem2 - mem1));
176#endif
177}
#define OGS_FATAL(...)
Definition Error.h:26
void gatherLocalVectors(PetscScalar local_array[], PetscScalar global_array[]) const
Collect local vectors.

References gatherLocalVectors(), OGS_FATAL, set(), size_, MathLib::u, and v_.

◆ getLocalIndex()

PetscInt MathLib::PETScVector::getLocalIndex ( const PetscInt global_index) const
private

Get local index by a global index.

Definition at line 252 of file PETScVector.cpp.

253{
254 if (global_index >= 0) // non-ghost entry.
255 {
256 return global_index - start_rank_;
257 }
258
259 // A special case for a ghost location with global index equal to
260 // the size of the local vector:
261 PetscInt real_global_index = (-global_index == size_) ? 0 : -global_index;
262
264}

References global_ids2local_ids_ghost_, set(), size_, and start_rank_.

Referenced by get(), and get().

◆ getLocalSize()

PetscInt MathLib::PETScVector::getLocalSize ( ) const
inline

Get the number of entries in the same rank.

Definition at line 84 of file PETScVector.h.

84{ return size_loc_; }

References size_loc_.

Referenced by copyValues().

◆ getLocalVector()

PetscScalar * MathLib::PETScVector::getLocalVector ( ) const
private

Get local vector, i.e. entries in the same rank

Definition at line 234 of file PETScVector.cpp.

References has_ghost_id_, set(), v_, and v_loc_.

Referenced by copyValues().

◆ getRangeBegin()

PetscInt MathLib::PETScVector::getRangeBegin ( ) const
inline

Get the start index of the local vector.

Definition at line 88 of file PETScVector.h.

88{ return start_rank_; }

References start_rank_.

◆ getRangeEnd()

PetscInt MathLib::PETScVector::getRangeEnd ( ) const
inline

Get the end index of the local vector.

Definition at line 90 of file PETScVector.h.

90{ return end_rank_; }

References end_rank_.

◆ getRawVector() [1/2]

◆ getRawVector() [2/2]

PETSc_Vec const & MathLib::PETScVector::getRawVector ( ) const
inline

Exposes the underlying PETSc vector.

Warning
This method is dangerous insofar as you can do arbitrary things also with a const PETSc vector!

Definition at line 178 of file PETScVector.h.

178{ return v_; }

References v_.

◆ operator=()

Disallow moving.

Todo
This operator should be implemented properly when doing a general cleanup of all matrix and vector classes.

◆ operator[]()

Get the value of an entry by [] operator. setLocalAccessibleVector() must be called beforehand.

Definition at line 155 of file PETScVector.h.

155{ return get(idx); }
std::vector< PetscScalar > get(std::vector< IndexType > const &indices) const

References get(), and set().

◆ restoreArray()

void MathLib::PETScVector::restoreArray ( PetscScalar * array) const
inlineprivate

Restore array after finish access local array

Parameters
arrayPointer to the local array fetched by VecGetArray

Definition at line 266 of file PETScVector.cpp.

267{
268 if (has_ghost_id_)
269 {
272 }
273 else
274 {
276 }
277}

References has_ghost_id_, set(), v_, and v_loc_.

Referenced by copyValues().

◆ set() [1/2]

void MathLib::PETScVector::set ( const PetscInt i,
const PetscScalar value )
inline

Insert a single entry with value.

Parameters
iEntry index
valueEntry value

Definition at line 97 of file PETScVector.h.

98 {
99 VecSetValue(v_, i, value, INSERT_VALUES);
100 }

References set(), and v_.

Referenced by PETScVector(), PETScVector(), PETScVector(), add(), add(), MathLib::applyKnownSolution(), config(), copyValues(), destroy(), finalizeAssembly(), gatherLocalVectors(), get(), get(), getGlobalVector(), getLocalIndex(), getLocalVector(), operator[](), restoreArray(), set(), set(), setZero(), shallowCopy(), and viewer().

◆ set() [2/2]

template<class T_SUBVEC >
void MathLib::PETScVector::set ( const std::vector< PetscInt > & e_idxs,
const T_SUBVEC & sub_vec )
inline

Add values to several entries

Parameters
e_idxsIndices of entries to be added. Note: std::size_t cannot be the type of e_idxs template argument
sub_vecEntries to be added

Definition at line 133 of file PETScVector.h.

134 {
135 VecSetValues(v_, e_idxs.size(), &e_idxs[0], &sub_vec[0], INSERT_VALUES);
136 }

References set(), and v_.

◆ setLocalAccessibleVector()

void MathLib::PETScVector::setLocalAccessibleVector ( ) const

Set local accessible vector in order to get entries. Call this before call operator[] or get(...).

Definition at line 179 of file PETScVector.cpp.

180{
182}
void copyValues(std::vector< PetscScalar > &u) const

References copyValues(), and entry_array_.

Referenced by MathLib::LinAlg::setLocalAccessibleVector().

◆ setZero()

void MathLib::PETScVector::setZero ( )
inline

Definition at line 139 of file PETScVector.h.

139{ VecSet(v_, 0.0); }

References set(), and v_.

◆ shallowCopy()

void MathLib::PETScVector::shallowCopy ( const PETScVector & v)

Definition at line 297 of file PETScVector.cpp.

298{
299 destroy();
300
301 VecDuplicate(v.getRawVector(), &v_);
302
303 start_rank_ = v.start_rank_;
304 end_rank_ = v.end_rank_;
305 size_ = v.size_;
306 size_loc_ = v.size_loc_;
307 size_ghosts_ = v.size_ghosts_;
308 has_ghost_id_ = v.has_ghost_id_;
309 global_ids2local_ids_ghost_ = v.global_ids2local_ids_ghost_;
310
311 config();
312}
static const double v

References config(), destroy(), end_rank_, global_ids2local_ids_ghost_, has_ghost_id_, set(), size_, size_ghosts_, size_loc_, start_rank_, MathLib::v, and v_.

Referenced by PETScVector(), MathLib::LinAlg::copy(), and MathLib::LinAlg::matMult().

◆ size()

PetscInt MathLib::PETScVector::size ( ) const
inline

Get the global size of the vector.

Definition at line 82 of file PETScVector.h.

82{ return size_; }

References size_.

◆ viewer()

void MathLib::PETScVector::viewer ( const std::string & file_name,
const PetscViewerFormat vw_format = PETSC_VIEWER_ASCII_MATLAB ) const

View the global vector for test purpose. Do not use it for output a big vector.

Parameters
file_nameFile name for output
vw_formatFile format listed as: PETSC_VIEWER_DEFAULT Default format PETSC_VIEWER_ASCII_MATLAB MATLAB format PETSC_VIEWER_ASCII_DENSE Print matrix as dense PETSC_VIEWER_ASCII_IMPL Implementation-specific format (which is in many cases the same as the default) PETSC_VIEWER_ASCII_INFO Basic information about object PETSC_VIEWER_ASCII_INFO_DETAIL More detailed info about object PETSC_VIEWER_ASCII_COMMON Identical output format for all objects of a particular type PETSC_VIEWER_ASCII_INDEX (for vectors) Prints the vector element number next to each vector entry PETSC_VIEWER_ASCII_SYMMODU Print parallel vectors without indicating the processor ranges PETSC_VIEWER_ASCII_VTK Outputs the object to a VTK file PETSC_VIEWER_NATIVE Store the object to the binary file in its native format (for example, dense matrices are stored as dense), DMDA vectors are dumped directly to the file instead of being first put in the natural ordering PETSC_VIEWER_DRAW_BASIC Views the vector with a simple 1d plot PETSC_VIEWER_DRAW_LG Views the vector with a line graph PETSC_VIEWER_DRAW_CONTOUR Views the vector with a contour plot

Definition at line 279 of file PETScVector.cpp.

281{
285
287 VecView(v_, viewer);
288
289#define nEXIT_TEST
290#ifdef EXIT_TEST
291 VecDestroy(v_);
293 exit(0);
294#endif
295}
void viewer(const std::string &file_name, const PetscViewerFormat vw_format=PETSC_VIEWER_ASCII_MATLAB) const

References set(), v_, and viewer().

Referenced by viewer().

Friends And Related Symbol Documentation

◆ finalizeVectorAssembly

void finalizeVectorAssembly ( PETScVector & vec)
friend

Function to finalize the vector assembly.

Definition at line 314 of file PETScVector.cpp.

315{
316 vec.finalizeAssembly();
317}

Member Data Documentation

◆ end_rank_

PetscInt MathLib::PETScVector::end_rank_
private

Ending index in a rank.

Definition at line 239 of file PETScVector.h.

Referenced by config(), getRangeEnd(), and shallowCopy().

◆ entry_array_

std::vector<PetscScalar> MathLib::PETScVector::entry_array_
mutableprivate

Array containing the entries of the vector. If the vector is created without given ghost IDs, the array contains all entries of the global vector, v_. Otherwise it only contains the entries of the global vector owned by the current rank.

Definition at line 258 of file PETScVector.h.

Referenced by get(), get(), and setLocalAccessibleVector().

◆ global_ids2local_ids_ghost_

std::map<PetscInt, PetscInt> MathLib::PETScVector::global_ids2local_ids_ghost_
mutableprivate

Map global indices of ghost entries to local indices.

Definition at line 261 of file PETScVector.h.

Referenced by PETScVector(), get(), get(), getLocalIndex(), and shallowCopy().

◆ has_ghost_id_

bool MathLib::PETScVector::has_ghost_id_ = false
private

Flag to indicate whether the vector is created with ghost entry indices.

Definition at line 249 of file PETScVector.h.

Referenced by getLocalVector(), restoreArray(), and shallowCopy().

◆ size_

PetscInt MathLib::PETScVector::size_
private

Size of the vector.

Definition at line 242 of file PETScVector.h.

Referenced by config(), get(), get(), getGlobalVector(), getLocalIndex(), shallowCopy(), and size().

◆ size_ghosts_

PetscInt MathLib::PETScVector::size_ghosts_ = 0
private

Size of local ghost entries.

Definition at line 246 of file PETScVector.h.

Referenced by getGhostSize(), and shallowCopy().

◆ size_loc_

PetscInt MathLib::PETScVector::size_loc_
private

Size of local entries.

Definition at line 244 of file PETScVector.h.

Referenced by PETScVector(), config(), gatherLocalVectors(), getLocalSize(), and shallowCopy().

◆ start_rank_

PetscInt MathLib::PETScVector::start_rank_
private

Starting index in a rank.

Definition at line 237 of file PETScVector.h.

Referenced by config(), getLocalIndex(), getRangeBegin(), and shallowCopy().

◆ v_

◆ v_loc_

PETSc_Vec MathLib::PETScVector::v_loc_ = nullptr
mutableprivate

Local vector, which is only for the case that v_ is created with ghost entries.

Definition at line 234 of file PETScVector.h.

Referenced by getLocalVector(), and restoreArray().


The documentation for this class was generated from the following files: