visit: ADIOS reader, large file, INT_MAX problem.

Dear all,

I have a large file .bp file containing 1 concentration field associated to a rectilinear mesh. The total amount of mesh points is above single integer limit (4.2 billion)

I can’t open the file with visit 2.13.3 (I can open a smaller file of 2 billion cells below, single integer limit)

The error message is the following :

The compute engine running on host n4368.occigen issued the following warning: Mesh and/or variable size exceeds INT_MAX for domain 0. This domain is being set to empty. Your only recourse to correct this issue is to decompose your input database into smaller domains. If you continue to process this data, this and likely other warnings will periodically re-appear.

Changelogs of version 2.13.1 indicates that:

Corrected a bug where VisIt would crash when the number of nodes or zones or tuples times the number of components exceeds INT_MAX in a single block.

So I am wondering if there still a problem with version 2.13.3. I may also miss some points about very large data files but .bp file seems OK to me (see bpls output below)

Thanks for your answer, best regards

Stéphane Glockner

File info: of groups: 1 of variables: 20 of attributes: 19 of meshes: 1 time steps: 0 - 0 file size: 32 GB bp version: 3 endianness: Little Endian statistics: Min / Max / Avg / Std_dev

integer nxg001 scalar = 3500 integer nyg001 scalar = 1104 integer nzg001 scalar = 1104 integer nxug001 scalar = 3501 integer nyvg001 scalar = 1105 integer nzwg001 scalar = 1105 integer nproc001 scalar = 8192 integer offs_x001 scalar = 0 integer offs_y001 scalar = 0 integer offs_z001 scalar = 0 integer nx001 scalar = 110 integer ny001 scalar = 69 integer nz001 scalar = 69 integer nxu001 scalar = 111 integer nyv001 scalar = 70 integer nzw001 scalar = 70 double X001 {3501} = 0 / 0.0035 / null / null double Y001 {1105} = -0.00055275 / 0.00055275 / null / null double Z001 {1105} = -0.00055275 / 0.00055275 / null / null double concentration_EtOH {1104, 1104, 3500} = -4.74853e-17 / 1 / null / null string /adios_schema/version_major attr = “1” string /adios_schema/version_minor attr = “1” string /adios_schema/mesh/type attr = “rectilinear” string /adios_schema/mesh/dimensions0 attr = “nzwg001” string /adios_schema/mesh/dimensions1 attr = “nyvg001” string /adios_schema/mesh/dimensions2 attr = “nxug001” integer /adios_schema/mesh/dimensions-num attr = 3 string /adios_schema/mesh/coords-multi-var0 attr = “Z001” string /adios_schema/mesh/coords-multi-var1 attr = “Y001” string /adios_schema/mesh/coords-multi-var2 attr = “X001” integer /adios_schema/mesh/coords-multi-var-num attr = 3 string /adios_schema/mesh/nspace attr = “3” string /adios_schema/mesh/time-varying attr = “yes” double /adios_schema/mesh/time-steps-count attr = 43400 double /adios_schema/mesh/time-scale-count attr = 0.00543711 string concentration_EtOH/adios_schema attr = “mesh” string concentration_EtOH/adios_schema/centering attr = “cell” double concentration_EtOH/adios_schema/time-steps-count attr = 43400 double concentration_EtOH/adios_schema

We’re trying to combine visit-users email list with GitHub issues. When replying on visit-users, please reply only to emails with a Subject line that includes [visit-dav/live-customer-response].


About this issue

  • Original URL
  • State: closed
  • Created 4 years ago
  • Comments: 24 (4 by maintainers)

Most upvoted comments

I merged the fix in. It is targeted for visit 3.1.3. You can either grab the source code from the 3.1RC and build it or I can build you a version for your platform of interest. Let me know what you would like.