Datasets

The Datasets page lists all of the datasets that have been both uploaded to and created within Enview Explore™.

Workflow Overview

The chart below depicts Explore’s workflow, beginning at data upload and ending with structure and DEM generation. Blue boxes represent datasets, and orange boxes represent processes or actions. Workflows for change analysis are located in their respective sections under Actions.

Flowchart image of datasets workflow

Datasets Page

Image of dataset page

Tabs

My Datasets: Lists all datasets uploaded and created in your personal Explore account. You have the permissions to update, delete, and manage these datasets.

Organization Shared: Lists all datasets shared within your organization.

Enview: Lists all demo datasets shared by Enview.

Please note: You cannot edit or delete datasets unless you are the owner, but Actions can be run and the derivatives will appear in your datasets. As the owner of the derivative dataset, you have the permissions to manage them.

Dataset Name

The name that the dataset was given at the time of upload/creation. To view additional details about your dataset, click on the name and you will be redirected to the Dataset Overview page.

Data Type

Displays the type of data in your dataset.

Access

Lists whether your dataset is private or shared within your organization.

Last Update

Displays the date that the dataset was last modified, or the date of upload if no modification was performed.

Status

The status column indicates which step along the processing workflow the dataset is currently in.

drawing While a dataset is being either uploaded or created, the spinning circle icon indicates that the process is running. You can safely log out of the system during this step.

drawing If the upload fails, a grey error icon will appear. Hovering over this icon will display the error message, and you can refer to the Error Messages section of Troubleshooting for more details.

drawing Once the data validation is complete, the icon changes to a green check mark.

Actions

drawing The Edit button opens the Update your Dataset window. For more information, refer to the Dataset Overview section of this page.

drawing The Delete button permanently removes this uploaded dataset from your list of datasets. You will be asked twice to confirm the removal of the dataset. This will clear space in your upload quota.

Filter Datasets Bar

drawing

Use Filter datasets to enter the name of the dataset that you’re looking for and narrow it down to datasets with just that text in the name.

Data Upload

Accepted File Formats

Enview Explore accepts LiDAR point clouds, raster imagery, and vector files in the formats listed below.

File Type Details
.geojson single GeoJSON file
.las / .laz classified or unclassified
.shp zipped into one file (not folder)
.tif / .tiff 1-band 8-bit type, 3-band 8-bit type, 4-band 8-bit type, 1-band palette color
.tfw world file. required accompanying file when .tif/.tiff does not carry geospatial information

If your source .las/.laz files contain RGB values, they can be visualized as a layer on the Map page. For .tif/.tiff files, band 4 will only be included if it is set as ‘Alpha’ Color Interpretation. Otherwise, all bands labeled 4 and higher will be ignored for web visualization. Additionally, please note that SRID information must be supplied in the header and/or metadata of these files, or alternatively entered during the data upload step.

Create a New Dataset

drawing After clicking the + New icon, the Create a new dataset window will appear.

drawing

The first step is to type in a dataset name. The top of the window also indicates your current file storage and availability out of your total storage capacity.

Click Next.

drawing

Step 2 will then ask you to click on the Browse button and select your file(s).

After selecting your file(s), you can click Next and the tool will determine the Horizontal and Vertical Projection codes using automatic detection. Alternatively, you can manually input these values by either typing the numbers to search for a matching code, or using the drop-down list.

Please note: Vertical projections are optional for point clouds, and do not currently apply to vectors or imagery rasters.

For additional SRID related support, refer to the Spatial Reference section in Troubleshooting.

Once you’re done, click Next.

Screen recorded GIF demonstrating uploads in progress

After you click Next, your dataset will start uploading and you can see the filename, size, and status of the upload. A Dataset Created pop-up message will also appear once your dataset begins to upload.

Please note: Only two dataset uploads may occur simultaneously. If you try to begin a third, you will receive an error.

The updated file storage is displayed at the top of the window. Additionally, the window can be closed and the file upload will continue in the background even if logged out. If you choose to close this window, the status can still be displayed by hovering over the status icon in the landing page.

Please note: The Create a new dataset window is the only place you can cancel or retry a per file upload in the instance of an error. Closing this window while the process is running will prompt a warning. If you close this window and an error occurs, the full dataset will need to be deleted and reuploaded.

Click Close.

Once the data ingest action has completed, the green check mark icon will appear under the Status column and you will receive an email notification.

drawing Please note: If there is no projection information in the header of your file(s), the Error icon will appear under the Status column on the Datasets page. Hovering over it will display the “Could not determine horizontal SRID” message; if you encounter this, please use the Update your Dataset window to edit the SRID and automatically begin a reingest of your dataset. For detailed instructions on how to perform the reingest, refer to the Data Upload Errors section of Troubleshooting.

Dataset Overview

Clicking on the dataset name will bring you to the Dataset Overview page, where you can view details and access additional functionality.

Image of Dataset Overview page

The Dataset Name will be visible at the top of the page, followed by a map preview that showcases the geographic extent of the data. To the right of the map preview, you will see the dataset Description, which defaults to the current name.

If the extent is highlighted by a blue rectangle after the data is validated, clicking on the map preview will take you to the Map page where the dataset can be visualized. This feature is available for point clouds, vectors, and several types of rasters including: Hillshades, select analysis output layers, and Change 2D Color produced during Topo Change analysis. For more details on the latter, please view the Generate Topo Change section of this page.

Please note: If the preview extent is red instead of blue, the dataset either is not compatible with this feature, or was created before this functionality was enabled. To enable it, the data must be reuploaded and/or rerun.

The original files are listed below the map preview, each with a Download option if in the original point cloud or raster format, and the About this dataset panel to the right of the Description box displays additional details. This panel may contain an Actions button which will allow you to see which processes can be run with your dataset. Clicking Edit will open the Update your Dataset window.

Update Your Dataset

The Update your Dataset window is where you can:

  • rename your dataset
  • edit the Description
  • add a Summary
  • change the Horizontal Projection (SRID) of your dataset
  • add/change the Vertical Projection of your dataset
  • change the Access privileges

Image of the Update Your Dataset window

Once you fill in the details and click Save, the details will be visible on the Dataset Overview page.

Image of Dataset Overview page

Please note: If either projection is updated, the dataset will begin to reingest, and this will be reflected on the Datasets page. Both of these fields need to be accurately updated, if necessary, before the Classify Points action.

Add Files

Image of Add Files button

To add additional files to a point cloud or raster source dataset, click the + Add Files button once your dataset has been validated. The Add files to dataset window will open, where you can select the files to append. The file type and SRID must match the original upload.

Image of Add Files window

The files will begin to upload, and once complete, the whole dataset will reingest. During this process, other actions will not be available.

Please note: The additional files do not impact derivative datasets previously created with this source dataset. All actions will need to be rerun.

Actions

Classify Points

In the Classify Points action, Enview Explore will declassify the original data and reclassify it for you. During this process, the calculations use the classified ground points in the LiDAR data as a reference to generate products.

Classify points window

The classified dataset name will default to ENVIEW CLASSIFIED appendeded to the original name, but can be changed. In the Classification Menu, you can toggle which classes will be generated. Ground cannot be deselected, and if Vegetation is selected, Buildings will be enabled by default.

Please note: If any of the options are greyed out, it means the provided dataset did not meet the technical requirements for that classification. This could be due to the intensity attribute not existing in the data, and/or whether the LiDAR data is multireturn.

The vegetation slider will only be enabled if the vegetation class checkbox is selected, and can be used to set the lower limits for medium and high vegetation. If the defaults are changed, the new values will be displayed both in the ranges below the slider and when hovering over the handles. The lower limit for low vegetation will always be 0, and the lower limits for medium and high vegetation can be set anywhere between 0 and 6 meters. To reset the default values, click on the circular arrow beside Vegetation.

Once your preferences are set, click Submit and the new dataset will be created. Like uploading a dataset, it will be visible processing on the Datasets page.

Please note: The classification process will take some time. You can safely log out of the system while the execution is running. If your dataset has been created but is not appearing on your Datasets page, try refreshing the page.

When the dataset is verified with a green check mark under the Status column, go into the Dataset Overview. If you are unsure whether the point cloud was classified by Enview, the output of the Classify Points action can be distinguished by the Product Type attribute in the About this dataset panel.

Enview Classified attribute

To visualize the classified data, click on the map preview and you will be taken to the Map page.

Generate Structures

If buildings are classified in your point cloud, the Generate Structures option will allow you to produce building polygons. Selecting this action will create a new vector dataset. When using a preclassified dataset, the classifications must match ASPRS Specifications in order to run this action. Building points should be located in class code 6.

Once the dataset has finished processing, it can be viewed on the Map page and/or downloaded as a shapefile (.shp) via the packaging interface.

Example structures in Explore

Generate Feature Change

This action highlights the change between two polygon/multipolygon datasets that have overlapping extents. If the comparison dataset has a different SRID than the current, it will be reprojected during processing. The workflow is depicted below.

Feature change workflow

To begin, ensure both datasets have finished processing and are validated on Explore; this is indicated by the green check mark icon under the Status column. Next, open the Dataset Overview for the current dataset and select the Generate Feature Change action. A window will open and autopopulate the Current Dataset field. Use the drop-down to select the Previous Dataset, and you may change the default name.

Feature Change window

Click Submit and the new change dataset will start processing. When complete, you can view it on the Map page or download it via our packaging interface.

Generate Models

From the Dataset Overview page of your desired point cloud dataset, click the Generate Models action. In the window that opens, you can choose which raster products to create.

Classify points window

To generate a new dataset, the options are DSM (Digital Surface Model), DEM (Digital Elevation Model), and Hillshade (Shaded Relief). Hillshade can only be generated if DEM is selected. For definitions of DSM, DEM, and Hillshade, please refer to the Glossary.

Detailed Terrain creates a web map layer. When finished processing, it will be located under your point cloud’s layers in the Add Data window of the Map page. You may activate Terrain Settings on this layer to visualize your dataset using a number of different properties such as slope, elevation, aspect, hillshade, and more. This feature extends 1000m, buffering the point cloud dataset to ensure consistent terrain within your area of interest. For more detail, please visit the Map section of the Product Manual.

Detailed terrain location

Once your preferred elevation models are selected, click Submit and the new raster datasets will start processing.

Generate Topo Change

This action will generate a 2D colored map of the topological elevation change between datasets of your choice. The chart below depicts the overall workflow for topo change.

Flowchart image of datasets workflow

Begin by opening the Dataset Overview of your DEM raster and selecting Generate Topo Change from the Actions button drop-down.

Image of generate topo change button

Click on the Generate Topo Change button and a window will appear. You will be able to select another dataset to compare to your current dataset, and name the two raster outputs.

The topo change raster products will include Change 2D Diff and Change 2D Color .tif files. The Change 2D Diff indicates the measured elevation change between your primary and secondary dataset. Transparent areas represent either no change or no data between the datasets. The Change 2D Color serves to indicate more clearly the areas where topo data was added (blue) or removed (red) between your primary and secondary dataset. The brighter the pixel, the more topo that was added or removed. Use these topo change raster products together to understand the measured topo change of the data.

Image of generate topo change button after selecting generate topo change

Please note: This analysis will detect changes that are greater than or equal to 10cm. For optimal results, the two LiDAR datasets being used to perform topo change should be coregistered within 10cm of each other.

Click Submit, and a pop-up message will alert you that the generating topo change process has started. Once the topo change products have been successfully generated, you will be notified via the email associated with your Enview Explore account.

Package and Download Data

Point clouds, rasters, and some vector datasets can be packaged for download on their respective Dataset Overview page. Use the Action button’s drop-down to select the Create Package option, and click on it. A popup will notify you that the packaging is in process.

Please note: User uploaded geoJSON files (.geojson) and shapefiles (.shp) are not available for packaging and download. Vector datasets generated by Explore can be downloaded.

Image of package data button

The button will grey out while it is Packaging Data, and will be available once more when the Download Package option is ready. Clicking it will open the Download Package window, where you can rename the package or accept the default dataset name. The downloaded zipped folder will contain Z14 (Zoom Level 14) .laz or .tif files, for point clouds and rasters respectively, or a .shp file for vector datasets. If changes are made to your dataset, it will need to be repackaged and redownloaded.