Documentation Index

Fetch the complete documentation index at: https://kb.vastdata.com/llms.txt

Use this file to discover all available pages before exploring further.

Using the Data Flow Tool

Prev Next

Changing the Data Sampling Period

The data displayed in the Data Flow page is sampled at 60 second granularity. It may take up to 60 seconds to see I/O reflected in data-flows.

The Defined Time field at the top left of the Data Flow page enables you to select the sampling time for which to display data flow analytics.

The options available are:

  • Real time. This is the default. With this setting, the last sample is queried from within the last three minutes, and the display refreshes automatically (unless you switch auto-refresh off).

  • A predefined time range. Data flow information is shown over the selected time amount of time in the immediate past. When the display refreshes automatically, the displayed data get updated for the immediate past.

    To set a predefined time:

    1. Click Defined Time and then  Select time range.

    2. Choose one of the following options:

      • 10 m. Show data flow sampled over the last ten minutes.

      • 2 H. Show data flow sampled over the last two hours.

      • 4 H. Show data flow sampled over the last four hours.

      • 8 H. Show data flow sampled over the last eight hours.

      • 1 D. Show data flow sampled over the last day.

      • 3 D. Show data flow sampled over the last three days.

    3. Click Apply.

  • A custom time range. The analytics are averaged over the selected time range.

    To set a custom time range:

    1. Click Defined Time and then  Select manually.

    2. Enter the start date and time in the Start field.

    3. Enter the end date and time in the End field.

    4. Click Apply.

Sorting Data Flow Points

Points on data flow paths (users, hosts, VIPs and so on) are sorted in their columns based on multiple criteria. Only top N performers are displayed, up to a limit set by the Limit field, and with the Protocol filter applied.

For any column, you can toggle between descending and ascending sorting order by clicking the arrow next to the column's name (arrow.png).

To set sorting and filtering criteria:

  • Click Sort By and choose one of the following criteria:

    • BW (MB/s) (default). Sorts the objects in each column by average bandwidth over the sampling period.

    • IOPS. Sorts the objects in each column by average number of IOs per second over the sampling period.

    • MD IOPS. Sorts the objects in each column by average number of metadata IOs per second over the sampling period.

  • Click Total and choose operation types to be taken into account when sorting the values as defined by the Sort By setting:

    • Total (default). Includes both read and write operations.

    • Read. Includes only read operations.

    • Write. Includes only write operations.

    For example, if Sort By is set to IOPS and Total set to Write, objects with the highest average write IOPS over the sampling period are displayed on top of the list. But if Total is set to Total, both read and write operations are taken into account when calculating the highest average IOPS over the sampling period.

  • Click Protocol to filter the display by access protocol:

    • All. Shows IOs from all protocols.

    • NFSv3. Shows only IOs sent via the NFSv3 protocol.

    • SMB. Show only IOs sent via the SMB protocol.

    • NFSv4.1. Show only IOs sent via the NFSv4.1 protocol.

    • S3. Show only IOs sent via the S3 protocol.

    • Database. Show only IOs sent to or from VAST Databases.

Limiting the Number of Displayed Data Flow Points in Each Column

You can set a limit on the number of top performers that are shown in each of the columns in the Data Flow page. Data flow points that are not displayed due to the limit can be found through a search.

To set the maximum allowed number of data flow points to show, select a value from the Limit dropdown. The default is 10.

When the number of data flow points in more than one category is greater than the maximum, the number of data flow points shown might sometimes be further reduced from the maximum allowed value in each category. This is because data flow points are only displayed if they share paths with the other displayed data flow points.

Toggling Between Virtual IPs and Virtual IP Pools

Use the slider to the left of the Vip column to toggle between displaying the flow through each virtual IP individually and displaying the flow through each virtual IP pool.

DataFlow_SwitchVIPPoolVip.png

Depending on the current setting, the column name is Vip or Vippool.

Viewing IO Metrics per Object

Hover over any object on the page, such as a virtual IP pool, to see the IO metrics for this object, averaged over the sampling period.

The IO metrics include average bandwidth, IOPS and metadata IOPS for read and/or write operations, and also statistics on objects along the data flow path, and ROW operations on Databases.

HoverOverObjectInDataFlow.png

The metrics displayed when you hover over an object reflect the aggregated flows included based on the sample period and the selected filters. They are recalculated when you change the sampling period, sort the flow points, or change the limit. However, they are not recalculated when the object is pinned or the paths through the data flow point are isolated as described in Focusing on Specific Data Flows and Objects.

Searching for Data Flow Points

The search feature searches the sampled IOs for the selected time period, and can find a data flow point and the IOs that went through that point during the sampling period even if the object at the data flow point is a low performer (according to the current sorting and filtering criteria) and is not displayed due to the limit.

If searching does not find an object (such as a CNode or a view), this means that IO did not flow through the object.

To search, enter text into the search field below a column's name. Partial text search is supported and can return multiple results. For example, searching for cnode-6 would also display CNodes named cnode-60, cnode-61, cnode-62, and so on.

PArtial_Text_Search.png

Refreshing the Display

The data displayed in the Data Flow page can be refreshed on demand or automatically as follows:

  • Automatic refresh is available when you are viewing real-time data. Automatic refresh is on by default, and you can switch it off and on using this button: AutoRefreshOnOff.gif

  • Manual refresh is available for all time selections. It refreshes data and recalculates the display. To refresh, click the manual refresh button: manualrefresh.png

Focusing on Specific Data Flows and Objects

To investigate data flow paths that go through a specific object, click the object to pin it. Pinning an object highlights data flow paths going through it, so that you can focus on these specific paths, while other paths appear greyed out.

You can pin one or more flow points in one column at a time. To unpin a flow point, click it again.

When flow points are pinned, you can isolate all the flows that go through those objects. Isolating flows gives you a simplified view of the paths you want to focus on, while hiding all the paths that do not flow through the pinned objects.

To isolate flows, first pin one or more objects and then click Isolate Selected Flows. When you're done looking at the isolated flows, you can clear them by clicking Clear isolation.