Senseforce 2.0 Manual
  • Welcome to Senseforce 2.0
  • SF MQTT API
  • SF Edge
    • Edge Package Overview
    • Edge Installation
      • Using the SF Edge Service installer in command shell
      • Headless SF Edge Servie execution
    • Edge Configuration
      • Which Plugins to load (appsettings.xml)
      • Edge Data Routing (EventDefinition.xml)
      • OTA configuration (otasettings.xml)
      • Edge Logging
      • Input plugins
        • SQL Plugin
        • SQLite Plugin
        • OPC UA Plugin
          • OPC UA server browser
        • SIEMENS S7/SINUMERIK Plugin
          • Creating connection definition file
        • S7 Plugin
        • REST Plugin
        • TCP Listener Plugin
        • XML File Parsing Plugin
        • Heidenhain Plugin
      • Output Plugins
        • MQTT Plugin
        • SQLite Plugin
    • Edge Compute plugins
      • Creating compute plugins
      • Using compute plugins
  • SF Edge Asset Management
    • Edge version repository
  • SF Platform
    • Navigation
      • Overview Screen
    • Dataset Builder
      • Filters, Aggregations and Groupings
      • Functions of the Formula Editor
      • Additional Settings
      • Special Events
      • FAQ and Troubleshooting
    • Script Editor
      • Details of the Script Editor
      • Installed Packages
      • Working with Timestamps
        • Working with Timestamps in Python
        • Working with Timestamps in R
      • FAQ and Troubleshooting
    • Widgets
      • Text
      • Headline
      • Image
      • Progress Bar & Gauge Chart
      • Table
      • Map
      • Line, Bar, Scatter and Area Chart
      • Pie Chart
      • Gantt Chart
      • Histogram
      • Overview
      • Log
      • Default colors and color conditions
      • FAQ and Troubleshooting
    • Dashboards
      • Dashboard Filters
      • Favorites
      • Data Drilldown & Widget Interaction
      • Editing multiple dashboard widgets
      • Time Zones
      • Synchronized Zooming
      • Sharable Dashboard URL
      • Multi-chart layout options
      • Default sort for table widgets
      • Releases
      • Reporting
      • FAQ and Troubleshooting
      • Applying zoom to global timestamp filter
      • Optimise the layout for different devices
    • Machine Master Data
      • Dimensions
      • Instances
      • Things
      • Use Case
      • FAQ and Troubleshooting
    • Automation
      • Trigger
      • Scheduling overview
      • Actions
      • Test your Automation
      • Zapier integration (necessary internal steps)
      • Zapier integration
      • Subscriptions
      • FAQ and Troubleshooting
    • Event Schema Management
      • Importing a Event Schema
      • FAQ and Troubleshooting
    • Virtual Events
      • Creating a Virtual Event
      • Scheduling Overview
      • Permissions and Data Access
      • FAQ and Troubleshooting
    • Details modal for elements
    • Copy / Duplicate elements
    • Whitelabeling
    • Edge Device Management
    • Element History
    • Public API
      • Get your access token
      • Endpoints
      • Debugging scripts
      • FAQ and Troubleshooting
    • User & Group Management
      • FAQ and Troubleshooting
    • Active Directory & SSO Setup
Powered by GitBook
On this page
  • About a selection of Filters
  • Time Zones
  • About a selection of Aggregations and Groupings
  • Example

Was this helpful?

  1. SF Platform
  2. Dataset Builder

Filters, Aggregations and Groupings

PreviousDataset BuilderNextFunctions of the Formula Editor

Last updated 2 years ago

Was this helpful?

About a selection of Filters

Let's have a look at some filters which might be not self-explanatory.

  • != is a common expression in programming and means "not equal", hence it filters for all rows which do not match the given value.

  • in takes multiple values and filters for all rows which match one of the values.

  • not in takes multiple values and filters for all rows which NOT match one of the values.

  • Timestamp filters are applied to data according to the selected time zone for the dataset. If no time zone has been selected, then it will by default be the time zone of the machine that created it. Also, keep in mind that filters on a timestamp column are always applied on the raw data not the aggregated or grouped result.

  • Relative Between acts as a combination of the "Today"/"Yesterday" and the "Between" filter types for timestamps. Data can be filtered to show a specific period over the current and previous day, relative to the time the dataset is executed.

  • like, not like behaves as the SQL operator does. So you can use "%" to match any sequence of characters and "_" to match any single character. No need to enclose the string you are looking to match in quotes ("). E.g. the filter "like: %chine_" would match "machine1" or "Location1$machine5" but not "machine20".

  • RegExp Match, Not RegExp Match will filter for the entries that match (or don't match) your regular expression. You can find many sources on how to write a regular expression on the internet.

Time Zones

By default, all timestamp fields in datasets will be displayed in your local time. If you wish to see how your data looks in a different timezone, you may use the time zone selector at the top of the screen. Changing the timezone will display all dataset timestamps in their equivalent time for your selected zone. Filtering and grouping will be done on the translated timestamp, which may change the data included in your dataset. For example, a filter showing data from the last 60 minutes will show different data for TZ "Europe/London" then it would for "Europe/Vienna".

Note: the timezone field is for testing purposes only, and the selected value will not persist when saved.

About a selection of Aggregations and Groupings

  • No data entries get ignored by default in the aggregations.

  • Minimum, Maximum applied to a text column will give you the lowest (for Minimum) or the highest (for Maximum) entry alphabetically (with the number being lower than character, hence "0Z" < "A").

  • Count will simply count the rows.

  • Standard Deviation, Variance uses the sample variation and sample standard deviation if you are on a system using Timescale DB. If you are on a system using Crate DB the population variance/standard deviation is used ("no data" entries are excluded from these calculations).

  • grouping creates a group for every distinct element and if you group by multiple columns every distinct combination results in a group. A group results in a "summary" of all entries represented in one single entry.

  • grouping timestamps has more options than grouping for text or numbers. Here you can put timestamps which are from the same minute, hour, day, etc. in a group. Grouping by e.g. day, week, or month implicitly needs a time zone. Here we use the local time "Europe/Vienna".

  • grouping timestamps by time period is an input that allows you to enter an amount of time to create groups or so called "time buckets" which size is determined by selected timestamp above and entered amount e.g. 7 minutes, 5 hours, 2 weeks etc. Default value is 1, and minimum allowed value is 0.01. Decimal values are supported.

Example

In the following video, we show how to create a dataset which contains the average speed of different machine per day, excluding the speed values below 5. We achieved this through grouping by thing and day, taking the average of one-speed column and filtering the second speed column for ">5" and setting it to not show data. Which leads to the data being filtered instead of the results.

(Left) Translated timestamps in "Australia/Sydney" (AEST) time. (Right) Local Time (CET)
Example of grouping by 5 seconds.