Missing One Minute Data from Table for Zero Carbon Pig Farm

[ahendo026]

Good Morning,

We are using Power BI to analyze sensor data on a zero carbon footprint, environmentally friendly pig farm. The farm adds enzymes to the pig waste which separates the methane gas, which is collected and burned to create electric energy. The excess electrical energy is then returned to the grid. There are a few hundred thousand data points generated daily and we use Power Bi to immediately perform calculations which took a person months to process. We are now beginning the yearend calculations to determine greenhouse gas credits.

The target data contains one-minute sensor data on which I need to perform some calculations. These calculations are related to the missing minutes for each day. A day with missing minutes is any day(s) in which there are not 1440 minutes total. 1440 is the total number of minutes in a 24 hour day.

I need to (1) identify any missing “Raw Gas” minutes in the 2018 data, (2) identify any time segments with 15 or more consecutive missing minutes, and (3) implement an algorithm for replacing those minutes

In the example below all the one-minute data before 4/23/2018 7:44:09 AM is missing from the DB. So on 4/23/2018 all the minutes from 12:00:XX AM to 7:43:XX AM are missing and need to be created by the algorithm. 

I am trying to figure out if we can do this analysis in Power BI or if we need to do it in another tool. Any specific suggestions on how to proceed with any of these steps would be greatly appreciated. 

[v-yuta-msft]

@ahendo026 ,

I need to (1) identify any missing “Raw Gas” minutes in the 2018 data, (2) identify any time segments with 15 or more consecutive missing minutes, and (3) implement an algorithm for replacing those minutes

In the example below all the one-minute data before 4/23/2018 7:44:09 AM is missing from the DB. So on 4/23/2018 all the minutes from 12:00:XX AM to 7:43:XX AM are missing and need to be created by the algorithm. 

I am trying to figure out if we can do this analysis in Power BI or if we need to do it in another tool. Any specific suggestions on how to proceed with any of these steps would be greatly appreciated. 

---

Could you clarify more details about the "algorithm for replacing those minutes"?

Community Support Team _ Jimmy Tao

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.