WF28: Update Data Quality Index (DQI)

Pre-requisites

• MADE Project: containing model items that have been defined with details requiring further information to update the Data Quality Index (DQI).

Detailed Descriptions (numbered steps)

1. Access 'Annotations' under 'Modeling' in the main menu bar.
2. Only proceed if annotating outstanding model parameters. To capture model knowledge (narratives, assumptions, comments), proceed to WF27.
3. Open 'Model Parameters' tab and use Filter Options to refine the list.
4. Open right-click context menu on target model parameter(s), and select 'Annotate…'.
5. Select data source from the drop-down menu, also defining a narrative (optional). Existing annotations may be edited to improve the Data Quality Index.
6. Continue defining all pending annotations to ensure Data Quality Index has been updated.
7. Open 'Dashboard' tab and review Model Quality Index and Data Sources that contribute to the Data Quality Index.
8. If Data Quality Index is not acceptable, determine where data sources can be improved and update accordingly.
9. All model parameters have been defined with annotations, contributing to an acceptable Data Quality Index. All this additional information may be generated in an Annotations Report.

Fields referenced in the diagram

• Define / Edit Data Quality: Data Source, Narrative

Decision points

• Update Data Quality Index? — No → Go to WF27: Capture Model Knowledge; Yes → View Model Parameters.
• All Annotations Defined? — No → loop back to Define / Edit Data Quality; Yes → Review Data Quality Index.
• DQI Acceptable? — No → loop back to Define / Edit Data Quality; Yes → Data Quality Index Updated.

Outputs

• Annotation Report: documentation that lists all model parameter annotations of the selected model item(s), including the Data Quality Index (DQI).

Screenshot walkthrough (captions/labels extracted)

Step 1: Access Annotations Editor

• 'Modeling' menu: New Connection, New Item, New RBD Group, Activate Failure Diagram, Hazard Diagram, Functional Diagram, Mission Profile Definition, Requirements, System Environment, Unit Life Parameter, System Model, Bond Graph, Failure Diagram, Functions, RBD Model, Maintenance Actions, System Maintenance Editor, Environment Library, Sensor Library, Annotations (highlighted).

Step 3: View Model Parameters

• "MADE Training - Annotations": left nav Dashboard, Model Parameters (selected), Narratives, Assumptions, Comments, Event Log. "Model Annotations" — "Filter Options": Status checkboxes Pending (checked), Annotated (unchecked), Unchanged (checked); Date range "All"; From date; Severity checkboxes Required (checked), Important (checked), Optional (unchecked); Item/Event Description search; Maximum records "500". Table (Status/Date/User/Type/Severity/Item/Event/Source/Comments/Annotated/Annotated by), sample rows: PENDING 2026/03/25 12:13:27 Sam (PHM ... Edited Required "Fault - Blocked (Lining)" "Failure Mode Ratio changed from 1.0 to 3.0"; PENDING rows for Fault - Seized/Interference/Perforated/Corroded/Pitted (Lining/Inlet) with Failure Mode Ratio changes 1.0→2.0/1.5/2.0/1.5; PENDING 2026/03/17 17:22:04 tester (PHM... Remo... Required "Engine" "Function Provide removed from Engine"; PENDING 2025/02/18 12:30:57 Rahul Gottu... Edited Required "Couple Mechanical - rotationa..." "Controllability changed from 10.0 to 4.8"; UNCHANGED rows (2024/08/16) Important "Angular Velocity Sensor 1" — "Sensor set name changed...", "Sensor acquisition cost changed from $0.00 to $0.00", "Sensor sampling interval changed from Nothing to Nothing", "Sensor test duration changed from Nothing to Nothing", "Current Mission Profile changed from Regular Trip to 100h"; further PENDING/UNCHANGED rows for "New Group", "New Group - (Long Trip)", "New Group - (Regular Trip)", "Coupling" (Part Failure Rate changed 1.00→856.10, Duration of Operation changed 91.2→91.2); PENDING 2023/11/14 13:52:04 rows "Sensor ... added" for Power Generation - Convert.., Fuel Tank - Provide Liquid Stat.., Driveline - Branch Mechanical.., Vehicle - Connect Mechanical.., Air Filter - Refine Gas Mass flo.., Half Shaft Front - Transmit Me.., Diesel Engine - Convert Mech..., and "Rotary Transformer" (Specificity changed from 100% to 92%).

Step 4: Annotate Model Parameter(s)

• Same "Model Annotations" table with multiple PENDING rows selected (highlighted blue), right-click context menu showing single option "Annotate..." highlighted.

Step 5: Define / Edit Data Quality

• "Annotation Details" dialog: "Provide a source of the information and enter a narrative." Event Description "3 selected annotations". Information source dropdown expanded: Engineer (highlighted/selected), Peer Reviewed Discussion, Published Database, OEM, Operating Data — showing "Confidence level: 20%" and description "Value determined by a User/Engineer currently using MADE (experienced)". Narrative field (empty). Buttons OK (disabled), Cancel.
• Second instance: Information source "Engineer", Confidence level: 20%, description as above. Narrative: "Based on operational data collected FY2024 - 2025 and approved by Lead Engineer" Buttons OK, Cancel.

Step 7: Review Data Quality Index

• "MADE Training - Annotations": "Dashboard" tab. "Model Quality Index": bar chart Coverage 12.4%, Quality 35.6%, Confidence Level 4.4%. "Data Sources": pie chart, legend Engineer, Peer Reviewed Discussion, Published Database, OEM, Operating Data. "Recent Events" table (Status/Date/User/Type/Item/Event), all Status "ANNOTATED": 2026/03/25 12:13:27 Sam (PHM Technology - Engi... Edited "Fault - Blocked (Lining)" "Failure Mode Ratio changed from 1.0 to 3.0"; similar ANNOTATED rows for Fault - Seized/Interference/Perforated/Corroded (Lining)/Pitted (Lining)/Corroded (Inlet)/Perforated (Inlet)/Pitted (Inlet) with Failure Mode Ratio changes.

Step 9: Data Quality Index Updated

• Annotation Report excerpt: "DATA QUALITY INDEX" — Coverage 12%, Quality 36%, Confidence Level 4%. Bar chart: Coverage 12.4%, Quality 35.6%, Confidence Level 4.4%. Pie chart with same source legend. "ANNOTATIONS BY TYPE" table: Model Property 325, Assumptions 1, Comments 0, Total 326. "ANNOTATIONS BY STATUS": Pending 295 (row shown), Annotated 27. "ANNOTATIONS BY SOURCE" table: Engineer ("Value determined by a User/Engineer currently using MADE (experienced)", 20%, 37), Peer Reviewed Discussion (50%, 0), Published Database (60%, 1), OEM (70%, 16), Operating Data (90%, 0). Footnote "* Optional severity annotations are not included". "ANNOTATIONS" table (Item/Model Element/Type/Status/Description/Annotation/Date/Source (Confidence)/User): "Air Filter" rows, all Model Properties Status "Pending": "Delay Time (hrs) changed from 0.0 to 5.0", "MTTR changed from 1.0 to 5.0", "Characteristic Life changed from 1 to 10000", "Expression Method changed from EXPONENTIAL to WEIBULL", "Part Failure Rate changed from 1.00 to 2.5197 using MTBUM Allocation (MTBUM Analysis).", "Slope changed from 1.00 to 3.00", "Turn Around Time (hrs) changed from 0.0 to 12.0" (13 Nov 2023, Rahul Gottumukkala); "Blocked"/"Contaminated"/"High"/"Low" Probability/Occurrence and Failure Mode Ratio changes (8 Nov 2023); "Fault - Outgrowths (Air Filter)"/"Fault - Perforated (Air Filter)" similar rows.

Related workflows

• WF27 – Capture Model Knowledge