Patient data analysis
An educational and research project only: its results are not a medical diagnosis and are not used to make any treatment decision.
Problem description
An exploratory analysis of health indicators for fictitious patients: detecting and imputing missing values and outliers, and studying the relationship between age and blood pressure. An educational and research project only: its results are not a medical diagnosis and must not be used for a treatment decision.
Objectives
- Counting and handling missing values
- Detecting outliers with the IQR method
- Writing cautious conclusions
Problem type
Exploratory analysis (EDA)
Dataset
Tools used
Algorithms
Implementation steps
- In KNIME: File → Import KNIME Workflow… and choose patients-analysis.knwf, then Execute all.
- Open patients-analysis.ows in Orange.
- Review Column Statistics for the missing values.
- Use a Box Plot of the heart rate to see the outliers.
- Impute with the median, then Correlations.
- In KNIME: Missing Value → Numeric Outliers → Linear Correlation.
Workflow diagram
Orange
DataVisualize
↔ Drag the diagram sideways to see all of it.
Connections as text (7)
- File → Data Table (Data)
- File → Column Statistics (Data)
- File → Box Plot (Data)
- File → Distributions (Data)
- File → Scatter Plot (Data)
- File → Impute (Data)
- Impute → Outliers (Data)
KNIME
SourceManipulatorVisualizerOtherData portModel port
↔ Drag the diagram sideways to see all of it.
Connections as text (4)
- CSV Reader → Missing Value
- Missing Value → Numeric Outliers
- Numeric Outliers → Linear Correlation
- Missing Value → Statistics
Project files
- CSV datasetCSV8.8 KB
- WEKA ARFF fileWEKA ARFF9.7 KB
- Orange workflow (.ows)Orange5.9 KB
- Data in Orange format (.tab) for the workflowOrange TAB8.9 KB
- KNIME workflow (.knwf): ran successfully in the KNIME 5.12 engine (not opened in the interface)KNIME58.2 KB
- Step-by-step implementation guide (PDF)PDF563.4 KB
- Full project package (ZIP)ZIP559.8 KB
The KNIME file (.knwf) was built on KNIME 5.12 and all its nodes ran successfully in the KNIME engine without opening the interface; open it from File → Import KNIME Workflow.
Results
Actual results computed on the attached files
IQR limits for the heart rate: from 50.5 to 102.5, and the number of readings outside them: 4
Correlation of age with systolic blood pressure: 0.654
Evaluation metrics
- The number of missing values in each column
- IQR limits
- Correlation coefficient
Interpreting the results
The positive correlation between age and blood pressure was built into the data generation on purpose to teach reading results, and nothing medical can be concluded from it. Outliers may be entry errors or real cases, and the decision needs a domain expert. An educational and research project only: its results are not a medical diagnosis and must not be used for a treatment decision.
Discussion questions
- When do you remove an outlier and when do you keep it?
- Why is the median preferred to the mean for imputation here?
- What are the ethical safeguards for handling real patient data?
Try it in the Data Preprocessing Lab
