Dataset statistics
| Number of variables | 10 |
|---|---|
| Number of observations | 116640 |
| Missing cells | 0 |
| Missing cells (%) | 0.0% |
| Duplicate rows | 0 |
| Duplicate rows (%) | 0.0% |
| Total size in memory | 8.9 MiB |
| Average record size in memory | 80.0 B |
Variable types
| BOOL | 4 |
|---|---|
| NUM | 4 |
| CAT | 2 |
Reproduction
| Analysis started | 2020-08-24 23:49:16.714664 |
|---|---|
| Analysis finished | 2020-08-24 23:49:23.510658 |
| Duration | 6.8 seconds |
| Version | pandas-profiling v2.8.0 |
| Command line | pandas_profiling --config_file config.yaml [YOUR_FILE.csv] |
| Download configuration | config.yaml |
inv-nodes has 52584 (45.1%) zeros | Zeros |
breast-quad has 43116 (37.0%) zeros | Zeros |
age
Real number (ℝ≥0)
| Distinct count | 115774 |
|---|---|
| Unique (%) | 99.3% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 50.887072935451044 |
|---|---|
| Minimum | 22.70721244812012 |
| Maximum | 75.94065856933594 |
| Zeros | 0 |
| Zeros (%) | 0.0% |
| Memory size | 911.4 KiB |
Quantile statistics
| Minimum | 22.70721245 |
|---|---|
| 5-th percentile | 34.60799923 |
| Q1 | 44.58634472 |
| median | 50.62482643 |
| Q3 | 57.25482273 |
| 95-th percentile | 66.78811798 |
| Maximum | 75.94065857 |
| Range | 53.23344612 |
| Interquartile range (IQR) | 12.66847801 |
Descriptive statistics
| Standard deviation | 9.674236425 |
|---|---|
| Coefficient of variation (CV) | 0.1901118667 |
| Kurtosis | -0.6643299387 |
| Mean | 50.88707294 |
| Median Absolute Deviation (MAD) | 6.268323898 |
| Skewness | -0.007419632656 |
| Sum | 5935468.187 |
| Variance | 93.5908504 |
Histogram with fixed size bins (bins=10)
| Value | Count | Frequency (%) | |
| 44.2289505 | 3 | < 0.1% | |
| 45.38502121 | 2 | < 0.1% | |
| 51.22075653 | 2 | < 0.1% | |
| 50.48575592 | 2 | < 0.1% | |
| 46.56327057 | 2 | < 0.1% | |
| 46.40901566 | 2 | < 0.1% | |
| 50.15187454 | 2 | < 0.1% | |
| 46.05487061 | 2 | < 0.1% | |
| 53.80262375 | 2 | < 0.1% | |
| 65.60231781 | 2 | < 0.1% | |
| 49.03860474 | 2 | < 0.1% | |
| 68.13941193 | 2 | < 0.1% | |
| 65.03392792 | 2 | < 0.1% | |
| 48.84786987 | 2 | < 0.1% | |
| 52.09459686 | 2 | < 0.1% | |
| 65.63278961 | 2 | < 0.1% | |
| 45.15192795 | 2 | < 0.1% | |
| 52.36730957 | 2 | < 0.1% | |
| 51.70977402 | 2 | < 0.1% | |
| 50.97578049 | 2 | < 0.1% | |
| 44.80986023 | 2 | < 0.1% | |
| 46.98396683 | 2 | < 0.1% | |
| 64.81917572 | 2 | < 0.1% | |
| 36.38105011 | 2 | < 0.1% | |
| 45.23083115 | 2 | < 0.1% | |
| Other values (115749) | 116589 | > 99.9% |
| Value | Count | Frequency (%) | |
| 22.70721245 | 1 | < 0.1% | |
| 23.76066589 | 1 | < 0.1% | |
| 24.17514229 | 1 | < 0.1% | |
| 24.30625343 | 1 | < 0.1% | |
| 24.70094872 | 1 | < 0.1% | |
| 24.7590332 | 1 | < 0.1% | |
| 25.09537506 | 1 | < 0.1% | |
| 25.19407463 | 1 | < 0.1% | |
| 25.22072983 | 1 | < 0.1% | |
| 25.3105545 | 1 | < 0.1% |
| Value | Count | Frequency (%) | |
| 75.94065857 | 1 | < 0.1% | |
| 75.76948547 | 1 | < 0.1% | |
| 75.54802704 | 1 | < 0.1% | |
| 75.34172058 | 1 | < 0.1% | |
| 75.17150879 | 1 | < 0.1% | |
| 75.16776276 | 1 | < 0.1% | |
| 75.07889557 | 1 | < 0.1% | |
| 75.04499054 | 1 | < 0.1% | |
| 75.04186249 | 1 | < 0.1% | |
| 74.97699738 | 1 | < 0.1% |
menopause
Categorical
| Distinct count | 3 |
|---|---|
| Unique (%) | < 0.1% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 911.4 KiB |
| 0 | |
|---|---|
| 1 | |
| 2 | 7277 |
| Value | Count | Frequency (%) | |
| 0 | 58516 | 50.2% | |
| 1 | 50847 | 43.6% | |
| 2 | 7277 | 6.2% |
Length
| Max length | 1 |
|---|---|
| Median length | 1 |
| Mean length | 1 |
| Min length | 1 |
Most occurring characters
| Value | Count | Frequency (%) | |
| 0 | 58516 | 50.2% | |
| 1 | 50847 | 43.6% | |
| 2 | 7277 | 6.2% |
Most occurring categories
| Value | Count | Frequency (%) | |
| Decimal Number | 116640 | 100.0% |
Most frequent Decimal Number characters
| Value | Count | Frequency (%) | |
| 0 | 58516 | 50.2% | |
| 1 | 50847 | 43.6% | |
| 2 | 7277 | 6.2% |
Most occurring scripts
| Value | Count | Frequency (%) | |
| Common | 116640 | 100.0% |
Most frequent Common characters
| Value | Count | Frequency (%) | |
| 0 | 58516 | 50.2% | |
| 1 | 50847 | 43.6% | |
| 2 | 7277 | 6.2% |
Most occurring blocks
| Value | Count | Frequency (%) | |
| ASCII | 116640 | 100.0% |
Most frequent ASCII characters
| Value | Count | Frequency (%) | |
| 0 | 58516 | 50.2% | |
| 1 | 50847 | 43.6% | |
| 2 | 7277 | 6.2% |
| Distinct count | 18 |
|---|---|
| Unique (%) | < 0.1% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 3.1407150205761316 |
|---|---|
| Minimum | 0.0 |
| Maximum | 17.0 |
| Zeros | 52584 |
| Zeros (%) | 45.1% |
| Memory size | 911.4 KiB |
Quantile statistics
| Minimum | 0 |
|---|---|
| 5-th percentile | 0 |
| Q1 | 0 |
| median | 1 |
| Q3 | 4 |
| 95-th percentile | 14 |
| Maximum | 17 |
| Range | 17 |
| Interquartile range (IQR) | 4 |
Descriptive statistics
| Standard deviation | 4.42793718 |
|---|---|
| Coefficient of variation (CV) | 1.409850034 |
| Kurtosis | 1.43983298 |
| Mean | 3.140715021 |
| Median Absolute Deviation (MAD) | 1 |
| Skewness | 1.542442221 |
| Sum | 366333 |
| Variance | 19.60662767 |
Histogram with fixed size bins (bins=10)
| Value | Count | Frequency (%) | |
| 0 | 52584 | 45.1% | |
| 3 | 14168 | 12.1% | |
| 1 | 10434 | 8.9% | |
| 2 | 7888 | 6.8% | |
| 7 | 5180 | 4.4% | |
| 10 | 3167 | 2.7% | |
| 4 | 2955 | 2.5% | |
| 8 | 2846 | 2.4% | |
| 9 | 2796 | 2.4% | |
| 5 | 2526 | 2.2% | |
| 17 | 1830 | 1.6% | |
| 14 | 1615 | 1.4% | |
| 6 | 1595 | 1.4% | |
| 12 | 1543 | 1.3% | |
| 15 | 1540 | 1.3% | |
| 13 | 1454 | 1.2% | |
| 11 | 1361 | 1.2% | |
| 16 | 1158 | 1.0% |
| Value | Count | Frequency (%) | |
| 0 | 52584 | 45.1% | |
| 1 | 10434 | 8.9% | |
| 2 | 7888 | 6.8% | |
| 3 | 14168 | 12.1% | |
| 4 | 2955 | 2.5% | |
| 5 | 2526 | 2.2% | |
| 6 | 1595 | 1.4% | |
| 7 | 5180 | 4.4% | |
| 8 | 2846 | 2.4% | |
| 9 | 2796 | 2.4% |
| Value | Count | Frequency (%) | |
| 17 | 1830 | 1.6% | |
| 16 | 1158 | 1.0% | |
| 15 | 1540 | 1.3% | |
| 14 | 1615 | 1.4% | |
| 13 | 1454 | 1.2% | |
| 12 | 1543 | 1.3% | |
| 11 | 1361 | 1.2% | |
| 10 | 3167 | 2.7% | |
| 9 | 2796 | 2.4% | |
| 8 | 2846 | 2.4% |
node-caps
Boolean
| Distinct count | 2 |
|---|---|
| Unique (%) | < 0.1% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 911.4 KiB |
| 0 | |
|---|---|
| 1 |
| Value | Count | Frequency (%) | |
| 0 | 88561 | 75.9% | |
| 1 | 28079 | 24.1% |
deg-malig
Categorical
| Distinct count | 3 |
|---|---|
| Unique (%) | < 0.1% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 911.4 KiB |
| 2 | |
|---|---|
| 1 | |
| 0 |
| Value | Count | Frequency (%) | |
| 2 | 52605 | 45.1% | |
| 1 | 36457 | 31.3% | |
| 0 | 27578 | 23.6% |
Length
| Max length | 3 |
|---|---|
| Median length | 3 |
| Mean length | 3 |
| Min length | 3 |
Most occurring characters
| Value | Count | Frequency (%) | |
| 0 | 144218 | 41.2% | |
| . | 116640 | 33.3% | |
| 2 | 52605 | 15.0% | |
| 1 | 36457 | 10.4% |
Most occurring categories
| Value | Count | Frequency (%) | |
| Decimal Number | 233280 | 66.7% | |
| Other Punctuation | 116640 | 33.3% |
Most frequent Decimal Number characters
| Value | Count | Frequency (%) | |
| 0 | 144218 | 61.8% | |
| 2 | 52605 | 22.6% | |
| 1 | 36457 | 15.6% |
Most frequent Other Punctuation characters
| Value | Count | Frequency (%) | |
| . | 116640 | 100.0% |
Most occurring scripts
| Value | Count | Frequency (%) | |
| Common | 349920 | 100.0% |
Most frequent Common characters
| Value | Count | Frequency (%) | |
| 0 | 144218 | 41.2% | |
| . | 116640 | 33.3% | |
| 2 | 52605 | 15.0% | |
| 1 | 36457 | 10.4% |
Most occurring blocks
| Value | Count | Frequency (%) | |
| ASCII | 349920 | 100.0% |
Most frequent ASCII characters
| Value | Count | Frequency (%) | |
| 0 | 144218 | 41.2% | |
| . | 116640 | 33.3% | |
| 2 | 52605 | 15.0% | |
| 1 | 36457 | 10.4% |
breast
Boolean
| Distinct count | 2 |
|---|---|
| Unique (%) | < 0.1% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 911.4 KiB |
| 1 | |
|---|---|
| 0 |
| Value | Count | Frequency (%) | |
| 1 | 61286 | 52.5% | |
| 0 | 55354 | 47.5% |
| Distinct count | 5 |
|---|---|
| Unique (%) | < 0.1% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 1.4569530178326475 |
|---|---|
| Minimum | 0 |
| Maximum | 4 |
| Zeros | 43116 |
| Zeros (%) | 37.0% |
| Memory size | 911.4 KiB |
Quantile statistics
| Minimum | 0 |
|---|---|
| 5-th percentile | 0 |
| Q1 | 0 |
| median | 2 |
| Q3 | 2 |
| 95-th percentile | 4 |
| Maximum | 4 |
| Range | 4 |
| Interquartile range (IQR) | 2 |
Descriptive statistics
| Standard deviation | 1.313991617 |
|---|---|
| Coefficient of variation (CV) | 0.9018764507 |
| Kurtosis | -1.040118538 |
| Mean | 1.456953018 |
| Median Absolute Deviation (MAD) | 1 |
| Skewness | 0.3117823196 |
| Sum | 169939 |
| Variance | 1.726573968 |
Histogram with fixed size bins (bins=10)
| Value | Count | Frequency (%) | |
| 0 | 43116 | 37.0% | |
| 2 | 39092 | 33.5% | |
| 3 | 14218 | 12.2% | |
| 1 | 10585 | 9.1% | |
| 4 | 9629 | 8.3% |
| Value | Count | Frequency (%) | |
| 0 | 43116 | 37.0% | |
| 1 | 10585 | 9.1% | |
| 2 | 39092 | 33.5% | |
| 3 | 14218 | 12.2% | |
| 4 | 9629 | 8.3% |
| Value | Count | Frequency (%) | |
| 4 | 9629 | 8.3% | |
| 3 | 14218 | 12.2% | |
| 2 | 39092 | 33.5% | |
| 1 | 10585 | 9.1% | |
| 0 | 43116 | 37.0% |
irradiation
Boolean
| Distinct count | 2 |
|---|---|
| Unique (%) | < 0.1% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 911.4 KiB |
| 0 | |
|---|---|
| 1 |
| Value | Count | Frequency (%) | |
| 0 | 83941 | 72.0% | |
| 1 | 32699 | 28.0% |
recurrence
Boolean
| Distinct count | 2 |
|---|---|
| Unique (%) | < 0.1% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 911.4 KiB |
| 0 | |
|---|---|
| 1 |
| Value | Count | Frequency (%) | |
| 0 | 76282 | 65.4% | |
| 1 | 40358 | 34.6% |
target
Real number (ℝ)
| Distinct count | 92234 |
|---|---|
| Unique (%) | 79.1% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 24.69291394898318 |
|---|---|
| Minimum | -8.526242256164549 |
| Maximum | 62.008262634277344 |
| Zeros | 0 |
| Zeros (%) | 0.0% |
| Memory size | 911.4 KiB |
Quantile statistics
| Minimum | -8.526242256 |
|---|---|
| 5-th percentile | 7.176139021 |
| Q1 | 18.91156435 |
| median | 25.13337612 |
| Q3 | 30 |
| 95-th percentile | 43.10170422 |
| Maximum | 62.00826263 |
| Range | 70.53450489 |
| Interquartile range (IQR) | 11.08843565 |
Descriptive statistics
| Standard deviation | 10.3484387 |
|---|---|
| Coefficient of variation (CV) | 0.4190853588 |
| Kurtosis | -0.1868727427 |
| Mean | 24.69291395 |
| Median Absolute Deviation (MAD) | 5.033381462 |
| Skewness | 0.06398273421 |
| Sum | 2880181.483 |
| Variance | 107.0901836 |
Histogram with fixed size bins (bins=10)
| Value | Count | Frequency (%) | |
| 30 | 24046 | 20.6% | |
| 45.78100586 | 3 | < 0.1% | |
| 38.45279694 | 2 | < 0.1% | |
| 24.75168228 | 2 | < 0.1% | |
| 18.67092133 | 2 | < 0.1% | |
| 25.76951408 | 2 | < 0.1% | |
| 19.60035133 | 2 | < 0.1% | |
| 25.16242981 | 2 | < 0.1% | |
| 47.65153503 | 2 | < 0.1% | |
| 24.16799164 | 2 | < 0.1% | |
| 25.03426933 | 2 | < 0.1% | |
| 26.19222832 | 2 | < 0.1% | |
| 21.57945824 | 2 | < 0.1% | |
| 20.56734657 | 2 | < 0.1% | |
| 20.48497009 | 2 | < 0.1% | |
| 39.25237274 | 2 | < 0.1% | |
| 19.91839027 | 2 | < 0.1% | |
| 21.51720428 | 2 | < 0.1% | |
| 18.80518532 | 2 | < 0.1% | |
| 24.66407967 | 2 | < 0.1% | |
| 24.7225399 | 2 | < 0.1% | |
| 24.93440819 | 2 | < 0.1% | |
| 37.8710022 | 2 | < 0.1% | |
| 19.23152161 | 2 | < 0.1% | |
| 25.01729012 | 2 | < 0.1% | |
| Other values (92209) | 92545 | 79.3% |
| Value | Count | Frequency (%) | |
| -8.526242256 | 1 | < 0.1% | |
| -7.27835083 | 1 | < 0.1% | |
| -7.227000237 | 1 | < 0.1% | |
| -6.797728062 | 1 | < 0.1% | |
| -6.521306992 | 1 | < 0.1% | |
| -6.419077873 | 1 | < 0.1% | |
| -6.360074043 | 1 | < 0.1% | |
| -6.100745201 | 1 | < 0.1% | |
| -6.08950901 | 1 | < 0.1% | |
| -5.974229813 | 1 | < 0.1% |
| Value | Count | Frequency (%) | |
| 62.00826263 | 1 | < 0.1% | |
| 58.25691223 | 1 | < 0.1% | |
| 58.23876572 | 1 | < 0.1% | |
| 58.08186722 | 1 | < 0.1% | |
| 58.03478241 | 1 | < 0.1% | |
| 57.6429863 | 1 | < 0.1% | |
| 57.51083755 | 1 | < 0.1% | |
| 57.43823242 | 1 | < 0.1% | |
| 57.21965408 | 1 | < 0.1% | |
| 57.20811844 | 1 | < 0.1% |
Pearson's r
The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.
Spearman's ρ
The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.
Kendall's τ
Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.
Phik (φk)
Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.Cramér's V (φc)
Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.First rows
| age | menopause | inv-nodes | node-caps | deg-malig | breast | breast-quad | irradiation | recurrence | target | |
|---|---|---|---|---|---|---|---|---|---|---|
| 0 | 43.296398 | 2 | 0.0 | 0 | 2.0 | 1 | 4 | 0 | 0 | 30.000000 |
| 1 | 53.447540 | 1 | 0.0 | 0 | 0.0 | 1 | 2 | 0 | 0 | 20.076019 |
| 2 | 50.262108 | 0 | 0.0 | 0 | 0.0 | 0 | 1 | 0 | 0 | 30.000000 |
| 3 | 44.398716 | 0 | 0.0 | 0 | 0.0 | 1 | 0 | 0 | 1 | 32.415188 |
| 4 | 49.598515 | 0 | 1.0 | 0 | 2.0 | 1 | 3 | 0 | 0 | 33.421253 |
| 5 | 67.982735 | 1 | 0.0 | 0 | 2.0 | 1 | 2 | 0 | 0 | 24.455177 |
| 6 | 62.187977 | 1 | 8.0 | 0 | 2.0 | 0 | 2 | 0 | 1 | 20.927906 |
| 7 | 64.673241 | 1 | 4.0 | 1 | 1.0 | 1 | 1 | 0 | 1 | 30.000000 |
| 8 | 34.301979 | 0 | 0.0 | 0 | 2.0 | 0 | 2 | 0 | 1 | 11.513506 |
| 9 | 42.491680 | 0 | 10.0 | 0 | 1.0 | 1 | 3 | 0 | 1 | 30.000000 |
Last rows
| age | menopause | inv-nodes | node-caps | deg-malig | breast | breast-quad | irradiation | recurrence | target | |
|---|---|---|---|---|---|---|---|---|---|---|
| 116630 | 44.609718 | 1 | 6.0 | 0 | 0.0 | 1 | 0 | 0 | 1 | 30.000000 |
| 116631 | 39.083138 | 0 | 0.0 | 0 | 2.0 | 0 | 2 | 0 | 0 | 4.987052 |
| 116632 | 70.723602 | 1 | 0.0 | 0 | 1.0 | 1 | 1 | 0 | 0 | 30.000000 |
| 116633 | 38.360680 | 2 | 1.0 | 1 | 1.0 | 1 | 0 | 1 | 0 | 46.038864 |
| 116634 | 62.524914 | 1 | 3.0 | 0 | 2.0 | 0 | 4 | 1 | 0 | 20.436518 |
| 116635 | 47.384506 | 0 | 0.0 | 0 | 1.0 | 1 | 0 | 0 | 0 | 24.230558 |
| 116636 | 51.599133 | 1 | 7.0 | 1 | 2.0 | 1 | 0 | 0 | 1 | 17.847170 |
| 116637 | 69.042389 | 1 | 0.0 | 0 | 2.0 | 1 | 0 | 0 | 0 | 15.111092 |
| 116638 | 48.264580 | 0 | 0.0 | 0 | 1.0 | 1 | 1 | 0 | 0 | 21.324703 |
| 116639 | 64.028008 | 1 | 0.0 | 0 | 2.0 | 1 | 1 | 0 | 0 | 20.348454 |