Dataset statistics
Number of variables | 10 |
---|---|
Number of observations | 116640 |
Missing cells | 0 |
Missing cells (%) | 0.0% |
Duplicate rows | 0 |
Duplicate rows (%) | 0.0% |
Total size in memory | 8.9 MiB |
Average record size in memory | 80.0 B |
Variable types
BOOL | 4 |
---|---|
NUM | 4 |
CAT | 2 |
Reproduction
Analysis started | 2020-08-24 23:49:16.714664 |
---|---|
Analysis finished | 2020-08-24 23:49:23.510658 |
Duration | 6.8 seconds |
Version | pandas-profiling v2.8.0 |
Command line | pandas_profiling --config_file config.yaml [YOUR_FILE.csv] |
Download configuration | config.yaml |
inv-nodes has 52584 (45.1%) zeros | Zeros |
breast-quad has 43116 (37.0%) zeros | Zeros |
age
Real number (ℝ≥0)
Distinct count | 115774 |
---|---|
Unique (%) | 99.3% |
Missing | 0 |
Missing (%) | 0.0% |
Infinite | 0 |
Infinite (%) | 0.0% |
Mean | 50.887072935451044 |
---|---|
Minimum | 22.70721244812012 |
Maximum | 75.94065856933594 |
Zeros | 0 |
Zeros (%) | 0.0% |
Memory size | 911.4 KiB |
Quantile statistics
Minimum | 22.70721245 |
---|---|
5-th percentile | 34.60799923 |
Q1 | 44.58634472 |
median | 50.62482643 |
Q3 | 57.25482273 |
95-th percentile | 66.78811798 |
Maximum | 75.94065857 |
Range | 53.23344612 |
Interquartile range (IQR) | 12.66847801 |
Descriptive statistics
Standard deviation | 9.674236425 |
---|---|
Coefficient of variation (CV) | 0.1901118667 |
Kurtosis | -0.6643299387 |
Mean | 50.88707294 |
Median Absolute Deviation (MAD) | 6.268323898 |
Skewness | -0.007419632656 |
Sum | 5935468.187 |
Variance | 93.5908504 |
Value | Count | Frequency (%) | |
44.2289505 | 3 | < 0.1% | |
45.38502121 | 2 | < 0.1% | |
51.22075653 | 2 | < 0.1% | |
50.48575592 | 2 | < 0.1% | |
46.56327057 | 2 | < 0.1% | |
46.40901566 | 2 | < 0.1% | |
50.15187454 | 2 | < 0.1% | |
46.05487061 | 2 | < 0.1% | |
53.80262375 | 2 | < 0.1% | |
65.60231781 | 2 | < 0.1% | |
49.03860474 | 2 | < 0.1% | |
68.13941193 | 2 | < 0.1% | |
65.03392792 | 2 | < 0.1% | |
48.84786987 | 2 | < 0.1% | |
52.09459686 | 2 | < 0.1% | |
65.63278961 | 2 | < 0.1% | |
45.15192795 | 2 | < 0.1% | |
52.36730957 | 2 | < 0.1% | |
51.70977402 | 2 | < 0.1% | |
50.97578049 | 2 | < 0.1% | |
44.80986023 | 2 | < 0.1% | |
46.98396683 | 2 | < 0.1% | |
64.81917572 | 2 | < 0.1% | |
36.38105011 | 2 | < 0.1% | |
45.23083115 | 2 | < 0.1% | |
Other values (115749) | 116589 | > 99.9% |
Value | Count | Frequency (%) | |
22.70721245 | 1 | < 0.1% | |
23.76066589 | 1 | < 0.1% | |
24.17514229 | 1 | < 0.1% | |
24.30625343 | 1 | < 0.1% | |
24.70094872 | 1 | < 0.1% | |
24.7590332 | 1 | < 0.1% | |
25.09537506 | 1 | < 0.1% | |
25.19407463 | 1 | < 0.1% | |
25.22072983 | 1 | < 0.1% | |
25.3105545 | 1 | < 0.1% |
Value | Count | Frequency (%) | |
75.94065857 | 1 | < 0.1% | |
75.76948547 | 1 | < 0.1% | |
75.54802704 | 1 | < 0.1% | |
75.34172058 | 1 | < 0.1% | |
75.17150879 | 1 | < 0.1% | |
75.16776276 | 1 | < 0.1% | |
75.07889557 | 1 | < 0.1% | |
75.04499054 | 1 | < 0.1% | |
75.04186249 | 1 | < 0.1% | |
74.97699738 | 1 | < 0.1% |
menopause
Categorical
Distinct count | 3 |
---|---|
Unique (%) | < 0.1% |
Missing | 0 |
Missing (%) | 0.0% |
Memory size | 911.4 KiB |
0 | |
---|---|
1 | |
2 | 7277 |
Value | Count | Frequency (%) | |
0 | 58516 | 50.2% | |
1 | 50847 | 43.6% | |
2 | 7277 | 6.2% |
Length
Max length | 1 |
---|---|
Median length | 1 |
Mean length | 1 |
Min length | 1 |
Most occurring characters
Value | Count | Frequency (%) | |
0 | 58516 | 50.2% | |
1 | 50847 | 43.6% | |
2 | 7277 | 6.2% |
Most occurring categories
Value | Count | Frequency (%) | |
Decimal Number | 116640 | 100.0% |
Most frequent Decimal Number characters
Value | Count | Frequency (%) | |
0 | 58516 | 50.2% | |
1 | 50847 | 43.6% | |
2 | 7277 | 6.2% |
Most occurring scripts
Value | Count | Frequency (%) | |
Common | 116640 | 100.0% |
Most frequent Common characters
Value | Count | Frequency (%) | |
0 | 58516 | 50.2% | |
1 | 50847 | 43.6% | |
2 | 7277 | 6.2% |
Most occurring blocks
Value | Count | Frequency (%) | |
ASCII | 116640 | 100.0% |
Most frequent ASCII characters
Value | Count | Frequency (%) | |
0 | 58516 | 50.2% | |
1 | 50847 | 43.6% | |
2 | 7277 | 6.2% |
Distinct count | 18 |
---|---|
Unique (%) | < 0.1% |
Missing | 0 |
Missing (%) | 0.0% |
Infinite | 0 |
Infinite (%) | 0.0% |
Mean | 3.1407150205761316 |
---|---|
Minimum | 0.0 |
Maximum | 17.0 |
Zeros | 52584 |
Zeros (%) | 45.1% |
Memory size | 911.4 KiB |
Quantile statistics
Minimum | 0 |
---|---|
5-th percentile | 0 |
Q1 | 0 |
median | 1 |
Q3 | 4 |
95-th percentile | 14 |
Maximum | 17 |
Range | 17 |
Interquartile range (IQR) | 4 |
Descriptive statistics
Standard deviation | 4.42793718 |
---|---|
Coefficient of variation (CV) | 1.409850034 |
Kurtosis | 1.43983298 |
Mean | 3.140715021 |
Median Absolute Deviation (MAD) | 1 |
Skewness | 1.542442221 |
Sum | 366333 |
Variance | 19.60662767 |
Value | Count | Frequency (%) | |
0 | 52584 | 45.1% | |
3 | 14168 | 12.1% | |
1 | 10434 | 8.9% | |
2 | 7888 | 6.8% | |
7 | 5180 | 4.4% | |
10 | 3167 | 2.7% | |
4 | 2955 | 2.5% | |
8 | 2846 | 2.4% | |
9 | 2796 | 2.4% | |
5 | 2526 | 2.2% | |
17 | 1830 | 1.6% | |
14 | 1615 | 1.4% | |
6 | 1595 | 1.4% | |
12 | 1543 | 1.3% | |
15 | 1540 | 1.3% | |
13 | 1454 | 1.2% | |
11 | 1361 | 1.2% | |
16 | 1158 | 1.0% |
Value | Count | Frequency (%) | |
0 | 52584 | 45.1% | |
1 | 10434 | 8.9% | |
2 | 7888 | 6.8% | |
3 | 14168 | 12.1% | |
4 | 2955 | 2.5% | |
5 | 2526 | 2.2% | |
6 | 1595 | 1.4% | |
7 | 5180 | 4.4% | |
8 | 2846 | 2.4% | |
9 | 2796 | 2.4% |
Value | Count | Frequency (%) | |
17 | 1830 | 1.6% | |
16 | 1158 | 1.0% | |
15 | 1540 | 1.3% | |
14 | 1615 | 1.4% | |
13 | 1454 | 1.2% | |
12 | 1543 | 1.3% | |
11 | 1361 | 1.2% | |
10 | 3167 | 2.7% | |
9 | 2796 | 2.4% | |
8 | 2846 | 2.4% |
node-caps
Boolean
Distinct count | 2 |
---|---|
Unique (%) | < 0.1% |
Missing | 0 |
Missing (%) | 0.0% |
Memory size | 911.4 KiB |
0 | |
---|---|
1 |
Value | Count | Frequency (%) | |
0 | 88561 | 75.9% | |
1 | 28079 | 24.1% |
deg-malig
Categorical
Distinct count | 3 |
---|---|
Unique (%) | < 0.1% |
Missing | 0 |
Missing (%) | 0.0% |
Memory size | 911.4 KiB |
2 | |
---|---|
1 | |
0 |
Value | Count | Frequency (%) | |
2 | 52605 | 45.1% | |
1 | 36457 | 31.3% | |
0 | 27578 | 23.6% |
Length
Max length | 3 |
---|---|
Median length | 3 |
Mean length | 3 |
Min length | 3 |
Most occurring characters
Value | Count | Frequency (%) | |
0 | 144218 | 41.2% | |
. | 116640 | 33.3% | |
2 | 52605 | 15.0% | |
1 | 36457 | 10.4% |
Most occurring categories
Value | Count | Frequency (%) | |
Decimal Number | 233280 | 66.7% | |
Other Punctuation | 116640 | 33.3% |
Most frequent Decimal Number characters
Value | Count | Frequency (%) | |
0 | 144218 | 61.8% | |
2 | 52605 | 22.6% | |
1 | 36457 | 15.6% |
Most frequent Other Punctuation characters
Value | Count | Frequency (%) | |
. | 116640 | 100.0% |
Most occurring scripts
Value | Count | Frequency (%) | |
Common | 349920 | 100.0% |
Most frequent Common characters
Value | Count | Frequency (%) | |
0 | 144218 | 41.2% | |
. | 116640 | 33.3% | |
2 | 52605 | 15.0% | |
1 | 36457 | 10.4% |
Most occurring blocks
Value | Count | Frequency (%) | |
ASCII | 349920 | 100.0% |
Most frequent ASCII characters
Value | Count | Frequency (%) | |
0 | 144218 | 41.2% | |
. | 116640 | 33.3% | |
2 | 52605 | 15.0% | |
1 | 36457 | 10.4% |
breast
Boolean
Distinct count | 2 |
---|---|
Unique (%) | < 0.1% |
Missing | 0 |
Missing (%) | 0.0% |
Memory size | 911.4 KiB |
1 | |
---|---|
0 |
Value | Count | Frequency (%) | |
1 | 61286 | 52.5% | |
0 | 55354 | 47.5% |
Distinct count | 5 |
---|---|
Unique (%) | < 0.1% |
Missing | 0 |
Missing (%) | 0.0% |
Infinite | 0 |
Infinite (%) | 0.0% |
Mean | 1.4569530178326475 |
---|---|
Minimum | 0 |
Maximum | 4 |
Zeros | 43116 |
Zeros (%) | 37.0% |
Memory size | 911.4 KiB |
Quantile statistics
Minimum | 0 |
---|---|
5-th percentile | 0 |
Q1 | 0 |
median | 2 |
Q3 | 2 |
95-th percentile | 4 |
Maximum | 4 |
Range | 4 |
Interquartile range (IQR) | 2 |
Descriptive statistics
Standard deviation | 1.313991617 |
---|---|
Coefficient of variation (CV) | 0.9018764507 |
Kurtosis | -1.040118538 |
Mean | 1.456953018 |
Median Absolute Deviation (MAD) | 1 |
Skewness | 0.3117823196 |
Sum | 169939 |
Variance | 1.726573968 |
Value | Count | Frequency (%) | |
0 | 43116 | 37.0% | |
2 | 39092 | 33.5% | |
3 | 14218 | 12.2% | |
1 | 10585 | 9.1% | |
4 | 9629 | 8.3% |
Value | Count | Frequency (%) | |
0 | 43116 | 37.0% | |
1 | 10585 | 9.1% | |
2 | 39092 | 33.5% | |
3 | 14218 | 12.2% | |
4 | 9629 | 8.3% |
Value | Count | Frequency (%) | |
4 | 9629 | 8.3% | |
3 | 14218 | 12.2% | |
2 | 39092 | 33.5% | |
1 | 10585 | 9.1% | |
0 | 43116 | 37.0% |
irradiation
Boolean
Distinct count | 2 |
---|---|
Unique (%) | < 0.1% |
Missing | 0 |
Missing (%) | 0.0% |
Memory size | 911.4 KiB |
0 | |
---|---|
1 |
Value | Count | Frequency (%) | |
0 | 83941 | 72.0% | |
1 | 32699 | 28.0% |
recurrence
Boolean
Distinct count | 2 |
---|---|
Unique (%) | < 0.1% |
Missing | 0 |
Missing (%) | 0.0% |
Memory size | 911.4 KiB |
0 | |
---|---|
1 |
Value | Count | Frequency (%) | |
0 | 76282 | 65.4% | |
1 | 40358 | 34.6% |
target
Real number (ℝ)
Distinct count | 92234 |
---|---|
Unique (%) | 79.1% |
Missing | 0 |
Missing (%) | 0.0% |
Infinite | 0 |
Infinite (%) | 0.0% |
Mean | 24.69291394898318 |
---|---|
Minimum | -8.526242256164549 |
Maximum | 62.008262634277344 |
Zeros | 0 |
Zeros (%) | 0.0% |
Memory size | 911.4 KiB |
Quantile statistics
Minimum | -8.526242256 |
---|---|
5-th percentile | 7.176139021 |
Q1 | 18.91156435 |
median | 25.13337612 |
Q3 | 30 |
95-th percentile | 43.10170422 |
Maximum | 62.00826263 |
Range | 70.53450489 |
Interquartile range (IQR) | 11.08843565 |
Descriptive statistics
Standard deviation | 10.3484387 |
---|---|
Coefficient of variation (CV) | 0.4190853588 |
Kurtosis | -0.1868727427 |
Mean | 24.69291395 |
Median Absolute Deviation (MAD) | 5.033381462 |
Skewness | 0.06398273421 |
Sum | 2880181.483 |
Variance | 107.0901836 |
Value | Count | Frequency (%) | |
30 | 24046 | 20.6% | |
45.78100586 | 3 | < 0.1% | |
38.45279694 | 2 | < 0.1% | |
24.75168228 | 2 | < 0.1% | |
18.67092133 | 2 | < 0.1% | |
25.76951408 | 2 | < 0.1% | |
19.60035133 | 2 | < 0.1% | |
25.16242981 | 2 | < 0.1% | |
47.65153503 | 2 | < 0.1% | |
24.16799164 | 2 | < 0.1% | |
25.03426933 | 2 | < 0.1% | |
26.19222832 | 2 | < 0.1% | |
21.57945824 | 2 | < 0.1% | |
20.56734657 | 2 | < 0.1% | |
20.48497009 | 2 | < 0.1% | |
39.25237274 | 2 | < 0.1% | |
19.91839027 | 2 | < 0.1% | |
21.51720428 | 2 | < 0.1% | |
18.80518532 | 2 | < 0.1% | |
24.66407967 | 2 | < 0.1% | |
24.7225399 | 2 | < 0.1% | |
24.93440819 | 2 | < 0.1% | |
37.8710022 | 2 | < 0.1% | |
19.23152161 | 2 | < 0.1% | |
25.01729012 | 2 | < 0.1% | |
Other values (92209) | 92545 | 79.3% |
Value | Count | Frequency (%) | |
-8.526242256 | 1 | < 0.1% | |
-7.27835083 | 1 | < 0.1% | |
-7.227000237 | 1 | < 0.1% | |
-6.797728062 | 1 | < 0.1% | |
-6.521306992 | 1 | < 0.1% | |
-6.419077873 | 1 | < 0.1% | |
-6.360074043 | 1 | < 0.1% | |
-6.100745201 | 1 | < 0.1% | |
-6.08950901 | 1 | < 0.1% | |
-5.974229813 | 1 | < 0.1% |
Value | Count | Frequency (%) | |
62.00826263 | 1 | < 0.1% | |
58.25691223 | 1 | < 0.1% | |
58.23876572 | 1 | < 0.1% | |
58.08186722 | 1 | < 0.1% | |
58.03478241 | 1 | < 0.1% | |
57.6429863 | 1 | < 0.1% | |
57.51083755 | 1 | < 0.1% | |
57.43823242 | 1 | < 0.1% | |
57.21965408 | 1 | < 0.1% | |
57.20811844 | 1 | < 0.1% |
Pearson's r
The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.
Spearman's ρ
The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.
Kendall's τ
Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.
Phik (φk)
Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.Cramér's V (φc)
Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.First rows
age | menopause | inv-nodes | node-caps | deg-malig | breast | breast-quad | irradiation | recurrence | target | |
---|---|---|---|---|---|---|---|---|---|---|
0 | 43.296398 | 2 | 0.0 | 0 | 2.0 | 1 | 4 | 0 | 0 | 30.000000 |
1 | 53.447540 | 1 | 0.0 | 0 | 0.0 | 1 | 2 | 0 | 0 | 20.076019 |
2 | 50.262108 | 0 | 0.0 | 0 | 0.0 | 0 | 1 | 0 | 0 | 30.000000 |
3 | 44.398716 | 0 | 0.0 | 0 | 0.0 | 1 | 0 | 0 | 1 | 32.415188 |
4 | 49.598515 | 0 | 1.0 | 0 | 2.0 | 1 | 3 | 0 | 0 | 33.421253 |
5 | 67.982735 | 1 | 0.0 | 0 | 2.0 | 1 | 2 | 0 | 0 | 24.455177 |
6 | 62.187977 | 1 | 8.0 | 0 | 2.0 | 0 | 2 | 0 | 1 | 20.927906 |
7 | 64.673241 | 1 | 4.0 | 1 | 1.0 | 1 | 1 | 0 | 1 | 30.000000 |
8 | 34.301979 | 0 | 0.0 | 0 | 2.0 | 0 | 2 | 0 | 1 | 11.513506 |
9 | 42.491680 | 0 | 10.0 | 0 | 1.0 | 1 | 3 | 0 | 1 | 30.000000 |
Last rows
age | menopause | inv-nodes | node-caps | deg-malig | breast | breast-quad | irradiation | recurrence | target | |
---|---|---|---|---|---|---|---|---|---|---|
116630 | 44.609718 | 1 | 6.0 | 0 | 0.0 | 1 | 0 | 0 | 1 | 30.000000 |
116631 | 39.083138 | 0 | 0.0 | 0 | 2.0 | 0 | 2 | 0 | 0 | 4.987052 |
116632 | 70.723602 | 1 | 0.0 | 0 | 1.0 | 1 | 1 | 0 | 0 | 30.000000 |
116633 | 38.360680 | 2 | 1.0 | 1 | 1.0 | 1 | 0 | 1 | 0 | 46.038864 |
116634 | 62.524914 | 1 | 3.0 | 0 | 2.0 | 0 | 4 | 1 | 0 | 20.436518 |
116635 | 47.384506 | 0 | 0.0 | 0 | 1.0 | 1 | 0 | 0 | 0 | 24.230558 |
116636 | 51.599133 | 1 | 7.0 | 1 | 2.0 | 1 | 0 | 0 | 1 | 17.847170 |
116637 | 69.042389 | 1 | 0.0 | 0 | 2.0 | 1 | 0 | 0 | 0 | 15.111092 |
116638 | 48.264580 | 0 | 0.0 | 0 | 1.0 | 1 | 1 | 0 | 0 | 21.324703 |
116639 | 64.028008 | 1 | 0.0 | 0 | 2.0 | 1 | 1 | 0 | 0 | 20.348454 |