analcatdata

Dataset statistics

Number of variables	5
Number of observations	50
Missing cells	0
Missing cells (%)	0.0%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	2.1 KiB
Average record size in memory	42.6 B

Variable types

NUM	4
BOOL	1

Reproduction

Analysis started	2020-08-25 01:04:41.342190
Analysis finished	2020-08-25 01:04:43.850281
Duration	2.51 seconds
Version	pandas-profiling v2.8.0
Command line	`pandas_profiling --config_file config.yaml [YOUR_FILE.csv]`
Download configuration	config.yaml

Warnings

`AIDS` has unique values	Unique
`Total` has unique values	Unique
`Age` has 10 (20.0%) zeros	Zeros
`Race` has 10 (20.0%) zeros	Zeros

Age
Real number (ℝ_≥0)

ZEROS

Distinct count	5
Unique (%)	10.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	2.0
Minimum	0
Maximum	4
Zeros	10
Zeros (%)	20.0%
Memory size	528.0 B

Quantile statistics

Minimum	0
5-th percentile	0
Q1	1
median	2
Q3	3
95-th percentile	4
Maximum	4
Range	4
Interquartile range (IQR)	2

Descriptive statistics

Standard deviation	1.428571429
Coefficient of variation (CV)	0.7142857143
Kurtosis	-1.309707447
Mean	2
Median Absolute Deviation (MAD)	1
Skewness	0
Sum	100
Variance	2.040816327

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
4	10	20.0%
3	10	20.0%
2	10	20.0%
1	10	20.0%
0	10	20.0%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	10	20.0%
1	10	20.0%
2	10	20.0%
3	10	20.0%
4	10	20.0%

Value	Count	Frequency (%)
4	10	20.0%
3	10	20.0%
2	10	20.0%
1	10	20.0%
0	10	20.0%

Race
Real number (ℝ_≥0)

ZEROS

Distinct count	5
Unique (%)	10.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	2.0
Minimum	0
Maximum	4
Zeros	10
Zeros (%)	20.0%
Memory size	528.0 B

Quantile statistics

Minimum	0
5-th percentile	0
Q1	1
median	2
Q3	3
95-th percentile	4
Maximum	4
Range	4
Interquartile range (IQR)	2

Descriptive statistics

Standard deviation	1.428571429
Coefficient of variation (CV)	0.7142857143
Kurtosis	-1.309707447
Mean	2
Median Absolute Deviation (MAD)	1
Skewness	0
Sum	100
Variance	2.040816327

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
4	10	20.0%
3	10	20.0%
2	10	20.0%
1	10	20.0%
0	10	20.0%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	10	20.0%
1	10	20.0%
2	10	20.0%
3	10	20.0%
4	10	20.0%

Value	Count	Frequency (%)
4	10	20.0%
3	10	20.0%
2	10	20.0%
1	10	20.0%
0	10	20.0%

AIDS
Real number (ℝ_≥0)

UNIQUE

Distinct count	50
Unique (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	9037.02
Minimum	3.0
Maximum	82334.0
Zeros	0
Zeros (%)	0.0%
Memory size	528.0 B

Quantile statistics

Minimum	3
5-th percentile	19.4
Q1	114.5
median	1640
Q3	9073.75
95-th percentile	45579.5
Maximum	82334
Range	82331
Interquartile range (IQR)	8959.25

Descriptive statistics

Standard deviation	16823.62682
Coefficient of variation (CV)	1.861634346
Kurtosis	7.814248603
Mean	9037.02
Median Absolute Deviation (MAD)	1597
Skewness	2.696343291
Sum	451851
Variance	283034419.3

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
34204	1	2.0%
48	1	2.0%
106	1	2.0%
83	1	2.0%
6	1	2.0%
910	1	2.0%
1944	1	2.0%
493	1	2.0%
1490	1	2.0%
1790	1	2.0%
2152	1	2.0%
490	1	2.0%
140	1	2.0%
82334	1	2.0%
417	1	2.0%
390	1	2.0%
26	1	2.0%
258	1	2.0%
560	1	2.0%
1162	1	2.0%
731	1	2.0%
38	1	2.0%
27200	1	2.0%
51776	1	2.0%
69	1	2.0%
Other values (25)	25	50.0%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
3	1	2.0%
6	1	2.0%
14	1	2.0%
26	1	2.0%
31	1	2.0%
38	1	2.0%
48	1	2.0%
55	1	2.0%
69	1	2.0%
77	1	2.0%

Value	Count	Frequency (%)
82334	1	2.0%
55300	1	2.0%
51776	1	2.0%
38006	1	2.0%
34204	1	2.0%
27200	1	2.0%
23896	1	2.0%
20712	1	2.0%
16068	1	2.0%
15713	1	2.0%

Total
Real number (ℝ_≥0)

UNIQUE

Distinct count	50
Unique (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	4423370.62
Minimum	162616.0
Maximum	22686934.0
Zeros	0
Zeros (%)	0.0%
Memory size	528.0 B

Quantile statistics

Minimum	162616
5-th percentile	170489.75
Q1	702786.5
median	1616417.5
Q3	2806359.25
95-th percentile	16994352.1
Maximum	22686934
Range	22524318
Interquartile range (IQR)	2103572.75

Descriptive statistics

Standard deviation	6371785.346
Coefficient of variation (CV)	1.440481907
Kurtosis	1.344818033
Mean	4423370.62
Median Absolute Deviation (MAD)	930730
Skewness	1.663655902
Sum	221168531
Variance	4.05996485e+13

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
162616	1	2.0%
2276276	1	2.0%
3718366	1	2.0%
14443382	1	2.0%
17282659	1	2.0%
175626	1	2.0%
2422980	1	2.0%
168876	1	2.0%
2727604	1	2.0%
172170	1	2.0%
837159	1	2.0%
2502800	1	2.0%
726561	1	2.0%
16641977	1	2.0%
15270378	1	2.0%
3580523	1	2.0%
1845800	1	2.0%
13888285	1	2.0%
255790	1	2.0%
1540381	1	2.0%
698637	1	2.0%
2410019	1	2.0%
1483278	1	2.0%
22686934	1	2.0%
178798	1	2.0%
Other values (25)	25	50.0%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
162616	1	2.0%
168876	1	2.0%
169115	1	2.0%
172170	1	2.0%
175626	1	2.0%
178798	1	2.0%
194858	1	2.0%
202360	1	2.0%
255790	1	2.0%
265637	1	2.0%

Value	Count	Frequency (%)
22686934	1	2.0%
21845911	1	2.0%
17282659	1	2.0%
16641977	1	2.0%
15270378	1	2.0%
14999423	1	2.0%
14704293	1	2.0%
14443382	1	2.0%
14422956	1	2.0%
13888285	1	2.0%

target
Boolean

Distinct count	2
Unique (%)	4.0%
Missing	0
Missing (%)	0.0%
Memory size	528.0 B

1	25
0	25

Frequency Table

Value	Count	Frequency (%)
1	25	50.0%
0	25	50.0%

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Count
Matrix

First rows

	Age	Race	AIDS	Total	target
0	0	4	2555.0	14443382.0	1
1	1	4	55300.0	14704293.0	1
2	2	4	82334.0	16641977.0	1
3	3	4	38006.0	13888285.0	1
4	4	4	16068.0	21845911.0	1
5	0	2	2489.0	2367256.0	1
6	1	2	34204.0	2410019.0	1
7	2	2	51776.0	2727604.0	1
8	3	2	23896.0	2276276.0	1
9	4	2	10169.0	3580523.0	1

Last rows

	Age	Race	AIDS	Total
40	0	1	6.0	726561.0
41	1	1	83.0	739686.0
42	2	1	106.0	837159.0
43	3	1	69.0	698637.0
44	4	1	55.0	1098938.0
45	0	0	3.0	175626.0
46	1	0	78.0	178798.0
47	2	0	77.0	202360.0
48	3	0	31.0	168876.0
49	4	0	14.0	265637.0

Overview

Variables

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Phik (φk)

Missing values

Sample

First rows

Last rows