522_pm10

Dataset statistics

Number of variables	8
Number of observations	500
Missing cells	0
Missing cells (%)	0.0%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	31.4 KiB
Average record size in memory	64.3 B

Variable types

NUM	8

Reproduction

Analysis started	2020-08-25 00:01:38.197097
Analysis finished	2020-08-25 00:01:48.301436
Duration	10.1 seconds
Version	pandas-profiling v2.8.0
Command line	`pandas_profiling --config_file config.yaml [YOUR_FILE.csv]`
Download configuration	config.yaml

Warnings

temperature_diff_2m_25m has 39 (7.8%) zeros Zeros

cars_per_hour
Real number (ℝ_≥0)

Distinct count	456
Unique (%)	91.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	7.013101393699646
Minimum	3.8066599369049072
Maximum	8.352080345153809
Zeros	0
Zeros (%)	0.0%
Memory size	4.0 KiB

Quantile statistics

Minimum	3.806659937
5-th percentile	4.819875073
Q1	6.260525107
median	7.523750067
Q3	7.82784009
95-th percentile	8.233010244
Maximum	8.352080345
Range	4.545420408
Interquartile range (IQR)	1.567314982

Descriptive statistics

Standard deviation	1.094036897
Coefficient of variation (CV)	0.1559990132
Kurtosis	-0.346298305
Mean	7.013101394
Median Absolute Deviation (MAD)	0.4936699867
Skewness	-0.913561164
Sum	3506.550697
Variance	1.196916732

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
6.432940006	3	0.6%
7.901750088	3	0.6%
5.484799862	3	0.6%
5.129899979	3	0.6%
7.855160236	2	0.4%
7.651120186	2	0.4%
6.63988018	2	0.4%
4.543290138	2	0.4%
4.477340221	2	0.4%
5.313210011	2	0.4%
7.525100231	2	0.4%
5.743000031	2	0.4%
7.543270111	2	0.4%
7.643479824	2	0.4%
7.593369961	2	0.4%
4.955830097	2	0.4%
7.436029911	2	0.4%
5.710430145	2	0.4%
5.62762022	2	0.4%
7.766839981	2	0.4%
7.552760124	2	0.4%
7.290289879	2	0.4%
6.16121006	2	0.4%
5.424950123	2	0.4%
4.700479984	2	0.4%
Other values (431)	446	89.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
3.806659937	1	0.2%
3.970289946	1	0.2%
4.110869884	1	0.2%
4.304069996	2	0.4%
4.369450092	1	0.2%
4.454349995	1	0.2%
4.477340221	2	0.4%
4.543290138	2	0.4%
4.564350128	1	0.2%
4.595119953	1	0.2%

Value	Count	Frequency (%)
8.352080345	1	0.2%
8.340689659	1	0.2%
8.334710121	1	0.2%
8.325790405	1	0.2%
8.315320015	1	0.2%
8.313850403	1	0.2%
8.313610077	1	0.2%
8.307209969	1	0.2%
8.305979729	1	0.2%
8.292550087	1	0.2%

temperature_at_2m
Real number (ℝ)

Distinct count	218
Unique (%)	43.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.7869999919235706
Minimum	-19.0
Maximum	21.899999618530273
Zeros	4
Zeros (%)	0.8%
Memory size	4.0 KiB

Quantile statistics

Minimum	-19
5-th percentile	-10.82000017
Q1	-3.12499994
median	1
Q3	4.224999905
95-th percentile	11.60000038
Maximum	21.89999962
Range	40.89999962
Interquartile range (IQR)	7.349999845

Descriptive statistics

Standard deviation	6.386757583
Coefficient of variation (CV)	8.115321027
Kurtosis	0.5215847788
Mean	0.7869999919
Median Absolute Deviation (MAD)	3.799999952
Skewness	-0.07115680333
Sum	393.499996
Variance	40.79067242

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
0.1000000015	9	1.8%
3.400000095	9	1.8%
0.200000003	7	1.4%
2.099999905	7	1.4%
-2.799999952	6	1.2%
1	6	1.2%
4.199999809	6	1.2%
1.5	6	1.2%
-4.400000095	6	1.2%
3.599999905	6	1.2%
3.299999952	6	1.2%
6.5	5	1.0%
-4.800000191	5	1.0%
1.399999976	5	1.0%
4.099999905	5	1.0%
1.700000048	5	1.0%
0.6999999881	5	1.0%
0.8000000119	5	1.0%
2.400000095	5	1.0%
-1.299999952	5	1.0%
1.600000024	5	1.0%
2	5	1.0%
-0.200000003	5	1.0%
2.200000048	5	1.0%
3	4	0.8%
Other values (193)	357	71.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
-19	1	0.2%
-18.60000038	1	0.2%
-15.5	1	0.2%
-15	1	0.2%
-14.89999962	1	0.2%
-14.60000038	1	0.2%
-14.19999981	1	0.2%
-13.5	1	0.2%
-13.39999962	2	0.4%
-13.10000038	3	0.6%

Value	Count	Frequency (%)
21.89999962	1	0.2%
19.79999924	1	0.2%
18.20000076	1	0.2%
17.79999924	1	0.2%
16.79999924	1	0.2%
16.29999924	1	0.2%
15.80000019	2	0.4%
15.10000038	1	0.2%
15	1	0.2%
14.89999962	1	0.2%

wind_speed
Real number (ℝ_≥0)

Distinct count	79
Unique (%)	15.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	3.2111999925971033
Minimum	0.30000001192092896
Maximum	9.899999618530273
Zeros	0
Zeros (%)	0.0%
Memory size	4.0 KiB

Quantile statistics

Minimum	0.3000000119
5-th percentile	0.8000000119
Q1	1.700000048
median	3
Q3	4.300000191
95-th percentile	6.609999919
Maximum	9.899999619
Range	9.599999607
Interquartile range (IQR)	2.600000143

Descriptive statistics

Standard deviation	1.86061234
Coefficient of variation (CV)	0.5794134106
Kurtosis	0.5937840127
Mean	3.211199993
Median Absolute Deviation (MAD)	1.299999952
Skewness	0.8238986084
Sum	1605.599996
Variance	3.461878279

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
1.5	18	3.6%
0.8000000119	16	3.2%
2.799999952	14	2.8%
3.900000095	13	2.6%
4.199999809	13	2.6%
3.099999905	13	2.6%
4.300000191	12	2.4%
1.899999976	12	2.4%
2.200000048	12	2.4%
2.099999905	12	2.4%
4	12	2.4%
3.599999905	11	2.2%
2.5	11	2.2%
1.799999952	11	2.2%
2.599999905	11	2.2%
3.200000048	10	2.0%
1.100000024	10	2.0%
1.399999976	10	2.0%
1.700000048	10	2.0%
3.5	10	2.0%
1.600000024	10	2.0%
2	10	2.0%
4.900000095	9	1.8%
2.400000095	8	1.6%
1	8	1.6%
Other values (54)	214	42.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.3000000119	1	0.2%
0.400000006	1	0.2%
0.5	7	1.4%
0.6000000238	7	1.4%
0.6999999881	8	1.6%
0.8000000119	16	3.2%
0.8999999762	7	1.4%
1	8	1.6%
1.100000024	10	2.0%
1.200000048	6	1.2%

Value	Count	Frequency (%)
9.899999619	1	0.2%
9.399999619	4	0.8%
8.899999619	1	0.2%
8.600000381	1	0.2%
8.300000191	1	0.2%
8.100000381	1	0.2%
8	2	0.4%
7.900000095	1	0.2%
7.699999809	1	0.2%
7.599999905	1	0.2%

temperature_diff_2m_25m
Real number (ℝ)

ZEROS

Distinct count	62
Unique (%)	12.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.15480000133812427
Minimum	-5.0
Maximum	4.0
Zeros	39
Zeros (%)	7.8%
Memory size	4.0 KiB

Quantile statistics

Minimum	-5
5-th percentile	-1.299999952
Q1	-0.200000003
median	0.1000000015
Q3	0.6000000238
95-th percentile	1.700000048
Maximum	4
Range	9
Interquartile range (IQR)	0.8000000268

Descriptive statistics

Standard deviation	0.9886312497
Coefficient of variation (CV)	6.386506726
Kurtosis	4.622818138
Mean	0.1548000013
Median Absolute Deviation (MAD)	0.3000000045
Skewness	-0.3071873536
Sum	77.40000067
Variance	0.9773917479

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
-0.1000000015	69	13.8%
0.1000000015	44	8.8%
-0.200000003	43	8.6%
0	39	7.8%
0.200000003	34	6.8%
-0.3000000119	19	3.8%
0.400000006	16	3.2%
1.100000024	16	3.2%
0.3000000119	16	3.2%
0.6000000238	15	3.0%
0.5	14	2.8%
0.6999999881	13	2.6%
1.200000048	11	2.2%
0.8000000119	10	2.0%
-0.400000006	9	1.8%
1.299999952	9	1.8%
-0.6000000238	8	1.6%
-0.5	8	1.6%
1.399999976	7	1.4%
1.700000048	7	1.4%
-0.8999999762	7	1.4%
-0.8000000119	6	1.2%
-0.6999999881	6	1.2%
0.8999999762	5	1.0%
1	5	1.0%
Other values (37)	64	12.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
-5	1	0.2%
-4.5	1	0.2%
-3.400000095	1	0.2%
-3.200000048	1	0.2%
-3.099999905	2	0.4%
-2.799999952	1	0.2%
-2.700000048	2	0.4%
-2.5	3	0.6%
-2.200000048	1	0.2%
-2	2	0.4%

Value	Count	Frequency (%)
4	1	0.2%
3.700000048	2	0.4%
3.599999905	1	0.2%
3.200000048	1	0.2%
3.099999905	1	0.2%
2.799999952	1	0.2%
2.700000048	1	0.2%
2.599999905	1	0.2%
2.5	1	0.2%
2.400000095	2	0.4%

wind_direction
Real number (ℝ_≥0)

Distinct count	354
Unique (%)	70.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	141.0909999256134
Minimum	5.0
Maximum	358.0
Zeros	0
Zeros (%)	0.0%
Memory size	4.0 KiB

Quantile statistics

Minimum	5
5-th percentile	38.09499855
Q1	71.27500153
median	101.8499985
Q3	216.8500023
95-th percentile	276.0399994
Maximum	358
Range	353
Interquartile range (IQR)	145.5750008

Descriptive statistics

Standard deviation	85.51077345
Coefficient of variation (CV)	0.6060682361
Kurtosis	-1.002653125
Mean	141.0909999
Median Absolute Deviation (MAD)	57.84999847
Skewness	0.4614759921
Sum	70545.49996
Variance	7312.092376

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
80	7	1.4%
78	7	1.4%
77	7	1.4%
75	6	1.2%
60	6	1.2%
79	6	1.2%
73	5	1.0%
81	5	1.0%
82	5	1.0%
66	5	1.0%
206	4	0.8%
55	4	0.8%
59	4	0.8%
86	4	0.8%
230	4	0.8%
85	4	0.8%
260	3	0.6%
243	3	0.6%
172	3	0.6%
200	3	0.6%
228	3	0.6%
232	3	0.6%
220	3	0.6%
44	3	0.6%
83	3	0.6%
Other values (329)	390	78.0%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
5	1	0.2%
9	1	0.2%
9.399999619	1	0.2%
10	1	0.2%
11	1	0.2%
14.30000019	1	0.2%
15	1	0.2%
16	2	0.4%
16.60000038	1	0.2%
17	1	0.2%

Value	Count	Frequency (%)
358	1	0.2%
357.5	1	0.2%
354	1	0.2%
353	1	0.2%
350	1	0.2%
345	1	0.2%
344.7000122	1	0.2%
341.1000061	1	0.2%
340	1	0.2%
337.7999878	1	0.2%

hour_of_day
Real number (ℝ_≥0)

Distinct count	24
Unique (%)	4.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	12.446
Minimum	1.0
Maximum	24.0
Zeros	0
Zeros (%)	0.0%
Memory size	4.0 KiB

Quantile statistics

Minimum	1
5-th percentile	2
Q1	7
median	13
Q3	18
95-th percentile	23
Maximum	24
Range	23
Interquartile range (IQR)	11

Descriptive statistics

Standard deviation	6.85748746
Coefficient of variation (CV)	0.5509792271
Kurtosis	-1.167314917
Mean	12.446
Median Absolute Deviation (MAD)	6
Skewness	-0.01976810176
Sum	6223
Variance	47.02513427

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
8	28	5.6%
14	26	5.2%
19	26	5.2%
3	24	4.8%
15	24	4.8%
13	23	4.6%
2	23	4.6%
21	22	4.4%
17	22	4.4%
16	21	4.2%
11	21	4.2%
24	21	4.2%
1	20	4.0%
7	20	4.0%
4	20	4.0%
18	19	3.8%
22	19	3.8%
5	19	3.8%
9	19	3.8%
10	18	3.6%
12	18	3.6%
23	17	3.4%
20	16	3.2%
6	14	2.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	20	4.0%
2	23	4.6%
3	24	4.8%
4	20	4.0%
5	19	3.8%
6	14	2.8%
7	20	4.0%
8	28	5.6%
9	19	3.8%
10	18	3.6%

Value	Count	Frequency (%)
24	21	4.2%
23	17	3.4%
22	19	3.8%
21	22	4.4%
20	16	3.2%
19	26	5.2%
18	19	3.8%
17	22	4.4%
16	21	4.2%
15	24	4.8%

day
Real number (ℝ_≥0)

Distinct count	273
Unique (%)	54.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	311.426
Minimum	32.0
Maximum	608.0
Zeros	0
Zeros (%)	0.0%
Memory size	4.0 KiB

Quantile statistics

Minimum	32
5-th percentile	51
Q1	119.5
median	212
Q3	511.25
95-th percentile	583
Maximum	608
Range	576
Interquartile range (IQR)	391.75

Descriptive statistics

Standard deviation	200.5807713
Coefficient of variation (CV)	0.6440720149
Kurtosis	-1.719374817
Mean	311.426
Median Absolute Deviation (MAD)	178.5
Skewness	0.05382143689
Sum	155713
Variance	40232.64582

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
51	6	1.2%
155	6	1.2%
212	5	1.0%
507	5	1.0%
397	4	0.8%
61	4	0.8%
574	4	0.8%
128	4	0.8%
196	4	0.8%
82	4	0.8%
473	4	0.8%
90	4	0.8%
460	4	0.8%
557	4	0.8%
124	4	0.8%
173	4	0.8%
533	4	0.8%
480	4	0.8%
470	4	0.8%
441	4	0.8%
445	3	0.6%
85	3	0.6%
450	3	0.6%
525	3	0.6%
409	3	0.6%
Other values (248)	399	79.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
32	2	0.4%
33	2	0.4%
34	2	0.4%
38	2	0.4%
39	1	0.2%
40	1	0.2%
42	2	0.4%
43	2	0.4%
44	2	0.4%
45	1	0.2%

Value	Count	Frequency (%)
608	1	0.2%
606	1	0.2%
605	1	0.2%
604	2	0.4%
602	3	0.6%
600	1	0.2%
599	1	0.2%
595	2	0.4%
594	1	0.2%
593	1	0.2%

target
Real number (ℝ_≥0)

Distinct count	117
Unique (%)	23.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	3.270929131269455
Minimum	0.6931499838829039
Maximum	5.393630027770996
Zeros	0
Zeros (%)	0.0%
Memory size	4.0 KiB

Quantile statistics

Minimum	0.6931499839
5-th percentile	1.791759968
Q1	2.708050013
median	3.295840025
Q3	3.871200085
95-th percentile	4.683047366
Maximum	5.393630028
Range	4.700480044
Interquartile range (IQR)	1.163150072

Descriptive statistics

Standard deviation	0.8868084459
Coefficient of variation (CV)	0.2711182084
Kurtosis	0.2710703101
Mean	3.270929131
Median Absolute Deviation (MAD)	0.5753600597
Skewness	-0.2930626529
Sum	1635.464566
Variance	0.7864292197

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
3.044519901	17	3.4%
3.401200056	16	3.2%
2.995729923	15	3.0%
2.564949989	14	2.8%
2.484910011	14	2.8%
2.079440117	14	2.8%
2.302589893	13	2.6%
3.295840025	13	2.6%
3.135489941	13	2.6%
3.258100033	13	2.6%
1.945909977	13	2.6%
3.218879938	12	2.4%
3.178050041	12	2.4%
2.63906002	11	2.2%
3.091039896	10	2.0%
2.944439888	10	2.0%
3.33220005	10	2.0%
2.197220087	9	1.8%
3.367300034	9	1.8%
0.6931499839	8	1.6%
2.708050013	8	1.6%
3.737669945	8	1.6%
2.833209991	7	1.4%
3.871200085	7	1.4%
3.433990002	7	1.4%
Other values (92)	217	43.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.6931499839	8	1.6%
1.098610044	3	0.6%
1.386289954	4	0.8%
1.609439969	6	1.2%
1.791759968	6	1.2%
1.945909977	13	2.6%
2.079440117	14	2.8%
2.197220087	9	1.8%
2.302589893	13	2.6%
2.397900105	5	1.0%

Value	Count	Frequency (%)
5.393630028	1	0.2%
5.384500027	1	0.2%
5.267859936	1	0.2%
5.252270222	2	0.4%
5.170479774	1	0.2%
5.153289795	1	0.2%
5.087600231	1	0.2%
5.056250095	1	0.2%
4.955830097	1	0.2%
4.9416399	1	0.2%

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Count
Matrix

First rows

	cars_per_hour	temperature_at_2m	wind_speed	temperature_diff_2m_25m	wind_direction	hour_of_day	day	target
0	7.74414	-4.4	4.2	0.0	18.000000	19.0	116.0	3.66356
1	8.03398	-5.7	4.8	-0.3	69.099998	9.0	506.0	3.04452
2	4.70048	-13.5	4.3	0.2	80.000000	3.0	95.0	3.71357
3	7.52510	1.4	3.0	0.1	177.000000	22.0	161.0	2.94444
4	7.76260	4.1	5.6	1.1	287.000000	7.0	80.0	4.06044
5	7.88683	5.8	2.3	-0.1	200.000000	9.0	33.0	3.68888
6	7.81521	2.7	1.9	0.4	228.000000	7.0	129.0	3.33220
7	7.77779	7.1	8.9	0.2	220.000000	15.0	155.0	3.36730
8	6.89163	4.1	2.0	0.1	183.000000	9.0	132.0	2.07944
9	7.67740	1.1	5.2	0.1	43.099998	10.0	480.0	1.94591

Last rows

	cars_per_hour	temperature_at_2m	wind_speed	temperature_diff_2m_25m	wind_direction	hour_of_day	day	target
490	7.54539	6.5	9.4	-0.9	250.000000	11.0	160.0	1.94591
491	6.23832	-0.4	3.3	0.3	215.100006	24.0	470.0	1.94591
492	4.56435	-6.3	2.0	2.3	223.000000	3.0	148.0	2.77259
493	6.58203	2.2	1.8	0.1	64.199997	6.0	549.0	2.70805
494	5.31321	-4.9	4.2	0.3	353.000000	2.0	117.0	1.79176
495	5.61677	-1.3	2.8	-0.1	65.199997	1.0	486.0	2.30259
496	7.71110	-5.1	0.7	0.3	60.000000	10.0	99.0	4.11087
497	6.25190	0.1	1.0	0.2	87.000000	24.0	111.0	3.40120
498	7.85516	6.5	5.2	-0.2	69.000000	19.0	196.0	3.68888
499	8.24512	8.6	1.6	-1.0	258.799988	15.0	530.0	4.17439

Overview

Variables

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Phik (φk)

Missing values

Sample

First rows

Last rows