Dataset statistics
| Number of variables | 11 |
|---|---|
| Number of observations | 1066 |
| Missing cells | 0 |
| Missing cells (%) | 0.0% |
| Duplicate rows | 751 |
| Duplicate rows (%) | 70.5% |
| Total size in memory | 91.7 KiB |
| Average record size in memory | 88.1 B |
Variable types
| CAT | 7 |
|---|---|
| BOOL | 2 |
| NUM | 2 |
Reproduction
| Analysis started | 2020-08-25 01:23:17.368982 |
|---|---|
| Analysis finished | 2020-08-25 01:23:18.996282 |
| Duration | 1.63 second |
| Version | pandas-profiling v2.8.0 |
| Command line | pandas_profiling --config_file config.yaml [YOUR_FILE.csv] |
| Download configuration | config.yaml |
Area of the largest spot has constant value "1" | Constant |
| Dataset has 751 (70.5%) duplicate rows | Duplicates |
class code has 147 (13.8%) zeros | Zeros |
largest spot code has 216 (20.3%) zeros | Zeros |
| Distinct count | 6 |
|---|---|
| Unique (%) | 0.6% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 2.627579737335835 |
|---|---|
| Minimum | 0 |
| Maximum | 5 |
| Zeros | 147 |
| Zeros (%) | 13.8% |
| Memory size | 8.5 KiB |
Quantile statistics
| Minimum | 0 |
|---|---|
| 5-th percentile | 0 |
| Q1 | 1 |
| median | 2 |
| Q3 | 5 |
| 95-th percentile | 5 |
| Maximum | 5 |
| Range | 5 |
| Interquartile range (IQR) | 4 |
Descriptive statistics
| Standard deviation | 1.844965019 |
|---|---|
| Coefficient of variation (CV) | 0.7021537701 |
| Kurtosis | -1.44657903 |
| Mean | 2.627579737 |
| Median Absolute Deviation (MAD) | 1 |
| Skewness | 0.134861704 |
| Sum | 2801 |
| Variance | 3.403895921 |
Histogram with fixed size bins (bins=10)
| Value | Count | Frequency (%) | |
| 5 | 331 | 31.1% | |
| 2 | 239 | 22.4% | |
| 1 | 211 | 19.8% | |
| 0 | 147 | 13.8% | |
| 3 | 95 | 8.9% | |
| 4 | 43 | 4.0% |
| Value | Count | Frequency (%) | |
| 0 | 147 | 13.8% | |
| 1 | 211 | 19.8% | |
| 2 | 239 | 22.4% | |
| 3 | 95 | 8.9% | |
| 4 | 43 | 4.0% | |
| 5 | 331 | 31.1% |
| Value | Count | Frequency (%) | |
| 5 | 331 | 31.1% | |
| 4 | 43 | 4.0% | |
| 3 | 95 | 8.9% | |
| 2 | 239 | 22.4% | |
| 1 | 211 | 19.8% | |
| 0 | 147 | 13.8% |
| Distinct count | 6 |
|---|---|
| Unique (%) | 0.6% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 2.958724202626642 |
|---|---|
| Minimum | 0 |
| Maximum | 5 |
| Zeros | 216 |
| Zeros (%) | 20.3% |
| Memory size | 8.5 KiB |
Quantile statistics
| Minimum | 0 |
|---|---|
| 5-th percentile | 0 |
| Q1 | 2 |
| median | 4 |
| Q3 | 4 |
| 95-th percentile | 5 |
| Maximum | 5 |
| Range | 5 |
| Interquartile range (IQR) | 2 |
Descriptive statistics
| Standard deviation | 1.703402798 |
|---|---|
| Coefficient of variation (CV) | 0.5757220619 |
| Kurtosis | -0.7660704256 |
| Mean | 2.958724203 |
| Median Absolute Deviation (MAD) | 1 |
| Skewness | -0.7874597319 |
| Sum | 3154 |
| Variance | 2.901581094 |
Histogram with fixed size bins (bins=10)
| Value | Count | Frequency (%) | |
| 4 | 414 | 38.8% | |
| 3 | 218 | 20.5% | |
| 0 | 216 | 20.3% | |
| 5 | 145 | 13.6% | |
| 2 | 46 | 4.3% | |
| 1 | 27 | 2.5% |
| Value | Count | Frequency (%) | |
| 0 | 216 | 20.3% | |
| 1 | 27 | 2.5% | |
| 2 | 46 | 4.3% | |
| 3 | 218 | 20.5% | |
| 4 | 414 | 38.8% | |
| 5 | 145 | 13.6% |
| Value | Count | Frequency (%) | |
| 5 | 145 | 13.6% | |
| 4 | 414 | 38.8% | |
| 3 | 218 | 20.5% | |
| 2 | 46 | 4.3% | |
| 1 | 27 | 2.5% | |
| 0 | 216 | 20.3% |
spot dist code
Categorical
| Distinct count | 4 |
|---|---|
| Unique (%) | 0.4% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 8.5 KiB |
| 2 | |
|---|---|
| 3 | |
| 1 | |
| 0 | 35 |
| Value | Count | Frequency (%) | |
| 2 | 477 | 44.7% | |
| 3 | 331 | 31.1% | |
| 1 | 223 | 20.9% | |
| 0 | 35 | 3.3% |
Length
| Max length | 1 |
|---|---|
| Median length | 1 |
| Mean length | 1 |
| Min length | 1 |
Most occurring characters
| Value | Count | Frequency (%) | |
| 2 | 477 | 44.7% | |
| 3 | 331 | 31.1% | |
| 1 | 223 | 20.9% | |
| 0 | 35 | 3.3% |
Most occurring categories
| Value | Count | Frequency (%) | |
| Decimal Number | 1066 | 100.0% |
Most frequent Decimal Number characters
| Value | Count | Frequency (%) | |
| 2 | 477 | 44.7% | |
| 3 | 331 | 31.1% | |
| 1 | 223 | 20.9% | |
| 0 | 35 | 3.3% |
Most occurring scripts
| Value | Count | Frequency (%) | |
| Common | 1066 | 100.0% |
Most frequent Common characters
| Value | Count | Frequency (%) | |
| 2 | 477 | 44.7% | |
| 3 | 331 | 31.1% | |
| 1 | 223 | 20.9% | |
| 0 | 35 | 3.3% |
Most occurring blocks
| Value | Count | Frequency (%) | |
| ASCII | 1066 | 100.0% |
Most frequent ASCII characters
| Value | Count | Frequency (%) | |
| 2 | 477 | 44.7% | |
| 3 | 331 | 31.1% | |
| 1 | 223 | 20.9% | |
| 0 | 35 | 3.3% |
Activity
Categorical
| Distinct count | 2 |
|---|---|
| Unique (%) | 0.2% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 8.5 KiB |
| 1 | |
|---|---|
| 2 | 164 |
| Value | Count | Frequency (%) | |
| 1 | 902 | 84.6% | |
| 2 | 164 | 15.4% |
Length
| Max length | 1 |
|---|---|
| Median length | 1 |
| Mean length | 1 |
| Min length | 1 |
Most occurring characters
| Value | Count | Frequency (%) | |
| 1 | 902 | 84.6% | |
| 2 | 164 | 15.4% |
Most occurring categories
| Value | Count | Frequency (%) | |
| Decimal Number | 1066 | 100.0% |
Most frequent Decimal Number characters
| Value | Count | Frequency (%) | |
| 1 | 902 | 84.6% | |
| 2 | 164 | 15.4% |
Most occurring scripts
| Value | Count | Frequency (%) | |
| Common | 1066 | 100.0% |
Most frequent Common characters
| Value | Count | Frequency (%) | |
| 1 | 902 | 84.6% | |
| 2 | 164 | 15.4% |
Most occurring blocks
| Value | Count | Frequency (%) | |
| ASCII | 1066 | 100.0% |
Most frequent ASCII characters
| Value | Count | Frequency (%) | |
| 1 | 902 | 84.6% | |
| 2 | 164 | 15.4% |
Evolution
Categorical
| Distinct count | 3 |
|---|---|
| Unique (%) | 0.3% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 8.5 KiB |
| 3 | |
|---|---|
| 2 | |
| 1 | 77 |
| Value | Count | Frequency (%) | |
| 3 | 505 | 47.4% | |
| 2 | 484 | 45.4% | |
| 1 | 77 | 7.2% |
Length
| Max length | 3 |
|---|---|
| Median length | 3 |
| Mean length | 3 |
| Min length | 3 |
Most occurring characters
| Value | Count | Frequency (%) | |
| . | 1066 | 33.3% | |
| 0 | 1066 | 33.3% | |
| 3 | 505 | 15.8% | |
| 2 | 484 | 15.1% | |
| 1 | 77 | 2.4% |
Most occurring categories
| Value | Count | Frequency (%) | |
| Decimal Number | 2132 | 66.7% | |
| Other Punctuation | 1066 | 33.3% |
Most frequent Decimal Number characters
| Value | Count | Frequency (%) | |
| 0 | 1066 | 50.0% | |
| 3 | 505 | 23.7% | |
| 2 | 484 | 22.7% | |
| 1 | 77 | 3.6% |
Most frequent Other Punctuation characters
| Value | Count | Frequency (%) | |
| . | 1066 | 100.0% |
Most occurring scripts
| Value | Count | Frequency (%) | |
| Common | 3198 | 100.0% |
Most frequent Common characters
| Value | Count | Frequency (%) | |
| . | 1066 | 33.3% | |
| 0 | 1066 | 33.3% | |
| 3 | 505 | 15.8% | |
| 2 | 484 | 15.1% | |
| 1 | 77 | 2.4% |
Most occurring blocks
| Value | Count | Frequency (%) | |
| ASCII | 3198 | 100.0% |
Most frequent ASCII characters
| Value | Count | Frequency (%) | |
| . | 1066 | 33.3% | |
| 0 | 1066 | 33.3% | |
| 3 | 505 | 15.8% | |
| 2 | 484 | 15.1% | |
| 1 | 77 | 2.4% |
Previous 24 hour code
Categorical
| Distinct count | 3 |
|---|---|
| Unique (%) | 0.3% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 8.5 KiB |
| 1 | |
|---|---|
| 3 | 25 |
| 2 | 13 |
| Value | Count | Frequency (%) | |
| 1 | 1028 | 96.4% | |
| 3 | 25 | 2.3% | |
| 2 | 13 | 1.2% |
Length
| Max length | 3 |
|---|---|
| Median length | 3 |
| Mean length | 3 |
| Min length | 3 |
Most occurring characters
| Value | Count | Frequency (%) | |
| . | 1066 | 33.3% | |
| 0 | 1066 | 33.3% | |
| 1 | 1028 | 32.1% | |
| 3 | 25 | 0.8% | |
| 2 | 13 | 0.4% |
Most occurring categories
| Value | Count | Frequency (%) | |
| Decimal Number | 2132 | 66.7% | |
| Other Punctuation | 1066 | 33.3% |
Most frequent Decimal Number characters
| Value | Count | Frequency (%) | |
| 0 | 1066 | 50.0% | |
| 1 | 1028 | 48.2% | |
| 3 | 25 | 1.2% | |
| 2 | 13 | 0.6% |
Most frequent Other Punctuation characters
| Value | Count | Frequency (%) | |
| . | 1066 | 100.0% |
Most occurring scripts
| Value | Count | Frequency (%) | |
| Common | 3198 | 100.0% |
Most frequent Common characters
| Value | Count | Frequency (%) | |
| . | 1066 | 33.3% | |
| 0 | 1066 | 33.3% | |
| 1 | 1028 | 32.1% | |
| 3 | 25 | 0.8% | |
| 2 | 13 | 0.4% |
Most occurring blocks
| Value | Count | Frequency (%) | |
| ASCII | 3198 | 100.0% |
Most frequent ASCII characters
| Value | Count | Frequency (%) | |
| . | 1066 | 33.3% | |
| 0 | 1066 | 33.3% | |
| 1 | 1028 | 32.1% | |
| 3 | 25 | 0.8% | |
| 2 | 13 | 0.4% |
Historically-complex
Categorical
| Distinct count | 2 |
|---|---|
| Unique (%) | 0.2% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 8.5 KiB |
| 1 | |
|---|---|
| 2 |
| Value | Count | Frequency (%) | |
| 1 | 635 | 59.6% | |
| 2 | 431 | 40.4% |
Length
| Max length | 1 |
|---|---|
| Median length | 1 |
| Mean length | 1 |
| Min length | 1 |
Most occurring characters
| Value | Count | Frequency (%) | |
| 1 | 635 | 59.6% | |
| 2 | 431 | 40.4% |
Most occurring categories
| Value | Count | Frequency (%) | |
| Decimal Number | 1066 | 100.0% |
Most frequent Decimal Number characters
| Value | Count | Frequency (%) | |
| 1 | 635 | 59.6% | |
| 2 | 431 | 40.4% |
Most occurring scripts
| Value | Count | Frequency (%) | |
| Common | 1066 | 100.0% |
Most frequent Common characters
| Value | Count | Frequency (%) | |
| 1 | 635 | 59.6% | |
| 2 | 431 | 40.4% |
Most occurring blocks
| Value | Count | Frequency (%) | |
| ASCII | 1066 | 100.0% |
Most frequent ASCII characters
| Value | Count | Frequency (%) | |
| 1 | 635 | 59.6% | |
| 2 | 431 | 40.4% |
become complex
Categorical
| Distinct count | 2 |
|---|---|
| Unique (%) | 0.2% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 8.5 KiB |
| 2 | |
|---|---|
| 1 | 133 |
| Value | Count | Frequency (%) | |
| 2 | 933 | 87.5% | |
| 1 | 133 | 12.5% |
Length
| Max length | 1 |
|---|---|
| Median length | 1 |
| Mean length | 1 |
| Min length | 1 |
Most occurring characters
| Value | Count | Frequency (%) | |
| 2 | 933 | 87.5% | |
| 1 | 133 | 12.5% |
Most occurring categories
| Value | Count | Frequency (%) | |
| Decimal Number | 1066 | 100.0% |
Most frequent Decimal Number characters
| Value | Count | Frequency (%) | |
| 2 | 933 | 87.5% | |
| 1 | 133 | 12.5% |
Most occurring scripts
| Value | Count | Frequency (%) | |
| Common | 1066 | 100.0% |
Most frequent Common characters
| Value | Count | Frequency (%) | |
| 2 | 933 | 87.5% | |
| 1 | 133 | 12.5% |
Most occurring blocks
| Value | Count | Frequency (%) | |
| ASCII | 1066 | 100.0% |
Most frequent ASCII characters
| Value | Count | Frequency (%) | |
| 2 | 933 | 87.5% | |
| 1 | 133 | 12.5% |
Area
Categorical
| Distinct count | 2 |
|---|---|
| Unique (%) | 0.2% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 8.5 KiB |
| 1 | |
|---|---|
| 2 | 27 |
| Value | Count | Frequency (%) | |
| 1 | 1039 | 97.5% | |
| 2 | 27 | 2.5% |
Length
| Max length | 1 |
|---|---|
| Median length | 1 |
| Mean length | 1 |
| Min length | 1 |
Most occurring characters
| Value | Count | Frequency (%) | |
| 1 | 1039 | 97.5% | |
| 2 | 27 | 2.5% |
Most occurring categories
| Value | Count | Frequency (%) | |
| Decimal Number | 1066 | 100.0% |
Most frequent Decimal Number characters
| Value | Count | Frequency (%) | |
| 1 | 1039 | 97.5% | |
| 2 | 27 | 2.5% |
Most occurring scripts
| Value | Count | Frequency (%) | |
| Common | 1066 | 100.0% |
Most frequent Common characters
| Value | Count | Frequency (%) | |
| 1 | 1039 | 97.5% | |
| 2 | 27 | 2.5% |
Most occurring blocks
| Value | Count | Frequency (%) | |
| ASCII | 1066 | 100.0% |
Most frequent ASCII characters
| Value | Count | Frequency (%) | |
| 1 | 1039 | 97.5% | |
| 2 | 27 | 2.5% |
| Distinct count | 1 |
|---|---|
| Unique (%) | 0.1% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 8.5 KiB |
| 1 |
|---|
| Value | Count | Frequency (%) | |
| 1 | 1066 | 100.0% |
target
Boolean
| Distinct count | 2 |
|---|---|
| Unique (%) | 0.2% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 8.5 KiB |
| 0 | |
|---|---|
| 1 |
| Value | Count | Frequency (%) | |
| 0 | 884 | 82.9% | |
| 1 | 182 | 17.1% |
Pearson's r
The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.
Spearman's ρ
The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.
Kendall's τ
Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.
Phik (φk)
Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.Cramér's V (φc)
Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.First rows
| class code | largest spot code | spot dist code | Activity | Evolution | Previous 24 hour code | Historically-complex | become complex | Area | Area of the largest spot | target | |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 0 | 5 | 4 | 3 | 1 | 3.0 | 1.0 | 1 | 2 | 1 | 1 | 0 |
| 1 | 1 | 3 | 1 | 1 | 2.0 | 1.0 | 1 | 2 | 1 | 1 | 0 |
| 2 | 2 | 3 | 2 | 1 | 3.0 | 1.0 | 1 | 2 | 1 | 1 | 1 |
| 3 | 5 | 4 | 3 | 2 | 2.0 | 1.0 | 2 | 2 | 1 | 1 | 0 |
| 4 | 1 | 4 | 2 | 1 | 3.0 | 1.0 | 1 | 2 | 1 | 1 | 0 |
| 5 | 1 | 4 | 2 | 1 | 2.0 | 1.0 | 2 | 2 | 1 | 1 | 0 |
| 6 | 2 | 2 | 1 | 1 | 3.0 | 1.0 | 2 | 2 | 1 | 1 | 0 |
| 7 | 2 | 3 | 2 | 1 | 3.0 | 1.0 | 1 | 2 | 1 | 1 | 0 |
| 8 | 0 | 5 | 2 | 1 | 2.0 | 1.0 | 1 | 2 | 1 | 1 | 0 |
| 9 | 2 | 1 | 2 | 1 | 2.0 | 1.0 | 2 | 2 | 1 | 1 | 0 |
Last rows
| class code | largest spot code | spot dist code | Activity | Evolution | Previous 24 hour code | Historically-complex | become complex | Area | Area of the largest spot | target | |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 1056 | 0 | 5 | 2 | 1 | 3.0 | 1.0 | 1 | 2 | 1 | 1 | 0 |
| 1057 | 2 | 4 | 2 | 1 | 2.0 | 1.0 | 2 | 2 | 1 | 1 | 0 |
| 1058 | 3 | 0 | 1 | 2 | 3.0 | 1.0 | 2 | 2 | 1 | 1 | 0 |
| 1059 | 0 | 5 | 2 | 1 | 3.0 | 1.0 | 1 | 2 | 1 | 1 | 0 |
| 1060 | 5 | 3 | 3 | 1 | 2.0 | 1.0 | 1 | 2 | 1 | 1 | 0 |
| 1061 | 5 | 4 | 3 | 1 | 1.0 | 1.0 | 1 | 2 | 1 | 1 | 0 |
| 1062 | 2 | 0 | 2 | 1 | 3.0 | 1.0 | 1 | 2 | 1 | 1 | 1 |
| 1063 | 5 | 4 | 3 | 1 | 3.0 | 1.0 | 1 | 2 | 1 | 1 | 0 |
| 1064 | 5 | 4 | 3 | 1 | 3.0 | 1.0 | 1 | 2 | 1 | 1 | 0 |
| 1065 | 5 | 0 | 3 | 1 | 3.0 | 1.0 | 1 | 1 | 1 | 1 | 0 |
Most frequent
| class code | largest spot code | spot dist code | Activity | Evolution | Previous 24 hour code | Historically-complex | become complex | Area | Area of the largest spot | target | count | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 6 | 0 | 5 | 2 | 1 | 3.0 | 1.0 | 1 | 2 | 1 | 1 | 0 | 67 |
| 138 | 5 | 4 | 3 | 1 | 2.0 | 1.0 | 1 | 2 | 1 | 1 | 0 | 44 |
| 20 | 1 | 3 | 2 | 1 | 3.0 | 1.0 | 1 | 2 | 1 | 1 | 0 | 40 |
| 136 | 5 | 4 | 3 | 1 | 2.0 | 1.0 | 1 | 1 | 1 | 1 | 0 | 35 |
| 4 | 0 | 5 | 2 | 1 | 2.0 | 1.0 | 1 | 2 | 1 | 1 | 0 | 26 |
| 142 | 5 | 4 | 3 | 1 | 3.0 | 1.0 | 1 | 1 | 1 | 1 | 0 | 25 |
| 18 | 1 | 3 | 2 | 1 | 2.0 | 1.0 | 1 | 2 | 1 | 1 | 0 | 23 |
| 140 | 5 | 4 | 3 | 1 | 2.0 | 1.0 | 2 | 1 | 1 | 1 | 0 | 23 |
| 28 | 1 | 4 | 2 | 1 | 3.0 | 1.0 | 1 | 2 | 1 | 1 | 0 | 22 |
| 67 | 2 | 3 | 2 | 1 | 3.0 | 1.0 | 1 | 2 | 1 | 1 | 0 | 21 |