Skip to content

Commit 27782f7

Browse files
actions-useractions-user
committed
Built site for PGRdup@0.2.4.0.9000: 31da1d1 
1 parent 26a8596 commit 27782f7

11 files changed

Lines changed: 160 additions & 164 deletions

File tree

‎articles/Introduction.html‎

Lines changed: 58 additions & 66 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

‎articles/Introduction.md‎

Lines changed: 57 additions & 65 deletions
Original file line numberDiff line numberDiff line change
@@ -759,8 +759,8 @@ GNdup
759759
KWIC1 fields : NationalID CollNo DonorID OtherID1 OtherID2
760760
761761
No..of.Sets No..of.Records
762-
PhoneticDuplicates 99 260
763-
Total 99 260(Distinct:260)
762+
PhoneticDuplicates 94 247
763+
Total 94 247(Distinct:247)
764764

765765
2. **Method `"b"`** : Performs string matching of keywords in the first
766766
KWIC index (query) with that of the keywords in the second index
@@ -851,8 +851,8 @@ GNdupb
851851
852852
No..of.Sets No..of.Records
853853
FuzzyDuplicates 107 353
854-
PhoneticDuplicates 41 126
855-
Total 148 479(Distinct:383)
854+
PhoneticDuplicates 38 105
855+
Total 145 458(Distinct:368)
856856

857857
``` r
858858
# Fetch fuzzy and phonetic duplicate sets by method c
@@ -887,8 +887,8 @@ GNdupc
887887
888888
No..of.Sets No..of.Records
889889
FuzzyDuplicates 363 724
890-
PhoneticDuplicates 98 257
891-
Total 461 981(Distinct:741)
890+
PhoneticDuplicates 93 244
891+
Total 456 968(Distinct:736)
892892

893893
### Matching Strategies
894894

@@ -1040,8 +1040,8 @@ GNdup
10401040
KWIC1 fields : NationalID CollNo DonorID OtherID1 OtherID2
10411041
10421042
No..of.Sets No..of.Records
1043-
PhoneticDuplicates 99 260
1044-
Total 99 260(Distinct:260)
1043+
PhoneticDuplicates 94 247
1044+
Total 94 247(Distinct:247)
10451045

10461046
Either the primary or alternate encodings can be used by specifying the
10471047
`encoding` argument.
@@ -1066,8 +1066,8 @@ GNdup
10661066
KWIC1 fields : NationalID CollNo DonorID OtherID1 OtherID2
10671067
10681068
No..of.Sets No..of.Records
1069-
PhoneticDuplicates 98 263
1070-
Total 98 263(Distinct:263)
1069+
PhoneticDuplicates 93 250
1070+
Total 93 250(Distinct:250)
10711071

10721072
The argument `phon.min.alpha` sets the limits for the number of alphabet
10731073
characters to be present in a string for executing phonetic matching.
@@ -1092,8 +1092,8 @@ GNdup
10921092
KWIC1 fields : NationalID CollNo DonorID OtherID1 OtherID2
10931093
10941094
No..of.Sets No..of.Records
1095-
PhoneticDuplicates 304 451
1096-
Total 304 451(Distinct:451)
1095+
PhoneticDuplicates 103 288
1096+
Total 103 288(Distinct:288)
10971097

10981098
Similarly `min.enc` sets the limits for the number of characters to be
10991099
present in the encoding of a keyword for phonetic matching.
@@ -1118,8 +1118,8 @@ GNdup
11181118
KWIC1 fields : NationalID CollNo DonorID OtherID1 OtherID2
11191119
11201120
No..of.Sets No..of.Records
1121-
PhoneticDuplicates 59 156
1122-
Total 59 156(Distinct:156)
1121+
PhoneticDuplicates 53 144
1122+
Total 53 144(Distinct:144)
11231123

11241124
3. **Semantic matching** matches keywords based on a list of accession
11251125
name synonyms supplied as list with character vectors of synonym
@@ -1145,7 +1145,7 @@ GNdup <- ProbDup(kwic1 = GNKWIC, method = "a", excep = exep,
11451145

11461146
Semantic matching
11471147

1148-
| |================== | 25%Block 1 / 4 | | |=================================== | 50%Block 2 / 4 | | |==================================================== | 75%Block 3 / 4 | | |======================================================================| 100%Block 4 / 4 |
1148+
| |=================================== | 50%Block 2 / 4 | | |==================================================== | 75%Block 3 / 4 | | |======================================================================| 100%Block 4 / 4 |
11491149

11501150
``` r
11511151
GNdup
@@ -1330,11 +1330,11 @@ GNdup
13301330

13311331
KWIC1 fields : NationalID CollNo DonorID OtherID1 OtherID2
13321332
1333-
No..of.Sets No..of.Records
1334-
FuzzyDuplicates 378 745
1335-
PhoneticDuplicates 99 260
1336-
SemanticDuplicates 2 5
1337-
Total 479 1010(Distinct:762)
1333+
No..of.Sets No..of.Records
1334+
FuzzyDuplicates 378 745
1335+
PhoneticDuplicates 94 247
1336+
SemanticDuplicates 2 5
1337+
Total 474 997(Distinct:758)
13381338

13391339
``` r
13401340
# Get disjoint probable duplicate sets of each kind
@@ -1347,11 +1347,11 @@ disGNdup1
13471347

13481348
KWIC1 fields : NationalID CollNo DonorID OtherID1 OtherID2
13491349
1350-
No..of.Sets No..of.Records
1351-
FuzzyDuplicates 181 745
1352-
PhoneticDuplicates 80 260
1353-
SemanticDuplicates 2 5
1354-
Total 263 1010(Distinct:762)
1350+
No..of.Sets No..of.Records
1351+
FuzzyDuplicates 181 745
1352+
PhoneticDuplicates 85 247
1353+
SemanticDuplicates 2 5
1354+
Total 268 997(Distinct:758)
13551355

13561356
``` r
13571357
# Get disjoint probable duplicate sets combining all the kinds of sets
@@ -1365,8 +1365,8 @@ disGNdup2
13651365
KWIC1 fields : NationalID CollNo DonorID OtherID1 OtherID2
13661366
13671367
No..of.Sets No..of.Records
1368-
DisjointDupicates 167 762
1369-
Total 167 762(Distinct:762)
1368+
DisjointDupicates 180 758
1369+
Total 180 758(Distinct:758)
13701370

13711371
Once duplicate sets are retrieved they can be validated by manual
13721372
clerical review by comparing with original PGR passport database(s)
@@ -1475,14 +1475,10 @@ new set.
14751475
subset(RevGNdup, SET_NO==13 & TYPE=="P", select= c(IDKW, DEL, SPLIT))
14761476
```
14771477

1478-
IDKW DEL SPLIT
1479-
111 [K1]EC38607:MANFREDI1 N 0
1480-
112 [K1]EC420966:MANFREDI N 0
1481-
113 [K1]EC42549:MANFREDI68 N 0
1482-
114 [K1]EC42550:MANFRED1 N 0
1483-
115 [K1]EC552714:CHAMPAQUI, [K1]EC552714:MANFREDI N 0
1484-
116 [K1]EC573128:MANFREDI84 N 0
1485-
117 [K1]IC304523:CHAMPAGUE, [K1]IC304523:MANFREDI N 0
1478+
IDKW DEL SPLIT
1479+
114 [K1]EC4087:KANYOMA N 0
1480+
115 [K1]EC514636:KANYOMA N 0
1481+
116 [K1]EC613806:KANYOMA N 0
14861482

14871483
``` r
14881484
# Make dummy changes to the set for illustration
@@ -1493,14 +1489,10 @@ RevGNdup[c(112, 115, 117), 7] <- 2
14931489
subset(RevGNdup, SET_NO==13 & TYPE=="P", select= c(IDKW, DEL, SPLIT))
14941490
```
14951491

1496-
IDKW DEL SPLIT
1497-
111 [K1]EC38607:MANFREDI1 N 1
1498-
112 [K1]EC420966:MANFREDI N 2
1499-
113 [K1]EC42549:MANFREDI68 Y 0
1500-
114 [K1]EC42550:MANFRED1 N 1
1501-
115 [K1]EC552714:CHAMPAQUI, [K1]EC552714:MANFREDI N 2
1502-
116 [K1]EC573128:MANFREDI84 Y 0
1503-
117 [K1]IC304523:CHAMPAGUE, [K1]IC304523:MANFREDI N 2
1492+
IDKW DEL SPLIT
1493+
114 [K1]EC4087:KANYOMA N 1
1494+
115 [K1]EC514636:KANYOMA N 2
1495+
116 [K1]EC613806:KANYOMA Y 0
15041496

15051497
``` r
15061498
# Reconstruct ProDup object
@@ -1513,11 +1505,11 @@ disGNdup1
15131505

15141506
KWIC1 fields : NationalID CollNo DonorID OtherID1 OtherID2
15151507
1516-
No..of.Sets No..of.Records
1517-
FuzzyDuplicates 181 745
1518-
PhoneticDuplicates 80 260
1519-
SemanticDuplicates 2 5
1520-
Total 263 1010(Distinct:762)
1508+
No..of.Sets No..of.Records
1509+
FuzzyDuplicates 181 745
1510+
PhoneticDuplicates 85 247
1511+
SemanticDuplicates 2 5
1512+
Total 268 997(Distinct:758)
15211513

15221514
``` r
15231515
# No. of sets after modifications
@@ -1529,10 +1521,10 @@ GNdup2
15291521
KWIC1 fields : NationalID CollNo DonorID OtherID1 OtherID2
15301522
15311523
No..of.Sets No..of.Records
1532-
FuzzyDuplicates 180 523
1533-
PhoneticDuplicates 81 258
1524+
FuzzyDuplicates 179 520
1525+
PhoneticDuplicates 84 244
15341526
SemanticDuplicates 2 5
1535-
Total 263 786(Distinct:674)
1527+
Total 265 769(Distinct:669)
15361528

15371529
## Other Functions
15381530

@@ -1639,11 +1631,11 @@ GNdupSplit[[1]]
16391631

16401632
KWIC1 fields : NationalID CollNo DonorID OtherID1 OtherID2
16411633
1642-
No..of.Sets No..of.Records
1643-
FuzzyDuplicates 338 744
1644-
PhoneticDuplicates 99 260
1645-
SemanticDuplicates 2 5
1646-
Total 439 1009(Distinct:762)
1634+
No..of.Sets No..of.Records
1635+
FuzzyDuplicates 338 744
1636+
PhoneticDuplicates 94 247
1637+
SemanticDuplicates 2 5
1638+
Total 434 996(Distinct:758)
16471639

16481640
``` r
16491641
GNdupSplit[[3]]
@@ -1669,11 +1661,11 @@ GNdupMerged
16691661

16701662
KWIC1 fields : NationalID CollNo DonorID OtherID1 OtherID2
16711663
1672-
No..of.Sets No..of.Records
1673-
FuzzyDuplicates 378 745
1674-
PhoneticDuplicates 99 260
1675-
SemanticDuplicates 2 5
1676-
Total 479 1010(Distinct:762)
1664+
No..of.Sets No..of.Records
1665+
FuzzyDuplicates 378 745
1666+
PhoneticDuplicates 94 247
1667+
SemanticDuplicates 2 5
1668+
Total 474 997(Distinct:758)
16771669

16781670
The summary of accessions according to a grouping factor field(column)
16791671
in the original database(s) within the probable duplicate sets retrieved
@@ -1756,7 +1748,7 @@ GNdupc <- ProbDup(kwic1 = GN1KWIC, kwic2 = GN2KWIC, method = "c",
17561748

17571749
Semantic matching
17581750

1759-
| |======================= | 33%Block 1 / 3 | | |=============================================== | 67%Block 2 / 3 | | |======================================================================| 100%Block 3 / 3 |
1751+
| |======================= | 33%Block 1 / 3 |
17601752

17611753
``` r
17621754
# Get the summary data.frames and Grob
@@ -1903,16 +1895,16 @@ sessionInfo()
19031895
[4] digest_0.6.39 magrittr_2.0.4 evaluate_1.0.5
19041896
[7] grid_4.5.2 fastmap_1.2.0 jsonlite_2.0.0
19051897
[10] httr_1.4.8 scales_1.4.0 stringdist_0.9.17
1906-
[13] XML_3.99-0.22 microbenchmark_1.5.0 textshaping_1.0.4
1898+
[13] XML_3.99-0.22 microbenchmark_1.5.0 textshaping_1.0.5
19071899
[16] jquerylib_0.1.4 cli_3.6.5 rlang_1.1.7
19081900
[19] withr_3.0.2 cachem_1.1.0 yaml_2.3.12
19091901
[22] tools_4.5.2 parallel_4.5.2 ggplot2_4.0.2
19101902
[25] curl_7.0.0 vctrs_0.7.1 R6_2.6.1
1911-
[28] lifecycle_1.0.5 fs_1.6.6 ragg_1.5.0
1903+
[28] lifecycle_1.0.5 fs_1.6.7 ragg_1.5.1
19121904
[31] pkgconfig_2.0.3 desc_1.4.3 pkgdown_2.2.0
19131905
[34] bslib_0.10.0 pillar_1.11.1 gtable_0.3.6
19141906
[37] data.table_1.18.2.1 glue_1.8.0 Rcpp_1.1.1
1915-
[40] systemfonts_1.3.1 xfun_0.56 knitr_1.51
1907+
[40] systemfonts_1.3.2 xfun_0.56 knitr_1.51
19161908
[43] farver_2.1.2 htmltools_0.5.9 igraph_2.2.2
19171909
[46] rmarkdown_2.30 labeling_0.4.3 compiler_4.5.2
19181910
[49] S7_0.2.1 RCurl_1.98-1.17

‎articles/Introduction_files/figure-html/unnamed-chunk-61-1.png‎

2.98 KB
Loading

‎articles/Introduction_files/figure-html/unnamed-chunk-62-1.png‎

-711 Bytes
Loading

0 commit comments

Comments
 (0)