How to import references: Difference between revisions

From IMAGE
Jump to navigation Jump to search
No edit summary
No edit summary
Line 1: Line 1:
<h2 class="clearleft">Steps</h2>
<h2 class="clearleft">Steps</h2>
Import the references per type: Book, Book section, Edited book, Journal article, Report, Other.
# Export the references from Scopus:   
# Export the references from Scopus:   
#* Go to [https://www.scopus.com Scopus] to the [https://www.scopus.com/search/form.uri?display=advanced advanced search]  
#* Go to [https://www.scopus.com Scopus] to the [https://www.scopus.com/search/form.uri?display=advanced advanced search]  
#* Create a query to retrieve the required articles analog to the query below. Try to approach the date of the last import. For instance, if the last import was on March 2017 then skip  the months before the import month. This way you avoid duplicates in the query result and the publication set in the wiki.
#* Create a query to retrieve the required articles analog to the query below. Try to approach the date of the last import. For instance, if the last import was on March 2017 then skip  the months before the import month. This way you avoid duplicates in the query result and the publication set in the wiki.
#* ( AUTHOR-NAME ( vuuren )  OR  AUTHOR-NAME ( stehfest )  OR  AUTHOR-NAME ( elzen ) )  AND  AFFILORG ( pbl )  AND  PUBYEAR  >  2016  AND NOT  PUBDATETXT ( january  2017 )  AND NOT  PUBDATETXT ( february  2017 )
#* ( AUTHOR-NAME ( vuuren )  OR  AUTHOR-NAME ( stehfest )  OR  AUTHOR-NAME ( elzen ) )  AND  AFFILORG ( pbl )  AND  PUBYEAR  >  2016  AND NOT  PUBDATETXT ( january  2017 )  AND NOT  PUBDATETXT ( february  2017 )
# Select all articles and export as CSV. Use the arrow aside 'Export CSV'. Deselect the fields: Author(s) ID; EID;Citation count;Access type.
# Select all articles and export as CSV. Use the arrow aside 'Export CSV'  
# Read the CSV into Excel and prepare the import sheet
# Read the CSV into Excel and prepare the import sheet
#* Author names should be in a list like this one: A. F. Hof; M. G. J. den Elzen; A. Mendoza Beltran;  Copy the Author column to a new sheet and apply the 'text to columns' function with delimiter=','. Add another sheet and enter the authors formula or a similar one. Copy and paste (Values only) the result into the author column.
#* Author names should be in a list like this one: A. F. Hof; M. G. J. den Elzen; A. Mendoza Beltran;  Copy the Author column to a new sheet and apply the 'text to columns' function with delimiter=','. Add another sheet and enter the authors formula or a similar one. Copy and paste (Values only) the result into the author column.
#* Check the Issue column: Excel interprets a '1-2' value as 1 Februari ( or 2 January). So if you see one or more dates in this column then check the original values in the export; Format he column as 'text' and replace the misinterpreted values.
# Check labels on:
#* Create one pages column '(format = 'text') from the  'Page start'  'Page end' columns - resulting in values like '412-420  -and remove the page count column.
#* duplicates
#* Check the column document type: put the rows with 'Article in Press' aside in another sheet. rename all types with exception of the 'Erratum' type to 'Journal article'
#* parse errors
#* Create the wiki titles. Insert a column 'A' and create the titles following the naming convention. First, use a formula to create for all rows the title based on the More Authors rule. Transform the formula values to 'values only' and second, correct the titles for rows with one or two authors. Naming convention :
#* double names
#**One author: <author name>, <space><year>
# Compare the labels of the new references with the existing publications. If the label exists and the publications are different,append a character to the label, e.g. Den Elzen et al., 2015c
#** Two authors: <author name> and <author name>, <space><year>
# Rename the header of the first column Label to Title
#** More authors: <first author name> et al., <space><year> 
# The headers  of the other columns must be assigned the correct values see the section [[#Headers per type]].
#** if the publication type is Erratum then add ' erratum' before the ','
# Save the file as Unicode text.  
#* insert (exact!) the following header row, check the columns!:<syntaxhighlight>
# IMPORTANT! Open the file in Textpad or Notepad++. Check the encoding, it should be UTF8. Replace the tabs "\t" with "," and save as .csv file
Title,ReferenceTemplate[Author],ReferenceTemplate[Title],ReferenceTemplate[Year],ReferenceTemplate[Journal],ReferenceTemplate[Volume2] ReferenceTemplate[Issue],ReferenceTemplate[Pages2],ReferenceTemplate[DOI],ReferenceTemplate[PublicationType]
# In Special pages choose: Import CSV, Browse to the created csv file, select "utf8", select the skip option and start the import.
 
</syntaxhighlight>
# Check the wiki content and the publications to import:
#* Open the [[IMAGE related publications overview|publication page]] of the wiki and set the filter on 'period > 2016'
#* duplicates: If the article is already in the wiki, then remove it from the excel sheet.
#* double names: Sort the sheet in Title order. All titles must be unique, so if in the wiki already exists an article with this title then append a 'b' (or ç' or 'd'...) at the end of the title in the sheet. Do the same for duplicate titles in the sheet.
# Save the sheet as .csv file. Check in Notepad++ whether the format in UTF8. Umlauts and other special characters should be readable.
# Admin only!. Special pages choose: Import CSV, Browse to the created csv file, select "utf8", select the skip option and start the import.
# Admin only: To purge these changes, so that pages will reflect them, activate the 'runjobs'  script and the refreshlinks script at the [[Special:MaintenanceShell|maintenace shell page]]. 
# Until this version (0.6.1)  of the extension 'Data transfer' the UTF8 import fails for fields with 'special' characters. So if you get back a message that some titles failed to import, then adjust these title by removing the 'special characters'. You also need to check every imported article on the author field and title field. A simple check is using the [[IMAGE related publications overview|publication page]] and check the citation.


=== Authors formula ===
=== Authors formula ===
Line 183: Line 172:
* ReferenceTemplate[Pages3]
* ReferenceTemplate[Pages3]
* ReferenceTemplate[Date]
* ReferenceTemplate[Date]
==Links==
http://unisa.libguides.com/content.php?pid=224578&sid=2908837 for exporting references
http://www.ehow.com/how_12014808_open-tab-delimited-files-excel.html
[[Category:Help]]
[[Category:Help]]

Revision as of 13:20, 6 March 2019

Steps

  1. Export the references from Scopus:
    • Go to Scopus to the advanced search
    • Create a query to retrieve the required articles analog to the query below. Try to approach the date of the last import. For instance, if the last import was on March 2017 then skip the months before the import month. This way you avoid duplicates in the query result and the publication set in the wiki.
    • ( AUTHOR-NAME ( vuuren )  OR  AUTHOR-NAME ( stehfest )  OR  AUTHOR-NAME ( elzen ) )  AND  AFFILORG ( pbl )  AND  PUBYEAR  >  2016 AND NOT  PUBDATETXT ( january  2017 )  AND NOT  PUBDATETXT ( february  2017 )
  2. Select all articles and export as CSV. Use the arrow aside 'Export CSV'
  3. Read the CSV into Excel and prepare the import sheet
    • Author names should be in a list like this one: A. F. Hof; M. G. J. den Elzen; A. Mendoza Beltran; Copy the Author column to a new sheet and apply the 'text to columns' function with delimiter=','. Add another sheet and enter the authors formula or a similar one. Copy and paste (Values only) the result into the author column.
  4. Check labels on:
    • duplicates
    • parse errors
    • double names
  5. Compare the labels of the new references with the existing publications. If the label exists and the publications are different,append a character to the label, e.g. Den Elzen et al., 2015c
  6. Rename the header of the first column Label to Title
  7. The headers of the other columns must be assigned the correct values see the section #Headers per type.
  8. Save the file as Unicode text.
  9. IMPORTANT! Open the file in Textpad or Notepad++. Check the encoding, it should be UTF8. Replace the tabs "\t" with "," and save as .csv file
  10. In Special pages choose: Import CSV, Browse to the created csv file, select "utf8", select the skip option and start the import.

Authors formula

<syntaxhighlight lang="vb.net"> CONCATENATE(Sheet1!B2,Sheet1!A2,";", IF(LEN(Sheet1!D2)=0,,CONCATENATE(Sheet1!D2,Sheet1!C2,";")), IF(LEN(Sheet1!F2)=0,,CONCATENATE(Sheet1!F2,Sheet1!E2,";")), IF(LEN(Sheet1!H2)=0,,CONCATENATE(Sheet1!H2,Sheet1!G2,";")), IF(LEN(Sheet1!J2)=0,,CONCATENATE(Sheet1!J2,Sheet1!I2,";")), IF(LEN(Sheet1!L2)=0,,CONCATENATE(Sheet1!L2,Sheet1!K2,";")), IF(LEN(Sheet1!N2)=0,,CONCATENATE(Sheet1!N2,Sheet1!M2,";")), IF(LEN(Sheet1!P2)=0,,CONCATENATE(Sheet1!P2,Sheet1!O2,";")), IF(LEN(Sheet1!R2)=0,,CONCATENATE(Sheet1!R2,Sheet1!Q2,";")), IF(LEN(Sheet1!T2)=0,,CONCATENATE(Sheet1!T2,Sheet1!S2,";")), IF(LEN(Sheet1!V2)=0,,CONCATENATE(Sheet1!V2,Sheet1!U2,";")), IF(LEN(Sheet1!X2)=0,,CONCATENATE(Sheet1!X2,Sheet1!W2,";")), IF(LEN(Sheet1!Z2)=0,,CONCATENATE(Sheet1!Z2,Sheet1!Y2,";")), IF(LEN(Sheet1!AB2)=0,,CONCATENATE(Sheet1!AB2,Sheet1!AA2,";")), IF(LEN(Sheet1!AD2)=0,,CONCATENATE(Sheet1!AD2,Sheet1!AC2,";")), IF(LEN(Sheet1!AF2)=0,,CONCATENATE(Sheet1!AF2,Sheet1!AE2,";")), IF(LEN(Sheet1!AH2)=0,,CONCATENATE(Sheet1!AH2,Sheet1!AG2,";")), IF(LEN(Sheet1!AJ2)=0,,CONCATENATE(Sheet1!AJ2,Sheet1!AI2,";")), IF(LEN(Sheet1!AL2)=0,,CONCATENATE(Sheet1!AL2,Sheet1!AK2,";")), IF(LEN(Sheet1!AN2)=0,,CONCATENATE(Sheet1!AN2,Sheet1!AM2,";")), IF(LEN(Sheet1!AP2)=0,,CONCATENATE(Sheet1!AP2,Sheet1!AO2,";")), IF(LEN(Sheet1!AR2)=0,,CONCATENATE(Sheet1!AR2,Sheet1!AQ2,";")), IF(LEN(Sheet1!AT2)=0,,CONCATENATE(Sheet1!AT2,Sheet1!AS2,";")), IF(LEN(Sheet1!AV2)=0,,CONCATENATE(Sheet1!AV2,Sheet1!AU2,";")), IF(LEN(Sheet1!AX2)=0,,CONCATENATE(Sheet1!AX2,Sheet1!AW2,";")), IF(LEN(Sheet1!AZ2)=0,,CONCATENATE(Sheet1!AZ2,Sheet1!AY2,";")), IF(LEN(Sheet1!BB2)=0,,CONCATENATE(Sheet1!BB2,Sheet1!BA2,";")), IF(LEN(Sheet1!BD2)=0,,CONCATENATE(Sheet1!BD2,Sheet1!BC2,";")), IF(LEN(Sheet1!BF2)=0,,CONCATENATE(Sheet1!BF2,Sheet1!BE2,";")), IF(LEN(Sheet1!BH2)=0,,CONCATENATE(Sheet1!BH2,Sheet1!BG2,";")), IF(LEN(Sheet1!BJ2)=0,,CONCATENATE(Sheet1!BJ2,Sheet1!BI2,";")), IF(LEN(Sheet1!BL2)=0,,CONCATENATE(Sheet1!BL2,Sheet1!BK2,";")), IF(LEN(Sheet1!BN2)=0,,CONCATENATE(Sheet1!BN2,Sheet1!BM2,";")), IF(LEN(Sheet1!BP2)=0,,CONCATENATE(Sheet1!BP2,Sheet1!BO2,";")), IF(LEN(Sheet1!BR2)=0,,CONCATENATE(Sheet1!BR2,Sheet1!BQ2,";")), IF(LEN(Sheet1!BT2)=0,,CONCATENATE(Sheet1!BT2,Sheet1!BS2,";")), IF(LEN(Sheet1!BV2)=0,,CONCATENATE(Sheet1!BV2,Sheet1!BU2,";")), IF(LEN(Sheet1!BX2)=0,,CONCATENATE(Sheet1!BX2,Sheet1!BW2,";")), IF(LEN(Sheet1!BZ2)=0,,CONCATENATE(Sheet1!BZ2,Sheet1!BY2,";")), IF(LEN(Sheet1!CB2)=0,,CONCATENATE(Sheet1!CB2,Sheet1!CA2,";")), IF(LEN(Sheet1!CD2)=0,,CONCATENATE(Sheet1!CD2,Sheet1!CC2,";")), IF(LEN(Sheet1!CF2)=0,,CONCATENATE(Sheet1!CF2,Sheet1!CE2,";")), IF(LEN(Sheet1!CH2)=0,,CONCATENATE(Sheet1!CH2,Sheet1!CG2,";")), IF(LEN(Sheet1!CJ2)=0,,CONCATENATE(Sheet1!CJ2,Sheet1!CI2,";")), IF(LEN(Sheet1!CL2)=0,,CONCATENATE(Sheet1!CL2,Sheet1!CK2,";")), IF(LEN(Sheet1!CN2)=0,,CONCATENATE(Sheet1!CN2,Sheet1!CM2,";")), IF(LEN(Sheet1!CP2)=0,,CONCATENATE(Sheet1!CP2,Sheet1!CO2,";")), IF(LEN(Sheet1!CR2)=0,,CONCATENATE(Sheet1!CR2,Sheet1!CQ2,";")), IF(LEN(Sheet1!CT2)=0,,CONCATENATE(Sheet1!CT2,Sheet1!CS2,";")), IF(LEN(Sheet1!CV2)=0,,CONCATENATE(Sheet1!CV2,Sheet1!CU2,";")), IF(LEN(Sheet1!CX2)=0,,CONCATENATE(Sheet1!CX2,Sheet1!CW2,";")), IF(LEN(Sheet1!CZ2)=0,,CONCATENATE(Sheet1!CZ2,Sheet1!CY2,";")) ) </syntaxhighlight>

Headers per type

For each PublicationType you can also add a header 'Free text' with additional information.

  • Note:Types are case sensitve!
  • Note: the header line may not contain any spaces!

Book

  • ReferenceTemplate[PublicationType] with values 'Book'
  • ReferenceTemplate[Author]
  • ReferenceTemplate[Year]
  • ReferenceTemplate[Title]
  • ReferenceTemplate[PBL-link]
  • ReferenceTemplate[DOI]
  • ReferenceTemplate[Volume5]
  • ReferenceTemplate[Publisher]
  • ReferenceTemplate[City]
  • ReferenceTemplate[ISBN]

Book section

  • ReferenceTemplate[PublicationType] with values 'Book section'
  • ReferenceTemplate[Author]
  • ReferenceTemplate[Year]
  • ReferenceTemplate[Title]
  • ReferenceTemplate[PBL-link]
  • ReferenceTemplate[DOI]
  • ReferenceTemplate[BookTitle]
  • ReferenceTemplate[Editor]
  • ReferenceTemplate[Publisher2]
  • ReferenceTemplate[City2]
  • ReferenceTemplate[Volume]
  • ReferenceTemplate[Pages]
  • ReferenceTemplate[ISBN2]

Edited book

  • ReferenceTemplate[PublicationType] with values 'Edited book'
  • ReferenceTemplate[Author]
  • ReferenceTemplate[Year]
  • ReferenceTemplate[Title]
  • ReferenceTemplate[PBL-link]
  • ReferenceTemplate[DOI]
  • ReferenceTemplate[Editor2]
  • ReferenceTemplate[SeriesTitle]
  • ReferenceTemplate[Volume4]
  • ReferenceTemplate[Publisher3]
  • ReferenceTemplate[City3]
  • ReferenceTemplate[ISBN3]

Report

  • ReferenceTemplate[PublicationType] with values 'Report'
  • ReferenceTemplate[Author]
  • ReferenceTemplate[Year]
  • ReferenceTemplate[Title]
  • ReferenceTemplate[PBL-link]
  • ReferenceTemplate[DOI]
  • ReferenceTemplate[Editor3]
  • ReferenceTemplate[Institution]
  • ReferenceTemplate[ReportNumber]
  • ReferenceTemplate[SeriesTitle2]
  • ReferenceTemplate[Publisher5]
  • ReferenceTemplate[City5]

Journal

  • ReferenceTemplate[PublicationType] with values 'Journal article'
  • ReferenceTemplate[Author]
  • ReferenceTemplate[Year]
  • ReferenceTemplate[Title]
  • ReferenceTemplate[PBL-link]
  • ReferenceTemplate[DOI]
  • ReferenceTemplate[Journal]
  • ReferenceTemplate[Volume2]
  • ReferenceTemplate[Issue]
  • ReferenceTemplate[Pages2]

Conference proceedings

  • ReferenceTemplate[PublicationType] with values 'Conference proceedings'
  • ReferenceTemplate[Author]
  • ReferenceTemplate[Year]
  • ReferenceTemplate[Title]
  • ReferenceTemplate[PBL-link]
  • ReferenceTemplate[DOI]
  • ReferenceTemplate[ConferenceName]
  • ReferenceTemplate[Volume6]
  • ReferenceTemplate[Pages4]

Other

  • ReferenceTemplate[PublicationType] with values 'Other'
  • ReferenceTemplate[Author]
  • ReferenceTemplate[Year]
  • ReferenceTemplate[Title]
  • ReferenceTemplate[PBL-link]
  • ReferenceTemplate[DOI]
  • ReferenceTemplate[SecondaryTitle]
  • ReferenceTemplate[SecondaryAuthor]
  • ReferenceTemplate[Publisher4]
  • ReferenceTemplate[City4]
  • ReferenceTemplate[Volume3]
  • ReferenceTemplate[Pages3]
  • ReferenceTemplate[Date]

Links

http://unisa.libguides.com/content.php?pid=224578&sid=2908837 for exporting references http://www.ehow.com/how_12014808_open-tab-delimited-files-excel.html

Retrieved from "https://models.pbl.nl/index.php?title=How_to_import_references&oldid=35716"