CiteSpace / Discussion / General Discussion: Trouble with scopus data conversion

Ali G - 2022-08-19

I'm pretty new to Citespace so please bare with me.

I had downloaded the files (RIS) I had needed yesterday from scopus. Converted them, ran the project and everything was working fine.

Come today I want to try an entirely new new project using more articles. This time it would only convert 3 of the 72 articles I have. I've noticed a weird command prompt when clicking on the input and output directory
'DataGUI 127: data.properties (Access is denied)
DataGUI 127: data.properties (Access is denied)'.

My stupidity has led me to removing all the converted files, deleting literally everything including all the existing projects to start fresh hoping it would work. (ITS ONLY MADE THING WORSE). I'm left with a folder of my original RIS Scopus articles.

HELP.PNG

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
- Chaomei Chen - 2022-08-19
  
  It looks your new files contain some ill-formatted data, e.g., a field without any value. I can filter out this type of data, but I haven't seen it with my test data, so not sure which fields may have this type of problems. If you can send me a sample file that was failed, I can take a close look.
  
  If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Ali G - 2022-08-20

Hi Chaomei,

I've attached the folder with the old and new RIS files (added on the 19th). Any help is greatly appreciated. Thank you!

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Ali G - 2022-08-20

I've included all the articles so far.

Original_2.zip

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
- Chaomei Chen - 2022-08-21
  
  As it turns out, your files do not contain any cited references. See attached for converted files. You can use them with CiteSpace, but your options are limited because your data miss cited references, the most important part of the data.
  Typically, you search in Scopus and export multiple records to a single file. One record per file is okay, but for what is worth it would be a good idea to export cited references from Scopus.
  
  converted.7z
  
  If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Ali G - 2022-08-22

Appreciate that Chaomei.
Was there anything I specifically did wrong? I merely searched for my articles through scopus, then RIS exported them with abstracts and converted them through citespace conversion. I mean all was going well for the first 60 articles until I started adding more
Just want to know so I don't make the same mistake in the future. Thank you.

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
- Chaomei Chen - 2022-08-22
  
  Scopus exported one bodyless field, which caused the problem. When you export, you should select ALL the fields available. It should be fine with the Advanced version. I will update the Basic version in 1-2 weeks.
  
  If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Stephan De Spiegeleire - 2022-08-27

Using 6.1.3_Advanced_Build_220825 on Windows. Trying to import Scopus files (all fields selected) from a folder. Converted csv to tab-delimited (outside of Excel because of the problem I have mentioned before). But I am getting the same error "DataGUI 127: data.properties (Access is denied)",m as soon as I select the folder in the GUI. The folder in question is fully accessible. Any thoughts on how to troubleshoot - or, better yet: fix - it? Thanks...

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
- Chaomei Chen - 2022-08-27
  
  I tested the data files attached above, but didn't see this error. If any of you can repeat this error, please let me know.
  
  If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
  - Stephan De Spiegeleire - 2022-08-27
    
    Ok, I'll let the others in our team try again too. Just sharing few
    thoughts/experiences :
    
    (using with the latest build, data import/export interface - 'Scopus'
    tab, not in MySQL)
    
    as you know, we work collaboratively. So we save all of our export
    folders and our (project- and run-specific) CS folders (Data,Projects,
    Concept trees) on our shared Google Drive folders, which we have offline
    on our hard drives, but which constantly sync with the online version. I
    suppose that could be a reason. But we have always done it like that, and
    we (at least I) have never had this problem before.
    
    I stopped Google sync - still the same problem
    
    I went out of Google drive - still the same problem
    
    I disabled my ethernet network adapter - still the same problem
    
    I went out of CS and went in it again (re-enabled the ethernet network
    adapter to get back into CS, then disabled it again - maybe some cache
    issue?) - same problem
    
    running CS as Admin - that solves that problem, but it still doesn't process
    them - at least it hasn't yet. Will give it some time, but I guess it
    doesn't look promising)
    
    So can I ask:
    
    did you do this successfully in the MySQL GUI or the Import Scopus one?
    
    in Windows?
    
    did it start converting right away, or did it take some time (I've
    been waiting for 10' now and still am looking at a black command-terminal?
    
    is there anything else I should try?
    
    Thanks!
    
    Last edit: Stephan De Spiegeleire 2022-08-28
    
    alternate
    
    If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
    - Chaomei Chen - 2022-08-28
      
      Converting Scopus data does not need the database.
      The following instructions are from the CiteSpace interface. RIS is preferred and update to date, whereas CSV is a secondary alternative and a revision is probably due.
      If you have multiple RIS files, perhaps you can try to divide and conquer and narrow down to problematic files and then share those with me
      
      Usage
      Step 1: Download data from Scopus
      Select all fields and save search results to the RIS format to a folder on your computer.
      You may also save as CSV files. Open them in Excel and save them as tab delimited files with filenames starting with the word 'download', e.g. download_tab.txt
      Step 2: Use CiteSpace to Convert the data format
      Set both input and output directories and then press the corresponding button below
      Note
      The successful rate of each conversion varies due to irregularities of references in the original Scopus data.
      
      If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Ali G - 2022-10-03

Hi Chaomei,

I've been really enjoying citespace so far, and as I continue to play around I'm getting more familiar with it.
However, just a little problem. When running my project, which contains 292 reports, citespace only seems to process 284 reports. I don't know which 8 reports are missing and why they are. They're all within the respective timeslice.
Thank you!

292_Unique.zip

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
- Chaomei Chen - 2022-10-10
  
  If you can provide the original data files from Scopus, I will take a look as soon as I can.
  
  If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Olalekan Christian Olatunde - 2022-10-22

Good day prof. I have been having problem uploading my data file from scopus. I am trying to convert to wos format but no output was generated. The process kept going on without terminating. find attached my file and the output file generated. Thanks

citespace.config

citespace.parameters

citespace.signature

scopus_1960-2022_n402.ris

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
- Chaomei Chen - 2022-10-24
  
  There was a minor issue. The fix will appear in the next version. In the meantime, see attached for the converted file.
  
  download_converted_1.txt
  
  If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Trouble with scopus data conversion

A widely used tool for visual exploration of scientific literature.

Forums

Help

Trouble with scopus data conversion

Trouble with scopus data conversion

A widely used tool for visual exploration of scientific literature.

Forums

Help

Trouble with scopus data conversion document.SUBSCRIPTION_OPTIONS = { "thing": "topic", "subscribed": false, "url": "subscribe", "icon": { "css": "fa fa-envelope-o" } };

Trouble with scopus data conversion