# Time required for importing data

**URL:** https://forum.qiime2.org/t/time-required-for-importing-data/10659
**Category:** User Support
**Created:** [July 12, 2019, 9:52pm UTC](https://forum.qiime2.org/t/time-required-for-importing-data/10659 "2019-07-12T21:52:58Z")
**Posts on this page:** 5
**Page:** 1

<div class="post-metadata">

### Author: ![SAHIL\_JAIN\_16110144](https://forum.qiime2.org/user_avatar/forum.qiime2.org/sahil_jain_16110144/32/5233_2.png) [@SAHIL\_JAIN\_16110144](https://forum.qiime2.org/u/SAHIL_JAIN_16110144)
#### Post date: [July 12, 2019, 9:52pm UTC](https://forum.qiime2.org/t/time-required-for-importing-data/10659/1 "2019-07-12T21:52:58Z")

</div>

Hi,  
I am trying to import 56 fastq piles (paired-end reads with 28 fastq files for forward and reverse reads each) on qiime2 - 2019.4 version. I am referring to the corresponding data importing tutorial for the manifest protocol.  
It has been more than 30 minutes but the command is still running. Does it usually take this long? No error has popped up yet neither the imported data. I am stuck. I am using MAC, and the running speed is usually good on this computer.

---

<div class="post-metadata">

### Author: ![Mehrbod\_Estaki](https://forum.qiime2.org/user_avatar/forum.qiime2.org/mehrbod_estaki/32/4001_2.png) [@Mehrbod\_Estaki](https://forum.qiime2.org/u/Mehrbod_Estaki)
#### Post date: [July 12, 2019, 10:27pm UTC](https://forum.qiime2.org/t/time-required-for-importing-data/10659/2 "2019-07-12T22:27:37Z")

</div>

Hi @SAHIL_JAIN_16110144,  
You're right that this is a bit longer than usual, unless you have some crazy big files, but if it is still running I would let it run until completion or at least let it reach an error that way we can work with the error. If you open a new terminal and run `top` can you confirm that the job is still running? Or that how much memory is dedicated to the task?

---

<div class="post-metadata">

### Author: ![SAHIL\_JAIN\_16110144](https://forum.qiime2.org/user_avatar/forum.qiime2.org/sahil_jain_16110144/32/5233_2.png) [@SAHIL\_JAIN\_16110144](https://forum.qiime2.org/u/SAHIL_JAIN_16110144)
#### Post date: [July 12, 2019, 11:27pm UTC](https://forum.qiime2.org/t/time-required-for-importing-data/10659/3 "2019-07-12T23:27:23Z")

</div>

I had to stop the run. I reduced the data size to 4 fastq files just to check if there is something wrong with the command. The data got imported and it took almost 20 minutes to import 4 files. This is a huge setback because I have to analyse samples from more than just 1 study (a meta analysis). Does multi core processing work for Qiime?

---

<div class="post-metadata">

### Author: ![Nicholas\_Bokulich](https://forum.qiime2.org/user_avatar/forum.qiime2.org/nicholas_bokulich/32/19937_2.png) [@Nicholas\_Bokulich](https://forum.qiime2.org/u/Nicholas_Bokulich)
#### Post date: [July 15, 2019, 12:25pm UTC](https://forum.qiime2.org/t/time-required-for-importing-data/10659/5 "2019-07-15T12:25:28Z")

</div>

> [@SAHIL\_JAIN\_16110144](#):
>
> I reduced the data size to 4 fastq files just to check if there is something wrong with the command. The data got imported and it took almost 20 minutes to import 4 files.

What is the size of those files? Unless if they are massive files, this runtime is very unusual (importing even large fastqs usually takes seconds or minutes, not hours). I suspect it is a problem with the file size or else with your system, you may want to check with your system administrator to see what is causing the slowdown. This is not an issue with QIIME 2, which you have confirmed is working (though slower than is typical).

> [@SAHIL\_JAIN\_16110144](#):
>
> This is a huge setback because I have to analyse samples from more than just 1 study (a meta analysis)

Yes this is a routine use of QIIME 2 — yet importing many datasets for meta-analysis usually takes minutes.

> [@SAHIL\_JAIN\_16110144](#):
>
> Does multi core processing work for Qiime?

Many actions in QIIME 2 can run in parallel, but not importing.

---

<div class="post-metadata">

### Author: ![system](https://forum-qiime2-org.s3.dualstack.us-west-2.amazonaws.com/original/3X/2/1/21af5fe23cb6f4579467c66a9ed94e55274ca7bd.svg) [@system](https://forum.qiime2.org/u/system)
#### Post date: [August 15, 2019, 6:25pm UTC](https://forum.qiime2.org/t/time-required-for-importing-data/10659/6 "2019-08-15T18:25:30Z")

</div>

This topic was automatically closed 31 days after the last reply. New replies are no longer allowed.
