---
author: Sam White
toc-title: Contents
toc-depth: 5
toc-location: left
date: 2016-03-08 21:37:54+00:00
layout: post
slug: data-management-o-lurida-2brad-dec2015-undetermined-fastq-files
title: Data Management - O.lurida 2bRAD Dec2015 Undetermined FASTQ files
categories:
  - 2016
  - 2bRAD Library Tests for Sequencing at Genewiz
  - Olympia oyster reciprocal transplant
tags:
  - 2bRAD
  - ipython notebook
  - jupyter notebook
  - olympia oyster
  - Ostrea lurida
  - RAD
  - RAD-seq
---

[An astute observation by Katherine Silliman ](https://github.com/RobertsLab/project-olympia.oyster-genomic/issues/13)revealed that the FASTQ files I had moved to our high-throughput sequencing archive on our server Owl, only had two FASTQ files labeled as "undetermined". Based on the number of lanes we had sequenced, we should have had many more. Turns out that the undetermined FASTQ files that were present in different sub-folders of the Genewiz project data were not uniquely named. Thus, when I moved them over (via a bash script), the undetermined files were continually overwritten, until we were left with only two FASTQ files labeled as undetermined.

So, I re-downloaded the entire project folder from Genewiz servers and renamed the FASTQ files labeled as undetermined and then copied them over to the archive on Owl:

https://owl.fish.washington.edu/nightingales/O_lurida/2bRAD_Dec2015

I also zipped up the raw data project from Genewiz and moved it to the same archive location and updated the checksum.md5 and readme.md files.

Details can be found in the Jupyter (iPython) notebook below.

Jupyter Notebook file: [20160308_find_rename_2bRAD_undetermined_fastqs.ipynb](https://eagle.fish.washington.edu/Arabidopsis/iPythonNotebooks/20160308_find_rename_2bRAD_undetermined_fastqs.ipynb)

Notebook Viewer: [20160308_find_rename_2bRAD_undetermined_fastqs.ipynb](https://nbviewer.jupyter.org/url/eagle.fish.washington.edu/Arabidopsis/iPythonNotebooks/20160308_find_rename_2bRAD_undetermined_fastqs.ipynb)