Data Carpentry's aim is to teach researchers basic concepts, skills, and tools for working with data so that they can get more done in less time, and with less pain.
Our curriculum includes:
Data Carpentry's teaching is hands-on, so participants are required to bring their own laptops. There are no pre-requisites, and we will assume no prior knowledge about the tools.
Instructors: Aleksandra Pawlik, Aleksandra Nenadic, Peter Juvan
Assistants: Ziva Ramsak, Brane L. Leskosek, Domen Soklic, Mateusz Kuzak
Where: Institute for Biostatistics and Medical Informatics, Faculty of Medicine, Vrazov trg 2, Ljubljana. Get directions with OpenStreetMap or Google Maps.
Contact: Please email tanja.dreo@nib.si, peter.juvan@mf.uni-lj.si for questions and information not covered here.
Twitter: #datacarpentry
Etherpad For communication we will be using this Etherpad
Monday, 20 July | 09:00 - 9:30 | Introduction and setup help |
09:30 - 10:30 | Better use of spreadsheets (Sample dataset 1.) (Sample dataset 2) | |
10:30 - 11:00 | Break | |
11:00 - 12:00 |
Open Refine Sample file for the OpenRefine lesson. | |
12:00 - 13:00 | Lunch break | |
13:00 - 14:30 | Introduction to R | |
14:30 - 15:00 | Coffee break | |
15:00 - 16:45 | Working with data in R | |
16:45 - 17:00 | Wrap-up | |
Tuesday, 21 July | 09:00 - 10:30 | Working with command line - part 1. (Sample dataset.) |
10:30 - 10:45 | Break | |
10:45 - 12:00 | Working with command line - part 2 | |
12:00 - 13:00 | Lunch | |
13:00 - 14:00 | Automating tasks in command line - scripting | |
14:00 - 14:30 | Data manipulation with SQL - part 1 | |
14:30 - 15:00 | Break | |
15:00 - 16:30 | Data manipulation with SQL - part 2 | |
16:30 - 17:00 | Wrap-up and feedback |
Plotting in R
To participate in a Data Carpentry bootcamp, you will need working copies of the software described below. Please make sure to install everything (or at least to download the installers) before the start of your bootcamp.
When you're writing scripts or text, it's nice to have a text editor that is optimized for writing code, with features like automatic color-coding of key words. The default text editor on Mac OS X and Linux is usually set to Vim, which is not famous for being intuitive. if you accidentally find yourself stuck in it, try typing the escape key, followed by ':wq!' (colon, lower-case 'q', exclamation mark), then hitting Return to return to the shell. (This will exit Vim and save the changes you made in the file.)
Bash is a commonly-used shell. Using a shell gives you more power to do more tasks more quickly with your computer.
R is a programming language that specializes in statistical computing. It is a powerful tool for exploratory data analysis. To interact with R, we will use RStudio, an interactive development environment (IDE).
SQL is a specialized programming language used with databases. We use a simple database manager called SQLite, either directly or through a browser plugin.
Notepad++ is a popular free code editor for Windows. Be aware that you must add its installation directory to your system path in order to launch it from the command line (or have other tools like Git launch it for you). The instructions to modify your path are available online here. Please ask your instructor to help you do this.
Install Git (version control) and a Bash shell for Windows from the msysGit project's homepage. This will provide you with Bash in the Git Bash program.
Other tools used in Data Carpentry have been packaged up by Software Carpentry in an installer. This installer requires an active internet connection.
Install R by downloading and running this .exe file from CRAN. Also, please install the RStudio IDE.
Install the Firefox SQLite browser plugin described below.
The default shell in all versions of Mac OS X is bash,
so no need to install anything. You access bash from
the Terminal (found
in /Applications/Utilities
). You may want
to keep Terminal in your dock for this workshop.
We recommend
Text Wrangler or
Sublime Text.
Alternatively, you can use nano
,
which should be pre-installed.
Install R by downloading and running this .pkg file from CRAN. Also, please install the RStudio IDE.
sqlite3
comes pre-installed on Mac OS X.
Also install the Firefox SQLite browser plugin described below.
The default shell is usually bash
,
but if your machine is set up differently
you can run it by opening a terminal and typing bash
.
There is no need to install anything.
Kate is one option for Linux users.
Alternatively, you can use nano
,
which should be pre-installed.
You can download the binary files for your distribution
from CRAN. Or
you can use your package manager, e.g. for Debian/Ubuntu
run apt-get install r-base
. Also, please install
the
RStudio IDE.
sqlite3
comes pre-installed on Linux.
Also install the Firefox SQLite browser plugin described below.
Instead of using sqlite3
from the command line,
you will use this plugin
for Firefox instead. If you don't already have firefox, install it first.
To install the sqlite plugin:
OpenRefine (formerly Google Refine) is a powerful tool for exploring and working with messy data. You will need a browser (Firefox or Chrome is recommended) to work with Open Refine. Once you install Open Refine, you should be able to launch it double clicking like most of the programs. Open Refine will open in the browser (but you don't have to be online)