PyLadies Talk: Learn to love the command line!

LEARNTOLOVETHE
COMMANDLINE
Thursday, 19 February, 2015
Google Montreal
Shopify Montreal

INLOVEWITH...
THECOMMANDLINE
/ /
http://cli-talk.bitballoon.com
Blanca Mancilla bluciam @Blanckus

LinuxCommand.org
You have Linux installed and running. The
GUI is working fine, but you are getting
tired of changing your desktop themes.
You keep seeing this "terminal" thing.

Anybody with little or no experience?
What do you know about it?
What are you expecting to learn tonight?
WHATISTHECOMMAND
LINE?

Specifically, the computer program is the operating
system (UNIX or nowadays Linux) and the interface is
what we called the .
THECOMMANDLINE
ANDTHESHELL
A command-line interface (CLI) is a means of interacting with a
computer program where the user issues commands to the program in
the form of successive lines of text (command lines).
https://en.wikipedia.org/wiki/Command-line_interface
shell

TYPESOFSHELLSINLINUX
sh
bash
csh and tcsh
ksh
read more...

HOWDOIKNOWWHICH
SHELL?
~ $ w h i c h b a s h
/ b i n / b a s h
~ $ w h i c h s h
/ b i n / s h
~ $ w h i c h c s h
~ $ e c h o $ S H E L L
/ b i n / b a s h
~ $ s h
$ e c h o $ S H E L L
/ b i n / b a s h
$ p s - p $ $
P I D T T Y T I M E C M D
1 7 7 9 3 p t s / 2 8 0 0 : 0 0 : 0 0 s h
$ ^ D
~ $ p s - p $ $
P I D T T Y T I M E C M D
1 5 6 1 5 p t s / 2 8 0 0 : 0 0 : 0 1 b a s h

by Jeroen JanssensData Science at the Command Line

—Chris H. Wiggins
Associate Professor in the Department of Applied Physics
and Applied Mathematics at Columbia University
and Chief Data Scientist at The New York Times
The Unix philosophy of simple tools, each
doing one job well, then cleverly piped
together, is embodied by the command
line. Jeroen expertly discusses how to
bring that philosophy into your work in
data science, illustrating how the
command line is not only the world of file
input/ output, but also the world of data
manipulation, exploration, and even
modeling.

APPENDIX:COMMANDS
alias awk aws bash bc bigmler body cat cd chmod cols
cowsay cp csvcut csvgrep csvjoin csvlook csvsort csvsql
csvstack csvstat curl curlicue cut display drake dseq echo
env export feedgnuplot fieldsplit find for git grep head
header in2csv jq json2csv less ls man mkdir mv parallel
paste pbc pip pwd python R Rio Rio-scatter rm

Yes! Of course.
FORLOOPS?
f o r i i n * p d f ; d o e v i n c e $ i ; d o n e

FORLOOPS
: l y c e u m $ l s * p d f
H o w T o B e A P r o g r a m m e r . p d f S E N G 3 0 2 0 - 0 . 1 . p d f t e a c h i n g - p r g m . p d f
S E N G 3 0 1 0 - B A R T - R e q - v 1 - 1 - 3 d . p d f S E N G 3 0 2 0 _ 0 7 s 2 . p d f
: l y c e u m $ e v i n c e * p d f
: l y c e u m $ f o r i i n * p d f ; d o e v i n c e $ i ; d o n e

or even
FORLOOPS
In a script
f o r i i n * p d f
d o
e v i n c e $ i
d o n e
f o r i i n ` l s * p d f `
d o
e v i n c e $ i
d o n e
More info

CHECKIFAFILEEXISTSAND
IFNOT...
c l i - t a l k : $ [ - f i n d e x . h t m l ] & & e c h o " Y e s , w e h a v e a p r e s e n t a t i o n ! "
| | e c h o " P A N I C "

IFNOT...

Let's try a demo
IFNOT...
c l i - t a l k : $ l o c a t e * 9 7 6 8 . J P G

GLOBPATTERNS:
REALMAGIC!
Strictly speaking, there are neither regular expressions
nor patterns used in pattern recognition.
They are .glob patterns

GLOBPATTERNS:
REALMAGIC!
l s a p p / * . { e r b , s c s s , r b , y m l }
v i p u b l i c _ h t m l / [ i I ] * . h t m *

My favorite: Move all image files for the years
2010 to 2012 into .
GLOBPATTERNS:
REALMAGIC!
my_dir
m v { I M G , i m g } * 2 0 1 [ 0 1 2 ] * . { j p g , J P G , p n g , g i f } m y _ d i r

FINDARESOURCE
ANYWHEREINYOURHARD
DRIVE

versus
FINDARESOURCE...
locate find
L o r i B i z : $ l o c a t e * . e r b
L o r i B i z : $ f i n d . - n a m e * . e r b

find . -name *.erb -exec ls {} ;
find . -name *.erb -exec grep mytableauthor {} ;
find . -name *.erb -exec grep -H mytableauthor {} ;
find . -name *.scss -exec grep -H mytableauthor {} ;
find . -name *.scss -exec grep -n -H mytableauthor {} ;
FINDARESOURCE...

FINDANDREPLACETRAILING
SPACESINSOURCECODE

FIND...TRAILINGSPACESIN
SOURCECODE
c l i - t a l k $ g r e p " s + $ " i n d e x . h t m l

...REPLACETRAILINGSPACES
INSOURCECODE
L o r i B i z $ f i n d . - n a m e * . e r b - e x e c g r e p - H n " s + $ " { } ;
L o r i B i z $ f i n d . - n a m e * . e r b - e x e c g r e p - H n " s + $ " { } ; - e x e c v i { } ;
# O n c e i n v i f i n d a n d r e p l a c e u s i n g t h e c o m m a n d
: % s / s + $ / /

MAKINGBACKUPSOF
GITREPOSITORIES
superspreadsheet.wordpress.com

MAKINGBACKUPSOF...
1. pullfrom the bare repository
2. commitlocal changes
3. pushchanges to the bare repository

Pull and Commit
MAKINGBACKUPSOF...
1 # ! / b i n / s h
2 #
3 # A u t o m a t i c p u l l a n d c o m m i t o n t h e d i r e c t o r i e s l i s t e d i n d i r s _ t o _ p u l l
4
5 C R O N L O G = " / c o m p l e t e / p a t h / t o / p u l l c o m m i t p u s h . l o g "
6 C O M M I T M S G = " / c o m p l e t e / p a t h / t o / m s g A u t o C o m m i t "
7 e c h o > > $ C R O N L O G
8 e c h o " N i g h t l y g i t a u t o - c o m m i t f o r t h e a b s e n t m i n d s : $ ( d a t e ) " > > $ C R O N L O G
9 f o r i i n ` c a t / c o m p l e t e / p a t h / t o / d i r s _ t o _ p u l l `
1 0 d o ( c d $ i ;
1 1 e c h o " P U L L $ i $ ( d a t e ) " > > $ C R O N L O G ;
1 2 g i t p u l l > > $ C R O N L O G 2 > & 1 ;
1 3 e c h o " C O M M I T $ i $ ( d a t e ) " > > $ C R O N L O G ;
1 4 g i t c o m m i t - a - F $ C O M M I T M S G > > $ C R O N L O G 2 > & 1
1 5 e c h o > > $ C R O N L O G )
1 6 d o n e
1 7 e c h o > > $ C R O N L O G ;

Push
MAKINGBACKUPSOF...
1 # ! / b i n / s h
2 #
3 # A u t o m a t i c p u s h o n t h e d i r e c t o r i e s l i s t e d i n d i r s _ t o _ p u s h
4
5 C R O N L O G = " / c o m p l e t e / p a t h / t o / p u l l c o m m i t p u s h . l o g "
6 e c h o > > $ C R O N L O G
7 e c h o " N i g h t l y g i t a u t o - p u s h f o r t h e a b s e n t m i n d s : $ ( d a t e ) " > > $ C R O N L O G
8 f o r i i n ` c a t / c o m p l e t e / p a t h / t o / d i r s _ t o _ p u s h `
9 d o ( c d $ i ;
1 0 e c h o " P U S H : $ i $ ( d a t e ) " > > $ C R O N L O G
1 1 g i t p u s h > > $ C R O N L O G 2 > & 1
1 2 e c h o > > $ C R O N L O G
1 3 ) ;
1 4 d o n e
1 5 e c h o > > $ C R O N L O G ;

: from the Greek word for time, χρόνος chronos.
MAKINGBACKUPSUSING...
cron

https://en.wikipedia.org/wiki/Cron
Cron is a time-based job scheduler that
Sysadmins use to schedule jobs to run
periodically at fixed times, dates, or
intervals (i.e. download email at regular
intervals).

c r o n t a b - e
minute hour dayOfMonth month dayOfWeek command
3 2 * * * / c o m p l e t e / p a t h / t o / p u l l _ c o m m i t 2 > / c o m p l e t e / p a t h / t o / p u l l _ c o m m i t . e r r
5 2 * * * / c o m p l e t e / p a t h / t o / p u s h 2 > / c o m p l e t e / p a t h / t o / p u s h . e r r

Blog post in development!
CREATINGACOPYOFAGIT
REPOSITORYWHICHISNOT
QUITEACOPY

JavaScript source code for the slides taken from
.
I encourage you to try it!
THEEND
reveal.js

PyLadies Talk: Learn to love the command line!

More Related Content

What's hot (20)

Similar to PyLadies Talk: Learn to love the command line! (20)

Recently uploaded (20)

PyLadies Talk: Learn to love the command line!