SlideShare a Scribd company logo
Testing of
Password Policy
Anton Dedov

ZeroNights 2013
Who Am I
• Software Developer and Security Engineer
@ Parallels Automation
• Open source developer
• Mail: adedov@gmail.com
• Twitter: @brutemorse
Motivation
• It is hard for application developers to choose
between existing password meters reasonably.
• Worse, some implement their own [or
customize existing] without understanding of
security and psychological implications.
• Need some framework/criteria that would
help reasonable choice.

3
NAÏVE SECURITY MODEL
Untargeted Online Attacks
User base

Common
passwords
100 K

• 1 guess per user / day
• 2 days to find first password
• 100 days to find 50 passwords

10 K

100 K
2.5 K

5K

• 1 guess per user / day
• 10 days to find first password
• 1.5yr to find 50 passwords
Targeted Online Attacks
•
•
•
•
•

10 failed attempts  1 hour block
240 attempts per user / day
7200 attempts per user / month
86400 attempts per user / year
More IP-s scale linearly
Offline Attacks
• Huge dictionaries
• Specialized hardware and clusters
• No time/complexity limitations except
– Enforced password quality
– Hash speed
– Salt uniqueness

7
TESTING PASSWORD METERS
Candidates
•
•
•
•
•

Plesk
jquery.complexify
zxcvbn
libpwquality
passwdqc
Method
•
•
•
•

Apply meters to password bases
Dictionary attacks with JtR
Rule-based attacks with JtR
Collect essential parameters
Apply Meters
• Requirement: meter should provide
unambiguous signal about if password is
accepted or not.
• Passwdqc tells straight “OK” or “Bad”.
• Others return score. Minimal accepted score
documented.

11
Password Bases
•
•
•
•
•

Real customers
RockYou all
CMIYC-2010 not cracked
Random passphrases
Random 10-char passwords

Red for attacks; blue for psychological acceptance.
12
Dictionaries
Dictionary
Tiny English
RockYou top
Common-passwords
English
Tiny English crossed / 8 chars

Size, words
817
1438
3546
54316
72100

13
Rules
Rule
JtR defaults
JtR jumbo
m3g9tr0n-2048512
m3g9tr0n-2048517

Factor
~ 40
~ 5500
= 3510
~ 860

14
Cracking Sessions
None
JtR default

Tiny

817 words
41K words

JtR jumbo

4M words

m3g9tr0n2048512

2.8M words

m3g9tr0n2048517

707K words
15
Cracking Sessions
• 25 attacks per password base per meter
• Min dictionary size 817
• Max dictionary size 396M

RockYou dictionary was not used against RockYou password base.
16
Parameters
• M – passwords approved by meter
• D – attack dictionary size
• C – # of guessed passwords during attack
• Attack effectiveness

• Attack economy

C
M
C
D
17
Online Attacks Effectiveness

For dictionaries < 100K
Max guess rate 0.007%

18
Max Attack Effectiveness
0.1400%
0.1200%
0.1000%
0.0800%
0.0600%
0.0400%
0.0200%
0.0000%

passwdqc
customer2
customer1
rockyou

plesk

zxcvbn

complexify

pwquality

0.0304%
0.0210%
0.0011%

0.0130%
0.0089%
0.0002%

0.0182%
0.0315%
0.0130%

0.0546%
0.0460%
0.0049%

0.0794%
0.0290%
0.0224%
19
Max Attack Economy
160.0000%
140.0000%
120.0000%
100.0000%
80.0000%
60.0000%
40.0000%
20.0000%
0.0000%
rockyou
pwquality
complexify
zxcvbn
plesk
passwdqc

62.1545%
19.8816%
64.1850%
0.1224%
0.1224%

customer1
0.2782%
0.1224%
0.2782%
0.1224%
0.1224%

customer2
0.1224%
0.1224%
0.1224%
0.1224%
0.1224%

20
Average Attack Economy
9.0000%
8.0000%
7.0000%
6.0000%
5.0000%
4.0000%
3.0000%
2.0000%
1.0000%
0.0000%
rockyou
pwquality
complexify
zxcvbn
plesk
passwdqc

3.2154%
1.0375%
3.4033%
0.0079%
0.0137%

customer1
0.0177%
0.0095%
0.0180%
0.0092%
0.0092%

customer2
0.0093%
0.0101%
0.0096%
0.0092%
0.0094%

21
Guesses Totals
Meter
plesk
passwdqc
zxcvbn
complexify
libpwquality

RockYou

Customer 1

Customer 2

0.08%
0.18%
0.54%
0.54%
1.16%

0.28%
0.23%
0.26%
1.06%
0.50%

0.28%
0.12%
0.06%
0.40%
0.45%
Guesses Totals
2.50%

2.00%

1.50%

rockyou-all
customer2

1.00%

customer1
0.50%

0.00%

passwdqc

plesk

zxcvbn

complexify pwquality
23
Psy. Acceptance: User Passwords

Meter
plesk
passwdqc
zxcvbn
complexify
libpwquality

RockYou

Customer 1

Customer 2

0.21%
1.60%
5.43%
2.03%
4.32%

3.45%
14.90%
16.29%
7.05%
11.88%

5.53%
40.62%
43.16%
27.18%
34.27%
Psy. Acceptance: User Passwords
70.00%
60.00%
50.00%
40.00%

customer2
customer1

30.00%

rockyou-all
20.00%

10.00%
0.00%

passwdqc

plesk

zxcvbn complexify pwquality

25
Psy. Acceptance: Hard Passwords
Meter

plesk
passwdqc
zxcvbn
complexify
libpwquality

CMYIC-2010 Pass-Phrases

24%
59%
42%
3%
10%

0%
99.98%
99.76%
99.94%
99.82%

Random
10 chars
42%
100%
99.99%
0%
81%
26
Psy. Acceptance: Hard Passwords
100.00%
90.00%
80.00%
70.00%
60.00%

CMIYC2010-uncracked

50.00%

phrases-rand39

40.00%

random10

30.00%
20.00%
10.00%
0.00%
passwdqc

plesk

zxcvbn complexify pwquality
27
The “editors” choice
Security
passwdqc
plesk
zxcvbn
jquery.complexify
libpwquality

Psychology
zxcvbn
passwdqc
libpwquality
jquery.complexify
plesk

28
Conclusions
•
•
•
•

Test your security tools for security
Avoid write your own security tools
All tested meters protect from online attacks
Also seem protect from offline attacks
(for slow hashes and unique salts)

• But most tend to deny more passwords than it
is necessary, including known to be hard ones
• Passwdqc and zxcvbn look best
Where to go?
• Bigger dictionaries and brute force
• Testing on real people to
– Learn evolution of “common passwords” lists
– Test psychological acceptance empirically

• More meters?

30
Special thanks

Alexander Peslyak
Solar Designer

31
Bonus: time to process RockYou…
(MBP 2011)
3:15

zxcvbn
pwquality
plesk
passwdqc
complexify

5:48

0:13

0:26

0:16

0:00

1:12

2:24

3:36
Hours

4:48

6:00

7:12

More Related Content

PPTX
A Educação no Brasil: como funciona o sistema de ensino brasileiro? Experiênc...
PDF
Slides - Resumão de Legislação Educacional.pdf
PDF
Why Nobody Fills Out My Forms
PPTX
Угадываем пароль за минуту
PDF
A Novel Web-based Approach for Balancing Usability and Security Requirements ...
PPTX
Password cracking and brute force
DOC
Password Policies
PDF
SBA Live Academy - Passwords: Policy and Storage with NIST SP800-63b by Jim M...
A Educação no Brasil: como funciona o sistema de ensino brasileiro? Experiênc...
Slides - Resumão de Legislação Educacional.pdf
Why Nobody Fills Out My Forms
Угадываем пароль за минуту
A Novel Web-based Approach for Balancing Usability and Security Requirements ...
Password cracking and brute force
Password Policies
SBA Live Academy - Passwords: Policy and Storage with NIST SP800-63b by Jim M...

Similar to ZeroNights2013 testing of password policy (20)

DOCX
Password Cracking
PDF
Password Security
PDF
Dr. Ziyad Salloum - Geographical Passwords
PDF
160428
PDF
How to Design Passwords
PDF
Passwords: Security vs Usability
PDF
Honeywords for Password Security and Management
PDF
Password Management
PDF
Password Patterns- An Analysis
PDF
IRJET - Secure Banking Application with Image and GPS Location
PDF
Password War Games Webinar
PPTX
160428 Do Users' Perceptions of Password Security Match Reality?
PDF
PPTX
Password Cracking
PDF
User Authentication: Passwords and Beyond
PPTX
Password Cracking
PPTX
Lesson Presentation Powerful Passwords.pptx
DOCX
Chapter 6Authenticating PeopleChapter 6 OverviewThe th
PDF
Password Cracking using dictionary attacks
PDF
ESORICS 2014: Local Password validation using Self-Organizing Maps
Password Cracking
Password Security
Dr. Ziyad Salloum - Geographical Passwords
160428
How to Design Passwords
Passwords: Security vs Usability
Honeywords for Password Security and Management
Password Management
Password Patterns- An Analysis
IRJET - Secure Banking Application with Image and GPS Location
Password War Games Webinar
160428 Do Users' Perceptions of Password Security Match Reality?
Password Cracking
User Authentication: Passwords and Beyond
Password Cracking
Lesson Presentation Powerful Passwords.pptx
Chapter 6Authenticating PeopleChapter 6 OverviewThe th
Password Cracking using dictionary attacks
ESORICS 2014: Local Password validation using Self-Organizing Maps
Ad

Recently uploaded (20)

PDF
Univ-Connecticut-ChatGPT-Presentaion.pdf
PPTX
Programs and apps: productivity, graphics, security and other tools
PPTX
TechTalks-8-2019-Service-Management-ITIL-Refresh-ITIL-4-Framework-Supports-Ou...
PDF
Hybrid model detection and classification of lung cancer
PDF
Unlocking AI with Model Context Protocol (MCP)
PPTX
Tartificialntelligence_presentation.pptx
PPTX
Group 1 Presentation -Planning and Decision Making .pptx
PPTX
A Presentation on Artificial Intelligence
PDF
Accuracy of neural networks in brain wave diagnosis of schizophrenia
PDF
DASA ADMISSION 2024_FirstRound_FirstRank_LastRank.pdf
PPTX
cloud_computing_Infrastucture_as_cloud_p
PDF
Enhancing emotion recognition model for a student engagement use case through...
PDF
DP Operators-handbook-extract for the Mautical Institute
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PDF
Zenith AI: Advanced Artificial Intelligence
PDF
Heart disease approach using modified random forest and particle swarm optimi...
PDF
gpt5_lecture_notes_comprehensive_20250812015547.pdf
PDF
Getting Started with Data Integration: FME Form 101
PDF
Video forgery: An extensive analysis of inter-and intra-frame manipulation al...
PDF
From MVP to Full-Scale Product A Startup’s Software Journey.pdf
Univ-Connecticut-ChatGPT-Presentaion.pdf
Programs and apps: productivity, graphics, security and other tools
TechTalks-8-2019-Service-Management-ITIL-Refresh-ITIL-4-Framework-Supports-Ou...
Hybrid model detection and classification of lung cancer
Unlocking AI with Model Context Protocol (MCP)
Tartificialntelligence_presentation.pptx
Group 1 Presentation -Planning and Decision Making .pptx
A Presentation on Artificial Intelligence
Accuracy of neural networks in brain wave diagnosis of schizophrenia
DASA ADMISSION 2024_FirstRound_FirstRank_LastRank.pdf
cloud_computing_Infrastucture_as_cloud_p
Enhancing emotion recognition model for a student engagement use case through...
DP Operators-handbook-extract for the Mautical Institute
Digital-Transformation-Roadmap-for-Companies.pptx
Zenith AI: Advanced Artificial Intelligence
Heart disease approach using modified random forest and particle swarm optimi...
gpt5_lecture_notes_comprehensive_20250812015547.pdf
Getting Started with Data Integration: FME Form 101
Video forgery: An extensive analysis of inter-and intra-frame manipulation al...
From MVP to Full-Scale Product A Startup’s Software Journey.pdf
Ad

ZeroNights2013 testing of password policy

Editor's Notes

  • #6: Naïve model
  • #19: 0.007 2276 0.64185 rockyou-all zxcvbn common-passwords-none
  • #21: 0.1224% : 1 to 1000
  • #22: 0.01% : 1 to 10000.001% : 1 to 10000
  • #25: 1.72% of CMYIC was cracked
  • #33: 20K/s vs. 2000/s