SlideShare a Scribd company logo
CPAN realtime feed
       Tatsuhiko Miyagawa
   YAPC::Asia 2009 lightning talks
CPAN authors?
(upload your module now)
What happens
when a new module is
 uploaded to CPAN
PAUSE
Perl Author Upload Server
Author:
uploads a module
5s
PAUSE:
index the module
~30s
QA mirrors:
fetches the diff
~20s
QA mirrors:
 reindex
1 hour
Other mirrors:
  rsync diffs
1~24 hour
Users:
update CPAN.pm cache
24 hours
 (default)
Upload (10s)
PAUSE index (30s)
QA mirrors sync (20s)
QA reindex (1h)
rsync mirrors (~24h)
CPAN cache (~24h)
~48 hours
Not cool.
A solution:
CPAN Realtime feed
friendfeed.com/cpan
The bot
Fetching QA’s diffs
Upload (10s)
PAUSE index (30s)
QA mirrors sync (20s)
QA reindex (1h)
rsync mirrors (~24h)
CPAN cache (~24h)
FriendFeed:
XMPP, APIs, Feeds
 PubSubHubbub
cpanf
(App::CPAN::Fresh)
Install CPAN modules
  via real time feeds
DEMO
(might fail.)

More Related Content

PPTX
Meet Akka gRPC
PPTX
C100 k and go
ODP
Trash Robotic Router Platform
PPT
Alchemy Catalyst Automation
PDF
Flink Forward Berlin 2017: Matt Zimmer - Custom, Complex Windows at Scale Usi...
PDF
What is new with JavaScript in Gnome: The 2021 edition
PPTX
Master C++ compilers
Meet Akka gRPC
C100 k and go
Trash Robotic Router Platform
Alchemy Catalyst Automation
Flink Forward Berlin 2017: Matt Zimmer - Custom, Complex Windows at Scale Usi...
What is new with JavaScript in Gnome: The 2021 edition
Master C++ compilers

What's hot (20)

PDF
MongoDB World 2016: Implementing Async Networking in MongoDB 3.2
PPTX
Introduction to GraalVM
PDF
Native Java with GraalVM
PPTX
C# 5 deep drive into asynchronous programming
PDF
Synchronizing parallel delivery flows in jenkins using groovy, build flow and...
PDF
Flink Forward Berlin 2017: Piotr Wawrzyniak - Extending Apache Flink stream p...
PDF
Types - slice, map, new, make, struct - Gopherlabs
PPTX
Async in .NET
PDF
Async/Await Best Practices
PDF
Big data: Loading your data with flume and sqoop
PPTX
Scrum-ban: Time-boxes and flow
PPTX
Java 7 & 8
PDF
Flink Forward Berlin 2017: Zohar Mizrahi - Python Streaming API
PDF
What's coming in Airflow 2.0? - NYC Apache Airflow Meetup
PPTX
Quick test professional (qtp) online training
PPTX
Open Source Load Testing: JMeter, Gatling and Taurus
PDF
Ceilometer juno-midpoint
PDF
Flink Forward Berlin 2017: Andreas Kunft - Efficiently executing R Dataframes...
PDF
KubeCon EU 2016: Leveraging ephemeral namespaces in a CI/CD pipeline
PDF
Flink Forward Berlin 2017: Maciek Próchniak - TouK Nussknacker - creating Fli...
MongoDB World 2016: Implementing Async Networking in MongoDB 3.2
Introduction to GraalVM
Native Java with GraalVM
C# 5 deep drive into asynchronous programming
Synchronizing parallel delivery flows in jenkins using groovy, build flow and...
Flink Forward Berlin 2017: Piotr Wawrzyniak - Extending Apache Flink stream p...
Types - slice, map, new, make, struct - Gopherlabs
Async in .NET
Async/Await Best Practices
Big data: Loading your data with flume and sqoop
Scrum-ban: Time-boxes and flow
Java 7 & 8
Flink Forward Berlin 2017: Zohar Mizrahi - Python Streaming API
What's coming in Airflow 2.0? - NYC Apache Airflow Meetup
Quick test professional (qtp) online training
Open Source Load Testing: JMeter, Gatling and Taurus
Ceilometer juno-midpoint
Flink Forward Berlin 2017: Andreas Kunft - Efficiently executing R Dataframes...
KubeCon EU 2016: Leveraging ephemeral namespaces in a CI/CD pipeline
Flink Forward Berlin 2017: Maciek Próchniak - TouK Nussknacker - creating Fli...
Ad

Viewers also liked (9)

KEY
Wight: Phantom’s Perl friend - YAPC::Asia 2012
KEY
Deploying Plack Web Applications: OSCON 2011
KEY
Remedie: Building a desktop app with HTTP::Engine, SQLite and jQuery
PDF
No Hugging, No Learning
PDF
Carton CPAN dependency manager
PDF
Network Programming With Anyevent
KEY
Intro to PSGI and Plack
KEY
Wight: Phantom’s Perl friend - YAPC::Asia 2012
Deploying Plack Web Applications: OSCON 2011
Remedie: Building a desktop app with HTTP::Engine, SQLite and jQuery
No Hugging, No Learning
Carton CPAN dependency manager
Network Programming With Anyevent
Intro to PSGI and Plack
Ad

Similar to CPAN Realtime feed (20)

ODP
CPAN Module Maintenance
PDF
Oleksandr Tarasenko "Using Kafka in your python applications"
PDF
Using Kafka in your python application - Python fwdays 2020
PDF
Introduction to Apache Beam & No Shard Left Behind: APIs for Massive Parallel...
PPT
Revisiting ppm
PDF
Evolution of kube-proxy (Brussels, Fosdem 2020)
PDF
Adopt DevOps philosophy on your Symfony projects (Symfony Live 2011)
PDF
rhaco updates - php conference japan 2010
PDF
Running large scale Kafka upgrades at Yelp (Manpreet Singh,Yelp) Kafka Summit...
PPTX
Kanban Method July 2018
PDF
WSO2 API Manager Community Call - November 2021
PDF
Flink Forward Berlin 2017: Aljoscha Krettek - Talk Python to me: Stream Proce...
PPTX
Ad Server Optimization
PDF
Open Source tools overview
PDF
Monitoring Kafka w/ Prometheus
PPTX
Mitigating Security Threats with Fastly - Joe Williams at Fastly Altitude 2015
KEY
Plack perl superglue for web frameworks and servers
KEY
Modern Commandline Tool
PPTX
Talk Python To Me: Stream Processing in your favourite Language with Beam on ...
PPTX
Test-Driven Infrastructure with Puppet, Test Kitchen, Serverspec and RSpec
CPAN Module Maintenance
Oleksandr Tarasenko "Using Kafka in your python applications"
Using Kafka in your python application - Python fwdays 2020
Introduction to Apache Beam & No Shard Left Behind: APIs for Massive Parallel...
Revisiting ppm
Evolution of kube-proxy (Brussels, Fosdem 2020)
Adopt DevOps philosophy on your Symfony projects (Symfony Live 2011)
rhaco updates - php conference japan 2010
Running large scale Kafka upgrades at Yelp (Manpreet Singh,Yelp) Kafka Summit...
Kanban Method July 2018
WSO2 API Manager Community Call - November 2021
Flink Forward Berlin 2017: Aljoscha Krettek - Talk Python to me: Stream Proce...
Ad Server Optimization
Open Source tools overview
Monitoring Kafka w/ Prometheus
Mitigating Security Threats with Fastly - Joe Williams at Fastly Altitude 2015
Plack perl superglue for web frameworks and servers
Modern Commandline Tool
Talk Python To Me: Stream Processing in your favourite Language with Beam on ...
Test-Driven Infrastructure with Puppet, Test Kitchen, Serverspec and RSpec

More from Tatsuhiko Miyagawa (20)

KEY
Plack at OSCON 2010
KEY
cpanminus at YAPC::NA 2010
KEY
Plack at YAPC::NA 2010
KEY
PSGI/Plack OSDC.TW
KEY
Plack - LPW 2009
PDF
Asynchronous programming with AnyEvent
PDF
Building a desktop app with HTTP::Engine, SQLite and jQuery
PPT
Remedie OSDC.TW
PDF
Why Open Matters It Pro Challenge 2008
PDF
20 modules i haven't yet talked about
PPT
Web::Scraper for SF.pm LT
PPT
Web Scraper Shibuya.pm tech talk #8
PPT
Web::Scraper
PPT
XML::Liberal
PPT
Test::Base
PPT
Hacking Vox and Plagger
PPT
Plagger the duct tape of internet
PPT
Tilting Google Maps and MissileLauncher
PPT
Writing Pluggable Software
PPT
How we build Vox
Plack at OSCON 2010
cpanminus at YAPC::NA 2010
Plack at YAPC::NA 2010
PSGI/Plack OSDC.TW
Plack - LPW 2009
Asynchronous programming with AnyEvent
Building a desktop app with HTTP::Engine, SQLite and jQuery
Remedie OSDC.TW
Why Open Matters It Pro Challenge 2008
20 modules i haven't yet talked about
Web::Scraper for SF.pm LT
Web Scraper Shibuya.pm tech talk #8
Web::Scraper
XML::Liberal
Test::Base
Hacking Vox and Plagger
Plagger the duct tape of internet
Tilting Google Maps and MissileLauncher
Writing Pluggable Software
How we build Vox

Recently uploaded (20)

PDF
Encapsulation_ Review paper, used for researhc scholars
PDF
Electronic commerce courselecture one. Pdf
PDF
Spectral efficient network and resource selection model in 5G networks
PDF
Approach and Philosophy of On baking technology
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
PDF
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
PPTX
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
PPTX
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
PDF
NewMind AI Weekly Chronicles - August'25 Week I
PDF
Building Integrated photovoltaic BIPV_UPV.pdf
PPTX
Cloud computing and distributed systems.
PPTX
Programs and apps: productivity, graphics, security and other tools
PDF
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
PDF
Encapsulation theory and applications.pdf
PPT
“AI and Expert System Decision Support & Business Intelligence Systems”
PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
PDF
Chapter 3 Spatial Domain Image Processing.pdf
PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
Encapsulation_ Review paper, used for researhc scholars
Electronic commerce courselecture one. Pdf
Spectral efficient network and resource selection model in 5G networks
Approach and Philosophy of On baking technology
Advanced methodologies resolving dimensionality complications for autism neur...
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
NewMind AI Weekly Chronicles - August'25 Week I
Building Integrated photovoltaic BIPV_UPV.pdf
Cloud computing and distributed systems.
Programs and apps: productivity, graphics, security and other tools
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
Encapsulation theory and applications.pdf
“AI and Expert System Decision Support & Business Intelligence Systems”
Mobile App Security Testing_ A Comprehensive Guide.pdf
Chapter 3 Spatial Domain Image Processing.pdf
Dropbox Q2 2025 Financial Results & Investor Presentation
Digital-Transformation-Roadmap-for-Companies.pptx
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows

CPAN Realtime feed