Scaffolding for Serverless: lightning talk for AWS Arlington Meetup
2 likes530 views
The document outlines a serverless application scaffolding framework developed by Chris Shenton, which utilizes AWS technologies such as Lambda, S3, and DynamoDB. It describes the testing and documentation processes, CI/CD deployment strategies, and code quality checks including linting. Additionally, it provides instructions for building and deploying the application across various environments, while including contact information for further inquiries.
![Testing: py.test with test coverage
(.venv3) chris@Haruspex:scaffold-serverless$ make tests
PIP INSTALLING REQUIREMENTS
.venv3/bin/pip install -r requirements.txt
================================================= test session starts
plugins: cov-2.5.1
collected 1 item
tests/test_example.py .
[100%]Coverage.py warning: No data was collected. (no-data-collected)
--------- generated xml file:
/Users/chris/Projects/vstudios/scaffold-serverless/test-results/junit/junit.xml ---------
---------- coverage: platform darwin, python 3.6.3-final-0 -----------
Name Stmts Miss Branch BrPart Cover Missing
------------------------------------------------------------
app/handler.py 55 55 16 0 0% 1-93
Coverage HTML written to dir test-results/coverage
============================================== 1 passed in 2.53 seconds](https://image.slidesharecdn.com/scaffoldingforserverlesslightningtalkawsarlington-180228183841/85/Scaffolding-for-Serverless-lightning-talk-for-AWS-Arlington-Meetup-3-320.jpg)
![Documentation: Sphinx generates HTML, ePub
(.venv3) chris@Haruspex:scaffold-serverless$ make docs
cd docs && make SPHINXBUILD=../.venv3/bin/sphinx-build html singlehtml epub
Running Sphinx v1.6.7
reading sources... [ 20%] api
reading sources... [ 40%] cicd
reading sources... [ 60%] index
reading sources... [ 80%] stage-envs
reading sources... [100%] todo
generating indices... genindex
writing additional pages... search
copying images... [100%] cicd-dashboard.png
dumping search index in English (code: en) ... done
build succeeded.
Build finished. The HTML pages are in _build/html.
Build finished. The HTML page is in _build/singlehtml.
Build finished. The ePub file is in _build/epub.](https://image.slidesharecdn.com/scaffoldingforserverlesslightningtalkawsarlington-180228183841/85/Scaffolding-for-Serverless-lightning-talk-for-AWS-Arlington-Meetup-4-320.jpg)
![Code Smells: Linting with Flake8
(.venv3) chris@Haruspex:scaffold-serverless$ make flake8
.venv3/bin/flake8 app/
app/handler.py:73:52: E222 multiple spaces after operator
app/handler.py:95:1: W391 blank line at end of file
make: *** [flake8] Error 1](https://image.slidesharecdn.com/scaffoldingforserverlesslightningtalkawsarlington-180228183841/85/Scaffolding-for-Serverless-lightning-talk-for-AWS-Arlington-Meetup-5-320.jpg)
Scaffolding for Serverless: lightning talk for AWS Arlington Meetup
- 1. A Scaffolding for Serverless Apps Chris Shenton: CTO, V! Studios AWS Meetup Arlington VA 2018-02-27
- 2. Drudgery, Automated ● Test framework ● Documentation ● Code smells ● Multiple stages, environments ● CI/CD ● Deployment to cloud ● Starter app ○ Lambda with Python3 ○ File upload to S3 ○ Metadata to DynamoDB ○ Soon: Angular2+ front-end
- 3. Testing: py.test with test coverage (.venv3) chris@Haruspex:scaffold-serverless$ make tests PIP INSTALLING REQUIREMENTS .venv3/bin/pip install -r requirements.txt ================================================= test session starts plugins: cov-2.5.1 collected 1 item tests/test_example.py . [100%]Coverage.py warning: No data was collected. (no-data-collected) --------- generated xml file: /Users/chris/Projects/vstudios/scaffold-serverless/test-results/junit/junit.xml --------- ---------- coverage: platform darwin, python 3.6.3-final-0 ----------- Name Stmts Miss Branch BrPart Cover Missing ------------------------------------------------------------ app/handler.py 55 55 16 0 0% 1-93 Coverage HTML written to dir test-results/coverage ============================================== 1 passed in 2.53 seconds
- 4. Documentation: Sphinx generates HTML, ePub (.venv3) chris@Haruspex:scaffold-serverless$ make docs cd docs && make SPHINXBUILD=../.venv3/bin/sphinx-build html singlehtml epub Running Sphinx v1.6.7 reading sources... [ 20%] api reading sources... [ 40%] cicd reading sources... [ 60%] index reading sources... [ 80%] stage-envs reading sources... [100%] todo generating indices... genindex writing additional pages... search copying images... [100%] cicd-dashboard.png dumping search index in English (code: en) ... done build succeeded. Build finished. The HTML pages are in _build/html. Build finished. The HTML page is in _build/singlehtml. Build finished. The ePub file is in _build/epub.
- 5. Code Smells: Linting with Flake8 (.venv3) chris@Haruspex:scaffold-serverless$ make flake8 .venv3/bin/flake8 app/ app/handler.py:73:52: E222 multiple spaces after operator app/handler.py:95:1: W391 blank line at end of file make: *** [flake8] Error 1
- 6. Multiple Stages, Cloud Environments Repo Branch AWS Stage Environment Comment master prod conventional name for production systems release/* qa quality assurance before release to production develop dev default stage name for Serverless Framework feature/* $CIRCLE_USERNAME each developer gets their own environment, named after their GitHub username
- 7. CI/CD: CircleCI every branch -- build and test, then deploy
- 8. Deployment: to multiple AWS environments
- 9. Starter App: Lambda with Python, API, DynamoDB API Gateway /assets API Gateway /upload_url Lambda s3upload() Get file metadata from S3: name, size, etag; store to DynamoDB Lambda get_upload_url() Return presigned URL allowing upload without credentials Lambda get_assets() Return metadata as JSON or HTML DynamoDB Uploads id, size, etag, bucket S3 Bucket Uploads Save file metadata Read all metadata