testing.md

End-to-end Testing instructions

Pre-requisites

This project uses Amazon Rekognition and can be run in one of three regions:

• US East (N. Virginia)
• US West (Oregon)
• EU (Ireland)

3 Lambda functions with Python 3.6 runtime are deployed as part of this project. The scripts are located in lambdas directory.

A cloudformation template: ddr.template has been provided to automate the server side infrastructure. The lambda scripts are uploaded as zip files and can be sourced only from S3 buckets in the same region.

Upload Lambda assets

1. Pick a region to host the project: us-east-1, us-west-2 or eu-west-1.
2. Create or re-use a bucket in region: aws s3 mb s3://<bucket-name> --region <region>
3. Deploy lambda functions using deploy_lambda.sh ./deploy_lambda.sh <bucket-name> <region>

Create or re-use a key pair

aws ec2 create-key-pair --key-name ddr-pdx --query 'KeyMaterial' --output text > ~/.ssh/ddr-pdx.pem; chmod 600 ~/.ssh/ddr-pdx.pem

Server Setup

Launch cloudformation stack to setup server resources

Use the console or launch using cli. See ddr_test_params.json for an example. You will need to provide:

• Key-pair
• Lambda Assets bucket name
• ID of your default or chosen VPC
• Two subnets in your VPC
• IP range for remote access (0.0.0.0/0 will be public access)

Cloudformation cli command:

aws cloudformation --region ${REGION} create-stack --stack-name ddr-stack \
  --template-body file://ddr.template \
  --parameters file://ddr_test_params.json \
  --capabilities "CAPABILITY_IAM"

Run scripts on server

1. Use the console or CLI to get the public ip of the instance launched. Substitute STACK_ID and REGION below.

aws cloudformation describe-stacks --stack ${STACK_ID} --region ${REGION} \
   | jq '.[]|.[]|.Outputs|.[]|select(.OutputKey == "DdrEC2PublicIp")|.OutputValue'

2. SSH to the EC2 server with the IP identified above ssh -i ddr-pdx.pem [email protected]

3. Execute setup script and run server process

• setup_bucket_notifications.sh - sets up notification events for s3 bucket and prepares ddr_config.props
• run_server.sh runs three processes:
  • sqs_poller - Processes incoming files on S3 notified to SQS
  • ddr_runner - computes scores and runs rekognition commands
  • op_server - Openpose server running zeromq endpoint. Listens on incoming requests and processes images

   cd ~/ddr
   git pull
   cd scripts
   ./setup_bucket_notifications.sh
   ./run_server.sh

4. Deploy webapp to created s3 webapp bucket

   cd ~/ddr
   ./deploy_webapp.sh

Raspberry PI

• Follow instructions in ddr_raspi/README.md
• It will create a S3 bucket
• See instructions in section: Run ddr_camera.py

Final Testing

Ensure the following:

• ddr_camera is running on raspberry pi

• run_server.sh has been executed on openpose EC2 instance

  • ps -ef | grep python and ps -ef | grep op_server should list the processes e.g.

    ubuntu@ip-172-31-9-99:~/ddr$ ps -ef | grep python
    ubuntu    2861     1  0 02:34 pts/1    00:00:35 python -m ddr_server.ddr_runner
    ubuntu    2862     1 16 02:34 pts/1    00:23:10 python -m ddr_server.sqs_poller
    ubuntu    3383  3282  0 04:56 pts/0    00:00:00 grep --color=auto python
    ubuntu@ip-172-31-9-99:~/ddr$ ps -ef | grep op_server
    ubuntu    2863     1  0 02:34 pts/1    00:00:06 ./build/examples/tutorial_pose/op_server.bin
    ubuntu    3385  3282  0 04:56 pts/0    00:00:00 grep --color=auto op_server

• Verify scores on the S3 website. Substitute bucket name and region.

  • Image: e.g. http://ddr-stack-20171028-220958-s3ddrwebapp-rvsrxjt4l0e.s3-website-us-east-1.amazonaws.com/images.html
  • Score: e.g. http://ddr-stack-20171028-220958-s3ddrwebapp-rvsrxjt4l0e.s3-website-us-east-1.amazonaws.com/scoreboard_v2_save_last.html

• Inspecting the API Gateway output. Substitute endpoint and region in the url below

  • Score: e.g. https://as8oin2dc6.execute-api.us-east-1.amazonaws.com/prod/score?lek=null
  • Image: e.g. https://as8oin2dc6.execute-api.us-east-1.amazonaws.com/prod/image?lek=null