Design-Build Serverless JMS -to-S3 with AWS Lambda (code included)
Budget
Posted: 4 year ago
Opened
- Description
- MUST HAVE EXPERIENCE WITH JMS, AWS and Java Programming Language
We are building a streaming stack similar to the article below. Our source data resides as XML in a JMS endpoint. We need help with the following deliverables:
1. Design an AWS serverless architecture which allows us to ingest, transform and analyze the data from multiple sources including our JMS sources, Twitter, etc. using S3 as the storage layer and recommend which storage format and transformation tool would work best for AWS Analysis products (AWS Glue, Athena, QuickSight, etc) (i.e. JSON, Parquet, etc.)
2. (INGEST) Build, Test and Deploy (2) using our existing JMS sources (java JMS consumer code and credentials will be provided)
3. (TRANSFORM and LOAD) Test and Deploy Data Transformation from XML to recommended format.
4. Upload completed Java Code to our S3 bucket (or preferred resource)
5. Provide quick guide on how to add additional data sources in the future
RESOURCES:
Design - https://developer.amazon.com/blogs/alexa/post/8df2b229-c0f4-4333-85dc-131d6bffeb83/delivering-voice-powered-business-analytics-with-alexa-for-business
AWS Glue Classifiers for XML (see developers guide)
https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-format.html
JMS Connection Code to use with AWS Lambda will be provided
Skills:
architectural design,jms,amazon web services,classification,data analysis,Extensible Markup Language (XML),extract, transform and load (etl),Java programming language,json,load testing,S3 programming language,software development
- Category
Source: peopleperhour.com
Drag