| Senior Data Engineer - Phoenix, AZ (Remote but need only local profiles ) at Phoenix, Arizona, USA |
| Email: [email protected] |
| Job Posting Title: Senior Data Engineer Description: POSITION TITLE: Sr Data Engineer Location : Phoenix, AZ (Remote but need only local profiles ) Additional notes: Mandatory experience: DynamoDB, Marklogic, Javascript, Python and AWS Lambda POSITION SUMMARY: Their role is to develop, enhance and support data pipelines using Informatica Power center, AWS and Snowflake. PROJECT INFORMATION: Contractor will be working on the Modernizers team, EAM BI team. Their role is to develop, enhance and support data pipelines using Informatica Power center, AWS and Snowflake. PRINCIPAL RESPONSIBILITIES: Designs and develops code and data pipelines to ingest from relational databases (Oracle, SQL Server, DB2, Aurora), file shares, and web services. Design and build Informatica Power Center mappings and workflows Streaming ingestion with Kinesis Streams, Kinesis Firehose, Kinesis Analytics and Kafka (MSK) Build Data Lake on AWS S3 with optimal performance considerations by partitioning and compressing data. Data Engineering and Analytics using AWS Glue, Informatica, EMR, Spark, Athena, Python. Data modeling and building Data Warehouse using Snowflake. Designs and develops code and data pipelines to ingest relational databases, file shares, and webservices. Designs JavaScript modules and REST APIs utilizing MarkLogic to support complex searches. Develops MarkLogic integrations with existing enterprise platforms. Participates in requirements definition, system architecture design, and data architecture design. Participates in all aspects of the software life cycle using Agile development methodologies. Build and design Informatica Power Center mappings and workflows MINIMUM QUALIFICATIONS: Bachelors degree in Computer Science, Computer Information Systems, Engineering, Statistics or closely related field (willing to accept foreign education equivalent) (required). Experience in AWS services for data and analytics (required). 5 years of experience in Data Ingestion, Data Extraction, and Data Integration (required). PREFERRED QUALIFICATIONS: 5+ years of experience in Enterprise Information Solution Architecture, Design, and development required. 5+ years of experience with integration architectures such as SOA, Microservices, ETL or other integration technologies. 5+ years of experience with working content or knowledge management systems, search engines, relational databases, NoSQL databases, ETL tools, geospatial systems, or semantic technology. 3+ years of hands-on experience with a MarkLogic framework , DynamoDB preferred. 3+ years of hands-on experience with AWS services ( S3, Kinesis, Lambda, Athena, Glue, EMR) required. 3+ years of analytics tools like SAS, R, Python, and other advanced statistical software. 3+ years of Web development experience with Angular, JavaScript, and Node.js. Experience with JSON or XML data modeling required. Experience with Git/GitHub, branching, and other modern source code management methodologies required. Domain knowledge of NoSQL or relational database required. Understanding of database architecture and performance implications required. Experience with Machine Learning and Artificial Intelligence. Ability to multi-task effectively. Ability to work collaboratively as part of an Agile Team. Extensive knowledge and experience with Python, JavaScript and Java. Excellent written and verbal communication skills, sense of ownership, urgency and drive. -- Keywords: javascript business intelligence sthree rlang information technology Arizona Senior Data Engineer - Phoenix, AZ (Remote but need only local profiles ) [email protected] |
| [email protected] View all |
| Wed Jun 19 00:13:00 UTC 2024 |