| AWS Data Engineer/Architect - Exp - 15+ min - Remote role at Remote, Remote, USA |
| Email: [email protected] |
| Position : Data Engineer/Architect - AWS Location : Remote role Duration : Long Term Contract Responsibilities Develop technical architecture to achieve more modular, cloud centric, API and streaming driven architecture for agile delivery. Migrating On-Premise solution to cloud including Teradata Vantage Develop data pipelines to integrate with enterprise data steams – Cloud and on-perm Collaborate on architecture decisions and develop solutions in AWS – Including Python, Databricks, Redshift, elastic search, DynamoDB, Lambda, Kinesis, Glue and AI/ML tools. Create Proof of concepts, innovate and integrate cloud-based software in a continuous delivery environment. Lead multiple activities including but not limited to data models, solution, design data pipeline, APIs, partner integrations, and cloud infrastructure. Skills: Experience with AWS capabilities – Databricks, dynamoDB, Lambda, Redshift, elastic search. Experience with API and Streaming technologies. Software development experience with Python, PySpark, Apache Spark and Kafka Strong knowledge of Data Integration (e.g. Streaming, Batch, Error and Replay) and data analysis techniques. Experience with GitHub, Jenkins, and Terraform. Experience with Teradata (Vantage) or any RDBMS system/ ETL Tools Good experience on designing and developing data pipelines for data ingestion and transformation using Spark. Excellent in trouble shooting the performance and data skew issues. Deep knowledge in partitioning, bucketing concepts of data ingestion. Working knowledge on the implementation of data lake ETL using AWS glue, Databricks etc. Proficiency in SQL, relational and non-relational databases, query optimization and data modelling. Expertise in designing technical solutions using object-oriented design concepts Excellent communication skills Provide recommendations and design optimal configurations for large-scale deployments. Be passionate about resolving user pain points through great design. Be open to receiving feedback and constructive criticism. Education: Bachelor's degree REQUIRED 8+ years of diverse Technology experience with a minimum of 5 years of experience in Software development with Bachelor in Computer Science or equivalent trade. SQL or AWS Certification preferred Skills and Experience: Required Skills: DATA PIPELINES GITHUB TERADATA VANTAGE STREAMING Additional Skills: DATA INTEGRATION SQL JENKINS VANTAGE STREAMING Additional Skills: DATA INTEGRATION SQL JENKINS TERRAFORM PERM DATA ANALYSIS SOFTWARE DESIGN PYTHON DATABASE SYSTEMS AMAZON WEB SERVICES KAFKA TECHNICAL ARCHITECTURE SOURCE CODE CONTROL CONTINUOUS INTEGRATION/DELIVERY LARGE-SCALE DATABASE MODELING RDBMS EXCELLENT COMMUNICATION SKILLS MARKETING ANALYSIS AMAZON DYNAMODB GITLAB CONTROL SYSTEMS Thanks, Prashanth -- Keywords: artificial intelligence machine learning information technology wtwo AWS Data Engineer/Architect - Exp - 15+ min - Remote role [email protected] |
| [email protected] View all |
| Thu Oct 24 21:04:00 UTC 2024 |