Data engineer // Texas // Contract at Remote, Remote, USA |
Email: [email protected] |
Job Title: Data engineer Location: ( Texas) Duration: Contract Job Description : Job Requirements: Senior Data Engineer Responsibilities: Data Architecture: Develop and maintain scalable data architectures and pipelines on AWS to support data analytics and business intelligence. ETL Processes: Build and manage ETL processes to extract, transform, and load data from various sources into data warehouses and data lakes. Data Integration: Integrate data from multiple sources, ensuring data quality, consistency, and security. Performance Optimization: Optimize data processing workflows for performance, scalability, and cost-efficiency. Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs. Monitoring: Implement monitoring and alerting systems to ensure data pipeline reliability and performance. Documentation: Maintain comprehensive documentation of data architectures, pipelines, and processes. Qualifications: Education: Bachelor/Masters degree in computer science, Engineering, or a related field. Experience: 7+ years of experience in data engineering, with a focus on AWS-based solutions. Proven experience in designing and implementing data pipelines and architectures. Technical Skills: AWS Services: Proficiency in AWS services such as S3, Redshift, Glue, Lambda, EMR, and RDS. Programming Languages: Strong programming skills in Python. Big Data Technologies: Experience with big data technologies like Hadoop, Spark, and Kafka. Database Management: Proficiency in SQL and NoSQL databases. Data Modeling: Strong understanding of data modeling, data warehousing, and data lake concepts. DevOps: Familiarity with DevOps practices and tools (e.g., Docker, Kubernetes, Jenkins). Security: Knowledge of data security best practices and compliance requirements. Certifications: AWS Certified Data Engineer - Associate The information transmitted is intended only for the person or entity to which it is addressed and may contain confidential and/or privileged material. Any review, retransmission, dissemination or other use of, or taking of any action in reliance upon this information by persons or entities other than the intended recipient is prohibited. If you received this in error, please contact the sender and delete the material from any computer. -- Keywords: sthree information technology Data engineer // Texas // Contract [email protected] |
[email protected] View all |
Tue Oct 29 21:33:00 UTC 2024 |