| Staff Data Engineer -- at Remote, Remote, USA |
| Email: [email protected] |
| Staff Data Engineer Need only Locals to Texas - Responsibilities: Data Architecture: Design, develop, and maintain scalable data architectures and pipelines on AWS to support data analytics and business intelligence. ETL Processes: Build and manage ETL processes to extract, transform, and load data from various sources into data warehouses and data lakes. Data Integration: Integrate data from multiple sources, ensuring data quality, consistency, and security. Performance Optimization: Optimize data processing workflows for performance, scalability, and cost-efficiency. Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs. Monitoring: Implement monitoring and alerting systems to ensure data pipeline reliability and performance. Documentation: Maintain comprehensive documentation of data architectures, pipelines, and processes. Qualifications: Education: Bachelor/Masters degree in computer science, Engineering, or a related field. Experience: 10+ years of experience in data engineering, with a focus on AWS-based solutions. Proven experience in designing and implementing data pipelines and architectures. Technical Skills: AWS Services: Proficiency in AWS services such as S3, Redshift, Glue, Lambda, EMR, and RDS. Programming Languages: Strong programming skills in Python. Big Data Technologies: Experience with big data technologies like Hadoop, Spark, and Kafka. Database Management: Proficiency in SQL and NoSQL databases. Data Modeling: Strong understanding of data modeling, data warehousing, and data lake concepts. DevOps: Familiarity with DevOps practices and tools (e.g., Docker, Kubernetes, Jenkins). Security: Knowledge of data security best practices and compliance requirements. Certifications: AWS Certified Data Engineer - Associate AWS Certified Data Analytics Specialty Soft Skills: Problem-Solving: Strong analytical and problem-solving skills. Communication: Excellent communication and interpersonal skills to interact with various stakeholders. Teamwork: Ability to work effectively in a collaborative team environment. Adaptability: Flexibility to adapt to changing business requirements and technologies. The information transmitted is intended only for the person or entity to which it is addressed and may contain confidential and/or privileged material. Any review, retransmission, dissemination or other use of, or taking of any action in reliance upon this information by persons or entities other than the intended recipient is prohibited. If you received this in error, please contact the sender and delete the material from any computer. -- Keywords: sthree information technology Staff Data Engineer -- [email protected] |
| [email protected] View all |
| Wed Oct 16 20:13:00 UTC 2024 |