| Senior Data Engineer at Austin, Texas, USA |
| Email: [email protected] |
| From: Himanshu Yadav, Innovyt [email protected] Reply to: [email protected] Position :: Senior Data Engineer Location :: Austin, TX Duration :: 6+ Months Responsibilities: Data Architecture: Develop and maintain scalable data architectures and pipelines on AWS to support data analytics and business intelligence. ETL Processes: Build and manage ETL processes to extract, transform, and load data from various sources into data warehouses and data lakes. Data Integration: Integrate data from multiple sources, ensuring data quality, consistency, and security. Performance Optimization: Optimize data processing workflows for performance, scalability, and cost-efficiency. Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs. Monitoring: Implement monitoring and alerting systems to ensure data pipeline reliability and performance. Documentation: Maintain comprehensive documentation of data architectures, pipelines, and processes. Qualifications: Education: Bachelor/Masters degree in computer science, Engineering, or a related field. Experience: 7+ years of experience in data engineering, with a focus on AWS-based solutions. Proven experience in designing and implementing data pipelines and architectures. Technical Skills: AWS Services: Proficiency in AWS services such as S3, Redshift, Glue, Lambda, EMR, and RDS. Programming Languages: Strong programming skills in Python. Big Data Technologies: Experience with big data technologies like Hadoop, Spark, and Kafka. Database Management: Proficiency in SQL and NoSQL databases. Data Modeling: Strong understanding of data modeling, data warehousing, and data lake concepts. DevOps: Familiarity with DevOps practices and tools (e.g., Docker, Kubernetes, Jenkins). Security: Knowledge of data security best practices and compliance requirements. Certifications: AWS Certified Data Engineer - Associate Soft Skills: Problem-Solving: Strong analytical and problem-solving skills. Communication: Excellent communication and interpersonal skills to interact with various stakeholders. Teamwork: Ability to work effectively in a collaborative team environment. Adaptability: Flexibility to adapt to changing business requirements and technologies. Keywords: sthree Texas Senior Data Engineer [email protected] |
| [email protected] View all |
| Tue Oct 15 01:33:00 UTC 2024 |