| AWS Big Data Engineer || Please share local to Columbus,OH /Plano,TX / Wilmington,DE only ||Please share H1B with passport number at Columbus, Ohio, USA |
| Email: [email protected] |
| AWS Big Data Engineer Columbus,OH /Plano,TX / Wilmington,DE Architecture Design: You'll be responsible for designing scalable, reliable, and cost-effective big data solutions on AWS. This involves selecting appropriate AWS services such as Amazon S3, Amazon EMR, Amazon Redshift, AWS Glue, etc., based on the specific requirements of the project. Data Ingestion: As a Big Data Engineer, you'll work on ingesting data from various sources into the AWS ecosystem. This could involve real-time data streaming using services like Amazon Kinesis or batch data ingestion using AWS Glue, AWS DataSync, or other tools. Data Storage and Management: You'll design data storage solutions on AWS, ensuring data is stored efficiently, securely, and in a format suitable for analysis. This might include leveraging Amazon S3 for object storage, Amazon DynamoDB for NoSQL databases, or Amazon RDS or Redshift for relational databases. Data Processing and Analysis: Utilizing services like Amazon EMR (Elastic MapReduce), AWS Glue, or AWS Lambda, you'll process and transform raw data into formats suitable for analysis. This could involve data cleansing, normalization, aggregation, or advanced analytics tasks. Data Visualization and Reporting: You might work closely with data analysts or data scientists to develop dashboards, reports, and visualizations using tools like Amazon QuickSight, Tableau, or other BI (Business Intelligence) tools. Optimization and Performance Tuning: Continuously optimize and fine-tune big data solutions to improve performance, scalability, and cost-efficiency. This could involve optimizing data processing workflows, tuning database configurations, or implementing caching strategies. Security and Compliance: Ensure that big data solutions on AWS adhere to security best practices and compliance requirements. This involves implementing encryption, access controls, and monitoring mechanisms to protect sensitive data and ensure regulatory compliance. Automation and Infrastructure as Code: Embrace infrastructure as code (IaC) practices using tools like AWS CloudFormation or Terraform to automate the provisioning and management of AWS resources, making deployments repeatable, consistent, and reliable. Collaboration and Communication: Work closely with cross-functional teams including data scientists, business analysts, and software developers to understand requirements, gather feedback, and deliver solutions that meet business needs. Continuous Learning and Improvement: Stay updated with the latest AWS services, best practices, and industry trends in big data technologies. Continuously seek opportunities to enhance your skills and knowledge through training, certifications, and hands-on experience. -- Keywords: business intelligence sthree information technology Delaware Ohio Texas AWS Big Data Engineer || Please share local to Columbus,OH /Plano,TX / Wilmington,DE only ||Please share H1B with passport number [email protected] |
| [email protected] View all |
| Fri May 17 01:51:00 UTC 2024 |