| Data ETL Developer Newark 2 days onsite 10 years exp at Newark, New Jersey, USA |
| Email: [email protected] |
| From: malini, Smacforce consulting LLC [email protected] Reply to: [email protected] Hi all, We are hiring Data ETL Developer Newark- 2 days onsite please share the relevant profile Position: Data ETL Developer Length: Up to 18 months contract Location : Newark- 2 days onsite Responsibilities: Design and implement scalable and efficient data architectures on cloud platforms such as Amazon Web Services (AWS) and Microsoft Azure. Define data storage, processing, and integration patterns that meet business requirements and ensure optimal performance. Data Pipeline Development Develop and maintain robust and scalable data pipelines to extract, transform, and load (ETL) data from diverse sources into cloud-based data systems. Implement data integration workflows, data transformations, and error handling mechanisms to ensure data accuracy and reliability. Data Transformation and Processing Apply data transformation techniques to clean, normalize, and enrich data for analysis and reporting purposes. Implement data processing workflows using technologies like Apache Spark or cloud-native services such as AWS Glue, DBT etc. Implement data quality checks, data profiling, and data validation processes to ensure data accuracy, completeness, and consistency. Identify and resolve data quality issues and collaborate with data stakeholders to improve data quality standards. Design and implement data warehousing solutions on cloud platforms, utilizing technologies like AWS Redshift, Snowflake. Optimize data storage, indexing, and partitioning strategies for efficient data retrieval and analysis. Implement data security measures, access controls, and encryption mechanisms to ensure the confidentiality and integrity of sensitive data in the cloud environment. Ensure compliance with relevant data protection regulations and industry best practices. Monitor and optimize the performance of data pipelines and data processing workflows. Identify and resolve performance bottlenecks, implement caching mechanisms, and fine-tune data retrieval and processing queries. Skills Required Bachelor's degree in Computer Science, Software Engineering, or a related field (Master's degree preferred). Proven experience as a Data Engineer or similar role, with a focus on cloud-based data engineering. Strong expertise in AWS cloud platforms and related services like S3, EC2, Lambda, Glue etc. Proficiency in programming language Python, for data engineering and scripting tasks. Experience working in Hadoop or other big data platforms Exposure to deploying code through pipeline Good exposure to Containers like ECS or Docker Direct experience supporting multiple business units for foundational data work and sound understanding of capital markets within Fixed Income Experience with data integration and ETL tools like Apache Spark, DBT or cloud-native solutions. Familiarity with data warehousing concepts and technologies like Redshift, Snowflake, or Synapse Analytics. Solid understanding of data modeling, data governance, and data quality principles. Knowledge of SQL, database systems, and data querying optimization techniques. Malinig 2676494530 SMACFORCE CONSULTING Keywords: sthree |
| [email protected] View all |
| Fri Jan 26 19:40:00 UTC 2024 |