| Hiring for Data Engineer (PA, NJ, NY - Hybrid, No H1b) at Remote, Remote, USA |
| Email: [email protected] |
| From: Lokesh Shiv, Paramount Software Solutions Inc [email protected] Reply to: [email protected] Data Engineer with Strong Pyspark (No H1b) Location: PA, NJ, NY (Hybrid, F2F) Duration: 6+ months Job Details: Candidates with strong PySpark/Python experience First round is on Teams Video FINAL ROUND ONSITE INTERVIEW in Jersey City, NJ, New York City, or Pittsburgh, PA- Someone who can be ONSITE in Pittsburgh, PA for DAY 1 of the project Key Responsibilities: Design, develop, and maintain scalable data pipelines using Python and PySpark. Work with Hadoop ecosystems to manage and process large-scale datasets. Develop and optimize data workflows using Apache Spark with Java. Implement and maintain ETL processes to collect, process, and transform data from various sources. Collaborate with data scientists, analysts, and other stakeholders to ensure data availability and integrity. Deploy, monitor, and manage data infrastructure on AWS cloud services (e.g., S3, EMR, Lambda, Redshift). Ensure data security and compliance with industry standards. Troubleshoot and resolve issues related to data processing and infrastructure. Optimize performance and scalability of data solutions. Stay up-to-date with the latest developments in big data technologies and cloud computing. Required Qualifications: Minimum 10+ years of experience as a Data Engineer or in a similar role. Strong programming skills in Python and Java. Hands-on experience with PySpark and Apache Spark for data processing. Proficiency with Hadoop ecosystems (e.g., HDFS, Hive, MapReduce). Experience with AWS cloud services, including S3, EMR, Lambda, and Redshift. Knowledge of data warehousing concepts and ETL processes. Strong problem-solving skills and ability to troubleshoot complex data issues. Bachelors or Masters degree in Computer Science, Information Technology, or a related field. Preferred Qualifications: Experience with other big data tools and technologies (e.g., Kafka, Airflow) Knowledge of DevOps practices for data engineering (CI/CD pipelines, infrastructure as code). Familiarity with database management systems (e.g., PostgreSQL, MySQL). Certification in AWS or other relevant technologies. Regards, Lokesh Shiv Direct: 770 456 5707 Email: [email protected] Keywords: continuous integration continuous deployment sthree New Jersey New York Pennsylvania Hiring for Data Engineer (PA, NJ, NY - Hybrid, No H1b) [email protected] |
| [email protected] View all |
| Tue Aug 27 20:21:00 UTC 2024 |