| Looking for 10+ Years - Python Data Engineer at Mclean, VA (Hybrid) at Mclean, Virginia, USA |
| Email: [email protected] |
| From: Karthick, Exaways [email protected] Reply to: [email protected] Hi Hope you are doing well This is Karthick from Exaways Corporation. We have an urgent requirement for the below position, if you are interested, please share your updated resume with below details. Role: Data Engineer Location: Mclean, VA (Hybrid) Mode: Contract Job Description: Hiring Manager Thoughts: This is a data platform team. They need data engineering and data architecture and that they have to do using Python. The team is looking for someone who can help the team to build data pipeline using YAML files. Good experience with Python AND PySpark experience is must. At least 3-5 experience as a Data Engineer. All the work is focused on Python mainly on programming side. Good SQL is mandatory. Basic knowledge on AWS would be good. Any database experience is fine unless he is good on SQL. The person will be making API call using Python. Boto3 is good to have which is Python SDK. Supplier Vetting Questions 1) Please describe your data engineering experience. Please provide examples of a big data problems you've solved using PySpark. 2) Please describe your experience using OLAP databases. Which databases have you used and what for Detailed Job Description: Position Overview: Develop data filtering, transformational and loading requirements Define and execute ETLs using Apache Sparks on Hadoop among other Data technologies Determine appropriate translations and validations between source data and target databases Implement business logic to cleanse & transform data Design and implement appropriate error handling procedures Develop project, documentation and storage standards in conjunction with data architects Monitor performance, troubleshoot and tune ETL processes as appropriate using tools like in the AWS ecosystem. Create and automate ETL mappings to consume loan level data source applications to target applications Execution of end-to-end implementation of underlying data ingestion workflow. Operations and Technology: Leverage and align work to appropriate resources across the team to ensure work is completed in the most efficient and impactful way Understand capabilities of and current trends in Data Engineering domain Qualifications At least 5 years of experience developing in Python, SQL (postgres/snowflake preferred) Bachelors degree with equivalent work experience in computer science, data science or a related field. Experience working with different Databases and understanding of data concepts (including data warehousing, data lake patterns, structured and unstructured data) 3+ years experience of Data Storage/Hadoop platform implementation, including 3+ years of hands-on experience in implementation and performance tuning Hadoop/Spark implementations. Implementation and tuning experience specifically using Amazon Elastic Map Reduce (EMR). Implementing AWS services in a variety of distributed computing, enterprise environments. Experience writing automated unit, integration, regression, performance and acceptance tests Solid understanding of software design principles If interested, Please share below details along with your updated resume Full Name (As per passport) : Mobile number: Email ID: Current Location: LinkedIn URL : Passport Number: Visa Type/Work Authorization: Currently in project(Yes/NO): Interview Availability: Reason for Job Change Rate Expectations: Education Details (Bachelors and Masters with Completion Year): Thanks & Regards Karthick Senior Technical Recruitment Specialist Exaways Corporation Desk: +1 650-850-5010 #505 Mobile: +1 650-640-4041 #35640 Fremont Blvd, St. 634 | Fremont, CA, 94536 Kindly Email or Text me if I missed your call Disclaimer: This email and any attachments are sent in strictest confidence for the sole use of the addressee and may contain legally privileged, confidential, and proprietary data. If you are not the intended recipient, please advise the sender by replying promptly to this email and then delete and destroy this email and any attachments without any further use, copying or forwarding. Keywords: rlang California Idaho Virginia |
| [email protected] View all |
| Tue Dec 12 23:05:00 UTC 2023 |