Python Spark Developer at Columbus, Ohio, USA |
Email: [email protected] |
From: manisha, Largeton [email protected] Reply to: [email protected] Hello! Hope you are doing well. I would like to share job description with you. Please review and help us to find suitable candidat e. Title:: Python Spark Developer Location:: Columbus, OH (Locals are preferred within a 60 to 80 miles distance) - onsite , local required MOI:: Call/ video I need the below information for every submission: Resume, 5 pages that includes candidate contact information Linkedin Profile with photo Photo ID with the candidate's legal name I94 required for submission Duties and responsibilities: 8+ Years Collaborate with the team to build out features for the data platform and consolidate data assets Build, maintain and optimize data pipelines built using Spark Advise, consult, and coach other data professionals on standards and practices Work with the team to define company data assets Migrate CMS data platform into Chases environment Partner with business analysts and solutions architects to develop technical architectures for strategic enterprise projects and initiatives Build libraries to standardize how we process data Loves to teach and learn, and knows that continuous learning is the cornerstone of every successful engineer Has a solid understanding of AWS tools such as EMR or Glue, their pros and cons and is able to intelligently convey such knowledge Implement automation on applicable processes Mandatory Skills: 5+ years of experience in a data engineering position Proficiency is Python (or similar) and SQL Strong experience building data pipelines with Spark Strong verbal & written communication Strong analytical and problem-solving skills Experience with relational datastores, NoSQL datastores and cloud object stores Experience building data processing infrastructure in AWS. Bonus skills: Bonus: Experience with infrastructure as code solutions, preferably Terraform. Bonus: Cloud certification. Bonus: Production experience with ACID compliant formats such as Hudi, Iceberg or Delta Lake. Bonus: Familiar with data observability solutions, data governance frameworks Requirements. Thanks, and Regards Manisha Gupta LARGETON INC. 13800 Coppermine Rd, Herndon, VA 20171 Disclaimer: Largeton is an equal opportunity employer. There is no discrimination based on race, color, religion, sex, national origin, age, disability, or any other protected status. Keywords: Idaho Ohio Virginia Python Spark Developer [email protected] |
[email protected] View all |
Wed Jul 10 20:39:00 UTC 2024 |