| Job Description: Cloud Data Engineer at Remote, Remote, USA |
| Email: [email protected] |
| From: Arun, 3ktechnologies [email protected] Reply to: [email protected] Hi ALL, We are looking for a Cloud Data Engineer, It is a hybrid working (2-3 days in a week) position on C2C at the location of Onsite(NY/NJ), Please do let me know if youre comfortable with onsite and the location of the position. *NOTE: In-person client interview at NY/NJ is mandatory Job Title: Cloud Data Engineer Location: hybrid working (2-3 days in a week NY/NJ) Type: C2C Job Description: This position is for a Cloud Data engineer with a background in SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business analyst expertise. Major Responsibilities: Design, develop, and deploy Databricks jobs to process and analyse large volumes of data. Collaborate with data engineers and data scientists to understand data requirements and implement appropriate data processing pipelines. Optimize Databricks jobs for performance and scalability to handle big data workloads. Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks. Implement best practices for data management, security, and governance within the Databricks environment. Experience designing and developing Enterprise Data Warehouse solutions. Demonstrated proficiency with Data Analytics, Data Insights Proficient writing SQL queries and programming including stored procedures and reverse engineering existing process. Leverage SQL, programming language (Python or similar) and/or ETL Tools (Azure Data Factory, Data Bricks, Talend and Snow SQL) to develop data pipeline solutions to ingest and exploit new and existing data sources. Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards. Skills: 10+ years - Enterprise Data Management 10+ years - SQL Server based development of large datasets 5+ years with Data Warehouse Architecture, hands-on experience with Databricks platform. Extensive experience in PySpark coding. Snowflake experience is good to have. 3+ years Python(NumPy, pandas) coding experience 3+ years experience in Finance / Banking industry some understanding of Securities and Banking products and their data footprints. Experience with Snowflake utilities such as Snow SQL and Snow Pipe - good to have. Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modelling. Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills. Capable of discussing enterprise level services independent of technology stack Experience with Cloud based data architectures, messaging, and analytics. Superior communication skills Cloud certification(s) Any experience with Regulatory Reporting is a Plus Education: Minimally a BA degree within an engineering and/or computer science discipline Masters degree strongly preferred. Thanks Arun Kumar Technical Recruiter 3K Technologies, LLC www.3ktechnologies.com [email protected] Analytics | BI | Big Data | Cloud |Software Engg. Keywords: business analyst business intelligence information technology New Jersey New York |
| [email protected] View all |
| Wed Dec 06 22:30:00 UTC 2023 |