| Lead Data Engineer and Senior Data Engineer-Chicago-Philadelphia-Hartford-CT-Irving-TX-Woonsocket-RI-Hybrid at Philadelphia, Pennsylvania, USA |
| Email: [email protected] |
| From: Gulshan, Stellent IT [email protected] Reply to: [email protected] Lead Data Engineer and Senior Data Engineer. Chicago,Philadelphia,Hartford-CT,Irving-TX,Woonsocket-RI-Hybrid Phone+Skype 6+Month Job Description Here are the must have skills: 10+ years experience Strong in Python Agile Data pipelines Azure and Aws Azure Data Factory Real-time and streaming technology (Azure Event Hubs and Spark Streaming) NoSQL Data modeling and system architecture design Coding standards, coding review extensive experience with microservices and real-time systems Lead Data Engineer Data engineer with strong AI collaborate with business partners to identify opportunities to leverage big data technologies in support of Pharmacy Personalization with a common set of tools and infrastructure to make analytics faster, more insightful, and more efficient design highly saleable and extensible Big Data platforms which enables collection, storage, modeling, and analysis of massive data sets from numerous channels define and maintain data architecture, focusing on applying technology to enable business solutions assess and provide recommendations on business relevance, with appropriate timing and deployment perform architecture design, data modeling, and implement CVS Big Data platforms and analytic applications bring a DevOps mindset to enable big data and batch/real-time analytical solutions that leverage emerging technologies develop prototypes and proof of concepts for the selected solutions, and implement complex big data projects apply a creative mindset to a focus on collecting, parsing, managing, and automating data feedback loops in support of business innovation. Required Qualifications Strong in SQL and Python, with 3+ years hands-on coding experience with both Experience building automated big data pipelines Experience performing data analysis and data exploration Experience working in an agile delivery environment Strong critical thinking, communication, and problem solving skills and a quick learner Experience with Snowflake, Databricks or any big data frameworks on Spark Experience with cloud-based platforms (i.e. Azure, GPC, AWS) Experience with RDBMS and NoSQL Databases and hands-on query tuning/optimization Experience working in multi-developer environment, using version control (i.e. Git) Experience with orchestrating pipelines using tools (i.e. Airflow, Azure Data Factory) Experience with real-time and streaming technology (i.e. Azure Event Hubs, Azure Functions Kafka, Spark Streaming) Experience with data modeling and system architecture design Experience partnering cross-functionally with other technical teams (i.e. data ingestion, data science, operational systems) to align priorities and achieve deliverable outcomes Experience with setting coding standards, performing code reviews, and mentoring junior developers Preferred Qualifications Experience with REST API/Microservice development using Python Experience with deployment/scaling of apps on containerized environment (i.e. Kubernetes, AKS) Experience with bash shell scripts, UNIX utilities & UNIX Commands Ability to understand complex systems and solve challenging analytical problems Previous healthcare experience and domain knowledge Exposure/understanding DevOps best practice and CICD (i.e. Jenkins) Education Bachelors Degree in Computer Science, Engineering, Statistics, Physics, Math, or related field or equivalent experience Preferred: Masters Degree with coursework focused on advanced algorithms, mathematics in computing, data structures, etc Keywords: artificial intelligence information technology Connecticut Rhode Island Texas |
| [email protected] View all |
| Wed Nov 22 02:25:00 UTC 2023 |