Requirement for Lead Data Engineer. Onsite-Hybrid at either of 1 location. Woonsocket, RI or Wellesley, MA or Dallas, TX or Chicago, IL, or New York City. at Dallas, Texas, USA |
Email: [email protected] |
From: SAPNA, ITECS [email protected] Reply to: [email protected] POSITION #1: Job Title: Lead Data Engineer Location: Hybrid (2 to 3 days per week onsite) - Woonsocket, RI or Wellesley, MA or Dallas, TX or Chicago, IL, or New York City. Job Description: Skills must have- Cloud Data Engineer backend focused and need expertise in Azure, ADF, Data Factory, Data Pipelines, Data Lake, Backend MicroServices, Kafka, Python. MicroServices is must to have. Position Summary: You will collaborate with business partners to identify opportunities to leverage big data technologies in support of Pharmacy Personalization with a common set of tools and infrastructure to make analytics faster, more insightful, and more efficient. You will design highly saleable and extensible batch and real-time big data and cloud platforms which enables collection, storage, modeling, and analysis of massive data sets from numerous channels. You will define and maintain data architecture, focusing on applying technology to enable business solutions. You will assess and provide recommendations on business relevance, with appropriate timing and deployment. You will perform architecture design, data modeling, and implement CVS Big Data platforms and analytic applications. You will bring a DevOps mindset to enable big data and batch/real-time analytical solutions that leverage emerging technologies. You will develop prototypes and proof of concepts for the selected solutions, and implement complex big data projects. You will apply a creative mindset to a focus on collecting, parsing, managing, and automating data feedback loops in support of business innovation. Required Qualifications : Required: Bachelors Degree in Computer Science, Engineering, Statistics, Physics, Math, or related field with 6+ years of professional or business analytics experience; or Masters Degree with 3+ years of experience in: Strong in SQL and Python, with 3+ years hands-on coding experience with both Experience building automated big data pipelines Experience performing data analysis and data exploration Experience working in an agile delivery environment Strong critical thinking, communication, and problem solving skills Experience with big data frameworks (i.e. Hadoop and Spark) Experience with cloud-based platforms (i.e. Azure, GPC, AWS) Experience with Snowflake and hands-on query tuning/optimization. Experience working in multi-developer environment, using version control (i.e. Git) Experience with orchestrating pipelines using tools (i.e. Airflow, Azure Data Factory) Experience with real-time and streaming technology (i.e. Azure Event Hubs, Azure Functions Kafka, Spark Streaming) Experience with REST API/Microservice development using Python Experience with deployment/scaling of apps on containerized environment (i.e. Kubernetes, AKS) Experience with technical solutioning and system architecture design Experience partnering cross-functionally with other technical teams (i.e. data ingestion, data science, operational systems) to align priorities and achieve deliverable outcomes Experience with setting coding standards, performing code reviews, and mentoring junior developers Experience overseeing project delivery by mentoring junior technical developers Preferred Qualifications : Previous healthcare experience and domain knowledge Exposure/understanding DevOps best practice and CICD (i.e. Jenkins) Exposure/understanding of containerization (i.e. Kubernetes, Docker) Education : Required: Bachelors Degree in Computer Science, Engineering, Statistics, Physics, Math, or related field or equivalent experience Preferred: Masters Degree with coursework focused on advanced algorithms, mathematics in computing, data structures, etc. Keywords: Illinois Massachusetts Rhode Island Texas |
[email protected] View all |
Thu Dec 14 12:36:00 UTC 2023 |