Remote Lead Data Engineer USC AND GC at Remote, Remote, USA |
Email: [email protected] |
Must have excellent communication skills. 2 interview process (remote), please send me your best candidate (no more than 2 submittals max) 1 with MUST HAVE SOLID EXP with MICROSERVICES REAL-TIME 1 with MUST HAVE GenAI, AI engineering workstreams, OpenAI Job Title Lead Data Engineer Client CVS Location: Can be: Chicago Philadelphia Hartford, CT Irving, TX Woonsocket, RI Remote but must be in one of the regions mentioned above Visa: GC or USC extensive experience with microservices and real-time systems Lead Data Engineer Data engineer with strong AI collaborate with business partners to identify opportunities to leverage big data technologies in support of Pharmacy Personalization with a common set of tools and infrastructure to make analytics faster, more insightful, and more efficient design highly saleable and extensible Big Data platforms which enables collection, storage, modeling, and analysis of massive data sets from numerous channels define and maintain data architecture, focusing on applying technology to enable business solutions assess and provide recommendations on business relevance, with appropriate timing and deployment perform architecture design, data modeling, and implement CVS Big Data platforms and analytic applications bring a DevOps mindset to enable big data and batch/real-time analytical solutions that leverage emerging technologies develop prototypes and proof of concepts for the selected solutions, and implement complex big data projects apply a creative mindset to a focus on collecting, parsing, managing, and automating data feedback loops in support of business innovation. Required Qualifications Strong in SQL and Python, with 3+ years hands-on coding experience with both Experience building automated big data pipelines Experience performing data analysis and data exploration Experience working in an agile delivery environment Strong critical thinking, communication, and problem solving skills and a quick learner Experience with Snowflake, Databricks or any big data frameworks on Spark Experience with cloud-based platforms (i.e. Azure, GPC, AWS) Experience with RDBMS and NoSQL Databases and hands-on query tuning/optimization Experience working in multi-developer environment, using version control (i.e. Git) Experience with orchestrating pipelines using tools (i.e. Airflow, Azure Data Factory) Experience with real-time and streaming technology (i.e. Azure Event Hubs, Azure Functions Kafka, Spark Streaming) Experience with data modeling and system architecture design Experience partnering cross-functionally with other technical teams (i.e. data ingestion, data science, operational systems) to align priorities and achieve deliverable outcomes Experience with setting coding standards, performing code reviews, and mentoring junior developers Preferred Qualifications Experience with REST API/Microservice development using Python Experience with deployment/scaling of apps on containerized environment (i.e. Kubernetes, AKS) Experience with bash shell scripts, UNIX utilities & UNIX Commands Ability to understand complex systems and solve challenging analytical problems Previous healthcare experience and domain knowledge Exposure/understanding DevOps best practice and CICD (i.e. Jenkins) Education Bachelors Degree in Computer Science, Engineering, Statistics, Physics, Math, or related field or equivalent experience Preferred: Masters Degree with coursework focused on advanced algorithms, mathematics in computing, data structures, etc. -- Keywords: artificial intelligence information technology green card Connecticut Rhode Island Texas |
[email protected] View all |
Wed Nov 29 19:53:00 UTC 2023 |