| Data Engineer at Minneapolis, Minnesota, USA |
| Email: [email protected] |
| From: Raghu Prasad, Blue Ocean Ventures [email protected] Reply to: [email protected] Hello Hope all is well, My name is Raghu Prasad, and I am a representative at Blue Ocean Ventures, a Search firm based out of Atlanta. I work closely with some of the leading Global IT Management Consulting companies for their hiring needs in the United States. Role: Data Engineer Location- Minneapolis, MN (Remote until April) Client: SLK America Job Description - As a Senior Data Engineer, you will be considered a technical expert in one or more phases of application and/or systems engineering. This includes providing design recommendations based on long-term IT organization strategy and expertise regarding the integration of applications across the business. You will determine specifications, plan, design, and develop business critical software solutions, utilizing appropriate software engineering processes - either individually or in concert with product team. - Responsible for expanding and optimizing our data and data pipeline - Experience building and optimizing big data data pipelines, architectures, and data sets - Experience with big data tools: Hadoop, Spark, Kafka, etc. - Experience with relational SQL and NoSQL databases, including SQL, Oracle, DB2, Hive, Hbase etc. - 5+ years of experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc. - Experience with data pipeline and any workflow management tools: Zena, control M, Oozie, Airflow, etc. - Build processes supporting data transformation, data structures, metadata, dependency and workload management. - A successful history of manipulating, processing and extracting value from large disconnected datasets. - Working knowledge of message queuing, stream processing, and highly scalable big data data stores. - Working knowledge of DevOps pipeline using Jenkins, Urban code, Azure devops etc. - Working knowledge of source code management using Git, Gitlab etc. -Provide technical leadership in the analysis and review of existing or proposed system features and integration, security, scalability and performance requirements with users, product teams, business analysts, architects and team members -Lead the evaluation and selection process for software solutions, advise on options, risk, cost vs. benefits, and impacts on business processes and goals -Develop systems and software integration patterns across a diverse IT ecosystem. These patterns should align to high level IT goals and business initiatives -Provide subject matter expert advice on system design issues and contribute to ongoing planning and development of system enhancements -Identify and specify technical / functional requirements, resources and required that may be needed to meet user requirements -Provide guidance and reinforcement around established engineering best practices -Participate in product planning and implementation -Serve as an escalation point in product level support for ongoing maintenance and production issues -Provide technical leadership and mentoring to other engineers of varying levels inside the product group - Experience with AWS cloud services like Glue, Athena, EC2, RDS, Redshift etc. Keywords: cplusplus access management information technology Minnesota |
| [email protected] View all |
| Sat Jan 21 03:09:00 UTC 2023 |