Senior Data Engineer - Remote role at Remote, Remote, USA |
Email: ritik.k@cloudquestek.com |
Visa: USC,GC,GC-EAD.H4-EAD (EADs with PP) Must have old LinkedIn account. At the time of submission need the recent 2 companies' professional reference and the Last 5 digits of SSN Title: Senior Data Engineer Location: Remote Duration: 12 Months Interview: Phone/Skype Job description- Please share only those profiles whose LinkedIn was created before 2021. Notes from HM: 1. We need strong communication and interpersonal skills; we work with many non-technical groups. A consulting background would be useful 2. Our current tech stack is largely comprised of: Data Warehousing: Hadoop on-prem Languages: SQL (preferably Hive), Python, Scala Frameworks: Apache Airflow (for orchestration), Apache Spark (via Scala for processing data with Hadoop) Other important aspects: Docker, Domo, GitHub, Databricks, important to note: we use Agile 3. Our future tech stack that may include other technologies like Snowflake and Power BI 4. Experience with sensitive data, working with executive reporting, Human Capital/People Team experience (like Durga has) What are the top 5-10 responsibilities for this position (please be detailed as to what the candidate is expected to do or complete on a daily basis) Architect all phases of software engineering including requirements analysis, application design, code development and testing with a focus on business intelligence dataset development Design reusable components, frameworks, and libraries Contribute and make recommendations to the design and architecture to enable secure, scalable, and maintainable solutions Clearly articulate the implications of design/architectural decisions, issues and plans to technology leadership Work collaboratively with People Analytics on the development and production of standard datasets to drive actionable decision making and reporting stability Conduct design and code reviews to ensure code developed meets business needs, coding best practices guidelines, unit testing, security, and scalability and maintainability guidelines Work very closely with architecture groups and drive solutions Assist with updating infrastructure components Use engineering best practices following an Agile methodology to deliver high-quality emerging tech solutions Communicate with impact - influence and negotiate effectively with all internal and external stakeholders to achieve win-win solutions that advance organizational goals Grow and maintain knowledge of and leverage emerging technologies Develop and analyze highly complex system standards, thresholds, and recommendations to maximize system performance Analyze project requirements and develop detailed specifications for new data warehouse reporting requirements Research API calls and make necessary changes to meet the business, contractual, security, performance needs Assesses and interprets customer requests for feasibility, priority, and complexity Create and maintain internal process documentation Support projects and change initiatives aligned to key priorities of People Analytics and People Analytics customers Understands priorities and organizes prescribed and non-prescribed work to meet or exceed deadlines and expectations Proactively keeps data secure and decommissions legacy content in our environment Serve as a resource to others within the People Analytics community; mentors other data engineers; provides explanations and information to others on difficult issues, problems, and solutions Works with minimal guidance; seeks guidance on only the most complex tasks Coaches, provides feedback, and guides others within the People Analytics community What does the ideal candidate background look like (ex: healthcare specific background specific industry experience etc.) Ideal candidate would have experience in the Human Capital space, working with the backend data warehousing of human capital systems What skills/attributes are required (please be detailed as to number of years of experience for each skill) 3+ years of data engineering experience 3+ years of full lifecycle application, software development experience 3+ years of modern programming language such as Python, Java, and Scala 2+ years of SDLC experience in an Agile environment Working knowledge of the following business and technology concepts: APIs, CI/CD, Big Data, data architecture and governance Experience with Cloud technologies and platforms such as Docker, OSE, Kubernetes, AWS, Snowflake, and Azure Experience with Jenkins, GitHub, Big Data technologies like Spark Experience using IDEs such as Eclipse, JBoss, IntelliJ Relational database experience Experience ingesting and working with large and complex datasets Experience gathering requirements from end users What skills/attributes are preferred (what will set a candidate apart) Experience in data extraction, manipulation, and management Experience researching issues, investigating data accuracy, and performing quality checks Project Management skills Ability to work independently and collaborate effectively with others Experience creating user stories using the As a (role), I want (function) so that (business value) methodology Basic understanding of statistical methodologies and measurements Experience leading people (directly or indirectly) or large-scale projects 1+ years in an agile environment or with agile tools such as Rally or Swift Regards: Ritik Kapoor Sr. Technical Recruiter -- Keywords: continuous integration continuous deployment business intelligence information technology green card Senior Data Engineer - Remote role ritik.k@cloudquestek.com |
ritik.k@cloudquestek.com View all |
Wed Jan 15 20:41:00 UTC 2025 |