| Job Opening || Lead Data Engineer | 100% Remote at Remote, Remote, USA |
| Email: [email protected] |
| Hello , Hope you are doing great! This is Nitin, I work as a Tech. Recruiter at NYTP. Reach me at [email protected]) if you want to apply for the below role: Position - Lead Date Engineer Location : 100% Remote T ype - Long Term Job Summary: Specifically: Design, Mentor, and build reusable components, frameworks and libraries at scale to support data analytics, reports, and efficient database structures. Design and implement product features in collaboration with business and Technology stakeholders. Identify and solve issues concerning data management to improve data quality and efficiency. Clean, prepare and optimize data for ingestion and consumption. Collaborate on the implementation of new data management projects and re-structure of the current data architecture. Review design, code, test plans and dataset implementation performed by other engineers in support of maintaining data engineering standards. Analyze and profile data for designing scalable solutions. Troubleshoot data issues and perform root cause analysis to proactively resolve product and operational issues. Develop architecture, design patterns, and frameworks to process and store data and then align with varying downstream contracts for distribution. Define and apply appropriate data acquisition and consumption strategies for given technical scenarios. Implement security around sensitive data. Create near real-time reporting in solutions like Tableau - automate data flows from DynamoDB to Athena into report visualization tools. WHAT YOU BRING Bachelor/Master degree in Computer Science or related technical subject area or equivalent combination of education and experience 10+ years relevant work experience in the Data Engineering field 5+ years experience building scalable, real-time and high-performance cloud data lake solutions Strong experience with data modeling and efficient design Strong experience with programming languages such as Python and TypeScript. Strong Experience with source control tools such as GitHub Actions, Terraform and related CI/CD processes Experience working with Data streaming services such as Kafka, etc. Strong Experience working with NoSQL data stores and caching mechanisms such as DynamoDB, DAX, etc. Strong Experience provisioning RESTful APIs to enable real-time data consumption Strong Experience working in AWS environment primarily S3, Lambdas, Redshift, Athena. Strong experience with visual reporting and analytics tools like Tableau, and ETL tools such as Databricks. Experience with data warehouses/RDBMS like Snowflake & Teradata Strong collaborator with experience providing guidance and mentorship to other engineers Strong understanding of algorithms, data structures, data architecture, and technical designs. Proven track record of rapidly learning new technologies and developing and implementing proof of concepts and practical, working code Proven track record to influence and communicate effectively with team members and business partners Proven track record to partner with teams in solving complex problems by taking a broad perspective to identify innovative solutions. Experience working with Agile/Scrum methodology and tools like JIRA and Test Automation Frameworks Thanks, _______________________________________ Nitin Pillai | New York Technology Partners 120 Wood Avenue S | Suite 504 | Iselin NJ 08830 | www.nytp.com We respect your online privacy. If you would like to be removed from our mailing list please reply with "Remove" in the subject and we will comply immediately. We apologize for any inconvenience caused. Please let us know if you have more than one domain. The material in this e-mail is intended only for the use of the individual to whom it is addressed and may contain information that is confidential, privileged, and exempt from disclosure under applicable law. If you are not the intended recipient, be advised that the unauthorized use, disclosure, copying, distribution, or the taking of any action in reliance on this information is strictly prohibited. -- Keywords: continuous integration continuous deployment sthree information technology New Jersey |
| [email protected] View all |
| Sat Dec 16 03:36:00 UTC 2023 |