| As Discussed Data Engineer Data bricks In Minnesota, at Remote, Remote, USA |
| Email: [email protected] |
| From: Mohammad Nooruddin, Techgene Solutions Inc [email protected] Reply to: [email protected] Data Engineer Databricks Onsite BOYCESTR, MN Key Responsibilities: Collaborate with Business SME to understand the requirements for building a cyber security solution for threat monitoring, analysis. Recommendation engine Understand and design the technical solution to effectively monitor the dark-web and other data sources to protect their company and their clients from threats Collaborate with the Architect and Business to define and understand the requirements for metrics, reports, and alerts that support the vision and are technically feasible given the available data and modeling resources. Required Knowledge: Understanding of the principles of cyber security and risk management Knowledge of tactics, techniques, and procedures used by cybercriminals, hackers, and other threat actors who operate on the dark web Understanding of the specific cybersecurity requirements and regulatory standards that apply to financial institutions Understanding of cloud engineering and the construction of data preparation and analytics pipelines Preferred Experience: 8-10 years of hands-on data analytics engineering experience Experience in working with teams building solutions monitoring, analyzing, and interpreting dark web data to identify potential security threats Experiences with design, develop, and implement end-to-end data engineering solutions using Databricks for large-scale data processing and data integration projects. Building, optimizing data ingestion processes from various sources, ensuring data quality, reliability, and scalability. Performing data transformation tasks, including data cleansing, aggregation, enrichment, and normalization, using Databricks and related technologies. Monitor and troubleshoot data pipelines, identifying and resolving performance issues, data quality problems, and other technical challenges. Implement best practices for data governance, data security, and data privacy within the Databricks environment. Strong SQL, Python, PySpark knowledge Knowledge in DataOps and experience in delivering CI/CD and DevOps capabilities in a data environment Certification in Databricks Engineer Professional would be a plus. Strong stakeholder management and communication skills Preferred 3-4 years of experience in data analytics, with a focus on security threat detection, preferably within the financial services industry Keywords: continuous integration continuous deployment Minnesota As Discussed Data Engineer Data bricks In Minnesota, [email protected] |
| [email protected] View all |
| Tue Aug 20 23:33:00 UTC 2024 |