| Hiring Now : : Lead Data Engineer OR Data Architect : : Remote at Remote, Remote, USA |
| Email: [email protected] |
| From: Surya kanta pradhan, Vyze inc. [email protected] Reply to: [email protected] Position: Lead Data Engineer/Data Architect Location: Fully Remote Duration: 6 Month MOI: Video/Phone Visa: All visa JD: Strong expertise in designing and implementing data models, including conceptual, logical, and physical data models, to support efficient data storage and retrieval. Strong knowledge of Microsoft Azure, including Azure Data Lake Storage, Azure Synapse Analytics, Azure Data Factory, and Azure Databricks, for building scalable and reliable data solutions. Proficiency in distributed computing frameworks such as Apache Spark for processing and analyzing large-scale datasets. Extensive experience with building robust and scalable ETL/ELT pipelines to extract, transform, and load data from various sources into data lakes or data warehouses. Ability to integrate data from disparate sources, including databases, APIs, and external data providers, using appropriate techniques such as API integration or message queuing. Proficiency in designing and implementing data warehousing solutions, including dimensional modeling, star schemas, and data aggregation techniques. Experience with Azure Cosmos DB, Azure Analysis Services, and Informix. Experience with Python and Python-based ETL tools. Experience with shell scripting in Bash, Unix or windows shell is preferable. Experience with Elasticsearch Familiarity with containerization and orchestration technologies (Docker, Kubernetes). Troubleshooting and Performance Tuning: Ability to identify and resolve performance bottlenecks in data processing workflows and optimize data pipelines for efficient data ingestion and analysis. Collaboration and Communication: Strong interpersonal skills to collaborate effectively with stakeholders, data engineers, data scientists, and other cross-functional teams. Keywords: database |
| [email protected] View all |
| Wed Dec 06 04:43:00 UTC 2023 |