| DataStage Developer ------ 10+ years ------- Chicago, IL at Chicago, Illinois, USA |
| Email: [email protected] |
| From: Naveen, Softcom Systems Inc [email protected] Reply to: [email protected] Job Details: Must Have Skills DataStage Python, Scala Awareness of cloud technologies Nice to have skills AzureDatabricks preferred Detailed Job Description Big Data Profiles with Azure having more than 6+ years of experience Participate in developing DataStage tool and having good experience on DataStage and having experience on ETL Architecture. Participate in design and implementation of the Data Lake, big data migration using Azure cloud as platform Having Experience on Python & Scala. Experience in working on Hadoop Distribution, good understanding of core concepts and best practices Working knowledge of DataStage tool Understanding of Big data, Data Lake Data Warehousing concepts Must have experience with Java,Scala,Big data,Hive,Spark, ControlM, Python and Microsoft Azure Synapse Cloud. Ability to build Azure data solutions and provide a technical perspective on storage, big data platform services Develops and maintains scalable data pipelines and builds out new API integrations to support continuing increases in data volume and complexity. Create and maintain optimal data pipeline architecture, including optimal extraction, transformation and loading of data, leveraging Databricks notebooks, Apache Spark (SQL, Python, Scala, Java) and other Microsoft Azure or open-source tools as required Strong experience as an Azure Databricks experience would be an preferrable Keywords: |
| [email protected] View all |
| Tue Mar 05 02:58:00 UTC 2024 |