Sr DataStage Developer - Cincinnati, OH - Onsite - SLK/53rd Bank __ Immediate Needed at Cincinnati, Ohio, USA |
Email: [email protected] |
Rate: $55/hr on c2c DataStage Developer Location: Cincinnati, OH (Onsite) Sample Job Description As a Senior DataStage developer with experience working with Snowflake, your role expands beyond traditional ETL processes to leverage the capabilities of Snowflake's cloud data platform. Heres how your responsibilities might evolve: Data Integration with Snowflake: Designing and developing DataStage jobs that interact with Snowflake as both a source and target for data integration. This involves understanding Snowflake's architecture, such as its separation of compute and storage, and optimizing data loading strategies accordingly. Data Modeling in Snowflake: Utilizing Snowflake's schema-on-read approach to define and manage data structures, ensuring efficient data modeling to support both operational and analytical workloads. Performance Optimization: Leveraging Snowflake's features like automatic scaling and query optimization to enhance the performance of ETL processes and SQL queries executed by DataStage jobs. Handling Semi-Structured Data: Integrating semi-structured data formats (like JSON, Avro) with Snowflake using DataStage, leveraging Snowflake's native support for semi-structured data. Concurrency and Workload Management: Understanding Snowflakes concurrency model and workload management capabilities to optimize DataStage job scheduling and resource utilization. Security and Governance: Implementing security best practices within Snowflake and ensuring that DataStage jobs adhere to data governance policies, including access controls, data encryption, and compliance requirements. Data Transformation: Implementing complex data transformations within DataStage before loading data into Snowflake, leveraging Snowflakes ability to perform transformations using SQL, JavaScript UDFs, or Snowflake's Snowpark/Java UDFs. Real-time Data Integration: Implementing real-time or near-real-time data integration solutions using Snowflakes features such as Snowpipe for continuous data ingestion, combined with DataStages capabilities for stream processing. Integration with other Tools: Integrating Snowflake with other tools and platforms in the data ecosystem (e.g., data lakes, BI tools, data governance tools) to facilitate seamless data flow and analytics. Performance Monitoring and Optimization: Monitoring ETL job performance and data pipeline health within DataStage and Snowflake, identifying bottlenecks, and implementing optimizations to improve overall system efficiency. Looking forward to work with you !! Best Regards Alex (Rajesh) | Talent Acquisition Manager - TAG Email: [email protected] | United IT Solutions Inc. LinkedIn: https://www.linkedin.com/in/rajesh-m-723131240/ www.uniteditinc.com | USA | INDIA | CANADA *** United IT Solutions, Inc is Celebrating 16 years in IT Industry *** -- Keywords: business intelligence information technology Ohio Sr DataStage Developer - Cincinnati, OH - Onsite - SLK/53rd Bank __ Immediate Needed [email protected] |
[email protected] View all |
Mon Jul 08 22:55:00 UTC 2024 |