APACHE NIFI SYSTEM ADMINISTRATOR || 12+ MONTHS || VIDEO || REMOTE at Apache, Oklahoma, USA |
Email: [email protected] |
From: Jyoti Mittal, KPG99 Inc [email protected] Reply to: [email protected] Hi, My name is Jyoti and I represent KPG99 INC. We work with clients across the USA. I have a very urgent role. If interested then please share with me your updated resume along with below information. NEED INDEPENDENT OR W2 CANDIDATE POSITION Apache NiFi System Administrator LOCATION Remote DURATION 12+ months or extendable INTERVIEW TYPE Video VISA USC REQUIRED SKILLS Client call notes Apache NiFi interesting product not a lot of people are familiar with it does database migration type work in infancy moving one type of record to another Bunge is using as a file transfer mechanism equally well suited for not what mainstream uses it for Viterra acquisition/merger coming up and has chosen this as primary means of data transfers with the companies cant link system until legal day 1 or after and need to have in place by then Base system has been created need to maintain and make adjustments to it as legal day 1 hits then after that Ex. 300 files transfer for Legal day 1 will balloon into a larger number- would like to bring on an architect in one of the positions for initial day one as they work through complex issues Should understand how to configure processors and need to be given right data After legal day 1 data transfer will be center of the world needs someone who is proactive / monitors all the time / can work independently doing X Y and Z Do need to be able to look at a problem and figure out that it may not be them but can help support something that isnt directly NiFi or right around the corner not so silod as a NiFi admin- may not be able to natively do that Would like them to do peer reviews as well Need to have excellent communication Given this product is made to connect with other products product itself not hugely complicated data in a field and tells it to connect to something special language used to manipulate and route NiFi Expression language experience important Things Aaron will focus on in interview General technical knowledge this product can connect to a DB if getting an Oracle error, this is an oracle error, need to talk to a DBA SFTP site / more likely their case what does it mean to receive a time out for SFTP Another potential issue to work through - Invalid permissions to place file those would be actual items that would encounter for this product Not hub and spoke, but needs to drive solutions and troubleshoot, be curious, specific oracle instance Network experience helpful basic troubleshooting for network / a lot of their issues will come from network Pre-Screening Questions: Can you describe your experience with designing and managing complex data flows in Apache NiFi What are some of the most challenging NiFi workflows you've implemented How have you integrated Apache NiFi with other systems, such as databases, cloud platforms, and messaging systems Can you provide examples of specific integrations you've implemented What strategies do you employ to optimize NiFi performance for large-scale data transfers Can you discuss your experience with backpressure settings, load balancing, and high availability configurations How do you ensure data security and compliance within Apache NiFi environments Can you discuss your experience with implementing security measures like user access control, data encryption, and SSL configurations What is your approach to troubleshooting performance issues or data flow errors in Apache NiFi Can you share a specific example of a complex issue you resolved What would your troubleshooting process be if you received an Oracle error How would you work through invalid permissions to place file Responsibilities: Design, implement, and manage data flows within Apache NiFi, ensuring efficient and reliable data movement across systems. Build scalable workflows for data ingestion, transformation, enrichment, and delivery. Configure processors, connections, and controllers to optimize data throughput and performance. Regularly monitor and maintain NiFi clusters, ensuring high availability and fault tolerance. Implement appropriate security measures, including user access control, data encryption, and SSL configurations within NiFi. Ensure compliance with organizational data governance policies and regulations. Work on integrating NiFi with other systems such as databases, cloud services (e.g., GCP, AWS, Azure) and other big data or messaging platforms. Ensure seamless connectivity between NiFi and external data sources or destinations. Implement monitoring tools and set up alerts to detect failures or performance issues. Generate reports on data flow metrics and performance for stakeholders. Stay up to date with the latest NiFi releases and patches, ensuring that the environment is using the latest stable versions. Optimize the performance of data transfer workflows by configuring NiFis backpressure settings, load balancing, and ensuring high availability across NiFi clusters. Monitor file transfer and API performance, troubleshooting bottlenecks and optimizing workflows as needed for both throughput and latency. Collaborate with cross-functional teams, including data engineers, security teams, and IT infrastructure teams from both entities, to ensure smooth data flow and integration. Provide detailed documentation on data flow architecture, security protocols, and API configurations to ensure that the integration process is well-understood and maintainable by both organizations post-acquisition. Ensure that the data transfer mechanisms built are scalable and sustainable for long-term use. Support the ongoing data synchronization between systems while moving toward full integration of IT ecosystems. Requirements: 5+ years of experience in Apache NiFi for managing data flows, file transfers, and API integrations. Knowledge of secure file transfer protocols (SFTP, FTPS, HTTPS) and encryption methods. Experience integrating systems using APIs and working with open systems (cloud, on-premise, hybrid). Strong understanding of data governance, compliance, and security practices, particularly in high-stakes M&A scenarios. Excellent troubleshooting and optimization skills for large-scale data migration and integration projects. Excellent English communication skills both written and verbal. Thanks & Regards, Jyoti Mittal | Technical Recruiter | KPG99,INC [email protected] | http://www.kpg99.com/ 3240 E State St EXT, Hamilton, NJ 08619 An E- Verified Company Certified Minority Owned Business Note: KPG99 does not endorse undesired email. If you do not want to receive our mails, please reply with Remove in the subject; I would ensure that you are not troubled further. I apologize for any inconvenience. Keywords: database information technology wtwo New Jersey APACHE NIFI SYSTEM ADMINISTRATOR || 12+ MONTHS || VIDEO || REMOTE [email protected] |
[email protected] View all |
Thu Oct 24 19:27:00 UTC 2024 |