Job Title:
Data Catalog Engineer: In this role you will work closely with senior technical leadership to implement and maintain metadata management solutions build scalable pipelines and ensure seamless integration of data sources into our Informatica CDGC platform. This is a handson role where you will contribute to the foundation of our data governance and quality framework.
Key Responsibilities:
Build Pipelines: Design develop and maintain data pipelines to integrate various data sources into the metadata catalog.
Scan Data Sources: Configure and execute scanning processes for structured semistructured and unstructured data sources using Informatica CDGC and related tools.
Metadata Management: Assist in the creation and maintenance of metadata repositories ensuring consistency and completeness.
Data Dictionaries: Develop and manage comprehensive data dictionaries promoting transparency and standardized definitions across the organization.
Support Lineage Efforts: Collaborate with team members to map data flows and establish clear reliable lineage for critical data assets.
Performance Optimization: Monitor pipeline performance troubleshoot issues and implement enhancements to improve efficiency and scalability.
Collaboration: Work closely with data engineers data scientists and business stakeholders to understand their needs and align metadata solutions with organizational goals.
Documentation: Maintain thorough documentation for pipelines metadata processes and lineage workflows ensuring accessibility for team members and stakeholders. Required Skills and Experience:
Technical Expertise:
o Proficiency in building and managing ETL/ELT pipelines using tools like Informatica AWS Glue Talend Apache NiFi or similar platforms.
o Experience with Informatica CDGC or similar metadata management tools.
o Familiarity with SQL and at least one programming or scripting language (e.g. Python Java).
Data Integration Knowledge:
o Strong understanding of data source scanning techniques for databases files APIs and cloudbased storage.
o Experience in data governance concepts including metadata lineage and data quality.
ProblemSolving Skills:
Ability to troubleshoot and resolve pipeline and integration issues quickly and effectively.
Collaboration: Experience working in crossfunctional teams with excellent communication and stakeholder management skills.
Preferred Qualifications:
Familiarity with Informatica Axon EDC or similar tools.
Exposure to cloudbased data platforms (e.g. AWS Glue Azure Data Factory Google Data Catalog).
Understanding of CI/CD practices for data pipeline development. Knowledge of AIdriven recommendations in metadata management or data quality.
Required Skills : About the Role: Were looking for a Technical Lead to take charge of implementing advanced data governance metadata management and quality initiatives using Informatica CDGC. This is a handson role where you will be a technical leader shaping the foundation for scalable and intelligent data systems.
Position Detail: This position is full-time, $19.25/hourly Some of our competitive benefit offerings include: ~ Comprehensive Medical & Prescription Insurance Plans (Mail Order RX & 24/7 TeleDoc)~ Competitive Dental & Vision Insurance Plans ~ Matching 401K ...
...Milwaukee, Detroit, Indianapolis Job Summary: Responsible for assisting the Director with the development of state & local government relations strategy; developing political strategy for geographic area of responsibility; communicating with contract lobbyists,...
...Extension Support Specialist II - Food Science As an individual contributor you will model and support a culture of diversity, equity, inclusion, and wellbeing and continually seek to understand how your role, behaviors, and actions impact the success of this culture...
...department and University. Collaborate with campus communications and marketing team on Investments Office communications and branding items. Manage all aspects of facilities management for the Investments Office. Assist Investments team by organizing and...
...Student Engineer, Civil/Structural, Salt Lake City, UT or Portland, OR #111909 Date: Dec 15, 2024 Location: SALT LAKE CITY, UT, US, 84116 Company: PacifiCorp JOIN OUR TEAM General Purpose To assist in the development of engineering studies...