Role: Lead PySpark Engineer
Job type: Fulltime
Location: Owings Mill, MD
Roles & Responsibilities:
10+ years of experience in big data and distributed computing.
• Very Strong hands-on experience with PySpark, Python, Airflow, DBT & DWH concepts
• Strong Hands on experience with SQL and NoSQL databases (DB2, PostgreSQL, Snowflake, etc.).
• Proficiency in data modeling and ETL workflows.
• Proficiency with workflow schedulers like Airflow
• Hands on experience with AWS cloud-based data platforms.
• Experience in DevOps, CI/CD pipelines, and containerization (Docker, Kubernetes) is a plus.
• Strong problem-solving skills and ability to lead a team
Develop, test and maintain high-quality solutions using PySpark /Python programming language.
· Participate in the entire software development lifecycle, building, testing and delivering high-quality
data pipelines.
· Collaborate with cross-functional teams to identify and solve complex problems.
· Write clean and reusable code that can be easily maintained and scaled.
· Keep up to date with emerging trends and technologies in Python development. Design and develop
business controls using AWS Glue and PySpark
· Integrate data from various sources into Amazon Redshift
· Optimize performance of data processing jobs and fine tune queries
Salary Range: $110,000 - $115,000 a Year
...Experienced civil trial attorney wanted for a dynamic litigation practice located in downtown Dallas. We handle a broad range of complex civil litigation, as well as professional liability. We put teamwork and client satisfaction at the top of our priority list. If you...
...Word, Excel, PowerPoint). Experience with CRM systems (e.g., Salesforce, HubSpot) is a plus. Willingness to travel within the... ...reporting to the Clifton Park, NY office at least 3 days per week. Remote work may be considered after 90 days at the supervisor's discretion...
Description We are a fast-growing, well-respected catering company in the DMV area known for our Indian and global fusion menus. As we continue expanding our operations, were looking for a culinary leader to help steer production, oversee kitchen logistics, and support...
Looking to hire a Marine Engineering Manager for a cargo shipping company in the West Palm Beach area. Manager provides supervision and direction of the repair and maintenance programs covering Company's fleet of vessels. PRINCIPAL DUTIES AND RESPONSIBILITIES -Manages...
...re looking for motivated and reliable independent contractor delivery drivers to join our logistics team. Youll be delivering packages,... ...opportunity for individuals with RAM ProMaster, or similar cargo vans who want consistent work and competitive pay. What Youll...